Transformers are taking the NLP and NLU world by storm due to their extreme power. With Hugging Face, it is quite straightforward to leverage that power. Databricks on the other hand provides an end-to-end lakehouse platform which allows you to do feature processing, model training, tracking and deployment in a single platform. In this presentation, we will show how to connect these components in order to fine tune and deploy a multi-turn, GPT based conversational chatbot.