llamafile

Learn the fundamentals of large language models (LLMs) and put them into practice by deploying your own solutions based on open source models. By the end of this course, you will be able to leverage state-of-the-art open source LLMs to create AI applications using a code-first approach.

By the end of this course, a learner will master Databricks to perform data engineering and data analytics tasks for data science workflows. Additionally, a student will learn to master running local large language models like Mixtral via Hugging Face Candle and Mozilla llamafile.

Learners will gain the skills to serve powerful language models as practical and scalable web APIs. They will learn how to use the llama.cpp example server to expose a large language model through a set of REST API endpoints for tasks like text generation, tokenization, and embedding extraction.