Llama for Python Programmers

University of Michigan via Coursera

Go to Course: https://www.coursera.org/learn/llama-for-python-programmers

Introduction

Understand how to use llama.cpp Python APIs to build Llama 2-based large language model (LLM)applications.

Learn to run and interact with the Llama 2 large language model on commodity local hardware.

Learn to utilize zero- and few-shot prompting as well as advanced methods like grammars in llama.cpp to enhance and constrain Llama 2 model output.

Learn about the different Llama 2 model variants: the base model, chat model, and code llama and how to interact with these models in Python.

Syllabus

Introduction to Llama 2: A High Quality Open Source Large Language Model

This module introduces you to Llama 2, highlighting its architecture, training method, and capabilities as a high-quality open-source LLM. This foundational segment prepares you for hands-on learning in the following modules.

Under the Hood with Llama2 and Python: Understanding How it Works

This module unravels Llama 2's intricacies within Python, guiding you through tokenization, the development of Llama 2 applications via llama.cpp, and parameter adjustments for improved interactions.

Building a Llama 2 Application

This module begins with a demonstration of zero and few-shot prompting techniques, then moves on to controlling model output for tailored responses. It culminates in practical programming assignments, enabling you to apply your knowledge and showcase your skills in crafting refined Llama 2 applications.