A large collection of ready-made LLM apps: agents, RAG systems and skills for coding agents. Every template can be run and taken apart piece by piece.
All repositories
LLMs-from-scratch
Code for Sebastian Raschka's book: you build a GPT-like model in PyTorch step by step, then pretrain and finetune it. The best way to see how an LLM works inside.
Who it is for
For people who want to understand how LLMs are built instead of only calling an API.
How to start
- Clone the code:
git clone --depth 1 https://github.com/rasbt/LLMs-from-scratch.git - Set up your environment following
setup/README.md - Follow the chapters from the README table of contents and run the notebooks
Steps are taken from the README. Check the current version in the repository before running them.
Stars over the last 30 days
+1,838Sep 6 — Oct 6
Author's description
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
More in «Awesome lists & learning»
A free 21-lesson Microsoft course that goes from generative AI basics and prompting to working applications. Each lesson ships with code.
An animation engine Grant Sanderson uses to make 3Blue1Brown videos, including the well-known neural network ones. It is not an AI library but a tool for explaining math and ML visually.
A 12-week course on classic machine learning: 26 lessons and 52 quizzes. The foundation that makes modern models easier to understand.
A three-part LLM roadmap: fundamentals, the LLM Scientist (building models) and the LLM Engineer (building apps). Topics come with Colab notebooks.
A Microsoft course of 18 lessons on building AI agents: tools, memory, planning, multiple agents. Code examples live in the code_samples folder.