rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Stars Over Time

99,942 stars by

tSh

Jupyter NotebookOtheraiartificial-intelligencechatbotchatgptdeep-learningfrom-scratchgenerative-aigptlanguage-modellarge-language-modelsllmmachine-learningneural-networkspythonpytorchtransformers

Growth

HOT

Last 30 days+953 stars

Owner

rasbt

github.com/rasbt

Notable Stargazers

In These Collections

Top Machine Learning Tools: A 2026 Guide

Building rasbt/LLMs-from-scratch?

We track who's paying attention — companies, roles, and the developers most likely to contribute or adopt.

Get in touch