Education & Learning Resources
Courses, tutorials, and educational materials to help you learn about Small Language Models from the ground up.
Build Your Own Small Language Model (Google)
Free course covering both theoretical concepts and practical coding exercises for building SLMs
Visit Resource →Small Language Models Course
Beginner-friendly course exploring SLM fundamentals, architecture, training, and applications
Visit Resource →MIT Media Lab - Little Language Models
Educational initiative helping children (ages 8-16) explore and build small-scale AI models
Visit Resource →Building A Small Language Model from Scratch
Practical guide from neural network fundamentals to implementing a complete SLM
Visit Resource →GitHub - LLM-tutorial
Simple tutorial on creating small(-ish) LLMs with code examples
Visit Resource →Articles
Research papers, blog posts, and articles exploring Small Language Models, their applications, and the latest developments.
"TinyStories: How Small Can Language Models Be and Still Speak Coherent English?"
Research paper introducing TinyStories dataset for training small coherent language models
Visit Resource →"SmolLM2: When Smol Goes Big"
Research documenting state-of-the-art small language model development
Visit Resource →"Can Small Language Models Revitalize Indigenous Languages?"
Brookings article on using SLMs for language preservation
Visit Resource →"Tiny Language Models Come of Age"
Quanta Magazine exploration of how smaller models are being trained effectively
Visit Resource →"What are Small Language Models (SLMs)"
GeeksforGeeks in-depth article on SLM types, workings, and applications
Visit Resource →Small Language Models | Thoughtworks
Exploration of trade-offs, use cases, and implementation considerations for SLMs
Visit Resource →Documentaries
Videos, talks, and documentary-style content about Small Language Models and their impact.
"How Small Language Models in AI Could Reform Education"
TEDx Talk by Roger Basler de Roca on SLM potential in education
Visit Resource →"Build a Small Language Model (SLM) From Scratch"
Comprehensive video tutorial by Dr. Raj Gandekar on building a functional SLM
Visit Resource →"Kids Are Learning How to Make Their Own Little Language Models"
MIT Media Lab article/video on children building small-scale language models
Visit Resource →Guides
Practical guides, documentation, and step-by-step tutorials for using and deploying Small Language Models.
Ollama Documentation
Guide to running small and large language models locally on your machine
Visit Resource →LM Studio Guide
Desktop app for discovering, downloading, and running local LLMs including small models
Visit Resource →Small Models, Big Support Framework
Stanford SCALE guide on leveraging small, locally deployed LLMs for educational content creation
Visit Resource →Implementing SLMs for Education in Underserved Communities
Step-by-step guide on deploying SLMs in resource-limited educational settings
Visit Resource →"Distilling Step-by-Step" Paper
Guide on training smaller models that outperform larger ones with less training data
Visit Resource →Hugging Face Small Language Models
Documentation and model hub for popular small language models like Phi-3, Mistral 7B, Qwen
Visit Resource →