🧭 Roadmap β€Ί Datasets & Resources
AI Journey Β· Reference

Datasets & Resources

Real data sources, model hubs, and reference archives used throughout the AI learning path. Use these when experimenting, building projects, or going deeper on any topic.

How to use this page: Each section matches a stage in your roadmap. Classic ML datasets (UCI etc.) are great for understanding concepts hands-on. LLM pre-training datasets are useful for understanding scale. Model hubs let you download and run real models locally.
No resources have all of the selected labels. Clear a filter to see more.
πŸ—„οΈ Classic ML & Tabular Datasets β€” Area 00–01
πŸ“Š
Kaggle Datasets
Community datasets Β· Competitions
Massive community-driven dataset hub. Great for real competition data, notebooks, and seeing how others approach the same dataset. Includes tabular, image, NLP, and time-series.
All types Notebooks included Free account
Open Kaggle β†’
πŸ€—
Hugging Face Datasets
NLP / LLM focused
The go-to hub for NLP and LLM datasets. Load any dataset in one line of Python: load_dataset("squad"). Covers text, vision, audio, code.
70k+ datasets Python API Streaming support
Open HF Datasets β†’
πŸ•Œ Domain & Specialty Datasets β€” Fine-tuning Β· RAG Β· Embeddings
πŸ“°
AG News
News classification Β· 4 categories
120k news headlines across 4 categories (World, Sports, Business, Sci/Tech). A go-to benchmark for text classification. Great for understanding how models learn to distinguish topics via embeddings.
120k samples Text classification HF loadable
Open AG News β†’
❓
SQuAD 2.0
Reading comprehension Β· Q&A
Stanford Question Answering Dataset β€” 150k+ question/answer pairs from Wikipedia paragraphs. The standard benchmark for reading comprehension. Excellent for understanding how RAG retrieval + generation works.
150k Q&A pairs RAG relevant BERT benchmark
Open SQuAD β†’
🧠 LLM Pre-Training Datasets β€” Area 04
🌐
Common Crawl
Web text Β· Petabyte scale
The raw web crawl data behind GPT-3, LLaMA, and most large models. Petabytes of text scraped from the open web since 2008. Too large to download in full β€” but understanding it explains why LLMs know so much.
Petabyte scale Multi-language Used in GPT-3, LLaMA
Open Common Crawl β†’
πŸ“š
The Pile (EleutherAI)
800GB Β· Open LLM training set
825GB curated open-source training corpus combining 22 high-quality datasets: Books3, GitHub, ArXiv, Wikipedia, StackExchange and more. Used to train GPT-Neo, GPT-J.
825GB 22 sources Openly licensed
Open The Pile β†’
πŸ”’
FineWeb (HuggingFace)
15T tokens Β· Recent Β· Clean
HuggingFace's own 15-trillion-token cleaned web dataset. Outperforms most existing open pre-training datasets on benchmarks. The current state-of-the-art open training corpus.
15T tokens 2024 Benchmark best
Open FineWeb β†’
πŸ€– Model Hubs β€” Run Locally or in Cloud
πŸ€—
Hugging Face Models
900k+ models
The world's largest open model hub. Download any model with one line. Includes BERT, GPT-2, LLaMA, Mistral, Falcon, Phi and thousands more in every size from 100M to 70B.
900k+ models All sizes Python API
Open HF Models β†’
πŸ¦™
Ollama
Run LLMs locally Β· Mac / Linux / Windows
The easiest way to run LLMs on your own machine. One command: ollama run llama3. Supports Llama 3, Mistral, Phi-3, Gemma, DeepSeek and more.
Local inference No API key Free
Open Ollama β†’
πŸ“¦
GGUF / Quantized Models
Compressed models Β· CPU-friendly
Quantized versions of large models that run on laptops without a GPU. A 7B model at 4-bit (Q4_K_M) needs only ~4GB RAM. Browse on Hugging Face and run via Ollama or llama.cpp.
4-bit / 8-bit CPU runnable llama.cpp / Ollama
Browse GGUF Models β†’
πŸ“– Papers, Benchmarks & Learning References
πŸ“„
Papers With Code
Research papers + code + benchmarks
Every major AI paper linked with its code, datasets, and benchmark results. See which model is state-of-the-art on any task. The best way to stay current with research.
Benchmarks SOTA tracking Code links
Open Papers With Code β†’
πŸ”¬
Arxiv (cs.LG / cs.CL)
Pre-print research papers
Where all new AI research is published first. Filter by cs.LG (machine learning) or cs.CL (computational linguistics / NLP). Every major model β€” GPT, BERT, LLaMA β€” was first published here.
Free Pre-prints cs.LG Β· cs.CL
Open Arxiv β†’
πŸ§ͺ
Google Colab
Free GPU notebooks
Free Jupyter notebooks with GPU access. Run HuggingFace models, fine-tune small models, experiment with tokenizers β€” all in-browser without installing anything locally.
Free GPU (T4) Python notebooks No setup
Open Colab β†’
πŸŽ₯
How Does a Token ID Become an Embedding?
YouTube video Β· Tokens β†’ Embeddings
A video on how a token ID is turned into an embedding vector. Pairs with the tokenization and vectorization steps in the Inside an LLM journey.
Video Token IDs Embeddings #charan
Watch on YouTube β†’
🧠 Interactive Labs β€” Learn by Doing
πŸ“
Rows. Dimensions. Vectors.
Visual lesson Β· 2 sliders Β· Illustrative numbers
What a dimension is, how a token ID selects a row of the embedding matrix, why vocabulary size is not the embedding dimension, and how vectors are stacked into the Transformer input matrix.
Dimension Vector Embedding matrix #charan
Open Lesson β†’
⛓️
The "If You…" Chain
19-step animated timeline
The same 19-concept chain as an animated zigzag timeline β€” each step slides in from alternating sides with live visualizations for tokens, attention scores, probability bars, and generated text.
Animated Auto-plays Speed control
Open Chain β†’
πŸ€–
Agent Loop Demo
Think Β· Act Β· Observe Β· Repeat
Animated Claude Code-style agent loop — watch the Think→Act→Observe cycle live with a streaming log, context window bar, tool highlights, and animated SVG orbit ring.
Agent loop Live log stream CSS animation
Open Demo β†’
AI Journey Β· Reference Β· Datasets & Resources
← Back to Roadmap Training Data topic β†’
This page 0:00
This session 0:00
Total (all pages) 0:00
Today 0:00
β–Ά Running
πŸ“Š View all study stats β†’
0:00 studying