For the last 30 days I’ve gone deep on the infrastructure behind AI agents. Not surface-level. The actual internals. Here’s everything I studied, so I can contribute to the companies building this stack:
MCP (
@AnthropicAI ecosystem)
→ JSON-RPC 2.0 message framing, request/response lifecycle
→ the tool / resource / prompt model and how a server declares capabilities
→ stdio vs HTTP/SSE transports
→ schema design with Zod (TS) and Pydantic (Python)
→ the TypeScript and Python SDKs, plus the Go and Rust SDKs
→ the SEP proposal process for spec changes
Agent frameworks (@LangChainAI, Microsoft AutoGen)
→ the Runnable / LCEL abstraction and how it composes
→ async Python patterns and Pydantic v2 internals
→ how integrations (LLMs, vector stores, tools) are structured
→ LangGraph’s graph/state model
→ multi-agent orchestration and message routing between agents
Inference engines (
@vllm_project,
@ollama)
→ paged attention and KV-cache management
→ continuous batching and request scheduling
→ quantization
→ Ollama’s model runner architecture and the GGUF format
→ the CGo bridge to llama.cpp
ML libraries (
@huggingface transformers, PyTorch)
→ how a model is structured: config, modeling_*, tokenizer
→ the “add a model” and “fix a model” patterns
→ autograd and the training loop
→ PyTorch’s ATen core and where Python ends and C++/CUDA begins
→ tokenizers, datasets, accelerate
Evals (
@OpenAI evals)
→ how an eval is specified: YAML registry + Python logic
→ prompt and grading design
→ the eval-template pattern for measuring whether a model is actually good
That’s the study phase. Now the real part. Next 30 days: one open-source PR a day, to the projects I just listed.
MCP,
@huggingface, @LangChainAI,
@vllm_project,
@ollama,
@OpenAI - I’m coming for your repos.
See you in September.