Choose a resource to close a specific skill gap, then demonstrate the skill in a small project and a design explanation. Completing more courses is not the same as becoming ready for an interview.
This is Learnastra's selection of external courses and primary documentation, reviewed September 24, 2026. The practice assignments below are Learnastra exercises, not claims about an external course's assessments or an employer's interview. Providers control their enrollment, prices, certificates and hosted services; access to this guide does not include those purchases.
Choose your next step
| You can already… | Your next gap | Start here | Produce this evidence |
|---|---|---|---|
| Write basic Python | Explain model behavior | Foundations | A tiny model or tokenizer experiment with a clear explanation |
| Call a model API | Build reliable data access | Retrieval | A scoped search-and-answer baseline with known failure cases |
| Build a useful prototype | Test quality and failure handling | Evaluation | A versioned dataset, rubric, error analysis and release comparison |
| Build one model workflow | Control tools and long-running state | Agents and memory | A recoverable workflow with bounded authority |
| Explain the architecture | Operate under real constraints | Serving and security | Load, failure, access and full-cost measurements |
| Lead a product or team | Define outcomes and evaluate tradeoffs | Product path | A decision brief with quality criteria, economics and launch gates |
Read diagram source
flowchart LR
G[Identify a skill gap] --> R[Read one focused resource]
R --> B[Build a bounded example]
B --> T[Test normal and failure cases]
T --> E[Explain the decision aloud]
E --> N[Record the next gap]
N --> G
Before enrolling, check prerequisites, the syllabus, software versions, current access terms and any separate GPU or API charges. Prefer a reproducible exercise over a long playlist you cannot apply.
Foundations: models and Transformers
| Resource | What to use it for | Prerequisite and currency note |
|---|---|---|
| Neural Networks: Zero to Hero — Andrej Karpathy | Build intuition by implementing neural networks and language-model components. | Python and basic calculus help. Distinguish the educational implementation from a production serving stack. |
| Hugging Face LLM Course | Tokenizers, datasets, Transformer models and the surrounding open-source tooling. | Python; the course evolved from its earlier NLP focus. The provider describes the course as free. |
| Practical Deep Learning for Coders — fast.ai | Learn applied model training through working projects. | Some coding experience. Check the lesson's library versions when reproducing notebooks. |
| Stanford CS336: Language Modeling from Scratch | Study tokenization, model construction, training systems, data and evaluation in depth. | A demanding university course; linear algebra, probability, deep learning and systems experience are useful. Use the stated course year. |
Practice: explain the difference between a token, an embedding and an attention weight. Run the tiny decoder lesson, change one assumption and report what happens. For detailed explanations, use the tokenization, attention and Transformer chapters.
Retrieval and RAG
| Resource | What to use it for | Prerequisite and currency note |
|---|---|---|
| Retrieval Augmented Generation — DeepLearning.AI | A structured path through retrieval, generation, evaluation and deployment concerns. | Intermediate Python. Inspect enrollment and assessment access separately; “enroll for free” does not establish that every feature is free. |
| LlamaIndex: building an LLM application | Learn ingestion, indexing, retrieval and application composition through the framework's current documentation. | Python and a basic retrieval model. Pin the package versions used by your exercise. |
| Haystack tutorials | Compare explicit retrieval and generation pipelines, including search and evaluation examples. | Read each tutorial's requirements; hosted dependencies may have separate charges. |
Practice: build lexical search over a small collection you are permitted to use. Add generation with citations, then compare vector or hybrid retrieval on the same questions. Include an absent answer, a deleted document, a changed permission and an exact identifier. Explain whether retrieval recall or synthesis failed before changing the design. Continue with RAG fundamentals and the enterprise RAG interview.
Agents and orchestration
| Resource | What to use it for | Prerequisite and currency note |
|---|---|---|
| Hugging Face Agents Course | Agent fundamentals, tools and framework-based exercises. | Python and basic model prompting. Recheck integrations against current SDK contracts. |
| LangChain Academy: Introduction to LangGraph | Explicit graph state, transitions and controlled model workflows. | Python; course enrollment and any model usage are separate. |
| Berkeley LLM Agents, Fall 2024 | Research lectures on agent capabilities, planning, learning and evaluation. | An archived course: useful for ideas, not a September 2026 package installation guide. |
Practice: create a support workflow with a read-only lookup tool and a proposed-action step. Add runtime-enforced tool scope, a total deadline and a maximum call count. Simulate a failed tool and a lost response. Explain why the workflow does or does not need several agents. Compare the agent fundamentals, orchestration and durable execution lessons.
Context and memory
| Resource | What to use it for | Prerequisite and currency note |
|---|---|---|
| LangGraph memory documentation | Understand short-term state and longer-lived stores within a concrete runtime. | Learn the graph execution model first. Persistence is not automatically a correct memory policy. |
| LangChain Academy | Find the current context, agent-harness and observability learning paths relevant to your application. | The catalog changes; select a bounded objective rather than completing every course. |
Practice: retain a user-approved preference, explain its provenance and expiry, then delete it. Demonstrate that the next answer no longer uses it, including through a cache or summary. Read memory architectures, long-term memory and context engineering.
Evaluation and observability
| Resource | What to use it for | Prerequisite and currency note |
|---|---|---|
| AI Evals for Engineers & PMs — Hamel Husain and Shreya Shankar | A structured course covering error analysis, evaluator design and operational evaluation. | A paid, cohort-based option. Confirm current dates, price and workload on the provider's page. It is optional external study. |
| Arize Phoenix documentation | Learn tracing, datasets and evaluation through a concrete tool. | Know the difference between telemetry and a valid quality measure. Check hosting and retention configuration. |
| Langfuse documentation | Instrument model applications and connect observations, datasets and evaluation. | Follow current SDK migration guidance; an older decorator example may not match the installed major version. |
| Evaluating and Debugging Generative AI — DeepLearning.AI | Experiment tracking, versioned artifacts and model-application debugging with Weights & Biases. | Python and model-training familiarity. Check current access terms and notebook dependencies. |
Practice: label a small, permission-safe set of outputs with an explicit rubric. Compare a proposed model judge with human labels. Report disagreements and unjudged cases, then run a paired baseline/candidate experiment on held-out cases. A small exercise teaches the method; it does not establish a production error bound. Use evaluation fundamentals, observability and the evaluation-gated delivery interview.
Prompting and structured generation
| Resource | What to use it for | Prerequisite and currency note |
|---|---|---|
| ChatGPT Prompt Engineering for Developers — DeepLearning.AI | Instruction clarity, iteration and small application examples. | An introductory course first released in 2023. Translate old model names and SDK syntax using current provider documentation. |
| DSPy documentation | Compose and optimize model programs with examples and measurable objectives. | Python, an evaluation dataset and a useful metric. An optimizer cannot repair a misleading objective. |
Practice: compare zero-shot instructions, representative demonstrations and a constrained schema on a fixed task. Keep a separate test set. Include malformed inputs and valid-looking but semantically wrong outputs. Explain how business validation differs from parsing. Continue with prompt fundamentals, structured generation and DSPy.
Fine-tuning and adaptation
| Resource | What to use it for | Prerequisite and currency note |
|---|---|---|
| Hugging Face PEFT documentation | Learn parameter-efficient methods and their supported implementations. | Model training basics. Check base-model license, hardware requirements and adapter compatibility. |
| Finetuning Large Language Models — DeepLearning.AI | Understand task selection, data preparation and the training/evaluation cycle. | Python and basic model usage. Treat hosted training services and course-era APIs as versioned examples. |
Practice: choose a stable, narrow task and compare a prompting baseline with an adapter. Keep training, development and test data separate. Report quality, memory, training cost, serving cost and a case where adaptation hurts. Use LoRA and QLoRA, preference optimization and verifiable rewards for distinct training objectives.
Inference, serving and MLOps
| Resource | What to use it for | Prerequisite and currency note |
|---|---|---|
| vLLM documentation | Study model serving, batching, memory and deployment options. | Linux/GPU and model-inference familiarity. Use documentation matching your installed release and hardware. |
| Stanford CS336 | Connect model computation and memory costs to systems decisions. | Select systems lectures appropriate to your preparation rather than treating all assignments as prerequisites for an application role. |
Practice: measure first-token and completion latency under increasing concurrency. Explain queueing, token quotas and memory use, then compare a change against the same workload. Include hardware and operations in the economics. Read serving infrastructure, CI/CD and FinOps.
Security, safety and governance
| Resource | What to use it for | Prerequisite and currency note |
|---|---|---|
| OWASP LLM application security project | Identify application threat classes and examine mitigations. | Record the document edition. A risk taxonomy is not an exhaustive threat model or certification. |
Practice: draw the trust boundaries around user input, documents, tools, memory and model providers. Test an indirect prompt injection in a local, synthetic exercise. Show which server-side restriction prevents the forbidden operation even if the model follows the malicious instruction. Read access control, agent sandboxing and governance.
Coding agents and developer tools
| Resource | What to use it for | Prerequisite and currency note |
|---|---|---|
| Claude Code documentation | Understand the current product's workflow, project instructions and permission controls. | Existing Git and development skills. Check plan/model charges and the execution surface. |
| OpenHands documentation | Explore a software-agent platform and its development/runtime interfaces. | Containers and software testing are useful. Follow the current documentation's SDK and deployment paths. |
Practice: ask an agent to make a bounded change in a disposable project. Review every changed file, run meaningful tests, inspect permissions and explain a missed requirement. Use coding-agent tools and the autonomous coding interview. In a real hiring process, use AI tools only when that employer's instructions permit them.
Product and leadership preparation
| Resource | What to use it for | Prerequisite and currency note |
|---|---|---|
| AI for Everyone — DeepLearning.AI | Establish nontechnical vocabulary for AI opportunities, project workflows and organizational decisions. | No programming prerequisite for the conceptual path. It does not replace technical architecture practice. |
| AI Evals for Engineers & PMs | Build a shared quality process between product and engineering. | Optional paid course; verify the current cohort and prerequisites. |
Practice: write a one-page proposal with the user problem, a non-AI baseline, measurable success, excluded uses, operating costs and a limited launch plan. Explain who labels quality, who handles exceptions and what would stop the rollout. Practice the behavioral examples using your actual experience, never invented employment or customer results.
Lectures and public learning material
The Karpathy, fast.ai, Hugging Face and university links above provide focused starting points for public learning material. For video, prefer the lecture links on the instructor's or university's page so the course year and accompanying notes remain clear. General news channels can help discover a topic; verify technical claims against a paper, specification or current project documentation before putting them into a design.
Public reading access does not imply free GPU use, hosted inference, graded assessments or certificates. A promotional access period can end.
Five practice paths
| Your objective | Suggested sequence | Completion evidence |
|---|---|---|
| Build your first AI application | Prompting → retrieval → evaluation → basic security | Explain an end-to-end prototype, its known errors and one justified improvement. |
| Understand models deeply | Neural-network fundamentals → tokenization/attention → CS336 topics → inference → adaptation | Derive key tensor/memory quantities and run a controlled experiment. |
| Build an evaluation process | Error analysis → rubrics → dataset design → judge validation → release gating → monitoring | Reproduce a comparison and explain uncertainty, regressions and missing outcomes. |
| Lead AI product quality | AI vocabulary → product success criteria → expert labeling → unit economics → release decision | Defend the launch criteria and explain when the product should defer to a person. |
| Introduce coding agents to a team | Tool permissions → bounded edits → independent review → CI → sandbox/recovery → cost measurement | Demonstrate a useful change and an intentionally failed case with safe recovery. |
Use a pace that matches your baseline knowledge. Finishing in a fixed number of weeks is not evidence of job readiness. Each path should end with a requirements-led interview exercise, not only a completed playlist.
Check your learning
- Can you define the concept in one or two sentences without naming a vendor?
- Can you draw the baseline and explain the path of one request?
- Can you identify a failure the tutorial did not demonstrate?
- Can you state which numbers are measured and which are assumptions?
- Can you explain the full cost, including human and operational work?
- Can someone reproduce your result using the recorded versions and permitted data?
- Can you justify keeping the baseline if the more complex option does not help?
Final notes: staying current
- Record the publication/course year and the software versions used in an exercise.
- Verify changed SDK syntax in primary documentation before changing the conceptual explanation.
- Keep your own error log and revisit the resources that address those errors.
- Use the research reading guide to assess new claims and the framework maintenance guide to plan upgrades.
- Keep certificates, subscriptions and tool purchases separate from evidence that you can solve and explain the problem.