Skip to content

Repository files navigation

Junior AI Infrastructure Engineer - Learning Repository

🎓 Part of the free, open-source AI Career Curriculum ecosystem — Infrastructure · ML Engineering · AI Engineering · Governance. Live cohorts & team programs: ai-infra-curriculum.github.io.

💜 Sponsor this curriculum — sponsorships keep the whole open-source AI Career Curriculum free and moving.

License: MIT GitHub Issues Contributions Welcome

Welcome to the Junior AI Infrastructure Engineer Learning Repository! This comprehensive curriculum is designed to take you from beginner to job-ready in AI/ML infrastructure, with hands-on projects and industry-relevant skills.

🎯 Learning Objectives

By completing this curriculum, you will be able to:

  • Deploy ML models via REST APIs with Flask/FastAPI
  • Containerize applications using Docker
  • Orchestrate deployments on Kubernetes
  • Build ML pipelines with experiment tracking (MLflow)
  • Implement monitoring with Prometheus and Grafana
  • Version datasets with DVC
  • Automate workflows using Airflow/Prefect
  • Deploy to cloud platforms (AWS/GCP/Azure)
  • Implement CI/CD for ML applications
  • Apply security best practices for production systems

✨ What's New

May 2026 Update — Content Completeness Pass:

  • 🐍 Flask Framework Lecture (Module 007) - When to choose Flask vs FastAPI, app factories, blueprints, extensions, ML serving patterns
  • 🧮 NoSQL Basics Lecture (Module 008) - MongoDB, Redis, vector databases, polyglot persistence for ML platforms
  • Helm Chart (Project 02) - Production-ready chart with HPA, ServiceMonitor, configurable model storage
  • 📊 Grafana Dashboards (Projects 02 & 04) - Model API overview, ML drift tracking, SLI/SLO error budget
  • 🔥 Load Testing Plan (Project 02) - Locust file with smoke/ramp/soak/spike scenarios and acceptance criteria
  • 📐 DVC Pipeline (Project 03) - 5-stage pipeline (ingest → preprocess → validate → train → evaluate) with parameter management
  • Great Expectations Suite (Project 03) - 13 expectations blocking training on bad data
  • ♻️ Retraining DAG (Project 03) - Weekly schedule with drift sensor and gated MLflow promotion
  • 🚨 Alertmanager + Runbooks (Project 04) - Routing tree, 5 structured runbooks for critical alerts
  • 🏗️ Terraform Modules (Project 05) - VPC, EKS, RDS, IAM modules with dev/staging/prod environments
  • 💾 Velero Backup (Project 05) - Helm values with daily/hourly schedules and quarterly restore drill
  • 📒 Cheat Sheets - Python, Linux, SQL, Prometheus quick references
  • 🗺️ Intermediate + Advanced Reading Paths - 6-month and 2-5 year curated reading lists

Earlier Additions:

  • 🤖 LLM Basics Exercise (Module 004) - Run your first language model with Hugging Face Transformers
  • GPU Fundamentals Exercise (Module 004) - Learn GPU acceleration for ML inference
  • 🏗️ Terraform/IaC Exercise (Module 010) - Infrastructure as Code with hands-on AWS deployment
  • 🔄 Airflow Workflow Exercise (Module 009) - Orchestrate ML pipelines with monitoring
  • 📋 Technology Versions Guide - Comprehensive version specifications for all tools
  • 🗺️ Curriculum Cross-Reference - Complete mapping to Engineer track
  • 📈 Career Progression Guide - Junior to Principal Engineer roadmap

📚 Curriculum Overview

Total Duration: 440 hours (11 weeks full-time, 22 weeks part-time) Difficulty: Beginner to Intermediate Prerequisites: Basic Python programming, command-line familiarity

Learning Modules (10 modules, ~150 hours)

Module Topic Duration Difficulty New Content
001 Python Fundamentals for Infrastructure 15 hours Beginner
002 Linux Essentials 15 hours Beginner
003 Git & Version Control 10 hours Beginner
004 ML Basics (PyTorch/TensorFlow) 20 hours Beginner +LLM Basics +GPU Fundamentals
005 Docker & Containerization 15 hours Beginner
006 Kubernetes Introduction 20 hours Beginner+
007 APIs & Web Services 15 hours Beginner +Flask Framework Lecture
008 Databases & SQL 15 hours Beginner +NoSQL Basics Lecture
009 Monitoring & Logging Basics 15 hours Beginner+ +Airflow Workflow
010 Cloud Platforms (AWS/GCP/Azure) 20 hours Beginner+ +Terraform/IaC

Hands-On Projects (5 projects, ~290 hours)

Project Description Duration Technologies
01 Simple Model API Deployment 60 hours Flask/FastAPI, Docker, AWS/GCP
02 Kubernetes Model Serving 80 hours Kubernetes, Helm, Prometheus
03 ML Pipeline with Experiment Tracking 100 hours MLflow, Airflow, DVC
04 Monitoring & Alerting System 80 hours Prometheus, Grafana, ELK Stack
05 Production-Ready ML System (Capstone) 120 hours All above + CI/CD

🚀 Getting Started

Prerequisites

Before starting, ensure you have:

  • Python 3.11+ installed
  • Docker Desktop or Docker Engine
  • Git for version control
  • Code editor (VS Code, PyCharm, etc.)
  • Cloud account (free tier): AWS, GCP, or Azure
  • Basic command-line skills

Setup Instructions

  1. Clone this repository:

    git clone https://github.com/ai-infra-curriculum/ai-infra-junior-engineer-learning.git
    cd ai-infra-junior-engineer-learning
  2. Set up Python environment:

    python3 -m venv venv
    source venv/bin/activate  # On Windows: venv\Scripts\activate
    pip install -r requirements.txt
  3. Install Docker:

  4. Choose your learning path:

    • Beginner: Start with Module 001
    • Some experience: Review modules 001-003, start Module 004
    • Ready for projects: Jump to Project 01

Recommended Learning Path

Week 1-2:  Modules 001-003 (Python, Linux, Git)
Week 3-4:  Modules 004-005 (ML Basics, Docker)
Week 5:    Module 006 (Kubernetes) + Project 01
Week 6-7:  Project 01 (Simple Model API)
Week 8:    Module 007-008 (APIs, Databases) + Project 02
Week 9-10: Project 02 (Kubernetes Serving)
Week 11:   Module 009-010 (Monitoring, Cloud)
Week 12-14: Project 03 (ML Pipeline)
Week 15-16: Project 04 (Monitoring)
Week 17-20: Project 05 (Capstone)
Week 21-22: Portfolio polish, job applications

📖 Repository Structure

ai-infra-junior-engineer-learning/
├── README.md                    # This file
├── CURRICULUM.md                # Detailed curriculum guide
├── CODE_OF_CONDUCT.md          # Community guidelines
├── CONTRIBUTING.md             # How to contribute
├── LICENSE                     # MIT License
├── requirements.txt            # Python dependencies
├── .github/                    # GitHub templates & workflows
│   ├── workflows/              # CI/CD automation
│   └── ISSUE_TEMPLATE/         # Issue templates
├── lessons/                    # Learning modules
│   ├── mod-001-python-fundamentals/
│   │   ├── README.md           # Module overview
│   │   ├── lecture-notes/      # Lecture content
│   │   ├── exercises/          # Hands-on practice
│   │   ├── quizzes/            # Knowledge checks
│   │   └── resources/          # Additional materials
│   ├── mod-002-linux-essentials/
│   └── ...                     # More modules
├── projects/                   # Hands-on projects
│   ├── project-01-simple-model-api/
│   │   ├── README.md           # Project guide
│   │   ├── requirements.md     # Requirements spec
│   │   ├── architecture.md     # Architecture deep-dive
│   │   ├── src/                # Code stubs
│   │   ├── tests/              # Test stubs
│   │   └── docker/             # Docker configs
│   ├── project-02-kubernetes-serving/
│   │   ├── kubernetes/         # Raw K8s manifests (teaching)
│   │   ├── helm/model-api/     # Helm chart (operations)
│   │   ├── grafana/            # Dashboard JSON
│   │   ├── loadtest/           # Locust load tests
│   │   └── monitoring/         # ServiceMonitor
│   ├── project-03-ml-pipeline-tracking/
│   │   ├── dags/               # Airflow DAGs (incl. retraining)
│   │   ├── dvc/                # DVC pipeline + params
│   │   ├── great_expectations/ # Data validation suite
│   │   ├── mlflow/             # MLflow project
│   │   └── src/                # Pipeline stages
│   ├── project-04-monitoring-alerting/
│   │   ├── prometheus/         # Prometheus + alerts
│   │   ├── alertmanager/       # Routing + Slack/PagerDuty
│   │   ├── grafana/dashboards/ # ML overview, drift, SLI/SLO
│   │   ├── elasticsearch/      # ELK config
│   │   └── runbooks/           # Incident playbooks
│   └── project-05-production-ml-capstone/
│       ├── terraform/          # VPC + EKS + RDS + IAM (dev/staging/prod)
│       ├── kubernetes/         # Kustomize base + overlays
│       ├── security/           # cert-manager + Vault
│       ├── velero/             # Cluster backup
│       ├── monitoring/         # SLOs
│       ├── cicd/               # GitHub Actions
│       └── docs/               # Deployment + DR plan
├── assessments/                # Quizzes & exams
│   ├── quizzes/                # Module quizzes
│   ├── practical-exams/        # Hands-on assessments
│   └── rubrics/                # Grading criteria
├── resources/                  # Additional resources
│   ├── cheat-sheets/           # Python, Linux, SQL, Git, Docker, K8s, Prometheus
│   ├── reading-lists/          # Beginner, Intermediate, Advanced paths
│   └── tools.md                # Tool recommendations
├── progress/                   # Track your learning
│   ├── overall-progress.md     # Overall tracker
│   ├── module-progress.md      # Module checklist
│   └── project-progress.md     # Project tracker
└── community/                  # Community resources
    ├── FAQ.md                  # Frequently asked questions
    └── study-groups.md         # Study group info

🎓 Assessment & Certification

Assessment Structure

Each project includes:

  • 100-point rubric with clear criteria
  • Passing score: 70 points
  • Excellence: 90+ points
  • Self-assessment checklists
  • Peer review guidelines

Grading Breakdown

  • Code Quality (25%): Clean, maintainable, well-documented code
  • Functionality (30%): Meets all requirements, works as expected
  • Infrastructure (20%): Proper deployment, scalability, reliability
  • Documentation (15%): Clear README, API docs, deployment guides
  • Performance (10%): Meets performance benchmarks

Portfolio Building

Each project is designed to be portfolio-worthy:

  • Professional README files
  • Live demos (where possible)
  • Architecture diagrams
  • Performance metrics
  • GitHub Actions CI/CD

Showcase your capstone project (Project 05) to potential employers!

🛠️ Technology Stack

Core Technologies

  • Languages: Python 3.11+, Bash, YAML
  • ML Frameworks: PyTorch 2.0+, TensorFlow 2.13+, Scikit-learn 1.3+
  • Container & Orchestration: Docker 24.0+, Kubernetes 1.28+, Helm 3.12+
  • MLOps: MLflow 2.8+, DVC 3.30+, Airflow 2.7+ / Prefect 2.13+
  • Monitoring: Prometheus 2.47+, Grafana 10.2+, ELK Stack 8.11+
  • Cloud: AWS / GCP / Azure (choose one)
  • Databases: PostgreSQL 15+, Redis 7+
  • CI/CD: GitHub Actions, GitLab CI

Development Tools

  • IDE: VS Code, PyCharm, or similar
  • Version Control: Git, GitHub
  • API Testing: Postman, cURL, httpie
  • Container Management: Docker Desktop, Minikube, Kind
  • Cloud CLI: aws-cli, gcloud, az

💼 Career Outcomes

What You'll Be Able to Do

After completing this curriculum, you'll be qualified for:

  • Junior ML Infrastructure Engineer
  • Junior MLOps Engineer
  • DevOps Engineer (ML focus)
  • Cloud Infrastructure Engineer (entry-level)
  • ML Platform Engineer (junior)

Expected Salary Range (US, 2025)

  • Entry-level: $67,000 - $95,000
  • With 1-2 years exp: $80,000 - $110,000
  • Geographic variation: Higher in tech hubs (SF, NYC, Seattle)

Skills You'll Master

Technical:

  • ML model deployment and serving
  • Container orchestration (Docker, Kubernetes)
  • Infrastructure as Code (Terraform basics)
  • CI/CD pipeline development
  • Monitoring and observability
  • Cloud platform management
  • Data pipeline development

Professional:

  • Problem-solving
  • Technical documentation
  • Code review
  • Agile methodologies
  • Collaboration and communication

📝 How to Use This Repository

For Self-Learners

  1. Start with Module 001 and progress sequentially
  2. Complete all exercises in each module
  3. Build each project following the requirements
  4. Self-assess using the provided rubrics
  5. Share your work on GitHub for portfolio building
  6. Join the community for support and networking

For Instructors

This repository provides:

  • Ready-to-use curriculum for a semester-long course
  • Comprehensive lecture materials with exercises
  • Hands-on projects with detailed specifications
  • Assessment rubrics for grading
  • Scaffolded learning from beginner to intermediate

Suggested course structure: 16-week semester, 10 hours/week

For Study Groups

  • Use the discussion forums for collaboration
  • Schedule weekly meetups to review modules
  • Pair program on projects
  • Peer review each other's code
  • Share resources and tips

🤝 Contributing

We welcome contributions! See CONTRIBUTING.md for guidelines.

Ways to contribute:

  • Report bugs or issues
  • Suggest improvements
  • Add exercises or resources
  • Share your project solutions (in discussions)
  • Improve documentation
  • Create tutorial videos

📞 Support & Community

Getting Help

Community Resources

  • Study Groups: Join or create one via GitHub Discussions.
  • Primary discussion channels: GitHub Discussions and Issues are the supported channels today. Dedicated chat/office-hours slots are not currently scheduled — open a Discussion if you'd like to coordinate one with other learners.

📜 License

This project is licensed under the MIT License - see LICENSE file for details.

🙏 Acknowledgments

  • Contributors: Thank you to all contributors!
  • Reviewers: Industry experts who validated this curriculum
  • Open Source Community: For the amazing tools we build upon
  • Students: Your feedback makes this curriculum better

🔗 Related Resources

Curriculum Documentation

Other Curriculum Levels

Solutions Repository

Looking for complete solutions and step-by-step guides? 👉 Junior AI Infrastructure Engineer - Solutions

Note: We recommend attempting projects on your own before reviewing solutions!


Ready to start your AI Infrastructure career? 🚀 Begin with Module 001: Python Fundamentals

Questions? Open an issue or join our community discussions!

Last Updated: May 2026 Version: 1.1.0


Maintained by VeriSwarm.ai

About

AI Infrastructure Junior Engineer Learning Track - Comprehensive curriculum for entry-level ML infrastructure engineers (0-2 years experience)

Topics

Resources

Code of conduct

Contributing

Stars

224 stars

Watchers

3 watching

Forks

Contributors

Languages