#####   ######  #####    ###    #   #  ###  #   #  ######
##  ##  ##      ##  ##  ## ##   #   #   #   #   #  ##
#####   ####    #####   #   #   #   #   #   #   #  ####
##  #   ##      ##      ## ##    # #    #    # #   ##
##   #  ######  ##       ###      #    ###    #    ######

$ curl repovive.com/roadmaps/karpathy-autoresearch/scaling-autoresearch-skypilot-agenthub-and-consumer-gpus

░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░███████████████████████████████████████████████████████████████████████████████████████████████████████████

#####   ######  #####    ###    #   #  ###  #   #  ######
##  ##  ##      ##  ##  ## ##   #   #   #   #   #  ##
#####   ####    #####   #   #   #   #   #   #   #  ####
##  #   ##      ##      ## ##    # #    #    # #   ##
##   #  ######  ##       ###      #    ###    #    ######

$ curl repovive.com/roadmaps/karpathy-autoresearch/scaling-autoresearch-skypilot-agenthub-and-consumer-gpus

Scaling AutoResearch: SkyPilot, AgentHub, and Consumer GPUs

Lessons

1. Introduction

2. Why Sequential Hill-Climbing Hits a Ceiling

3. SkyPilot: Multi-GPU Setup

Ready to start learning?

4. Running Parallel Agents Across GPUs

5. Factorial Grid Search via Agent Swarms

6. The 16-GPU Case: 910 Experiments in 8 Hours

7. Cost Modeling: API + GPU Per Experiment

8. What 8 Hours of Scaled Compute Costs

9. AgentHub: Why GitHub Doesn't Work for Agents

10. AgentHub's Bare Git DAG

11. AgentHub Setup

12. Org Engineering: Programming AI Research Organizations

13. Emergent Multi-Agent Behaviors

14. Emergent Behavior: The Two-Tier Hardware Strategy

15. When to Scale vs. When Not To

16. Cost/Improvement Tradeoff Analysis

17. Running on an RTX 4090

18. macOS and MLX Setup

19. AMD GPU Setup

20. Section Recap