Skip to content

DEV Community

Running LLMs Locally on Consumer Hardware Series' Articles

Back to Sven Welack's Series

Jul 31

LLMs on Consumer Hardware — Part 3: A Multi-Agent Setup with Hermes — Delegation and Early Failure Modes

#localllama #ai #llm #agents

5 min read

Aug 4

LLMs on Consumer Hardware — Part 2: Prefill and the Failure of the AI PC

#localllama #ai #llm #homelab

4 min read

Aug 5

LLMs on Consumer Hardware — Part 1: The Stack and First Benchmarks

#localllama #ai #llm #homelab

3 min read

Aug 19

LLMs on Consumer Hardware — Part 4: The Coordinator Search — Role-Casting and the Memory Wall

#localllama #ai #llm #agents

4 min read

Oct 14

LLMs on Consumer Hardware — Part 5: Distributing the Workers and the Memory Budget

#localllama #ai #llm #agents

4 min read

Oct 18

LLMs on Consumer Hardware — Part 6: The Orchestration Ceiling — Why a Bigger Coordinator Doesn't Fix the Loop

#localllama #ai #llm #agents

3 min read

Oct 19

Running LLMs on Consumer Hardware — Part 7: The Strategist — Judgment on a Cloud Model, Execution Local

#localllama #ai #llm #agents

4 min read