DEV Community

#localai

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Your Secrets Stay Home: Underdog, the Assistant That Never Leaves Your Laptop
bluetickconsultants_inc profile

Your Secrets Stay Home: Underdog, the Assistant That Never Leaves Your Laptop

#aiautomation #aiagents #aiprivacy #localai
Comments
9 min read
How to Compare Local AI Models Side by Side on Your Mac in 2026 (One Question, Up to Six Models)
alichherawalla profile

How to Compare Local AI Models Side by Side on Your Mac in 2026 (One Question, Up to Six Models)

#localai #llm #macos #ollama
Comments 1
6 min read
Elzi: Building an AI YouTube Narrator on a Local TTS Model
mihai_leanzero profile

Elzi: Building an AI YouTube Narrator on a Local TTS Model

#ai #localai #tts #youtube
1
Comments
64 min read
Strata runs a 125B model on a 12 GB gaming GPU by leaning on system RAM, and the README spells out the cost
renolu profile

Strata runs a 125B model on a 12 GB gaming GPU by leaning on system RAM, and the README spells out the cost

#llm #localai #inference #ai
Comments
3 min read
Tokens per second is a memory bandwidth number. Measure it in 2 seconds.
lowspecai profile

Tokens per second is a memory bandwidth number. Measure it in 2 seconds.

#localai #hardware #performance #ollama
Comments
6 min read
Model Context Protocol (MCP) for Local LLMs: Connect Ollama & vLLM to Workstation Tools
abdulrahman_maslmany profile

Model Context Protocol (MCP) for Local LLMs: Connect Ollama & vLLM to Workstation Tools

#ai #machinelearning #python #localai
2
Comments
10 min read
Can a local model replace Jev in my Claude Code memory tool? I tested two
avinash_jetwani_e9c5b4eda profile

Can a local model replace Jev in my Claude Code memory tool? I tested two

#localai #claudecode #ai #opensource
Comments
2 min read
🚀 Introducing ZY-S1 Preview — Building AI That Doesn't Need to Be Huge
zyragentai profile

🚀 Introducing ZY-S1 Preview — Building AI That Doesn't Need to Be Huge

#ai #localai #zys1
Comments
2 min read
Local 144.3M or a hosted API for your approval gate? Three questions and one honest table.
perrylink profile

Local 144.3M or a hosted API for your approval gate? Three questions and one honest table.

#ai #llm #machinelearning #localai
Comments
6 min read
How the Ledger Module Actually Works: SQLite, Regex, and Avoiding LLM Maths
slawekluzny profile

How the Ledger Module Actually Works: SQLite, Regex, and Avoiding LLM Maths

#accounting #localai #sqlite #regex
Comments
3 min read
เราแกะ Qwen3.8-27B-Fable-5-Coding-Distilled ว่าโมเดล เช็กก่อนแก้ ตัวนี้จริงแค่ไหน
sarantoon profile

เราแกะ Qwen3.8-27B-Fable-5-Coding-Distilled ว่าโมเดล เช็กก่อนแก้ ตัวนี้จริงแค่ไหน

#ai #localai #llm #opensource
Comments
3 min read
LabClusters
creature917519 profile

LabClusters

#ai #programming #localai #machinelearning
Comments
2 min read
Run DeepSeek V4 on Your Own Hardware With DwarfStar, the Redis Creator's New Inference Engine
jamilxt profile

Run DeepSeek V4 on Your Own Hardware With DwarfStar, the Redis Creator's New Inference Engine

#ai #localai #deepseek #tutorial
1
Comments
7 min read
Jev: O Que É, Como Funciona e Por Que Você Não Precisa Dele
maiquelleonel profile

Jev: O Que É, Como Funciona e Por Que Você Não Precisa Dele

#localai #opensource #modernbert #onnx
Comments
18 min read
GGUF VRAM Calculator: Check Before You Download
mrsaynothing profile

GGUF VRAM Calculator: Check Before You Download

#ai #gguf #localai #devtools
7
Comments 1
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.