InferenceKey

Open models on your own GPUs: experiments, measurements and the exact commands behind them. Full write-ups at inferencekey.com

Joined on Oct 14, 2026 https://inferencekey.com

InferenceKey for InferenceKey

Oct 20

Running DeepSeek-V4.1-Flash (763B) on one 96 GB GPU: the three settings that decide your speed

#ai #llm #gpu #opensource

3 min read

Want to connect with InferenceKey?

Create an account to connect with InferenceKey. You can also sign in below to proceed if you already have an account.

Create Account

Already have an account? Sign in

InferenceKey for InferenceKey

Oct 19

Serving Iris-3B Turbo: the 42 GB repo, the 21 GB of VRAM and the 8 MB payload limit

#ai #machinelearning #python #opensource

5 min read

InferenceKey for InferenceKey

Oct 17

Serving a 125B coding model to a team from one RTX 5090: what broke and what we tuned

#ai #llm #gpu #opensource

3 min read

InferenceKey for InferenceKey

Oct 17

Kandinsky 6.0 in a pipeline: offload, the untimed default and what to measure

#ai #machinelearning #opensource #gpu

4 min read

InferenceKey for InferenceKey

Oct 16

A 763B MoE on two 96 GB GPUs: put the idle experts in host RAM, then measure per stream

#llm #gpu #machinelearning #selfhosted

4 min read

InferenceKey for InferenceKey

Oct 15

Same config.json, different serve command: what to check before serving AREX-2

#ai #llm #machinelearning #gpu

5 min read

InferenceKey for InferenceKey

Oct 14

Three things that break when you point Claude Code at your own model

#ai #llm #selfhosted #opensource

4 min read

DEV Community

InferenceKey

Badges

Writing Debut

Organizations

InferenceKey

Running DeepSeek-V4.1-Flash (763B) on one 96 GB GPU: the three settings that decide your speed

Want to connect with InferenceKey?

Serving Iris-3B Turbo: the 42 GB repo, the 21 GB of VRAM and the 8 MB payload limit

Serving a 125B coding model to a team from one RTX 5090: what broke and what we tuned

Kandinsky 6.0 in a pipeline: offload, the untimed default and what to measure

A 763B MoE on two 96 GB GPUs: put the idle experts in host RAM, then measure per stream

Same config.json, different serve command: what to check before serving AREX-2

Three things that break when you point Claude Code at your own model