DEV Community

#benchmarking

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
AI Agent Evaluation End to End: How LFORLA Scores a LEGO Build From Brief to Render

AI Agent Evaluation End to End: How LFORLA Scores a LEGO Build From Brief to Render

Comments
5 min read
How Much Context Fits Beside a 12B on an 8 GB GPU? Gemma 4 12B's Context Cache on an RTX 3050

How Much Context Fits Beside a 12B on an 8 GB GPU? Gemma 4 12B's Context Cache on an RTX 3050

2
Comments
9 min read
Benchmarking an Agent Without Lying to Yourself

Benchmarking an Agent Without Lying to Yourself

Comments
5 min read
Benchmarking S3 Throughput: How to Measure Without Lying

Benchmarking S3 Throughput: How to Measure Without Lying

Comments
11 min read
csperf Diff: Comparing Two Runs Without Spreadsheet Chaos

csperf Diff: Comparing Two Runs Without Spreadsheet Chaos

Comments
4 min read
We Wanted a Fast Offline AI. First, We Had to Fix Our Benchmark.

We Wanted a Fast Offline AI. First, We Had to Fix Our Benchmark.

Comments
22 min read
I Built a Benchmark That Catches AI Models Cheating (And They All Failed)

I Built a Benchmark That Catches AI Models Cheating (And They All Failed)

Comments
3 min read
Noise Sources: Affinity, Frequency, and Background Load — How to isolate and quantify non‑compiler variance with csperf

Noise Sources: Affinity, Frequency, and Background Load — How to isolate and quantify non‑compiler variance with csperf

Comments
3 min read
Kev gives the same answer every time. Until you batch it.

Kev gives the same answer every time. Until you batch it.

Comments
8 min read
SGLang vs vLLM: Your Agent Is Slow Because You Picked the Wrong Cache

SGLang vs vLLM: Your Agent Is Slow Because You Picked the Wrong Cache

1
Comments 1
5 min read
A Dense 31B on an 8 GB GPU: Gemma 4 31B on an RTX 3050

A Dense 31B on an 8 GB GPU: Gemma 4 31B on an RTX 3050

10
Comments
10 min read
I Tested Whether Frontier AI Can Do a Texas Real Estate Agent's Desk Work — Here's What 3 Models Taught Me (and What the 4th Taught Me About Benchmarks)

Kaggle Benchmarking Challenge Submission

I Tested Whether Frontier AI Can Do a Texas Real Estate Agent's Desk Work — Here's What 3 Models Taught Me (and What the 4th Taught Me About Benchmarks)

Comments
6 min read
Can a QAT 12B Fit an 8 GB GPU? Gemma 4 12B on an RTX 3050

Can a QAT 12B Fit an 8 GB GPU? Gemma 4 12B on an RTX 3050

7
Comments
15 min read
Warmup Deep Dive: What You’re Throwing Away and Why

Warmup Deep Dive: What You’re Throwing Away and Why

Comments
4 min read
Stability Metrics: Min, Max, and Standard Deviation as First-Class Citizens

Stability Metrics: Min, Max, and Standard Deviation as First-Class Citizens

Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.