DEV Community

#benchmarking

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Eggs, Cholesterol, and GPU Flags
devbrewery profile

Eggs, Cholesterol, and GPU Flags

#llm #benchmarking #gpu
Comments
3 min read
Measure the Binary You Run
devbrewery profile

Measure the Binary You Run

#llm #benchmarking #devops
Comments 1
2 min read
Same Model, 13.3% to 38.3%
harrisonsec profile

Same Model, 13.3% to 38.3%

#ai #machinelearning #benchmarking #llm
Comments 3
7 min read
The sleep loop is the tell: agents that pay per action optimize to do nothing
cole_halton_42f71d71b809b profile

The sleep loop is the tell: agents that pay per action optimize to do nothing

#aiagents #evaluation #llm #benchmarking
Comments 1
2 min read
I benchmarked Dragonfly vs Redis vs Valkey. First, let me show you how I kept it honest.
sunnysahijwani profile

I benchmarked Dragonfly vs Redis vs Valkey. First, let me show you how I kept it honest.

#redis #database #performance #benchmarking
1
Comments
6 min read
Our benchmark was leaking the answers to the model. The numbers looked fine the whole time.
aioilshield profile

Our benchmark was leaking the answers to the model. The numbers looked fine the whole time.

#security #ai #benchmarking #opensource
Comments
3 min read
Fairness Under the Microscope: Why HY3 Beats Nemotron 3 Ultra on lforla's Bias Stereotypes Audit
resk profile
RESK

Fairness Under the Microscope: Why HY3 Beats Nemotron 3 Ultra on lforla's Bias Stereotypes Audit

#ai #llm #fairness #benchmarking
1
Comments
3 min read
The Compiler Got 5% Slower. The Benchmark Called It a 10% Regression a Quarter of the Time.
bedvibe_studios profile

The Compiler Got 5% Slower. The Benchmark Called It a 10% Regression a Quarter of the Time.

#quantum #testing #benchmarking #python
Comments 1
6 min read
I benchmarked 5 managed graph databases — and the "obvious" winner changed depending on what I measured
ahmed_amer profile

I benchmarked 5 managed graph databases — and the "obvious" winner changed depending on what I measured

#database #graphdatabase #benchmarking
Comments
5 min read
The Model Reading My Benchmark Mattered More Than the Memory System Did
spranab profile

The Model Reading My Benchmark Mattered More Than the Memory System Did

#ai #llm #benchmarking #opensource
Comments
7 min read
I benchmarked CognoDB against four other graph databases. The most interesting result had nothing to do with CognoDB.
sachin_meru profile

I benchmarked CognoDB against four other graph databases. The most interesting result had nothing to do with CognoDB.

#webdev #database #devops #benchmarking
Comments 1
5 min read
I benchmarked 5 graph databases. The first four hours measured the Indian Ocean.
burz4m_13b009bb9f0a92a88c profile

I benchmarked 5 graph databases. The first four hours measured the Indian Ocean.

#showdev #database #benchmarking #devops
Comments
6 min read
Don't Trust a New Model's Benchmarks Until You Run Your Own 30-Minute Smoke Test
webx_2736 profile

Don't Trust a New Model's Benchmarks Until You Run Your Own 30-Minute Smoke Test

#ai #programming #benchmarking #opensource
Comments
5 min read
Before You Adopt MiniMax H3, Run a Twenty-Minute Model Audit
aiio_6471 profile

Before You Adopt MiniMax H3, Run a Twenty-Minute Model Audit

#ai #opensource #programming #benchmarking
Comments
3 min read
DeepSeek Harness: What "Everything is a Plugin" Actually Means for Agent Frameworks
cole_halton_42f71d71b809b profile

DeepSeek Harness: What "Everything is a Plugin" Actually Means for Agent Frameworks

#deepseek #aiagents #opensource #benchmarking
Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.