DEV Community

#benchmark

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
The cheapest model per million tokens was the most expensive per request

The cheapest model per million tokens was the most expensive per request

Comments
4 min read
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA RL Game Agents Benchmark

How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA RL Game Agents Benchmark

Comments
4 min read
ScaleDown CDMs: Fast, Cheap Classify, Extract and Summarize Models Tested

ScaleDown CDMs: Fast, Cheap Classify, Extract and Summarize Models Tested

Comments
8 min read
What a Youden index of 77 actually means on the OWASP Benchmark

What a Youden index of 77 actually means on the OWASP Benchmark

Comments
1 min read
AI 신약 설계 챌린지 2만 3,886건의 점수표를 뜯어 보니: 만점에 닿은 축과 한 번도 닿지 못한 축

AI 신약 설계 챌린지 2만 3,886건의 점수표를 뜯어 보니: 만점에 닿은 축과 한 번도 닿지 못한 축

Comments
4 min read
Benchmarking 6 Open LLMs on a 2-Machine RPC Cluster (Consumer GPUs, ~96GB VRAM)

Benchmarking 6 Open LLMs on a 2-Machine RPC Cluster (Consumer GPUs, ~96GB VRAM)

Comments
6 min read
SelectPdf vs IronPDF in 2026, measured on Windows and Linux

SelectPdf vs IronPDF in 2026, measured on Windows and Linux

1
Comments
7 min read
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Satellite Geo QCM Benchmark

How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Satellite Geo QCM Benchmark

Comments
4 min read
2위와 0.05점 차이도 1위일까: 허깅페이스 보드 44곳에서 자사 1위 11개의 두께를 재 봤습니다

2위와 0.05점 차이도 1위일까: 허깅페이스 보드 44곳에서 자사 1위 11개의 두께를 재 봤습니다

Comments
4 min read
We ran a decision-memory tool through a 61-task coding benchmark. Here's what changed, and what it did to the token bill

We ran a decision-memory tool through a 61-task coding benchmark. Here's what changed, and what it did to the token bill

1
Comments 2
4 min read
GPQA Diamond Has 198 Questions: What the Hugging Face Leaderboard's 115 Rows Can and Cannot Rank

GPQA Diamond Has 198 Questions: What the Hugging Face Leaderboard's 115 Rows Can and Cannot Rank

Comments
14 min read
Shorter outputs, same price: what DeepSeek V4.1-Flash-1017 changes in an agent's bill

Shorter outputs, same price: what DeepSeek V4.1-Flash-1017 changes in an agent's bill

Comments
13 min read
Perfume MCP servers compared: a 40-question benchmark

Perfume MCP servers compared: a 40-question benchmark

Comments
5 min read
Loading a 117.2-million-relationship graph: Semurg 6.0 to 70.3 times faster than FalkorDB, ArcadeDB and SurrealDB

Loading a 117.2-million-relationship graph: Semurg 6.0 to 70.3 times faster than FalkorDB, ArcadeDB and SurrealDB

Comments
3 min read
같은 모델인데 AUROC 0.835가 0.565로: 신약 AI 벤치마크에 시간 분할이 필요한 이유

같은 모델인데 AUROC 0.835가 0.565로: 신약 AI 벤치마크에 시간 분할이 필요한 이유

Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.