Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
benchmark
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
The cheapest model per million tokens was the most expensive per request
chenyu
chenyu
chenyu
Follow
Oct 24
The cheapest model per million tokens was the most expensive per request
#
llm
#
api
#
performance
#
benchmark
Comments
Add Comment
4 min read
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA RL Game Agents Benchmark
RESK
RESK
RESK
Follow
Oct 24
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA RL Game Agents Benchmark
#
llm
#
evaluation
#
benchmark
#
reinforcementlearnin
Comments
Add Comment
4 min read
ScaleDown CDMs: Fast, Cheap Classify, Extract and Summarize Models Tested
Ishank Choudhary
Ishank Choudhary
Ishank Choudhary
Follow
Oct 24
ScaleDown CDMs: Fast, Cheap Classify, Extract and Summarize Models Tested
#
ai
#
llm
#
machinelearning
#
benchmark
Comments
Add Comment
8 min read
What a Youden index of 77 actually means on the OWASP Benchmark
Ward Ed
Ward Ed
Ward Ed
Follow
Oct 23
What a Youden index of 77 actually means on the OWASP Benchmark
#
security
#
appsec
#
benchmark
#
testing
Comments
Add Comment
1 min read
AI 신약 설계 챌린지 2만 3,886건의 점수표를 뜯어 보니: 만점에 닿은 축과 한 번도 닿지 못한 축
Vidraft_lab
Vidraft_lab
Vidraft_lab
Follow
Oct 22
AI 신약 설계 챌린지 2만 3,886건의 점수표를 뜯어 보니: 만점에 닿은 축과 한 번도 닿지 못한 축
#
ai
#
python
#
datascience
#
benchmark
Comments
Add Comment
4 min read
Benchmarking 6 Open LLMs on a 2-Machine RPC Cluster (Consumer GPUs, ~96GB VRAM)
faliye
faliye
faliye
Follow
Oct 22
Benchmarking 6 Open LLMs on a 2-Machine RPC Cluster (Consumer GPUs, ~96GB VRAM)
#
ai
#
llm
#
benchmark
#
llama
Comments
Add Comment
6 min read
SelectPdf vs IronPDF in 2026, measured on Windows and Linux
Florentin Badea
Florentin Badea
Florentin Badea
Follow
Oct 22
SelectPdf vs IronPDF in 2026, measured on Windows and Linux
#
dotnet
#
csharp
#
pdf
#
benchmark
1
reaction
Comments
Add Comment
7 min read
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Satellite Geo QCM Benchmark
RESK
RESK
RESK
Follow
Oct 22
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Satellite Geo QCM Benchmark
#
llm
#
evaluation
#
benchmark
#
geo
Comments
Add Comment
4 min read
2위와 0.05점 차이도 1위일까: 허깅페이스 보드 44곳에서 자사 1위 11개의 두께를 재 봤습니다
Vidraft_lab
Vidraft_lab
Vidraft_lab
Follow
Oct 21
2위와 0.05점 차이도 1위일까: 허깅페이스 보드 44곳에서 자사 1위 11개의 두께를 재 봤습니다
#
ai
#
machinelearning
#
benchmark
#
llm
Comments
Add Comment
4 min read
We ran a decision-memory tool through a 61-task coding benchmark. Here's what changed, and what it did to the token bill
kgaidev
kgaidev
kgaidev
Follow
Oct 23
We ran a decision-memory tool through a 61-task coding benchmark. Here's what changed, and what it did to the token bill
#
ai
#
claude
#
benchmark
#
testing
1
reaction
Comments
2
comments
4 min read
GPQA Diamond Has 198 Questions: What the Hugging Face Leaderboard's 115 Rows Can and Cannot Rank
Ward Ed
Ward Ed
Ward Ed
Follow
Oct 21
GPQA Diamond Has 198 Questions: What the Hugging Face Leaderboard's 115 Rows Can and Cannot Rank
#
ai
#
opensource
#
llm
#
benchmark
Comments
Add Comment
14 min read
Shorter outputs, same price: what DeepSeek V4.1-Flash-1017 changes in an agent's bill
ai maya
ai maya
ai maya
Follow
Oct 21
Shorter outputs, same price: what DeepSeek V4.1-Flash-1017 changes in an agent's bill
#
ai
#
opensource
#
llm
#
benchmark
Comments
Add Comment
13 min read
Perfume MCP servers compared: a 40-question benchmark
10ML
10ML
10ML
Follow
Oct 21
Perfume MCP servers compared: a 40-question benchmark
#
mcp
#
ai
#
api
#
benchmark
Comments
Add Comment
5 min read
Loading a 117.2-million-relationship graph: Semurg 6.0 to 70.3 times faster than FalkorDB, ArcadeDB and SurrealDB
Semurg
Semurg
Semurg
Follow
Oct 21
Loading a 117.2-million-relationship graph: Semurg 6.0 to 70.3 times faster than FalkorDB, ArcadeDB and SurrealDB
#
database
#
graph
#
benchmark
#
performance
Comments
Add Comment
3 min read
같은 모델인데 AUROC 0.835가 0.565로: 신약 AI 벤치마크에 시간 분할이 필요한 이유
Vidraft_lab
Vidraft_lab
Vidraft_lab
Follow
Oct 21
같은 모델인데 AUROC 0.835가 0.565로: 신약 AI 벤치마크에 시간 분할이 필요한 이유
#
ai
#
machinelearning
#
benchmark
#
datascience
Comments
Add Comment
3 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account