DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
100% vuln detection wasn't enough: measuring whether AI respects the patch

Kaggle Benchmarking Challenge Submission

100% vuln detection wasn't enough: measuring whether AI respects the patch

6
Comments 1
6 min read
Three perfect scores weren't enough: testing AI outage decisions one fact at a time

Kaggle Benchmarking Challenge Submission

Three perfect scores weren't enough: testing AI outage decisions one fact at a time

5
Comments
5 min read
Small AI Models Can See the Trap. They Fall In Anyway

Kaggle Benchmarking Challenge Submission

Small AI Models Can See the Trap. They Fall In Anyway

1
Comments
5 min read
Can AI Diagnose a Linux Production Incident Without Making It Worse?

Kaggle Benchmarking Challenge Submission

Can AI Diagnose a Linux Production Incident Without Making It Worse?

Comments 1
5 min read
Can an AI Agent Know When Not to Act? A Fail-Closed Reliability Benchmark Across Six Models

Kaggle Benchmarking Challenge Submission

Can an AI Agent Know When Not to Act? A Fail-Closed Reliability Benchmark Across Six Models

Comments
4 min read
Breaking Character: How "Thinking" AI Survives Villain Roleplay Traps

Breaking Character: How "Thinking" AI Survives Villain Roleplay Traps

Comments
2 min read
How AI Models "See" Hidden Meaning: A Beginner's Subtext Benchmark

How AI Models "See" Hidden Meaning: A Beginner's Subtext Benchmark

Comments
1 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.