A benchmark of 23 web frameworks: the top 5 were Rust-based

🧪 Benchmark Methodology (4-Tier Architecture)

To simulate different real-world scenarios, our testing approach is divided into four robust tiers:

🌍 Tier 1: Fast Load (Baseline Performance)

• Goal: Establish a baseline for raw Requests Per Second (RPS) and latency.
• Load: 125 concurrent connections for 10 seconds.
• Endpoints: /text, /json, /db-single, /html

⚡ Tier 2: Concurrency & Latency (High Traffic)

• Goal: Evaluate behavior under sudden traffic spikes and measure P99 latency.
• Load: 300 concurrent connections for 30 seconds.
• Endpoints: /json

🧠 Tier 3: Resource Efficiency (Idle vs. Peak)

• Goal: Identify CPU and RAM utilization of "greedy" vs. "efficient" architectures.
• Method: Measure Docker stats during 0 traffic (Idle) vs. 200 concurrent connections (Peak).

🔥 Tier 4: Stress & Resilience (Memory Leak Detection)

• Goal: Ensure frameworks don't crash or leak memory under prolonged stress.
• Load: 500 concurrent connections for a sustained 2 minutes.
• Endpoints: /json

🏅 The Efficiency Ranking Score (RPS/MB)

Our official ranking is determined by the Efficiency Score, which measures how many requests a framework can handle per megabyte of memory it consumes.

• Formula: Efficiency = JSON RPS (Tier 1) / Peak RAM in MB (Tier 3)
• Example: A framework handling 100,000 RPS with 20MB RAM scores 5,000. A framework handling 100,000 RPS with 200MB RAM scores 500.
• The Disqualification Penalty: Any framework that drops connections, crashes, or returns timeout errors during the Tier 4 Stress Test is automatically disqualified and receives 0 Points. Speed is irrelevant if the server collapses under pressure!

💻 Minimum Hardware Requirements

To run these benchmarks locally without skewing the results due to resource starvation (especially during the 500-connection Tier 4 tests), we recommend the following minimum specifications:

• CPU: 4 Cores / 8 Threads (8+ Cores recommended)
• RAM: 8GB Minimum (16GB+ recommended)
• OS: Linux, macOS, or Windows (WSL2)
• Docker Engine: Ensure Docker is allocated at least 4 CPUs and 8GB of RAM.

📊 Official Tested Hardware

All benchmark results listed in this repository were run on the following environment to ensure consistency:

• CPU: AMD Ryzen 7 5700U (8 Cores / 16 Threads)
• RAM: 8GB
• OS: Windows 11 (Docker with WSL2)

🗄️ Database Architecture

All frameworks connect to a dedicated PostgreSQL 15 container.

• The database is initialized via the db-init scripts which pre-populate a table called world with thousands of random rows.
• Frameworks must fetch the World record with ID = 1 for the /db-single endpoint. Connection pooling is strictly recommended.

The Top 10:

🏅 Official Efficiency Ranking

Do you want to see the top 23?
Here is the link: https://rullst.github.io/Benchmarks/
Link of the Repo: https://github.com/Rullst/Benchmarks/