Performance Benchmarks
Last Updated
These benchmarks were automatically generated on 2025-11-13 from the latest CI run.
Environment: Ubuntu Latest âĸ .NET SDK 10.0.100
đ Runtime Benchmarksâ
Click on any benchmark to view detailed results:
- AsyncTests - Detailed performance analysis
- DataDrivenTests - Detailed performance analysis
- MassiveParallelTests - Detailed performance analysis
- MatrixTests - Detailed performance analysis
- ScaleTests - Detailed performance analysis
- SetupTeardownTests - Detailed performance analysis
đ¨ Build Benchmarksâ
- Build Performance - Compilation time comparison
đ Methodologyâ
These benchmarks compare TUnit against the most popular .NET testing frameworks:
| Framework | Version Tested |
|---|---|
| TUnit | 1.1.0 |
| xUnit v3 | 3.2.0 |
| NUnit | 4.4.0 |
| MSTest | 4.0.2 |
Test Scenariosâ
The benchmarks measure real-world testing patterns:
- DataDrivenTests: Parameterized tests with multiple data sources
- AsyncTests: Realistic async/await patterns with I/O simulation
- ScaleTests: Large test suites (150+ tests) measuring scalability
- MatrixTests: Combinatorial test generation and execution
- MassiveParallelTests: Parallel execution stress tests
- SetupTeardownTests: Expensive test fixtures with setup/teardown overhead
Environmentâ
- OS: Ubuntu Latest (GitHub Actions)
- Runtime: .NET 10.0.0 (10.0.0, 10.0.25.52411), X64 RyuJIT x86-64-v3
- SDK: .NET SDK 10.0.100
- Hardware: GitHub Actions Standard Runner (Ubuntu)
- Tool: BenchmarkDotNet v0.15.7, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
Why These Numbers Matterâ
- No Mocking: All tests use realistic patterns, not artificial micro-benchmarks
- Equivalent Logic: Each framework implements identical test scenarios
- Warm-Up Excluded: Measurements exclude JIT warm-up overhead
- Statistical Rigor: Multiple iterations with outlier detection
Source Codeâ
All benchmark source code is available in the tools/speed-comparison directory.
Continuous Benchmarking
These benchmarks run automatically daily via GitHub Actions.
Each benchmark runs multiple iterations with statistical analysis to ensure accuracy. Results may vary based on hardware and test characteristics.
Last generated: 2025-11-13T00:28:35.383Z