Skip to main content

Performance Benchmarks

Last Updated

These benchmarks were automatically generated on 2025-11-13 from the latest CI run.

Environment: Ubuntu Latest â€ĸ .NET SDK 10.0.100

🚀 Runtime Benchmarks​

Click on any benchmark to view detailed results:

🔨 Build Benchmarks​


📊 Methodology​

These benchmarks compare TUnit against the most popular .NET testing frameworks:

FrameworkVersion Tested
TUnit1.1.0
xUnit v33.2.0
NUnit4.4.0
MSTest4.0.2

Test Scenarios​

The benchmarks measure real-world testing patterns:

  • DataDrivenTests: Parameterized tests with multiple data sources
  • AsyncTests: Realistic async/await patterns with I/O simulation
  • ScaleTests: Large test suites (150+ tests) measuring scalability
  • MatrixTests: Combinatorial test generation and execution
  • MassiveParallelTests: Parallel execution stress tests
  • SetupTeardownTests: Expensive test fixtures with setup/teardown overhead

Environment​

  • OS: Ubuntu Latest (GitHub Actions)
  • Runtime: .NET 10.0.0 (10.0.0, 10.0.25.52411), X64 RyuJIT x86-64-v3
  • SDK: .NET SDK 10.0.100
  • Hardware: GitHub Actions Standard Runner (Ubuntu)
  • Tool: BenchmarkDotNet v0.15.7, Linux Ubuntu 24.04.3 LTS (Noble Numbat)

Why These Numbers Matter​

  • No Mocking: All tests use realistic patterns, not artificial micro-benchmarks
  • Equivalent Logic: Each framework implements identical test scenarios
  • Warm-Up Excluded: Measurements exclude JIT warm-up overhead
  • Statistical Rigor: Multiple iterations with outlier detection

Source Code​

All benchmark source code is available in the tools/speed-comparison directory.


Continuous Benchmarking

These benchmarks run automatically daily via GitHub Actions.

Each benchmark runs multiple iterations with statistical analysis to ensure accuracy. Results may vary based on hardware and test characteristics.

Last generated: 2025-11-13T00:28:35.383Z