domains / families / science / atc-experiments

atc-experiments

separate

Use when designing or auditing the evaluation of an ATC (ACM SIGOPS Annual Technical Conference, formerly USENIX ATC) systems paper — matching evidence to the claim with real testbeds, fair baselines, end-to-end plus microbenchmark results, tail-latency and variance reporting, workload realism, and honest cost accounting.

When to use

• designing ATC paper evaluation
• auditing ATC paper evaluation
• matching evidence to claims
• defining fair baselines
• reporting tail latency and variance
• describing testbeds and workloads
• accounting for system costs

When not to use

• asymptotic analysis
• dataset accuracy evaluation

Skill page

Source