At CodSpeed we sometimes get reports that benchmarks regressed when making seemingly unrelated code changes. Common examples include updating documentation, changing different CI workflows, or adding/removing benchmarks. This article aims to dig deeper into an investigation we recently had, where this was the case.