Our codebase has been growing rapidly and so has our test codebase. Tools like pytest-split balance shards by individual tests but that means every shard has to collect all test files. Instead we developed pytest-fsplit to balance shards by individual test files so each shard only needs to collect the relevant files. This got us down from 3 minutes to 40s of pytest startup.