LibreCrawl is completely free, handles 1M+ URLs smoothly using virtual scrolling and memory profiling, and includes features even paid tools don't have (multi-session support, custom CSS injection, real-time memory dashboard).
It's MIT licensed and self-hostable for complete data control.
Would love feedback from the HN community!