frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

Open in hackernews

Building Rq: A Fast Parallel File Search Tool for Windows in Modern C

https://github.com/seeyebe/rq
5•seeyebe•3h ago

Comments

seeyebe•3h ago
Windows search is slow and painful for developers. Even tools like Everything or PowerShell Get-ChildItem can crawl on huge directories. I wanted a CLI tool that feels instant—so I built rq, an open-source file search utility in modern C17 that leverages parallel directory traversal.

rq is typically 3–7x faster than common alternatives, supports filters (size, date, type, regex, glob), and streams results as text or JSON. It’s designed for scripting and developer workflows.

Why not just use existing tools? • Windows Explorer: slow, not scriptable • PowerShell: Get-ChildItem is painfully slow • Everything: fast, but GUI-first • ripgrep: amazing, but focused on text content search

rq focuses on metadata-based search for files and directories on Windows.

Core challenges: 1. Handling Windows quirks like MAX_PATH and Unicode (rq uses \?\ paths and UTF-8 internally) 2. Efficient parallel traversal without burning CPUs 3. Adding powerful filters without making everything slow

Design highlights: • Custom thread pool built on Windows Thread Pool API • Directory traversal is fully parallel: each worker processes directories and queues subdirectories • CLI filters: size, extension, date, regex, glob, file type

Example usage: rq D:\ “*.png” –glob –min 1M –after 2024-01-01 –threads 8

Performance benchmark (1.2M files on NVMe SSD, Windows 11, Ryzen 7): • rq (8 threads): 3.2s • Everything CLI: 6.8s • PowerShell Get-ChildItem: ~40s

Lessons learned: • C17 is still great for high-performance tools • Windows APIs are powerful but painful for paths and Unicode • Thread pools beat raw threads for scalability • Avoid syscalls in the hot path for speed

Source: https://github.com/seeyebe/rq

eevmanu•3h ago
This tool looks great. Congrats for the making of this tool. I would like to know if there is any internal file that could be used to create a benchmark from it in order to compare how fast it gets results in comparison with Void Everything, which is the most common app if a Windows user would like to improve file search.
seeyebe•3h ago
Thanks! Great question. Everything is an excellent tool, but it works differently—it uses a pre-built index, while rq scans the file system in real time.

To benchmark, you can use hyperfine like this:

hyperfine 'rq C:\ ".png" --glob' 'es.exe .png' 'fd --type f png'

This compares rq, Everything CLI (es.exe), and fd.

I'm Rebelling Against the Algorithm

https://varunraghu.com/im-rebelling-against-the-algorithm/
1•Varun08•1m ago•0 comments

My worst tech purchase became my best DIY desk lamp

https://medium.com/@philwornath/when-2-useless-items-unite-repurpose-your-monitor-lamp-bar-ikeahackers-upcycling-02e6ad595e1b
1•philjw•2m ago•1 comments

Show HN: Vizr – Ask questions about your marketing data, get real answers

https://vizr.app/
1•arifliftos•7m ago•0 comments

With One Call, Trump Alters the Fate of a Contested Power Project

https://www.nytimes.com/2025/07/17/climate/hawley-grain-belt-express-invenergy-trump.html
1•zekrioca•9m ago•0 comments

Is Translation the Killer App?

https://substack.com/home/post/p-168658235
1•mathattack•10m ago•0 comments

California wood pellet plants canceled amid market decline and public pushback

https://news.mongabay.com/short-article/california-wood-pellet-plants-canceled-amid-market-decline-public-pushback/
2•PaulHoule•11m ago•0 comments

Show HN: RunAgent: Model Context Protocol (MCP) and Vercel but for AI Agents

https://github.com/runagent-dev/runagent
2•adewba•12m ago•0 comments

Two-photon 3D printing of functional microstructures inside living cells [pdf]

https://arxiv.org/abs/2506.13232
1•thunderbong•13m ago•0 comments

'Utopian' city California Forever announces tech manufacturing park

https://techcrunch.com/2025/07/17/utopian-city-california-forever-announces-huge-tech-manufacturing-park/
1•geox•15m ago•0 comments

Marathon fusion claims to invent alchemy, making 5000 kgs gold per gigawatt

https://www.marathonfusion.com/
1•apugoneappu•16m ago•1 comments

I Became the First Linux User in India

https://medium.com/@vishalmisra/how-i-became-the-first-linux-user-in-india-b86be9d2a6c5
2•GuinansEyebrows•18m ago•0 comments

How to write Rust in the Linux kernel: part 3

https://lwn.net/SubscriberLink/1026694/3413f4b43c862629/
3•chmaynard•19m ago•0 comments

Two Simple Rules to Fix Code Reviews

https://serce.me/posts/2025-07-17-two-simple-rules-to-fix-code-reviews
1•ghuntley•21m ago•0 comments

Show HN: Tech docs → video explainers in seconds

https://symvol.io/
2•feliks22•21m ago•0 comments

Pitfalls of Customer Feedback That Create Bad Products

https://jasonevanish.com/2025/07/18/harsh-truths-customer-feedback/
2•jevanish•22m ago•0 comments

"So what if ChatGPT wrote it?"

https://www.sciencedirect.com/science/article/pii/S0268401223000233
1•bookofjoe•23m ago•0 comments

Ask HN: Will AI Usage Make Frameworks Last Longer?

1•CM30•25m ago•0 comments

Show HN: Numbl – A daily number puzzle inspired by Wordle and Sudoku

https://henryjburg.github.io/numbl/
1•henryjburg•25m ago•0 comments

Anthropic Is Expanding Their Compute

https://trust.anthropic.com
1•JLO64•26m ago•1 comments

Amazon EKS ultra scale clusters

https://aws.amazon.com/blogs/containers/under-the-hood-amazon-eks-ultra-scale-clusters/
1•sbmthakur•27m ago•0 comments

A Short Story of the Google Error Page

https://meiert.com/blog/the-google-error-page/
1•varun_ch•27m ago•0 comments

CCO of private investment firm SMH caught cheating on Series 24 exam [pdf]

https://www.sec.gov/files/litigation/opinions/2025/34-103498.pdf
1•amendegree•29m ago•0 comments

Show HN: AI File Sorter: Organize Files and Folders with AI (Local LLMs)

https://github.com/hyperfield/ai-file-sorter
2•hyperfield•30m ago•0 comments

Who Hates YouTube?

1•thoth001•30m ago•2 comments

Stealth Macintosh Portable case mod

https://biosrhythm.com/?p=2956
1•classichasclass•31m ago•0 comments

Fcrand (Go language): drop-in replacement for crypto/rand, up to 10x faster

https://github.com/sdrapkin/fcrand
1•sdrapkin•32m ago•2 comments

Test Code Like Zelda: When to Implement Automated Testing

https://www.usetusk.ai/resources/when-to-implement-automated-testing
2•Marceltan•47m ago•0 comments

Target to end price-matching policy amid business challenges

https://time.com/7303400/target-price-matching-policy-ending/
2•hhs•49m ago•0 comments

How do you compute the midpoint of an interval? (2014) [pdf]

https://hal.science/file/index/docid/576641/filename/computing-midpoint.pdf
1•todsacerdoti•54m ago•0 comments

Show HN: Benchstreet – the stock prediction AI benchmark

https://github.com/puffinsoft/benchstreet
4•ColonelParrot•54m ago•0 comments