frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: Hands-Rust MCP/CLI that sees the Windows desktop and clicks real Chrome

2•ryan-b•3h ago
I built Hands because I wanted a coding agent to use this Windows PC and a real Chrome profile the way I do: look at the screen, move the real mouse, type, click , without turning Chrome into an automation browser.

It is a Rust MCP/CLI. A harness (Grok, Codex, Claude Code, OpenCode, etc.) calls tools like observe, click, type, scroll. Observe is a screenshot path plus a small element list (UIA + optional Chrome DOM ids). Click is OS SendInput on a Bézier path, not a Chrome DevTools click.

There is no Playwright, no Puppeteer, no remote debugging port. Daily Chrome is launched with no extra flags, or attached if it’s already open. Sites that key on CDP/automation flags mostly don’t see that. They can still see injected input (LLMHF_INJECTED).

A tiny unpacked Chrome extension can fuse page structure (chr: ids, listing cards) so the model isn’t guessing from pixels. Sideload is manual. Fusion dies if the service worker goes inactive; reload the card.

What it is good for: personal research on your own desk. “Find a Camry on cars.com,” read a page, fill a ZIP, dismiss a cookie banner.

What it is not: • Not a sandbox. It can click whatever is on screen, including checkout and Easy Apply. • Confirm-before-money is best-effort classification in the binary, not a guarantee. Prompt injection from the screenshot/DOM is real; the binary treats that text as untrusted, the model might not. • Not a CAPTCHA solver on daily Chrome. Two visible tries, then it yields and waits for the puzzle to go away. • Windows only. • Install is: build the exe, register a native-messaging host, sideload the extension, point an MCP client at hands mcp. README is the runbook. Missing an API key does not fail the build; do_task is optional. • Logs live under %LOCALAPPDATA%\hands\logs\. The extension asks for <all_urls> so it can map the tab you’re looking at.

Repo: https://github.com/Ryan-AI-Studios/hands (MIT)

Happy to answer how observe/fusion/the fence work. If you try it, Pause/Break is the kill switch.

Show HN: Public Muscriptor Instance (latest, most powerful Audio-to-MIDI model)

https://www.pianoify.net/
24•jardy•1d ago•7 comments

Show HN: One portal for all your MCP servers

https://onemcp.dev/
2•ddoronin•1h ago•0 comments

Show HN: Dictata – Local Whisper dictation with LLM cleanup

https://github.com/AntoineChatry/Dictata
2•AntoineC_•1h ago•0 comments

Show HN: OzBrain, a shared brain for knowledge between agents and your team

https://ozbrain.com
82•dariusmonsef•1d ago•48 comments

Show HN: terminal-code – VS Code inside the terminal

https://terminal-code.com
86•robpruzan•3d ago•20 comments

Show HN: LayoutLens: AI-Powered Visual UI Testing

https://github.com/gojiplus/layoutlens
2•neehao•2h ago•0 comments

Show HN: Make your logo extra bright on HDR screens

https://www.soverybright.com/
54•telecuda•10h ago•65 comments

Show HN: Anonymous age verification with passkey-powered encryption

https://loginwithone.com/
39•mikeysight•3d ago•18 comments

Show HN: Rotation via Double Reflection

https://static.laszlokorte.de/rotor-reflect/
54•laszlokorte•1d ago•11 comments

Show HN: CtrlTool – 132 free online tools for developers and everyday tasks

https://ctrltool.wtf
2•jetroni•3h ago•0 comments

Show HN: Zcomplete – Shell Typo Correction

https://github.com/omarfakih1/zcomplete
16•omarfakih•1d ago•2 comments

Show HN: Hands-Rust MCP/CLI that sees the Windows desktop and clicks real Chrome

2•ryan-b•3h ago•0 comments

Show HN: Agent2Creator – a video social network whose members are AI agents

https://agent2creator.vidmoat.com
3•abilafredkb•4h ago•3 comments

Show HN: Nice Licence – An anti-copyleft permissive licence

https://github.com/Jamedjo/git-hunk/commit/240ac0f7e986fbe783a7de1c220fc047771ee059
2•jamedjo•4h ago•1 comments

Show HN: Active Source of Truth for Your Coding Agents

https://meetless.ai
3•anphamthanh•4h ago•2 comments

Show HN: A comic and manga viewer component for React

https://react-comic-viewer.kkweb.io
3•piro0919•4h ago•0 comments

Show HN: Lens AI – generate your JSON-LD files and keep them up-to-date

https://knowledgelens.ai/
2•k7vin•5h ago•0 comments

Show HN: A2G (Agent to Agent) Marketplace – Beta Test

https://www.a2gmarketplace.com
2•egbert87•5h ago•0 comments

Show HN: Shoehorn – Quantize any model down to run on your machine

https://notactuallytreyanastasio.github.io/shoehorn/
96•rhgraysonii•4d ago•16 comments

Show HN: Rex, a parallel functional language for scientific workflows

https://github.com/peterkelly/rex
28•peterkelly•5d ago•6 comments

Show HN: Huzzah – a novel approach to coding with AI

https://www.danielvaughn.dev/posts/huzzah/
378•danielvaughn•2d ago•209 comments

Show HN: Built a CLI to find and disable telemetry for package.json dependencies

https://github.com/apvarun/no-telemetry
2•apvarun•8h ago•0 comments

Show HN: I trained a 125M model to autocomplete piano on-device

https://simedw.com/2026/08/20/midi-autocomplete/
588•simedw•2d ago•117 comments

Show HN: 3D Engine for Rust Programs

https://github.com/David-OConnor/graphics
4•the__alchemist•15h ago•0 comments

Show HN: Rackast, a screen recorder with a built in editor, made with Tauri

https://rackast.com/
2•SzegiRoli•11h ago•0 comments

Show HN: Open-source Stripe Connect alternative

https://zoneless.com
82•tinyprojects•2d ago•36 comments

Show HN: Check if any of the $656M in unclaimed royalties at The MLC is yours

https://pub.doub.ly/
76•knaught•2d ago•37 comments

Show HN: Proliferate- open-source, self-hostable Codex for any coding agent

https://github.com/proliferate-ai/proliferate
44•pablo24602•1d ago•16 comments

Show HN: Get Your IP Address

https://ip.ysebie.be/
4•whizzx•14h ago•0 comments

Show HN: Forst – migrate TypeScript back ends to Go incrementally

https://forst-lang.org/docs
3•haveyaseen•16h ago•0 comments