frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Was going to share my work

1•hiddenarchitect•14s ago•0 comments

Pitchfork: A devilishly good process manager for developers

https://pitchfork.jdx.dev/
1•ahamez•16s ago•0 comments

You Are Here

https://brooker.co.za/blog/2026/02/07/you-are-here.html
1•mltvc•4m ago•0 comments

Why social apps need to become proactive, not reactive

https://www.heyflare.app/blog/from-reactive-to-proactive-how-ai-agents-will-reshape-social-apps
1•JoanMDuarte•5m ago•1 comments

How patient are AI scrapers, anyway? – Random Thoughts

https://lars.ingebrigtsen.no/2026/02/07/how-patient-are-ai-scrapers-anyway/
1•samtrack2019•5m ago•0 comments

Vouch: A contributor trust management system

https://github.com/mitchellh/vouch
1•SchwKatze•5m ago•0 comments

I built a terminal monitoring app and custom firmware for a clock with Claude

https://duggan.ie/posts/i-built-a-terminal-monitoring-app-and-custom-firmware-for-a-desktop-clock...
1•duggan•6m ago•0 comments

Tiny C Compiler

https://bellard.org/tcc/
1•guerrilla•8m ago•0 comments

Y Combinator Founder Organizes 'March for Billionaires'

https://mlq.ai/news/ai-startup-founder-organizes-march-for-billionaires-protest-against-californi...
1•hidden80•8m ago•1 comments

Ask HN: Need feedback on the idea I'm working on

1•Yogender78•9m ago•0 comments

OpenClaw Addresses Security Risks

https://thebiggish.com/news/openclaw-s-security-flaws-expose-enterprise-risk-22-of-deployments-un...
1•vedantnair•9m ago•0 comments

Apple finalizes Gemini / Siri deal

https://www.engadget.com/ai/apple-reportedly-plans-to-reveal-its-gemini-powered-siri-in-february-...
1•vedantnair•10m ago•0 comments

Italy Railways Sabotaged

https://www.bbc.co.uk/news/articles/czr4rx04xjpo
3•vedantnair•10m ago•0 comments

Emacs-tramp-RPC: high-performance TRAMP back end using MsgPack-RPC

https://github.com/ArthurHeymans/emacs-tramp-rpc
1•fanf2•11m ago•0 comments

Nintendo Wii Themed Portfolio

https://akiraux.vercel.app/
1•s4074433•16m ago•1 comments

"There must be something like the opposite of suicide "

https://post.substack.com/p/there-must-be-something-like-the
1•rbanffy•18m ago•0 comments

Ask HN: Why doesn't Netflix add a “Theater Mode” that recreates the worst parts?

2•amichail•19m ago•0 comments

Show HN: Engineering Perception with Combinatorial Memetics

1•alan_sass•25m ago•2 comments

Show HN: Steam Daily – A Wordle-like daily puzzle game for Steam fans

https://steamdaily.xyz
1•itshellboy•27m ago•0 comments

The Anthropic Hive Mind

https://steve-yegge.medium.com/the-anthropic-hive-mind-d01f768f3d7b
1•spenvo•27m ago•0 comments

Just Started Using AmpCode

https://intelligenttools.co/blog/ampcode-multi-agent-production
1•BojanTomic•28m ago•0 comments

LLM as an Engineer vs. a Founder?

1•dm03514•29m ago•0 comments

Crosstalk inside cells helps pathogens evade drugs, study finds

https://phys.org/news/2026-01-crosstalk-cells-pathogens-evade-drugs.html
2•PaulHoule•30m ago•0 comments

Show HN: Design system generator (mood to CSS in <1 second)

https://huesly.app
1•egeuysall•30m ago•1 comments

Show HN: 26/02/26 – 5 songs in a day

https://playingwith.variousbits.net/saturday
1•dmje•31m ago•0 comments

Toroidal Logit Bias – Reduce LLM hallucinations 40% with no fine-tuning

https://github.com/Paraxiom/topological-coherence
1•slye514•33m ago•1 comments

Top AI models fail at >96% of tasks

https://www.zdnet.com/article/ai-failed-test-on-remote-freelance-jobs/
5•codexon•33m ago•2 comments

The Science of the Perfect Second (2023)

https://harpers.org/archive/2023/04/the-science-of-the-perfect-second/
1•NaOH•34m ago•0 comments

Bob Beck (OpenBSD) on why vi should stay vi (2006)

https://marc.info/?l=openbsd-misc&m=115820462402673&w=2
2•birdculture•38m ago•0 comments

Show HN: a glimpse into the future of eye tracking for multi-agent use

https://github.com/dchrty/glimpsh
1•dochrty•39m ago•0 comments
Open in hackernews

Firecrawl getting blocked due to headlesness

3•maclarens•2mo ago
I’ve noticed that Firecrawl struggles with certain sites that do better with headful browsers. So we made Teracrawl (https://github.com/BrowserCash/teracrawl), which is an open source crawler built on a headful chrome browser API. (Browser.cash)

I tested a few URLs that are very JS-heavy and anti-bot-ish:

1. Yahoo Finance – Currencies https://finance.yahoo.com/currencies

Teracrawl: got the full currencies table (it actually ran the React app and hit the live pricing API).

Firecrawl: only got the header/nav shell, no Forex table at all. Was getting completely blocked by Yahoo.

2. AT&T wireless phones https://www.att.com/buy/wireless/phones

Firecrawl: just the AT&T header + basic chrome, no phones catalog.

Teracrawl: full phones list + pricing, filters, etc., since it executed the React frontend and fetched the JSON endpoints.

3. GoDaddy domain search https://www.godaddy.com/en-ca/domainsearch/find?…domainToCheck=mydomain.io

Firecrawl: static shell (nav + footer), zero search results. Again, getting blocked.

Teracrawl: full domain search output – availability, pricing, premium/upsell info, all the JS/API-loaded stuff.

Firecrawl seems fine for static content, but on JS-heavy pages or headful checks, it often just gives me skeleton HTML or is blocked.

Teracrawl, because it’s running real headful Chrome, behaves much more like an actual user browser and consistently returned dynamic content and was blocked less.

Firecrawl isn’t bad overall, but for certain sites using a headful browser wins out.