frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Humanely dealing with humungus crawlers

https://flak.tedunangst.com/post/humanely-dealing-with-humungus-crawlers
38•freediver•2h ago

Comments

bobbiechen•1h ago
>We’ve already done the work to render the page, and we’re trying to shed load, so why would I want to increase load by generating challenges and verifying responses? It annoys me when I click a seemingly popular blog post and immediately get challenged, when I’m 99.9% certain that somebody else clicked it two seconds before me. Why isn’t it in cache? We must have different objectives in what we’re trying to accomplish. Or who we’re trying to irritate.

+1000 I feel like so much bot detection (and fraud prevention against human actors, too) is so emotionally-driven. Some people hate these things so much, they're willing to cut off their nose to spite their face.

jitl•1h ago
Really? If I’m an unsophisticated blog not using a CDN, and I get a $1000 bill for bandwidth overage or something, I’m gonna google a solve and slap it on there because I don’t want to pay another $1000 for Big Basilisk. I don’t think that’s emotional response, it’s common sense.
phantompeace•8m ago
Wouldn't it be easier to put the unsophisticated blog behind cloudflare
zkmon•32m ago
Sorry, what's the point of this blog? I hope people would write a quick abstract/summary in the first few lines and then go on elaborating. Or at least put that summary at the end, in old-fashioned way.
politelemon•17m ago
The point of a blog is whatever the author would like it to be. It doesn't have to follow a structure or expectations. We just happen to be consuming it.
nektro•4m ago
it's sad we've gotten to the point where mitigations against this have to be such a consideration when hosting a site

UTF-8 is a brilliant design

https://iamvishnu.com/posts/utf8-is-brilliant-design
67•vishnuharidas•1h ago•28 comments

EU court rules nuclear energy is clean energy

https://www.weplanet.org/post/eu-court-rules-nuclear-energy-is-clean-energy
233•mpweiher•1h ago•114 comments

Many hard LeetCode problems are easy constraint problems

https://buttondown.com/hillelwayne/archive/many-hard-leetcode-problems-are-easy-constraint/
290•mpweiher•4h ago•205 comments

QGIS is a free, open-source, cross platform geographical information system

https://github.com/qgis/QGIS
96•rcarmo•2h ago•25 comments

Rust: A quest for performant, reliable software [video]

https://www.youtube.com/watch?v=k_-6KI3m31M
30•raphlinus•11h ago•0 comments

The treasury is expanding the Patriot Act to attack Bitcoin self custody

https://www.tftc.io/treasury-iexpanding-patriot-act/
477•bilsbie•7h ago•370 comments

How FOSS Projects Handle Legal Takedown Requests

https://f-droid.org/2025/09/10/how-foss-projects-handle-legal-takedown-requests.html
35•mkesper•2h ago•4 comments

3D modeling with paper

https://www.arvinpoddar.com/blog/3d-modeling-with-paper
175•joshuawootonn•5h ago•28 comments

Humanely dealing with humungus crawlers

https://flak.tedunangst.com/post/humanely-dealing-with-humungus-crawlers
38•freediver•2h ago•6 comments

Vector database that can index 1B vectors in 48M

https://www.vectroid.com/blog/why-and-how-we-built-Vectroid
43•mathewpregasen•2h ago•15 comments

Advanced Scheme Techniques (2004) [pdf]

https://people.csail.mit.edu//jhbrown/scheme/continuationslides04.pdf
75•mooreds•3h ago•7 comments

Qwen3-Next

https://qwen.ai/blog?id=4074cca80393150c248e508aa62983f9cb7d27cd&from=research.latest-advancement...
478•tosh•13h ago•187 comments

Windows-Use: an AI agent that interacts with Windows at GUI layer

https://github.com/CursorTouch/Windows-Use
72•djhu9•3d ago•12 comments

Power series, power serious (1999) [pdf]

https://www.cambridge.org/core/services/aop-cambridge-core/content/view/19863F4EAACC33E1E01DE2A21...
7•signa11•2d ago•1 comments

How to Become a Pure Mathematician (Or Statistician)

http://hbpms.blogspot.com/
25•ipnon•3d ago•3 comments

Oq: Terminal OpenAPI Spec Viewer

https://github.com/plutov/oq
62•der_gopher•4h ago•9 comments

Building a Deep Research Agent Using MCP-Agent

https://thealliance.ai/blog/building-a-deep-research-agent-using-mcp-agent
44•saqadri•2d ago•9 comments

Doom-ada: Doom Emacs Ada language module with syntax, LSP and Alire support

https://github.com/tomekw/doom-ada
58•tomekw•4h ago•5 comments

VaultGemma: The most capable differentially private LLM

https://research.google/blog/vaultgemma-the-worlds-most-capable-differentially-private-llm/
40•meetpateltech•3h ago•10 comments

Racintosh Plus – Rackmount Mac Plus

http://www.identity4.com/2025-racintosh-plus/
103•zdw•3d ago•19 comments

Why do browsers throttle JavaScript timers?

https://nolanlawson.com/2025/08/31/why-do-browsers-throttle-javascript-timers/
15•vidyesh•1h ago•11 comments

Groundbreaking Brazilian Drug, Capable of Reversing Spinal Cord Injury

https://www1.folha.uol.com.br/internacional/en/scienceandhealth/2025/09/groundbreaking-brazilian-...
10•_aleph2c_•26m ago•0 comments

Show HN: DWS OS, a Plan 9 Inspired Web “OS”

https://dws.rip
38•tdubey•4h ago•8 comments

Chat Control faces blocking minority in the EU

https://twitter.com/TutaPrivacy/status/1966384776883142661
327•miohtama•6h ago•104 comments

A beginner's guide to extending Emacs

https://blog.tjll.net/a-beginners-guide-to-extending-emacs/
114•ibobev•4h ago•13 comments

Ships are sailing with fake insurance from the Norwegian Ro Marine

https://www.nrk.no/vestland/xl/over-100-ships-have-sailed-without-legitimate-insurance-from-the-n...
190•aregue•5h ago•85 comments

K2-Think: A Parameter-Efficient Reasoning System

https://arxiv.org/abs/2509.07604
8•mgl•2h ago•2 comments

Show HN: I made a generative online drum machine with ClojureScript

https://dopeloop.ai/beat-maker/
144•chr15m•10h ago•27 comments

Show HN: An MCP Gateway to block the lethal trifecta

https://github.com/Edison-Watch/open-edison
32•76SlashDolphin•4h ago•14 comments

Debian 13, Postgres, and the US time zones

https://rachelbythebay.com/w/2025/09/11/debtz/
255•move-on-by•17h ago•130 comments