frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Messing with Scraper Bots

https://herman.bearblog.dev/messing-with-bots/
27•HermanMartinus•2h ago

Comments

ArcHound•27m ago
Neat! Most of the offensive scrapers I met try and exploit WordPress sites (hence the focus on PHP). They don't want to see php files, but their outputs.

What you have here is quite close to a honeypot, sadly I don't see an easy way to counter-abuse such bots. If the attack is not following their script, they move on.

NoiseBert69•21m ago
Hm.. why not using dumbed down small, self-hopsted LLM networks to feet the big scrapers with bullshit?

I'd sacrifice two CPU cores for this just to make their life awful.

jcynix•13m ago
If you control your own Apache server and just want to shortcut to "go away" instead of feeding scrapers, the RewriteEngine is your friend, for example:

      RewriteEngine On

      # Block requests that reference .php anywhere (path, query, or encoded)
      RewriteCond %{REQUEST_URI} (\.php|%2ephp|%2e%70%68%70) [NC,OR]
      RewriteCond %{QUERY_STRING} \.php [NC,OR]
      RewriteCond %{THE_REQUEST} \.php [NC]
      RewriteRule .* - [F,L]
Notes: there's no PHP on my servers, so if someone asks for it, they are one of the "bad boys" IMHO. Your mileage may differ.
localhostinger•8m ago
Interesting! It's nice to see people are experimenting with these, and I wonder if this kind of junk data generators will become its own product. Or maybe at least a feature/integration in existing software. I could see it going there.

Quantum Finance in Action: Fast Portfolio Optimization for Stock Investors

https://soma.biz
1•Hellene•6m ago•0 comments

MetaMagic turns any URL into 3 SEO titles and descriptions in 10s

https://metamagic.vercel.app
1•astralshard•7m ago•1 comments

One Handed Keyboard

https://github.com/htx-studio/One-Handed-Keyboard
1•doppp•11m ago•0 comments

The honest troubleshooting code of conduct

http://rachelbythebay.com/w/2021/05/01/code/
1•fanf2•13m ago•0 comments

Apple's new 15% mini-app deal gets Tencent to cut Cupertino in

https://www.theregister.com/2025/11/15/apple_tencent_app_deal/
2•praseodym•18m ago•0 comments

Tim Cook could step down as Apple CEO 'as soon as next year'

https://9to5mac.com/2025/11/14/tim-cook-step-down-as-apple-ceo-as-soon-as-next-year-report/
3•dabinat•35m ago•0 comments

Future data centers are driving up forecasts for energy demand

https://apnews.com/article/artificial-intelligence-energy-texas-ohio-pennsylvania-ferc-data-cente...
1•1vuio0pswjnm7•37m ago•0 comments

Firm Tied to Kristi Noem Got Money from $220M DHS Ad Contracts

https://www.propublica.org/article/kristi-noem-dhs-ad-campaign-strategy-group
4•TheAlchemist•39m ago•0 comments

NATO Ended Russia's Estonian Air Incursions

https://themilitaryanalyst.com/2025/11/13/the-real-story-how-nato-ended-russias-estonian-air-incu...
4•madspindel•40m ago•0 comments

Unlocking high software engineering pace

https://dev.jimgrey.net/2025/11/13/unlocking-high-software-engineering-pace-ruthlessly-eliminate-...
2•vinhnx•44m ago•0 comments

Forensic linguistics: how dark web criminals give themselves away

https://theconversation.com/forensic-linguistics-how-dark-web-criminals-give-themselves-away-with...
2•zeristor•44m ago•0 comments

What happens when you press a key in your terminal? (2022)

https://jvns.ca/blog/2022/07/20/pseudoterminals/
1•vinhnx•44m ago•0 comments

The Original iPhone SE Is the Best iPhone Apple Ever Made

https://blog.bschwind.com/2025/01/11/the-original-iphone-se-is-the-best-iphone-apple-ever-made/
2•usui•45m ago•0 comments

Valve just built the Xbox that Microsoft is dreaming of

https://www.theverge.com/tech/819844/valve-steam-machine-xbox-console-steamos-competition-notepad
2•ent101•47m ago•0 comments

Who Pays When A.I. Is Wrong?

https://www.nytimes.com/2025/11/12/business/media/ai-defamation-libel-slander.html
4•1vuio0pswjnm7•51m ago•2 comments

Where Should Philosophy Go in the Age of AI?

https://dotnetxpert.com/philosophers_ai_intro.html
1•nettalk83•57m ago•1 comments

Vibe Coders vs Natural Language Developers

https://marmelab.com/blog/2025/09/03/natural-language-developers.html
1•nerdright•59m ago•0 comments

Supply Chain Security made the OWASP Top Ten, this changes nothing

https://anchore.com/blog/supply-chain-security-made-the-owasp-top-ten-this-changes-nothing/
1•birdculture•1h ago•0 comments

EyesOff: I Built a Screen Contact Detection Model

https://ym2132.github.io/building_EyesOff_part2_model_training
1•Two_hands•1h ago•0 comments

Fossil fuel lobbyists outnumber all Cop30 delegations except Brazil

https://www.theguardian.com/environment/2025/nov/14/fossil-fuel-lobbyists-cop30
5•measurablefunc•1h ago•0 comments

Blender Ocean Wave Tutorial for Beginners (Animation Guide) [video]

https://www.youtube.com/watch?v=h9S9ZSSaMw4
1•techwrath11•1h ago•0 comments

How to change ICON in Filament 3.2 Laravel 12 [video]

https://www.youtube.com/watch?v=PWD3q89eEOY
1•techwrath11•1h ago•0 comments

Why Is There a Sea in the Middle of California? [video]

https://www.youtube.com/watch?v=VYRYUuhfML0
1•dataflow•1h ago•0 comments

Strilanc uses gauge symmetry to help Aaronson ward off quantum hype

https://scottaaronson.blog/?p=9325
2•gsf_emergency_4•1h ago•0 comments

Why You Hate Contemporary Architecture

https://www.currentaffairs.org/news/2017/10/why-you-hate-contemporary-architecture
2•luu•1h ago•2 comments

How My Speed Date Got Stolen Onstage at a Live Comedy Dating Show

https://psychotechnology.substack.com/p/how-my-speed-date-got-stolen-onstage
10•eatitraw•1h ago•2 comments

AI Diffusion Where AI is most used, developed and built

https://www.microsoft.com/en-us/research/group/aiei/ai-diffusion/
1•hunglee2•1h ago•0 comments

Projection: A static site generator for your coding project portfolio

https://github.com/quasarbright/projection
1•QuasarBright•1h ago•1 comments

AMD Enterprise AI Suite

https://enterprise-ai.docs.amd.com/en/latest/platform-overview.html
2•latchkey•1h ago•0 comments

Elon Time Converter

https://elontime.io/
9•ta12653421•1h ago•1 comments