frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

The Janitor on Mars

https://www.newyorker.com/magazine/1998/10/26/the-janitor-on-mars
1•evo_9•36s ago•0 comments

Bringing Polars to .NET

https://github.com/ErrorLSC/Polars.NET
1•CurtHagenlocher•2m ago•0 comments

Adventures in Guix Packaging

https://nemin.hu/guix-packaging.html
1•todsacerdoti•3m ago•0 comments

Show HN: We had 20 Claude terminals open, so we built Orcha

1•buildingwdavid•3m ago•0 comments

Your Best Thinking Is Wasted on the Wrong Decisions

https://www.iankduncan.com/engineering/2026-02-07-your-best-thinking-is-wasted-on-the-wrong-decis...
1•iand675•3m ago•0 comments

Warcraftcn/UI – UI component library inspired by classic Warcraft III aesthetics

https://www.warcraftcn.com/
1•vyrotek•4m ago•0 comments

Trump Vodka Becomes Available for Pre-Orders

https://www.forbes.com/sites/kirkogunrinde/2025/12/01/trump-vodka-becomes-available-for-pre-order...
1•stopbulying•6m ago•0 comments

Velocity of Money

https://en.wikipedia.org/wiki/Velocity_of_money
1•gurjeet•8m ago•0 comments

Stop building automations. Start running your business

https://www.fluxtopus.com/automate-your-business
1•valboa•12m ago•1 comments

You can't QA your way to the frontier

https://www.scorecard.io/blog/you-cant-qa-your-way-to-the-frontier
1•gk1•14m ago•0 comments

Show HN: PalettePoint – AI color palette generator from text or images

https://palettepoint.com
1•latentio•14m ago•0 comments

Robust and Interactable World Models in Computer Vision [video]

https://www.youtube.com/watch?v=9B4kkaGOozA
2•Anon84•18m ago•0 comments

Nestlé couldn't crack Japan's coffee market.Then they hired a child psychologist

https://twitter.com/BigBrainMkting/status/2019792335509541220
1•rmason•20m ago•0 comments

Notes for February 2-7

https://taoofmac.com/space/notes/2026/02/07/2000
2•rcarmo•21m ago•0 comments

Study confirms experience beats youthful enthusiasm

https://www.theregister.com/2026/02/07/boomers_vs_zoomers_workplace/
2•Willingham•28m ago•0 comments

The Big Hunger by Walter J Miller, Jr. (1952)

https://lauriepenny.substack.com/p/the-big-hunger
2•shervinafshar•29m ago•0 comments

The Genus Amanita

https://www.mushroomexpert.com/amanita.html
1•rolph•34m ago•0 comments

We have broken SHA-1 in practice

https://shattered.io/
9•mooreds•35m ago•2 comments

Ask HN: Was my first management job bad, or is this what management is like?

1•Buttons840•36m ago•0 comments

Ask HN: How to Reduce Time Spent Crimping?

2•pinkmuffinere•37m ago•0 comments

KV Cache Transform Coding for Compact Storage in LLM Inference

https://arxiv.org/abs/2511.01815
1•walterbell•42m ago•0 comments

A quantitative, multimodal wearable bioelectronic device for stress assessment

https://www.nature.com/articles/s41467-025-67747-9
1•PaulHoule•44m ago•0 comments

Why Big Tech Is Throwing Cash into India in Quest for AI Supremacy

https://www.wsj.com/world/india/why-big-tech-is-throwing-cash-into-india-in-quest-for-ai-supremac...
2•saikatsg•44m ago•0 comments

How to shoot yourself in the foot – 2026 edition

https://github.com/aweussom/HowToShootYourselfInTheFoot
2•aweussom•44m ago•0 comments

Eight More Months of Agents

https://crawshaw.io/blog/eight-more-months-of-agents
4•archb•46m ago•0 comments

From Human Thought to Machine Coordination

https://www.psychologytoday.com/us/blog/the-digital-self/202602/from-human-thought-to-machine-coo...
1•walterbell•46m ago•0 comments

The new X API pricing must be a joke

https://developer.x.com/
1•danver0•47m ago•0 comments

Show HN: RMA Dashboard fast SAST results for monorepos (SARIF and triage)

https://rma-dashboard.bukhari-kibuka7.workers.dev/
1•bumahkib7•48m ago•0 comments

Show HN: Source code graphRAG for Java/Kotlin development based on jQAssistant

https://github.com/2015xli/jqassistant-graph-rag
1•artigent•53m ago•0 comments

Python Only Has One Real Competitor

https://mccue.dev/pages/2-6-26-python-competitor
4•dragandj•54m ago•0 comments
Open in hackernews

StackOverflow disallows all crawlers in robots.txt file

http://stackoverflow.com/robots.txt
17•yawndex•6mo ago

Comments

yawndex•6mo ago
Someone pointed this out on Twitter - it looks like StackOverflow recently updated their robots.txt file to explicitly disallow all crawlers. Obviously, this won't stop those that don't respect robots.txt, but I found this decision strange. Not even Google or Bing's crawlers (which respect robots.txt) will be able to crawl StackOverflow, which could be the final nail in the coffin for SO, since (presumably) most StackOverflow traffic comes from search engines.
cheschire•6mo ago
I just tested it with ChatGPT agent mode and it returned a 502 bad gateway, so even agents are not going to be a source of traffic.

They must really want only organic traffic for some reason.

integralid•6mo ago
https://meta.stackexchange.com/questions/404687/our-robots-t...

>After this change, any trusted crawler will continue to see the old copy of robots.txt.

I think this still works for crawlers like Google

VivaTechnics•6mo ago
- With the advent of LLMs, sites like StackOverflow are effectively obsolete—robots.txt or not.

- It’s the inevitable consequence when companies cease to innovate.

integralid•6mo ago
Was stackexchange, a web forum company, supposed to innovate an LLM?
VivaTechnics•6mo ago
I never claimed Stack Exchange should’ve pioneered LLMs. But it’s not merely a web forum company—just as Google isn’t just a search company. Stack Exchange is a 15-year-old tech firm that has stagnated. Innovation has been virtually nonexistent; their idea of progress has long been superficial UI tweaks on a legacy platform.

Even now, Stack Exchange resists adaptation. This very post highlights their `robots.txt` policy, which actively blocks crawlers—a clear signal of protectionism over transparency. They market themselves as community-driven, but the reality is far more corporate and insular.

Stack Overflow’s situation is telling: while search traffic is down a modest –5% to –14% (per their own data), engagement metrics are in freefall. Weekly posts have dropped 16%; monthly questions are down as much as 66% from their peak. That’s not a dip—it’s systemic decay.