frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Ask HN: How long did Google take to index your large catalogue site?

1•willphill•24m ago
I have a static site with about 18,700 pages. Each page is about one item in a large catalogue, and they're all generated from the same data by a script.

Google has indexed around 3,000 of them and is fetching about 38 pages a day, so at this rate the rest will take over a year. Most of the others sit under "Discovered, currently not indexed" in Search Console.

What I've checked: every page returns 200, the pages are fast, the sitemap is split and has change dates, canonicals are in place, and two site audits found nothing technical to fix. The pages Google does crawl mostly get indexed.

The site is about four months old and has very few links from other sites, which I assume is most of the problem. A similar site that started around the same time has far more pages indexed.

Is this just a matter of waiting and getting links, or is there something practical that makes Google crawl a new site faster? I'd be grateful for anything that has worked for you.

Someone Has Doom Running on a USB Thumb Drive

https://pcper.com/2026/11/someone-has-doom-running-on-a-usb-thumb-drive/
1•speckx•3m ago•0 comments

Show HN: NumWit – a multiplayer Keynesian Beauty Contest game in the browser

https://numwit.prajvex.com/
1•prajju2501•4m ago•0 comments

Verifair – review what your coding agent proves, not its diff

https://github.com/romanzdk/verifair
1•romanzdk•4m ago•0 comments

PeerMirror – See yourself through the eyes of your peers with anonymous

https://peermirror.io
1•leocave•5m ago•0 comments

Show HN: Solipsist – Local Only Notes + Pi agents

https://solipsist.sh/
2•pulkitsh1234•5m ago•0 comments

WorldCraft – A 1:1 scale replica of Earth in Minecraft

https://worldcraft.gg
1•yakkomajuri•5m ago•0 comments

Show HN: Skull-locker – lock one file with Argon2id and XChaCha20-Poly1305

https://github.com/skull-org/skull-locker
1•Amogh_Misra•5m ago•0 comments

Aegis – Zero-Trust edge proxy with Shannon entropy and Linux RAPL telemetry

https://github.com/aivo-labs/aegis
1•andjurka•6m ago•0 comments

Interesting way to format JSON files

https://github.com/dscape/ensure/blob/master/package.json
1•modinfo•7m ago•0 comments

What it takes to count the Linux kernel's 36M lines of code in under 70ms

https://petros-papatheodorou.dev/writing/mezura/counting-the-linux-kernel/
1•petrospapa21•9m ago•1 comments

Show HN: Dieometer – a life expectancy model that runs in the browser

https://dieometer.com/
2•tingleads•10m ago•0 comments

Intelligence, Data Arrangement, and Artificial Intelligence

https://zenodo.org/records/24196608
1•hamoodalitansha•10m ago•0 comments

I Built My Own AI Agent Orchestration Tool

https://www.checklyhq.com/blog/agentic-crafting-table-ai-agent-orchestration/
3•stefanjudis•10m ago•0 comments

Visual Guide to Russia and Ukraine's Jet Drones and Low-Cost Cruise Missiles

https://www.hisutton.com/Ukraine-Russia-Low-Cost-Cruise-Missiles.html
1•speckx•11m ago•0 comments

Mandarins, Plebs and the Singularity

https://clichefactory.com/writing/mandarins-plebs-and-the-singularity/
1•urbsgpw•13m ago•0 comments

Codebase RAG vs. grep for AI agents:the same grep hits scored 10, 30 or 34 of 40

https://tobiasuhlig.medium.com/codebase-rag-vs-grep-for-ai-coding-agents-the-same-grep-hits-score...
1•tobiu•17m ago•0 comments

We built Jarvis, our AI team member for every department

https://www.searchagora.com/blog/how-we-built-jarvis-our-ai-team-member-for-every-department
3•astronautmonkey•18m ago•0 comments

Can a formally-verified C compiler be as performant as GCC -O2?

https://ut-infraai.github.io/2026/11/13/trying-to-make-compcert-as-fast-as-gcc-o2/
1•frostbyte7•20m ago•0 comments

Anthropic IPO set to fuel AI gold rush in London's high-end property market

https://www.theguardian.com/business/2026/nov/17/millionaire-factory-anthropic-ipo-set-to-fuel-ai...
1•edward•21m ago•0 comments

A Record Player Gave Me the Idea to Revive the Home Computer

https://text.tchncs.de/r3nun0mxs9
1•doener•22m ago•0 comments

Making Games in Go: Entity Component System (ECS)

https://threedots.tech/post/making-games-in-go-ecs/
1•roblaszczak•23m ago•0 comments

Ask HN: How long did Google take to index your large catalogue site?

1•willphill•24m ago•0 comments

NOX Local – a coding agent for 4B models on an 8 GB GPU

https://github.com/Johnny008-creator/nox-local
1•Johnny008-creat•24m ago•0 comments

Claude Code Review Find bugs at the pace of agentic code

https://claude.com/product/code-review
1•geoffbp•26m ago•0 comments

The model with the lower price per token cost me twice as much per task

https://github.com/apimodels/llm-agent-field-notes/blob/main/cost-per-task.md
1•lewislucas88•27m ago•0 comments

'Katastrophe': inside the chaos at Deutsche Bank

https://www.ft.com/content/4f8dae68-bfec-43bd-bef6-b830815ec538
2•komape•28m ago•1 comments

Ask HN: What does your internal code search setup look like?

1•Winterflow3r•30m ago•0 comments

Show HN: Push.tg – Email aliases and one-curl alerts, delivered to Telegram

https://push.tg/
1•pushtg•31m ago•1 comments

Show HN: Shoptimist – Amazon but Curated

https://shoptimist.co/
3•MisterJoe•32m ago•1 comments

Show HN: Gami.Fied – Self-hosted gamification engine (XP, streaks, leaderboards)

https://github.com/gami-fied/gami.fied
1•ronak0020•34m ago•0 comments