frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I made Google Trends for Hacker News by indexing 18 years of comments

https://hackernewstrends.com
143•ytkimirti•1h ago

Comments

ytkimirti•1h ago
Hello HN,

This was a small project of mine after I've found out that I can simply the whole hackernews archive (~48GB) and play around with it.

You can compare terms just like in google trends and you can also see the exact posts & comments from that time.

I like that you can discover what went crazy in the timeline, they just come up as small burst of activity, it's quite fun to play around with it. https://hackernewstrends.com/?q=litecoin&q=dogecoin&q=solana...

I also have a seperate page for the "Who is Hiring?" posts, here is the distribution of programming languages over each monthly "Who is hiring?" post in HN ever. https://hackernewstrends.com/who-is-hiring

Any kind of feedback is welcome.

jupr•32m ago
Honestly the HN archive is very valuable. If you had it all on a local db with everything indexed you basically end up with a offline search engine.

Where is this archive located you speak of?

fragmede•23m ago
It's on firebase, per https://github.com/hackernews/api
cbeach•26m ago
This is excellent.

A minor suggestion - I'd like to be able to render the current graph taller (full height of my browser window).

Also some sentiment analysis on the "people" graphs would be very insightful (particularly for the likes of Edward Snowdon, Julian Assange, Elon Musk and Sam Altman). Perhaps colour the area under the graph red-orange-green based on the sentiment?

clacker-o-matic•51m ago
ooh this is sick! really nice ui too!
NoSalt•48m ago
Woah, great work!

I am really liking the trend for "linux": https://hackernewstrends.com/?q=linux

dgellow•45m ago
Funny how closely that tracks with windows

https://hackernewstrends.com/?q=linux&q=windows

addandsubtract•35m ago
Does the trend only show absolute numbers? Because I think it should be divided by the number of posts during the time frame (day?).
oystersauce8•48m ago
love it
simonpure•43m ago
Hug of death

` /api/hn -> 504 An error occurred with your deployment FUNCTION_INVOCATION_TIMEOUT cle1::c8vgv-1782399959042-aeba3cae05ff `

aNapierkowski•42m ago
yeah we killed it :(
jjordan•33m ago
back in my day we called this a good ole' fashioned slashdotting.
lysace•21m ago
Our little startup got slashdotted in 1998 or so. I was the only one randomly awake at the time. Remember watching all the logs from our poor little server in realtime, ready to immediately kill anything or anyone threatening the overall availability. 2 Mbps uplink, I think. Self-hosted little data center at our office.
Onavo•16m ago
Its funny that these days the bottleneck is usually the data layer. Servers are so powerful now that even your average $5 server can handle HN levels of load if configured correctly.
docheinestages•31m ago
If this project is an ad for their product (Upstash, promising "Highly Available, Infinitely Scalable"), then the last thing they'd want is a hug of death :/
vachina•43m ago
This is the only HN submission I ever upvoted because it is amazing
frankzero•38m ago
I know right
fragmede•24m ago
If more people spent time on /new looking for awesome stuff and vouching for dead items, HN would be a better place.
ytkimirti•19m ago
Thanks, it was my first ever post here as well, would you look at that
scarecrw•41m ago
Very cool!

I'd love to have some sort of normalization option to separate more subtle positive trends from the general increase in number of posts.

GL26•40m ago
insane ! I don't know if it's possible but it would be huge if we had access to the localisation of the trends
some_furry•39m ago
https://hackernewstrends.com/?q=furries&q=furry

Hmm, did I break something?

dom96•37m ago
Very cool idea. Shows programming language trends pretty well.

https://hackernewstrends.com/?q=Nim&q=Rust&q=Zig

docheinestages•36m ago
But can it discover new trends without having to type the keywords?
flakiness•35m ago
The example comparisons made me smile. Well done!
lazystar•35m ago
nice. i guess AWS still had nothing to fear from GCP/Azure. ty for this
sinuhe69•33m ago
IMO, using AI to assign keywords to a broader group of strict synonymous keywords would make the comparison much more helpful.

Because in general we want to know the trend of categories more than of a word, asking for “auto pilot” for ex. should include “self driving”, FSD etc.

marky1991•13m ago
I would not like this. This is the kind of change that made google search so annoying. (Eg what if I want to track the history of 'self-driving' vs 'auto pilot' in sales pitches? Or more basically, what if the system wrongly interprets me wrongly?) Better to support | or similar old-fashioned search engine syntax and dwis and not dwim.
cloudkj•33m ago
This is great, I was just hoping to find a tool like this and specifically scoped to "Show HN" posts? Is there a way to do that?
ytkimirti•21m ago
Great idea actually, I'll add that as well for sure
rightbyte•31m ago
Nice. Is the data points y-axis normalized by total amount of comments at that time?

Edit: Nvm seems like absolute count if you click the graph.

jdw64•31m ago
COOOOOOOOOOL!!!!!!
drchaim•27m ago
too slow or broker right now
ytkimirti•25m ago
We had to take the site down for a second, it'll be online in a few minutes. Thanks for trying it out
smalltorch•25m ago
Reminds me of this side project I'm working on.

https://gitlab/here_forawhile/torum

It's a HN clone, that syncs with HN that allows you to basically establish smaller private communities who can discuss anything that's on HN without actually being on HN.

It also indexes and let's you search through the DB which I find is really useful to find things that peak my interest.

hk__2•16m ago
Fixed link: https://gitlab.com/here_forawhile/torum
joelres•25m ago
Really beautiful, informative, and functional layout. Great work!
chris_money202•22m ago
Love this, seems to struggle with newly indexed words. Will try again when the FP load is gone
arjie•18m ago
One useful feature would be to normalize by total so that I can see changes in something as opposed to just total site growth. Right now I have to chart a single generic parameter but if I pick poorly it’ll confuse the issue.
jahala•9m ago
Really cool! Where would you get the data for something like this? Is it open, or its scraped?
kaelyx•6m ago
Hello, /api/hn -> 502 {"error":"Your database has been temporarily rate-limited, please contact support@upstash.com for further details."}
ryan_n•27m ago
Oof that would be hilarious/tragic
steve1977•17m ago
Downstash
ytkimirti•29m ago
We will be with you shortly :)
Roonerelli•18m ago
I get

/api/hn -> 502 {"error":"Search entry should have an initialized schema, command was: [\"SEARCH.AGGREGATE\",\"hn\",\"{\\\"$or\\\":[{\\\"title\\\":{\\\"$eq\\\":\\\"anthropic\\\",\\\"$boost\\\":5}},{\\\"text\\\":{\\\"$eq\\\":\\\"anthropic\\\"}}]}\",\"{\\\"by_month\\\":{\\\"$dateHistogram\\\":{\\\"field\\\":\\\"time\\\",\\\"fixedInterval\\\":\\\"30d\\\"}},\\\"top_authors\\\":{\\\"$terms\\\":{\\\"field\\\":\\\"by\\\",\\\"size\\\":6}},\\\"by_type\\\":{\\\"$terms\\\":{\\\"field\\\":\\\"type\\\",\\\"size\\\":4}}}\"]"}

superxpro12•18m ago
/api/hn -> 502 {"error":"Your database has been temporarily rate-limited, please contact support@upstash.com for further details."}
esafak•11m ago
Needs caching.

Show HN: I made Google Trends for Hacker News by indexing 18 years of comments

https://hackernewstrends.com
157•ytkimirti•1h ago•49 comments

Show HN: Turn native language audio into flashcards and shadowing practice

https://lingochunk.com/try
39•alder•4h ago•17 comments

Show HN: Navatala GPU – multi-back end GPU kernels and Python bindings

https://github.com/navatala-systems/navatala_gpu
5•bvenkat•54m ago•0 comments

Show HN: Secs-man, a secrets manager you can (not) rely on

https://github.com/Fran314/secrets-manager-rs
15•Fran314•3h ago•12 comments

Show HN: StartupsBR – A map of Brazilian startups

https://www.startupsbr.com/sao-paulo
47•leonagano•5d ago•21 comments

Show HN: FileVeil · Hide Any File Inside Another File

https://fileveil.com/
3•fileveil•1h ago•2 comments

Show HN: Nimic – Pure Python as a systems language with AOT compilation

https://github.com/dima-quant/nimic
30•dima-quant•2d ago•22 comments

Show HN: Nub – A Bun-like all-in-one toolkit for Node.js

https://github.com/nubjs/nub
260•colinmcd•1d ago•73 comments

Show HN: Write SaaS apps where users control where their data is stored

https://github.com/wolfoo2931/linkedrecords/
66•WolfOliver•6d ago•30 comments

Show HN: Monolisa v3 – a typeface for developers and creatives

https://www.monolisa.dev/
176•bebraw•3d ago•82 comments

Show HN: DPI Bypass – directory of tools and clients to evade DPI

https://github.com/ubub111/awesome-dpi-bypass
3•ububus•3h ago•0 comments

Show HN: Wordit – Change One Letter, Keep the Chain Going

https://victorribeiro.com/wordit/
35•atum47•1d ago•23 comments

Show HN: Brain Frog – Can you be random enough for 11 lines of JavaScript?

https://brainfrog.lol
47•AlexanderZ•6d ago•31 comments

Show HN: LookAway, a Mac break reminder that knows when not to interrupt

https://lookaway.com
68•_kush•1d ago•21 comments

Show HN: Multi Agent Protocol for AI Scientist by Hexo Labs

https://github.com/hexo-ai/socrates
5•martianvoid•4h ago•0 comments

Show HN: Visual Workspace for Agents Based on Unix

https://www.prototyper.co
10•thijsverreck•4h ago•2 comments

Show HN: peerd – AI agent harness that runs entirely in your browser

https://github.com/NotASithLord/peerd
65•NotASithLord•2d ago•22 comments

Show HN: ParseHawk – 100% Local Document AI with API, CLI, and Web UI

https://github.com/parsehawk/parsehawk
6•francisrafal•4h ago•0 comments

Show HN: Tree, truth, druid and tar share one Proto-Indo-European root

https://p.migdal.pl/tree-of-tree/
4•stared•6h ago•1 comments

Show HN: Pure Effect – Reproduce production bugs on your laptop without a DB

https://pure-effect.org
56•tie-in•3d ago•14 comments

Show HN: An ASCII 3D Rendering Engine

https://glyphcss.com
207•apresmoi•4d ago•50 comments

Show HN: TikZ Editor – WYSIWYG editor for figures in LaTeX

https://tikz.dev/editor/
442•DominikPeters•2d ago•74 comments

Show HN: Got sick of ads, so I made my own logic puzzle site

https://puzzlelair.com/
246•HaxleRose•3d ago•165 comments

Show HN: Promptctl – Git for your AI prompts

https://github.com/naya-ai/promptctl
4•shawnaya101•14h ago•2 comments

Show HN: CleverCrow: give tokens to your favorite projects

https://clevercrow.io
66•zhubert•3d ago•80 comments

Show HN: FastUbu – An Ultrafast Video Archive

https://fastubu.com/
47•lukeigel•3d ago•6 comments

Show HN: Neural Particle Automata

https://selforg-npa.github.io/
87•esychology•2d ago•19 comments

Show HN: Lumli – Privacy-first image tools that run entirely in your browser

https://www.lumli.de
6•lumli•20h ago•0 comments

Show HN: The Cascade Graph – An interactive map of AI and energy constraints

https://atomprophet.io/tools/cascade/
26•antisyzygy•2d ago•12 comments

Show HN: Criterion Closet as a website – pull any of 1,247 films off the shelf

https://the-criterion-closet.vercel.app
191•olievans•5d ago•55 comments