Show HN: I made Google Trends for Hacker News by indexing 18 years of comments

So you can create any sort of similar services in a single SQL query and an HTML page.

I also hosted it as a publicly accessible data lake, which you can query from everywhere: https://github.com/ClickHouse/ClickHouse/issues/29693#issuec...

It is also updated in real-time.

This is about published text. More like if Google Trends counted word occurrences on webpages. Or if Google Ngrams counted webpages instead of books

People don't write much about non-newsworthy things whereas many people search "burger" anytime they want a burger delivery. The datasets aren't usable in the same way

Edit: not to say it's not a cool product! Just keep this in mind and enjoy using it :)

For some reason the results cut off at 2018-10 even though "Popular Comparisons" preview shows more.

` /api/hn -> 504 An error occurred with your deployment FUNCTION_INVOCATION_TIMEOUT cle1::c8vgv-1782399959042-aeba3cae05ff `

https://gitlab/here_forawhile/torum

It's a HN clone, that syncs with HN that allows you to basically establish smaller private communities who can discuss anything that's on HN without actually being on HN.

It also indexes and let's you search through the DB which I find is really useful to find things that peak my interest.

This is cool concept, would love a positive/negative sentiment computed for each comment that refers to a given word, so you can see trends of "cloudflare (positive)" vs "cloudflare (negative)" where first one counts comments only if sentiment confidence is greater than say 0.6 and the other one counts comments only if sentiment is less than 0.4 (assuming [0,1] sentiment score)

one subtle consistency bug that made it hard for me to interpret when I was clicking around: the small thumbnail plot vs the full plot often (always?) seem to use different colors.

The blue / orange gets assigned to the opposite labels in the A vs. B when you click, which made it confusing to understand.

This was a small project of mine after I've found out that I can simply the whole hackernews archive (~48GB) and play around with it.

You can compare terms just like in google trends and you can also see the exact posts & comments from that time.

I like that you can discover what went crazy in the timeline, they just come up as small burst of activity, it's quite fun to play around with it. https://hackernewstrends.com/?q=litecoin&q=dogecoin&q=solana...

I also have a seperate page for the "Who is Hiring?" posts, here is the distribution of programming languages over each monthly "Who is hiring?" post in HN ever. https://hackernewstrends.com/who-is-hiring

Any kind of feedback is welcome.

The transition between crypto and ai on the graphs is already pretty funny. https://hackernewstrends.com/?q=crypto&q=chatgpt

Because in general we want to know the trend of categories more than of a word, asking for “auto pilot” for ex. should include “self driving”, FSD etc.

One thing I’d like to see is normalization by total HN activity over time.

I wondered if "go" got filtered out because it's also just a regular word.

Either way, very cool!

https://hackernewstrends.com/?q=Nim&q=Rust&q=Zig

I'd love to have some sort of normalization option to separate more subtle positive trends from the general increase in number of posts.

I am really liking the trend for "linux": https://hackernewstrends.com/?q=linux

Edit: Nvm seems like absolute count if you click the graph.

Reminds that I wish there was a modern way to do this for the words people speak and write online with. I want to literally know when people started putting literally twice in sentences.

Ngram seems is out of date a piece meal. Now Corpus seems like they try but UX terrible.

Hmm, did I break something?

No. Looking at the diagram, REST is the default until 2017, GraphQL is briefly popular around early 2020s, then the web resturns to REST.