frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Show HN: IOPS Profiler – Jupyter magic to measure I/O operations per second

https://github.com/lincc-frameworks/iops-profiler
2•mtauraso•1h ago

Comments

mtauraso•1h ago
Author here. Built this while working on astronomy data pipelines where we process terabyte-scale datasets. We kept hitting a frustrating pattern: libraries promised great performance, benchmarks looked solid, but our pipelines were mysteriously slow. CPU and memory were fine, yet tasks taking minutes in theory took hours in practice.

The culprit was consistently I/O. Either we were making millions of tiny operations, or the "optimized" storage layer wasn't doing what we expected. But there was no easy way to see actual I/O behavior without leaving Jupyter and diving into system tools.

So we built this. Now %%iops at the top of a cell immediately shows: "Oh, 50,000 separate writes instead of buffering. That's why."

It's been invaluable for debugging performance gaps between expectations and real-world behavior in our workloads.

Interesting sidenote: I'm a pretty extreme AI skeptic, but wanted to see how far current tools could be taken. With minor edits, all the code, documentation, and even this HN submission were generated by Claude/Copilot. The results surprised me. Happy to answer questions or hear if others have hit similar performance mysteries.

Neurotech Startups Are Confusing

https://www.owlposting.com/p/questions-to-ponder-when-evaluating
1•abhishaike•42s ago•0 comments

When Fixed-Point Beats Floating-Point (and When It Doesn't)

https://speytech.com/insights/fixed-point-vs-floating-point-tradeoffs/
1•william1872•52s ago•0 comments

Samsung's TriFold phone will cost $2,899 in the US

https://techcrunch.com/2026/01/27/samsungs-trifold-phone-will-cost-2899-in-the-us/
1•gloxkiqcza•1m ago•0 comments

I Built a 2300-File Codebase with AI. How I Prevented Architectural Drift

https://medium.com/@stefanvanegmond/i-built-a-2300-file-codebase-with-ai-heres-the-jig-i-built-to...
1•stefanve•3m ago•1 comments

Show HN: Semantic Primitives- TypeScript types that understand natural language

https://github.com/elicollinson/semantic-primitives
1•emcodes•3m ago•0 comments

Show HN: I vibecoded an X64, ARM64 operating system that boots on real hardware

https://github.com/viralcode/vib-OS
2•xdpi542•5m ago•0 comments

Show HN: Kimi K2.5 (Agent Swarm, beats GPT-5) now on RouterLab (Swiss hosting)

https://routerlab.ch/blog/kimi-k2-5
1•ScioNos•7m ago•0 comments

Hope vs. Realism: The Stockdale Paradox

https://www.leadingsapiens.com/stockdale-paradox/
1•sherilm•8m ago•0 comments

Nils' K1v – Kawai K1 Emulation Plugin VSTi/AU

https://www.nilsschneider.de/wp/nils-k1v/
1•unleaded•8m ago•0 comments

Ask HN: Best email service for custom domain?

1•max_•8m ago•1 comments

Yahoo Scout, a New AI Answer Engine

https://www.yahooinc.com/press/introducing-yahoo-scout-a-new-ai-answer-engine
1•drtz•9m ago•0 comments

Ask HN: Anyone else finding Claude failures almost unusable?

1•boringg•11m ago•1 comments

China has purged its highest-ranked military general. Why?

https://www.bbc.com/news/articles/c8d0l0g8yz5o
2•tartoran•12m ago•0 comments

Professional wedding photo retouching service

https://www.photorestorationretouching.com/wedding-photo-retouching/
1•prophoto•12m ago•1 comments

Cursor lied about it's new Browser [video]

https://www.youtube.com/watch?v=U7s_CaI93Mo
1•shantnutiwari•13m ago•0 comments

Sync vs. async vs. event-driven AI requests: what works in production

https://modelriver.com/how-modelriver-works/event-driven-async
2•akarshc•15m ago•2 comments

Kimi K2.5 – new open weights SOTA

https://huggingface.co/moonshotai/Kimi-K2.5
1•nikhizzle•15m ago•0 comments

The Mysterious Electrides

https://knowablemagazine.org/content/article/physical-world/2026/chemistry-of-electrides-new-cata...
1•Brajeshwar•16m ago•0 comments

Trump raises US tariffs on South Korea imports to 25%

https://www.bbc.com/news/articles/cwyw3ynwe37o
19•tartoran•16m ago•3 comments

A drying climate is making East Africa pull apart faster

https://www.livescience.com/planet-earth/a-drying-climate-is-making-east-africa-pull-apart-faster
1•Brajeshwar•16m ago•0 comments

An ultra-high-resolution map of (dark) matter

https://arxiv.org/abs/2601.17239
1•Brajeshwar•16m ago•0 comments

Show HN: SpecFlow – I added a "Bad Cop" auditor to Claude Code

https://github.com/ivkan/specflow-cc
1•easysolpro•17m ago•0 comments

Ask HN: How do you budget for token based AI APIs?

1•Barathkanna•18m ago•0 comments

Decoding the elite soccer player's psychological profile

https://www.pnas.org/doi/10.1073/pnas.2415126122
1•mhb•19m ago•0 comments

Claude-subconscious: Give Claude Code a subconscious

https://github.com/letta-ai/claude-subconscious
1•simonpure•19m ago•0 comments

Medusa AI-First Security Scanner – A Simple Look at Its Powerful Features

https://thecyberedition.com/medusa-ai-first-security-scanner-a-simple-look-at-its-powerful-features/
1•thehacknews•19m ago•0 comments

What Happened to MCP?

https://hntrends.net/compare/words?words=mcp
1•TimCTRL•20m ago•1 comments

DeepMind chief Demis Hassabis warns AI investment looks 'bubble-like'

https://www.ft.com/content/a1f04b0e-73c5-4358-a65e-09e9a6bba857
2•1vuio0pswjnm7•20m ago•1 comments

Mistral Launches Vibe 2.0

https://mistral.ai/news/mistral-vibe-2-0
2•pember•21m ago•1 comments

Speciesquest 2026

https://eukaryotewritesblog.com/2025/12/31/speciesquest-2026/
1•surprisetalk•21m ago•0 comments