frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Show HN: Hekate – A Zero-Copy ZK Engine Overcoming the Memory Wall

3•y00zzeek•2h ago
Most ZK proving systems are optimized for server-grade hardware with massive RAM. When scaling to industrial-sized traces (2^20+ rows), they often hit a "Memory Wall" where allocation and data movement become a larger bottleneck than the actual computation.

I have been developing Hekate, a ZK engine written in Rust that utilizes a Zero-Copy streaming model and a hybrid tiled evaluator. To test its limits, I ran a head-to-head benchmark against Binius64 on an Apple M3 Max laptop using Keccak-256.

The results highlight a significant architectural divergence:

At 2^15 rows: Binius64 is faster (147ms vs 202ms), but Hekate is already 10x more memory efficient (44MB vs ~400MB).

At 2^20 rows: Binius64 hits 72GB of RAM usage, entering swap hell on a laptop. Hekate processes the same workload in 4.74s using just 1.4GB of RAM.

At 2^24 rows (16.7M steps): Hekate finishes in 88s with a peak RAM of 21.5GB. Binius64 is unable to complete the task due to OOM/Swap on this hardware.

The core difference is "Materialization vs. Streaming". While many engines materialize and copy massive polynomials in RAM during Sumcheck and PCS operations, Hekate streams them through the CPU cache in tiles. This shifts the unit economics of ZK proving from $2.00/hour high-memory cloud instances to $0.10/hour commodity hardware or local edge devices.

I am looking for feedback from the community, especially those working on binary fields, GKR, and memory-constrained SNARK/STARK implementations.

Comments

SERSI-S•1h ago
Interesting work. This seems highly relevant for ZK systems that need to generate large proofs on commodity hardware. Streaming-first proving could be a key enabler for permissionless ZK infrastructure
y00zzeek•1h ago
Exactly. If we can't prove 2^24 rows on a laptop, ZK will stay centralized forever. Hekate is my answer to the memory wall that forces teams into $2+/hour AWS instances. Proving should be a commodity, not a luxury.
SERSI-S•1h ago
Agreed. The scary part is that memory requirements quietly define who is allowed to be a prover. If ZK infra assumes 64–128GB RAM by default, decentralization is already lost, regardless of the cryptography. Streaming-first designs feel like a prerequisite for permissionless proving, not just an optimization.
y00zzeek•1h ago
My motivation for building Hekate is simple: I am done watching well-funded teams with 50+ people and a busload of PhDs produce engineering trash.

There is a massive, widening gap between academic brilliance and silicon-level implementation. You can write the most elegant paper in the world, but if your prover requires 100GB of RAM to execute a basic trace, you haven't built a protocol, you've built a research project that collapses under its own weight.

I don't have "strategic planning" committees or HR-mandated consensus. If Hekate's core doesn't meet my performance standards, I rewrite it in 48 hours. This agility is a weapon. I want to prove that a single engineer, driven by physics and zero-copy principles, can wreck the unit economics of a multi-million dollar venture-backed startup.

Disrupting inefficient financial models is more than fun—it's necessary. The current "safe" hiring meta (US-only, HR-compliant, resume-padded candidates) is a strategic failure. While industry leaders focus on compliance, state-sponsored actors like Lazarus are eating their lunch.

You don't need "safe" candidates. You need predators. You need the difficult, inconvenient outliers who don't need a visa to outcode your entire department. Hekate is a reminder that in deep-tech, capital is noise, but performance is the only signal that matters.

wmf•1h ago
You should probably write this as a blog post or readme and submit the link instead. I can't provide any technical feedback since I don't even understand what a row is in this context.

I don't have "strategic planning" committees or HR-mandated consensus...

Look, if your code is better just say it's better. But this kind of LinkedIn slop conspiracist virtue signaling isn't a good look. It's fine to believe that but you should never say it out loud.

y00zzeek•1h ago
Fair point on the tone. I'll trade the rhetoric for physics.

A "row" in this context is a single step of the Keccak-f[1600] permutation within the AIR (Algebraic Intermediate Representation) table. Most engines materialize this entire table in RAM before proving. At 2^24 rows, that’s where you hit the "Memory Wall" and your cloud bill goes parabolic.

Hekate is "better" because it uses a Tiled Evaluator to stream these rows through the CPU cache (L1/L2) instead of saturating the memory bus. While Binius64 hits 72GB RAM on 2^20 rows, Hekate stays at 21.5GB for 16x the workload (2^24).

The "committees" comment refers to the gap between academic theory and hardware-aware implementation. One prioritizes papers; the other prioritizes cache-locality. Most well-funded teams choose the easy path (more RAM, more AWS credits) over the hard path (cache-aware engineering).

If you want to talk shop, tell me how you'd handle GPA Keys computation at 2^24 scale without a zero-copy model. I’m genuinely curious.

Tunnl.gg: Expose Localhost to the Internet

https://github.com/klipitkas/tunnl.gg
1•thunderbong•3m ago•1 comments

What were books like in ancient Greece and Rome?

https://www.popsci.com/science/what-were-books-like-in-ancient-greece-and-rome/
1•WaitWaitWha•5m ago•0 comments

AIVO Standard Operational AI Reliance Observation Protocol

https://zenodo.org/records/18286718
1•businessmate•17m ago•1 comments

Is the World Random?

https://mantrna.com/astrobench
2•prabhatkr•27m ago•0 comments

Show HN: 30min video analysis for $0.003 via frame-tiling and Vision API

https://github.com/unhaya/vam-seek-ai
3•haasiy•30m ago•1 comments

300X fast clustering with rust-louvain for nodes

https://github.com/FastBuilderAI/rust-louvain
2•prabhatkr•30m ago•0 comments

Quantum Name Service (QNS)- Path to Web5

https://github.com/aevov/qns
2•cr8oscloud•32m ago•1 comments

Show HN: vr.dev – simple 3D/VR/XR portfolio and links (Meta hit hard this week)

https://www.vr.dev/
2•vrdev•33m ago•0 comments

Shackleton and the Endurance Expedition: Photos from the 1915 Disastrous Journey

https://www.utterlyinteresting.com/post/the-amazing-survival-story-of-ernest-shackleton-and-his-e...
4•nomagicbullet•34m ago•2 comments

Show HN: Task Orchestrator – Production Safety for Claude Code Agents

https://github.com/TC407-api/task-orchestrator
2•Travis_Cole•34m ago•1 comments

Model is intended for use particularly for language learning

https://huggingface.co/EnversonAI/DeepSeek-R1-FineTuned-AdaptiveQGen-COT
2•AslanMammadli•49m ago•1 comments

Ask HN: Is repalcing an enterprise product with LLMs a realistic strategy?

2•chandmk•50m ago•0 comments

Pushing the smallest possible change to production

https://ankursethi.com/blog/smallest-possible-change/
2•GeneralMaximus•50m ago•0 comments

Why Xcode's AI Writes Better SwiftUI Than Claude Code, Codex

https://www.ameyalambat.com/blog/swiftui-skills
3•ameyalambat128•53m ago•0 comments

Show HN: Open-Source DLP for LLMs

https://github.com/dorcha-inc/ceil-dlp
2•unclecolm•55m ago•0 comments

Cursor AI refusing $20 refund after 3 days of broken service

2•Waldopro•55m ago•1 comments

Show HN: Monitor Claude/Codex usage on Linux via browser cookies (no API keys)

https://github.com/NihilDigit/waybar-ai-usage
4•NihilDigit•58m ago•1 comments

Spectrum Brings NBA Games in Apple Immersive to Apple Vision Pro

https://www.apple.com/newsroom/2025/10/spectrum-brings-nba-games-in-apple-immersive-to-apple-visi...
1•Austin_Conlon•1h ago•0 comments

Crypto holder loses $283M to scammer impersonating wallet support

https://bsky.app/profile/web3isgoinggreat.com/post/3mcn26h32wp2q
6•unforgivenpasta•1h ago•1 comments

AI-Powered Diabetes Analysis with GitHub Copilot and Claude Skills [video]

https://www.youtube.com/watch?v=on5R6PWj8Wg
4•shanselman•1h ago•0 comments

No Chess on a Dead Planet

https://indianexpress.com/article/sports/chess/climate-activists-protests-hold-up-tata-steel-ches...
1•akbarnama•1h ago•0 comments

Show HN: Vanslist – Craigslist for tech freelancers, no fees

https://vanslist.com
1•netgeniuskid•1h ago•0 comments

Show HN: Turkish Sieve Engine – GPU-Accelerated Prime Number Generator

https://github.com/bilgisofttr/turkishsieve
1•bilgisoft•1h ago•0 comments

Tell HN: Google Trust and Safety is a joke

2•tokyobreakfast•1h ago•1 comments

The relentless rule of my fitness tracker

https://timharford.com/2025/10/the-relentless-rule-of-my-fitness-tracker/
10•Arnt•1h ago•2 comments

Aldrich Ames built a career on betraying trust

https://www.economist.com/obituary/2026/01/15/aldrich-ames-built-a-career-on-betraying-trust
1•petethomas•1h ago•0 comments

Show HN: macOS Screenshot Organizer

https://www.shotsnap.ai/
2•libiny•1h ago•0 comments

'We'll Sue': White House's Warning to CBS Is Sign of a New Media Status Quo

https://www.nytimes.com/2026/01/17/business/media/cbs-news-trump-interview.html
3•stopbulying•1h ago•2 comments

jQuery 4.0.0 Released

https://blog.jquery.com/2026/01/17/jquery-4-0-0/
61•OuterVale•1h ago•13 comments

SkillHub – NPM for AI agent rules, share team standards across 13 AI tools

https://github.com/cloudvalley-tech/skillhub
1•zxh•1h ago•1 comments