frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Mizu – zero-copy parallel R and Python over shared memory

https://github.com/shikokuchuo/pymizu
12•cscheid•57m ago

Comments

shikokuchuo•55m ago
Author here: I wrote mizu (R) and pymizu (Python), packages that offer lock-free async and parallel computing over shared memory, built on the same C core, libmizu. The link above is for the Python package.

A task round trip drops to under one microsecond, from around 100 µs over sockets with Python's ProcessPoolExecutor or mirai, my other R framework. These are numbers from my laptop (an M4 Pro), and benchmark scripts are in the repos for you to run.

Workers claim tasks off lock-free queues, there is no task dispatcher, and system calls are avoided on the hot path.

`PoolExecutor` is a drop-in `concurrent.futures.Executor`, tasks are awaitable in asyncio, NumPy arrays and polars, pyarrow and pandas frames cross as zero-copy views. As mizu and pymizu share the same wire format, data frames and Arrow types also cross zero-copy between worker pools of different languages.

Of course, this is single-machine only as it uses shared memory. The API is still experimental. Usability feedback and bug reports are most welcome at the repos. I'd love to hear about places you'd like to see this used.

Write-up with full benchmarks and the R/Python code examples: https://opensource.posit.co/blog/2026-11-05_mizu-0-1-0/

Places in Tokyo that feel like Night City

https://milos.fyi/blog/places-in-tokyo-that-feel-like-night-city
1•mmilanovic4•1m ago•0 comments

Ask HN: What is going on with SMS 2FA?

1•tkdb•2m ago•0 comments

Scala News – October 31st, 2026 Edition

https://www.scalanews.net/Archive/2026/scala_news_2026-10-31.html
1•softinio•2m ago•0 comments

Roko's Basilisk: The most rational idea in the world [video]

https://www.youtube.com/watch?v=A-5SI4KMHt8
1•gessha•3m ago•0 comments

AI Bureaucracy Will Enable Total Surveillance [video]

https://www.youtube.com/watch?v=WT_quXWFh0o
2•verdverm•3m ago•0 comments

Chess, but you can make the board bigger

https://www.willmeye.rs/chess-board-get-bigger
2•willmeyers•3m ago•0 comments

Show HN: Gleanary – a personal knowledge library you can talk to, for macOS

https://gleanary.app/
1•darvid•3m ago•0 comments

Show HN: PinSharing – OSM static maps and geocoding you can cache forever

https://pinsharing.com/
1•pingtest•4m ago•0 comments

Motorola Signature 27 with GrapheneOS support

https://motorolanews.com/motorola-signature-27-2/
2•monneyboi•5m ago•0 comments

OCAP Bounded Authority: Edera's Managed Approach to Object Capabilities

https://edera.dev/stories/ocap-bounded-authority
3•virtio_vixen•5m ago•0 comments

Show HN: RippleMap – Map dependencies across GitHub repositories

https://github.com/Zintrivious/ripplemap
1•Zintrivious•5m ago•0 comments

Show HN: Roblox game idea generator I built with AI as a non-coder

https://robloxideas.com/
1•nickcastrobuild•5m ago•0 comments

Shotoku – local authorization layer for AI agents

https://www.shotoku.dev/
1•stizix•6m ago•0 comments

Show HN: A Modern Agentic LaTeX Editor

https://papilot.ai/
1•cuichen•7m ago•0 comments

Nvidia chips pile up in Hong Kong as China withholds import approval

https://www.reuters.com/world/china/nvidia-chips-pile-up-hong-kong-china-withholds-import-approva...
4•samizdis•9m ago•0 comments

Model Routing with Nvidia's NeMo Switchyard

https://pub.towardsai.net/model-routing-with-nvidias-nemo-switchyard-9f52edda0af2
1•allessa•11m ago•0 comments

Mistral Studio adds managed agents, workflows and apps

https://mistral.ai/news/build-with-studio/
1•acossta•11m ago•0 comments

Show HN: Stroq – a local audit of what your coding agent did and why

https://github.com/AGGIB/Stroq
2•agybay_07•12m ago•1 comments

Remote AI Jobs

https://nokku.payanai.com/jobs/remote-ai-jobs
1•payanai•12m ago•1 comments

Hiding a Rule Inside Another Model's Weights

https://jonneslin.github.io/weight-space-trigger-en.html
1•jinhonglin•12m ago•0 comments

Building a Multi-Agent System from Scratch: Architecture Patterns

https://kadhar.dev/blog/multi-agent-systems-from-scratch
3•kadharmfn•14m ago•0 comments

Show HN: Securing GrokBot

1•maximelb•15m ago•0 comments

Mercedes Gives Its Cars an AI Upgrade

https://www.wsj.com/cio-journal/mercedes-gives-its-cars-an-ai-upgrade-607daae2
1•thm•15m ago•0 comments

Fonzi – Job board for problems to move humanity forward

https://talent.fonzi.ai/
1•peter_d_sherman•16m ago•0 comments

Show HN: OldTunes – iTunes 4.9 for modern macOS (With GEISS)

https://github.com/rib3ye/oldTunes
1•rib3ye•17m ago•0 comments

How Much Does Reasoning Effort Affect Score and Cost?

https://www.vals.ai/blogs/reasoning-effort
1•gmays•18m ago•0 comments

Show HN: Northmeadow – encrypted shared memory for local AI agents and people

https://github.com/bavarian-studio/northmeadow/releases/tag/v0.1.0-alpha.1
1•Judi2108•18m ago•1 comments

We beat DeepL at its strongest settings, 99 to 3

https://airtranslate.ai/blog/airtranslate-vs-deepl
1•dsavant•18m ago•0 comments

Ask HN: What are some good resources on encoded/encrypted search?

1•lyfeninja•19m ago•0 comments

Brush paint mini-game inspired by spreading liquid

https://paint.gosen.me/
1•gosen•19m ago•1 comments