frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Gemini 4 Neon is the new #1 on the Models Engineering Index

https://git-aarvin.github.io/mei/
266•hn-aarvin•4h ago•161 comments

Anthropic’s Nasdaq debut

https://www.reuters.com/business/finance/anthropics-historic-debut-put-ais-promise-peril-wall-st-...
1004•wslh•11h ago•1962 comments

Pancreatic cancer halted by virus injection in three patients

https://www.newscientist.com/article/2528235-pancreatic-cancer-halted-by-virus-injection-in-three...
672•cybermango•11h ago•105 comments

OpenSSL: Buffer overflow in EVP_EncodeBlock() (CVE-2026-121481, CVSS 9.8)

https://github.com/openssl/openssl/pull/33652
64•JacobHenner•2h ago•35 comments

What Comes After AGI?

https://institute.deepmind.com/essays/what-comes-after-agi/
24•jdkee•1h ago•37 comments

Postgres 19 Repack: Faster, Built-In Table Bloat Cleanup

https://www.snowflake.com/en/blog/engineering/postgres-19-repack-table-bloat/
14•craigkerstiens•1h ago•0 comments

Vint Cerf on why TCP/IP was never patented

https://seremot.com/p/vint-cerf-on-why-tcpip-was-never
50•emot•3h ago•10 comments

Claude solves two open problems in the physics of black holes

https://www.anthropic.com/research/claude-black-hole-physics
433•cybermango•11h ago•197 comments

How to CAD Almost Anything

https://ocw.mit.edu/courses/res-16-002-how-to-cad-almost-anything-january-iap-2024/
177•o4c•2d ago•51 comments

Garage Door Spam

https://blog.harrison.page/garage-door-spam/
790•harrisonpage•3d ago•335 comments

The 98% Slot Machine: How Paid Advertising Became an Extraction Tax

https://globalcommercegraph.com/writing/the-ninety-eight-percent-slot-machine
232•dev1one1•9h ago•124 comments

Launch HN: Onlook (YC W25) – An open-source developer tool for designers

https://github.com/onlook-dev/onlook/
96•D_R_Farrell•11h ago•69 comments

Weight-Space Programming builds neural networks like a 1990s researcher

https://notesbylex.com/weight-space-programming-1990s
36•lexandstuff•2d ago•1 comments

Postgres 19 is out, and it's available on Neon and Databricks Lakebase

https://www.databricks.com/blog/postgresql-19-available-lakebase
29•sp_from_db•3h ago•11 comments

RegExr: Temporarily Offline

https://regexr.com/
63•somebudyelse•6h ago•31 comments

Someone reported java4shell bug in September 2026

https://github.com/openjdk/jdk/pull/32781
392•notmine1337•16h ago•106 comments

Talking Venice with Mahesh Subramony at AMD In-Depth

https://chipsandcheese.com/p/talking-venice-with-mahesh-subramony
22•rbanffy•2d ago•0 comments

Show HN: Cornhole News – A Hacker News inspired site for news across the Midwest

https://cornholenews.news
201•cornholemedia•12h ago•94 comments

Should governments slow frontier AI? Jacob Coxon and Robin Hanson debate [video]

https://www.youtube.com/watch?v=lwfewYL7X0o
90•sandslash•9h ago•165 comments

Synology Security Advisory

https://www.synology.com/en-uk/security/advisory/Synology_SA_26_21
120•choult•6h ago•87 comments

IRA Velinsky, industrial designer for Commodore and Atari

https://dfarq.homeip.net/ira-velinsky-industrial-designer-of-the-commodore-64/
10•onename•1d ago•1 comments

UK government forced to admit it issued Apple a secret encryption order

https://macanorak.com/uk-government-forced-to-admit-it-issued-apple-a-secret-encryption-order/
566•Terretta•12h ago•259 comments

Rebuilding my local voice assistant pipeline

https://blog.platypush.tech/article/Rewriting-my-voice-assistant-pipeline
76•todsacerdoti•7h ago•12 comments

Visa, Mastercard and JPMorgan Customer Data Leaked by Hackers

https://www.wsj.com/finance/banking/visa-mastercard-and-jpmorgan-customer-data-leaked-by-hackers-...
139•mikhael•5h ago•38 comments

Making 8-page foldable zines from a single A4 sheet in the browser

https://krthr.co/paper-folds-and-whats-new-in-fanzines-app/
264•krthr•15h ago•59 comments

Nintendo takes Picofly firmware down from GitHub [video]

https://www.youtube.com/watch?v=-TLCGUpoD6c
266•cowlevel•1d ago•108 comments

An Oregon library ditched Dewey Decimal and got people excited about books again

https://www.fastcompany.com/91597520/oregon-library-ditched-dewey-decimal-wayfinding-system
213•bookofjoe•2d ago•152 comments

How the European Commission rolled out Matrix to more than 40k staff

https://element.io/blog/how-the-european-commission-rolled-out-matrix-to-more-than-40-000-staff/
677•liotier•17h ago•330 comments

Do not buy RAM, compress

https://curiousbits.nl/blog/do-not-buy-ram-compress/
271•Ecno92•19h ago•219 comments

Computer Graphics from Scratch (2021)

https://www.gabrielgambetta.com/computer-graphics-from-scratch/index.html
69•ibobev•2d ago•14 comments
Open in hackernews

OpenTelemetry protocol with Apache Arrow

https://opentelemetry.io/blog/2025/otel-arrow-phase-2/
108•tanelpoder•1y ago

Comments

andygrove•1y ago
I've just started exploring adding OpenTelemetry support to the Comet subproject of DataFusion. I'm excited to see the integration with Apache Arrow (Rust) and potentially DataFusion in the future.
SomaticPirate•1y ago
Wow, anyone able to provide a ELI5? OTel sounds amazing but this is flying over my head
theLiminator•1y ago
Not sure, but seems like it will be producing apache arrow data and carrying it across the data stack end to end from OTEL. This would be great for creating data without a bunch of duplication/redundant processing steps and exporting it in a form that's ready to query.
piterrro•1y ago
Unless I dont understand that fully (which could be the case).

This idea could fly if downstream readers will be able to read it. Json is great because anything can read it, process, transform and serialize without having to know the intrisics of the protocol.

Whats the point of using binary, columnar format for data in transit?

arccy•1y ago
better compression https://opentelemetry.io/blog/2023/otel-arrow/

You don't do high performance without knowing the data schema.

odie5533•1y ago
Is Arrow better than Parquet or Protobuf?
theLiminator•1y ago
Arrow is an in-memory columnar format, kinda orthogonal to parquet (which is an at-rest format). Protobuf is a better comparison, but it's more message oriented and not suited for analytics.
arccy•1y ago
the blog post comparison is against OTLP which is protobuf
datadrivenangel•1y ago
Not having to write to disk is great, and zero-copy in memory access is instant...
phillipcarter•1y ago
Warning: this is an oversimplification.

Performance optimization and being able to "plug in" to the data ecosystem that Apache Arrow exists in.

OpenTelemetry is pretty great for a lot of uses, but the protocol over the wire is too chunky for some applications where. From last year's post on the topic[0]:

> In a side-by-side comparison between OpenTelemetry Protocol (“OTLP”) and OpenTelemetry Protocol with Apache Arrow for similarly configured traces pipelines, we observe 30% improvement in compression. Although this study specifically focused on traces data, we have observed results for logs and metrics signals in production settings too, where OTel-Arrow users can expect 50% to 70% improvement relative to OTLP for similar pipeline configurations.

For your average set of apps and services running in a k8s cluster somewhere in the cloud, this is just a nice-to-have, but size on wire is a problem for a lot of systems out there today, and they are precluded from adopting OpenTelemetry until that's solved.

[0]: https://opentelemetry.io/blog/2024/otel-arrow-production/

potamic•1y ago
This diagram really depicts things nicely

https://opentelemetry.io/blog/2023/otel-arrow/row-vs-columna...

ahoka•1y ago
A bit hand wavy.
KAdot•1y ago
> We are interested in making OTAP pipelines safely embeddable, through strict controls on memory and through support for thread-per-core runtimes.

I'm curious about the thread-per-core runtimes, are there even any mature thread-per-core runtimes in Rust around?

jauntywundrkind•1y ago
glommio is pretty well respected. https://www.datadoghq.com/blog/engineering/introducing-glomm... https://github.com/DataDog/glommio

ByteDance also has their very fast monio. https://github.com/bytedance/monoio

Both integrate io-uring support for very fast io.

julian-datable•1y ago
Integrations with OTLP are critical to driving adoption and probably one of the biggest pain points we've encountered when adopting it ourselves (and encouraging others to the same).

Adopting OTLP without third-party support is pretty time consuming, especially is your tech stack is large and/or varied.

Re runtimes: curious about this too. Feels like the right direction if you’re optimizing a telemetry pipeline.

akdor1154•1y ago
Damn that's some scope creep if I ever saw it: 'try sending Arrow frames end to end' => 'rewrite the otel pipeline in rust'. Seems like the goals of the contributors don't exactly align with the goals of the project.

Kind of a bummer - one thing i was hoping to come out of this was better Arrow ecosystem support for golang.

gitroom•1y ago
Man Ive dipped my toes into this too, and yeah, the way everyone wants different things always shakes things up fast. Kinda love seeing where it all ends up tbh.
mike_heffner•1y ago
Thanks for sharing this — it’s a really promising direction. The advantages of Arrow for OTLP, especially when used end-to-end, are compelling given the protocol overhead of OTLP.

We’ve been thinking along similar lines with the use of Rust, particularly for OpenTelemetry collection in environments where high performance and low resource overhead are critical, such as edge and serverless. With that in mind, we’ve open-sourced a lightweight OpenTelemetry collector written in Rust to address these use cases. We’ve also developed a native Lambda extension around it, and have seen encouraging interest from folks aiming to improve cold start times.

The project is still fairly early, but we’re optimistic that Rust can open up new opportunities for efficient observability pipelines. Vendors like Datadog are also moving in this direction with their Lambda extension and appear to be adopting Rust more broadly for data-plane components.

If this resonates, feel free to take a look here: https://github.com/streamfold/rotel. We’d love to hear your thoughts on how this could be useful.