frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Vendor lock-in vs. open metadata architecture? What works?

https://medium.com/datastrato/if-youre-not-all-in-on-databricks-why-metadata-freedom-matters-35cc5b15b24e
1•wey-gu•11m ago

Comments

wey-gu•11m ago
I was reading an article earlier today, and it brought me back to a question I’ve heard over and over again in real data/infra teams: Do we just accept vendor lock-in because it’s convenient, or do we take the pain and build an open, multi-engine metadata stack? For context (not my product, just what triggered the thought): https://medium.com/p/35cc5b15b24e I’m not trying to argue Gravitino vs. UC here — I’m more interested in the architectural mindset behind these two approaches. On the vendor-integrated side, the upsides are obvious: smoother UX one place for lineage/policies fewer moving parts But so are the downsides: cost keeps creeping up you end up tied to one engine/format migrations basically don’t happen in real life And on the open/composable side: Spark/Trino/Flink/Ray all first-class Iceberg/Hudi/Delta can actually coexist Metadata isn’t tied to compute But again: inconsistent metadata models everywhere no unified governance layer someone eventually owns a pile of glue code forever So I’m curious: what actually works in practice? If your company had to make this choice: Did you go all-in on a vendor, or build something open? Did the decision age well after a year or two? Has anyone actually avoided metadata sprawl without getting locked in? Where do lineage, ACLs, policies, and the “source of truth” actually live in your setup? Really interested in what folks think, especially if you're juggling multiple engines, table formats, and clouds.

Drawing with Chaos

https://yberreby.com/posts/strangedraw/
1•yberreby•36s ago•0 comments

The Shai-Hulud 2.0 npm worm: analysis, and what you need to know

https://securitylabs.datadoghq.com/articles/shai-hulud-2.0-npm-worm/
1•saikatsg•3m ago•0 comments

Show HN: Lissajous Curve Music Visualization

https://github.com/ThatXliner/ljv
1•thatxliner•4m ago•0 comments

Show HN: Interpret your Liver Labs like a top Longevity Clinic would

https://www.longevity-tools.com/liver-function-interpreter
1•zsolt224•4m ago•0 comments

Master Spring Data AOT in IntelliJ Idea

https://blog.jetbrains.com/idea/2025/11/spring-data-aot/
1•quapster•5m ago•0 comments

The role of masturbation in relieving symptoms associated with menopause

https://lww.com/_layouts/1033/OAKS.Journals/Error/JavaScript.html
1•rclkrtrzckr•5m ago•0 comments

The Ruby community needs to know what happened last week at SF Ruby Conf

https://blog.adrianthedev.com/sf-ruby-2025-and-the-thousand-people-framework
1•nonconstant•6m ago•0 comments

Why Are You Productive for "Only" 5-6 Hours Each Day?

https://ashleyjanssen.com/why-are-you-productive-for-only-5-6-hours-each-day/
1•speckx•8m ago•0 comments

A Gentle, Incrementally Comprehensive Introduction to GPUs

https://eyeamansh.substack.com/p/a-gentle-incrementally-comprehensive
1•anshyyy•10m ago•0 comments

Vendor lock-in vs. open metadata architecture? What works?

https://medium.com/datastrato/if-youre-not-all-in-on-databricks-why-metadata-freedom-matters-35cc...
1•wey-gu•11m ago•1 comments

Cloudflare outage should not have happened

https://ebellani.github.io/blog/2025/cloudflare-outage-should-not-have-happened-and-they-seem-to-...
2•b-man•11m ago•0 comments

Fox News hires Palantir to build AI newsroom tools

https://www.axios.com/2025/11/18/fox-news-palantir-ai-newsroom-tools
3•doener•12m ago•0 comments

From Software Engineer to AI Environment Architect

https://infini-ai-lab.github.io/ai-environment-architect/
1•lovecoding_•14m ago•0 comments

Fears About A.I. Prompt Talks of Super PACs to Rein in the Industry

https://www.nytimes.com/2025/11/25/us/politics/ai-super-pac-anthropic.html
3•JumpCrisscross•15m ago•0 comments

Chinese Regulators May Kill Retractable Car Door Handles

https://hackaday.com/2025/11/26/chinese-regulators-may-kill-retractable-car-door-handles-that-nev...
2•speckx•16m ago•0 comments

Jayne in Brief

https://pgadey.ca/experimental/jayne-latex2html/
1•surprisetalk•17m ago•0 comments

Containership Dali Contact with Francis Scott Key Bridge [video]

https://www.youtube.com/watch?v=bu7PJoxaMZg
1•surprisetalk•17m ago•0 comments

More than half of new articles on the internet are being written by AI

https://theconversation.com/more-than-half-of-new-articles-on-the-internet-are-being-written-by-a...
3•geox•17m ago•1 comments

'Sovereign AI' Takes Off as Countries Seek to Avoid Overreliance on Superpowers

https://www.wsj.com/tech/ai/sovereign-ai-takes-off-as-countries-seek-to-avoid-overdependence-on-s...
1•JumpCrisscross•17m ago•0 comments

Date Me Directory

https://dateme.directory/browse
1•surprisetalk•17m ago•0 comments

Crick: A Mind in Motion review, the charismatic philanderer who changed science

https://www.theguardian.com/books/2025/nov/25/crick-a-mind-in-motion-by-matthew-cobb-review-the-c...
1•Lio•20m ago•0 comments

React Challenges – Improving the typical "React challenge platform" experience

https://www.reactchallenges.com
1•DuffmanCC•21m ago•1 comments

Launching the Julia Security Working Group

https://www.julialang.org/blog/2025/11/launching-security-wg/
1•postflopclarity•22m ago•0 comments

Slop Detective – Fight the Slop Syndicate

https://slopdetective.kagi.com/
2•speckx•22m ago•0 comments

The Chinese periodic table goes hard [video]

https://www.youtube.com/watch?v=8ol7DsPnHcE
1•surprisetalk•23m ago•0 comments

Protection of dogs and cats: deal on EU rules to stop abuse

https://www.europarl.europa.eu/news/en/press-room/20251121IPR31539/protection-of-dogs-and-cats-de...
3•JumpCrisscross•24m ago•0 comments

Extract structured information from Hacker News and keep in sync with Postgres

https://cocoindex.io/blogs/custom-source-hackernews
1•badmonster•25m ago•0 comments

Everything that's going wrong with architecture

https://www.dezeen.com/2025/11/17/everything-wrong-edwin-heathcote-performance-review/
1•eustoria•26m ago•0 comments

List of 12,000 NeurIPS Attendees – The Official App Shows Only 200

https://docs.google.com/spreadsheets/d/1cUbPXGpo2ES6XHzGdeGk5bk5eO9BjsDIgQJGlQ6lhUo/edit?usp=sharing
2•aminmo•26m ago•1 comments

Universal LLM Memory Does Not Exist

https://fastpaca.com/blog/memory-isnt-one-thing
3•gmays•28m ago•0 comments