Hi HN!

This is an early proof of concept of a branchable, versioned OLTP + OLAP database that runs on a single, open copy of your data in object storage. If you are familiar with Databricks' LTAP (https://www.databricks.com/company/newsroom/press-releases/d...) announcement from June, you can think of this as aspiring to be a fully open source, Apache 2.0 LTAP alternative with additional data versioning/auditability guarantees that enable audit, as_of queries, and (eventually) revert straight out of the box.

How it works:

1. Writes land in vanilla postgres which functions as an ephemeral hot tier

2. A background pass flushes committed rows out to columnar files in an object storage cold tier

3. A DataFusion based query engine merges results across the two tiers (with some fancy caching and indexing)

For a deep dive on the architecture/intended design/vision see: https://penca.io/blog/the-penca-architecture.html.

This project is very, very early on. It is mostly a PoC right now and there are many bugs and shortcomings with many major items still on the roadmap. I hope to get some real performance numbers soon.

A few features I would like to add in no particular order:

- Iceberg export

- Branching (from any branch, not just main)

- Improved SQL support (e.g. multi-statement execution)

- Full-text search and vector indexes

- Configurable isolation levels (currently last write wins)

- A pgwire frontend

Any and all feedback is appreciated. I'd also like help! If any of this appeals to you and the project doesn't seem like the craziest idea of all time, shoot me an email at nico@penca.io.

Disclaimer: before someone comments this, yes, the code is heavily AI generated. I have tried to leave as much of the dev tooling in the repo as possible to demonstrate what the end-to-end development workflow looks like. Also, the majority of the commit history is missing as I had to rename/migrate + scrub the repo prior to open sourcing.

Show HN: Agents that learn and remember. On your machine, under your control

Thomson Reuters built its own AI model that now ranks among the best

Show HN: An LSP for agent skills–rename, references, completion, and diagnostics

DCSystems: Independent tech talk series in the DMV area

Cost of Living by Robert Sheckley (1952)

The Incoherence of the Iran Hawks

Claude Code helps me recover after surgery

Old.reddit Is Back?

Replit Secures Every Layer of the Vibe Coding Stack

AI Valuation Math

Show HN: Baduz – Action Adventure Game Maker

The million-dollar talent wars for 20-something math geniuses

The Chatbot Act Forces One Parenting Model on Every Family

Snapchat to no longer spotlight AI generated content

Peso Problem

Show HN: Do Skill.md Linters Matter? An Empirical Study

Show HN: Penca – branchable, versioned OLTP+OLAP on one open copy of your data

The Screen Act Threatens Privacy Far Beyond Adult Websites

Apple Will 'Watch Everything Burn' When AI Bubble Bursts

Shades of Meaning (2018)

C++ Dependencies Without the Headache: Vcpkg and Copilot CLI

Caryatid: Women Who Hold Up Buildings

How AI Is Helping One-Person Companies Scale to $1M–and Beyond

Questionable Technical Co-Founder Agreement

Lawsuit: A $45M film was left unencrypted on a Netflix desk, then stolen

Apple's Siri Got an A.I. Brain Transplant. Try These 5 Prompts to Get Acclimated

Claude published malicious code to the Internet and attacked 3 real companies

AI and the Paperclip Apocalypse

All our Agents get computers, we pay for almost none

The Four Horsemen of the AI Bubble Apocalypse

Ask HN: Are you running production workloads in Pytorch eager mode?