Airport for DuckDB

https://airport.query.farm/

115•jonbaer•3d ago

Comments

blef•9h ago

This is a cool thought exercise to think that everything that we do in the data world can be done in SQL, from SQL. In a sense this is the MCPs but for the DuckDB world.

simlevesque•9h ago

last monday: https://news.ycombinator.com/item?id=44036343

mrbungie•8h ago

I was almost going to build a lakehouse* with DuckDB because I low-key love it, easiest and strongest analytical engine I've found yet: scale from laptops to big metal, while being mostly out-of-core when doing sane stuff, and avoiding distributed computing for SQL in the process (looking at you Spark).

That is until I found out it does not support Iceberg writes[1], big nono as I would need another engine for inserts, and I want a simple stack :(. What a bummer.

[1] https://github.com/duckdb/duckdb_iceberg/issues/37

*that is what they are called now aren't they? I just can't follow the terms anymore haha.

mritchie712•8h ago

it's coming. they already have hive style parquet writes. Iceberg is more complicated than that, but it's certainly doable.

mrbungie•8h ago

Yeah, it just would be great if it already did so and I hope it supports Iceberg soon, as it would enable me to change expensive (and bad) engines like AWS Athena for something more manageable.

Don't get me wrong, I'm just being a tongue-in-check egotistical bastard data engineer from hell. DuckDB is a fine piece of software as it is, and those mantainers deserve heaven.

jeadie•7h ago

This is one of the ideas behind using DuckDB in github.com/spiceai/spiceai

mrbungie•7h ago

Looks very cool! I will take a look, tysm!

nicornk•4h ago

Fivetran tried to upstream write support but it was not accepted https://github.com/duckdb/duckdb-iceberg/pull/95

the_optimist•8h ago

What’s the situation where this is useful? Seems like ‘replace your remote duckDB instance—used to replace a DB server—with duckDB instance + a flight server (or a bunch of them!)’. Who has a problem for which this is the solution?

simlevesque•7h ago

A Flight server paired with duckdb is a good way to get concurrent writes.

r3tr0•6h ago

I love duck db. We use it a ton for indexing and organizing system / kernel level metrics exported by eBPF.

Check out our sandbox:

https://yeet.cx/play

rubenvanwyk•6h ago

Does this mean the data source and destination both have to set up flight servers? I imagine then this won’t be useful for integration of third-party services.

k_bx•3h ago

Not clear. Will this allow loading ipc files in DuckDB finally? That's been my biggest issue, since I use IPC files for append operations before I turn them into parquet files.

vkaku•3h ago

This is very nice. I also love the fuzzycomplete and lindel from the same org/authors.

code_biologist•2h ago

fuzzycomplete - https://github.com/Query-farm/fuzzycomplete "This fuzzycomplete extension serves as an alternative to DuckDB's autocomplete extension, with several key differences: ..."

lindel - https://github.com/Query-farm/lindel "This lindel extension adds functions for the linearization and delinearization of numeric arrays in DuckDB. It allows you to order multi-dimensional data using space-filling curves. ... Linearization maps multi-dimensional data into a one-dimensional sequence while preserving locality, enhancing the efficiency of data structures and algorithms for spatial data, such as in databases, GIS, and memory caches."

John Carmack talk at Upper Bound 2025 – slides and notes

Tallest Wooden Wind Turbine

KumoRFM: A Foundation Model for In-Context Learning on Relational Data

Show HN: Defuddle, an HTML-to-Markdown alternative to Readability

Lockheed Martin and IBM combine quantum computing with HPC in new research

'Turbocharged' Mitochondria Power Birds' Epic Migratory Journeys

That fractal that's been up on my wall for years

Claude 4

Airport for DuckDB

Does Earth have two high-tide bulges on opposite sides? (2014)

32 bits that changed microprocessor design

Mozilla to shut down Pocket and Fakespot

Sketchy Calendar

Fast Allocations in Ruby 3.5

Improving performance of rav1d video decoder

How to cheat at settlers by loading the dice (2017)

A Formal Mathematical Investigation on the Validity of Kellogg's Glaze Claims

A South Korean grand master on the art of the perfect soy sauce

We’ll be ending web hosting for your apps on Glitch

Ancient law requires a bale of straw to hang from Charing Cross rail bridge

I Built My Own Audio Player

Loading Pydantic models from JSON without running out of memory

Richard Garwin’s role in designing the hydrogen bomb was obscured

Remote Prompt Injection in Gitlab Duo Leads to Source Code Theft

When a team is too big

The Future of Flatpak

Show HN: SQLite JavaScript - extend your database with JavaScript

Launch HN: WorkDone (YC X25) – AI Audit of Medical Charts

When good pseudorandom numbers go bad

Problems in AI alignment: A scale model

Airport for DuckDB

Comments

John Carmack talk at Upper Bound 2025 – slides and notes

Tallest Wooden Wind Turbine

KumoRFM: A Foundation Model for In-Context Learning on Relational Data

Show HN: Defuddle, an HTML-to-Markdown alternative to Readability

Lockheed Martin and IBM combine quantum computing with HPC in new research

'Turbocharged' Mitochondria Power Birds' Epic Migratory Journeys

That fractal that's been up on my wall for years

Claude 4

Airport for DuckDB

Does Earth have two high-tide bulges on opposite sides? (2014)

32 bits that changed microprocessor design

Mozilla to shut down Pocket and Fakespot

Sketchy Calendar

Fast Allocations in Ruby 3.5

Improving performance of rav1d video decoder

How to cheat at settlers by loading the dice (2017)

A Formal Mathematical Investigation on the Validity of Kellogg's Glaze Claims

A South Korean grand master on the art of the perfect soy sauce

We’ll be ending web hosting for your apps on Glitch

Ancient law requires a bale of straw to hang from Charing Cross rail bridge

I Built My Own Audio Player

Loading Pydantic models from JSON without running out of memory

Richard Garwin’s role in designing the hydrogen bomb was obscured

Remote Prompt Injection in Gitlab Duo Leads to Source Code Theft

When a team is too big

The Future of Flatpak

Show HN: SQLite JavaScript - extend your database with JavaScript

Launch HN: WorkDone (YC X25) – AI Audit of Medical Charts

When good pseudorandom numbers go bad

Problems in AI alignment: A scale model