Hey friends. I'd like to share a project that's dear to me. fenic is a dataframe API with LLMs added as first-class citizens, a classic lazy dataframe API extended with new operators that are backed by LLMs.

What this gets you is the ability to work with structured and unstructured data in the same context. Most importantly, the LLMs aren't integrates as opaque UDF black boxes. They're exposed as "semantic" operators that the planner can reason about alongside the classic ones.

(There are examples and code snippets on the repo to see how everything works together)

Why build this? I'm a data infra / systems person. When LLMs showed up, what I saw was a new type of compute that changes the characteristics of the workloads we deal with. I wanted to experiment with how our current systems can absorb these new workloads and compute types, and what it would take to make the DX as seamless as possible, that's where the UDF + arbitrary prompt was feeling too problematic.

To support this properly, we had to introduce a few really cool things:

New plan operators. You don't just send prompts at an LLM. You use operators like semantic join, semantic map and reduce, and semantic filter, among others. They mix with the classic operators, and because the planner sees them as real operators rather than black boxes, it can reorder work around them.

Typed outputs. There's ergonomics to turn the output of a semantic operator straight into a typed dataframe column. A Pydantic schema for the LLM output becomes a typed struct column you can unnest, explode, and so on.

New data types like a markdown data type. Markdown became an important way to share information with LLMs, even though it started life as a way to format text for presentation. It carries structure, and being able to access that structure the way you would a struct or JSON type adds to the developer experience I mentioned.

Async UDFs. One of the more interesting shifts in workloads from the LLM explosion is the need to put heavily I/O-bound steps in your pipeline: fetching a response from an API, crawling a website, and so on. Async UDFs fill that gap, and the implementation handles the nuances for you: concurrency, retries, and the rest.

An LLM-inference-aware planner and runtime. This is one of the parts I'm most excited about, and there's a lot still to do. Today: identical prompts within a batch collapse to a single model call, so duplicates cost zero tokens; requests are dispatched concurrently under per-provider rpm/tpm limits with retries and backoff; null and empty cells skip the model entirely; and you get token and cost metrics per operator. There's also an optional persistent response cache so re-runs skip the model.

MCP as a new catalog primitive. Much like a registered view, you can register a dataframe pipeline as an MCP tool in the catalog. fenic then serves an MCP server with that pipeline as the tool's logic, executed over your data.

These are just some of what's gone into fenic while experimenting with how LLMs can become part of our compute infrastructure. There's more, and plenty more to polish on what's already there.

I've been using fenic for all sorts of things. On the small/personal end, I use it to take my podcast audio recordings and turn them into nicely structured tables of metadata I can research. On the heavier end, I use it as tooling for agents to analyze agent traces exported from Pydantic Logfire, to discover evals and turn them into reproducible artifacts in the form of dataframe pipelines.

  pip install fenic
  Repo: https://github.com/typedef-ai/fenic
  Docs: https://docs.fenic.ai

There's also a skill you can use with claude code, codex etc. to quickly get started with fenic in your favourite agentic coding environment.

I'd love to hear your thoughts, criticism, and anything else that comes to mind.

I'm here to answer questions.

Migrating to client-side load balancing at a million requests per second

(Lord) Timothy Dexter

July Xbox layoffs rumored to be 'largest in gaming history'

Show HN: My 13-year-old built an ant colony tracker

Nano Banana 2 Lite

What kinds of bugs does AI generate?

How to hustle like a tech founder

The baby of OpenClaw, Manus and Claude Code

Highlights from Git 2.55

Is there some secret rule to post links here

GenomeNarrator – clinical-grade reports from 23andMe/AncestryDNA data

Who Logs You in When You Use Tailscale SSH?

Crypto firms have spent $189M so far on 2026 US election, report says

SF that survived the 7.x Quake

US Supreme Court upholds birthright citizenship in loss for Trump

How to reverse-engineer an endpoint security product using LLMs

Speculation is all you need

The Future of Building Design

Show HN: fenic – LLMs as dataframe operators, query meaning and structure

Localhost Is Disappearing

Ask HN: Books on the Design of Design Tools

Tests should become public property

Local LLMs on a Ryzen 8700G iGPU: 13-15 tok/s on gemma4, 9-12 on qwen3.6

Bloomberg joins as the first Video sponsor of Meeting C++ 2026

Claude Code session URL is leaking into your Git history as of v2.1.179

Show HN: Vanta – Markdown notes for iPhone with on-device AI

Show HN: Agent Sandbox Options

What Makes a Vulnerability Report Excellent

Do Excellent Vulnerability Reports

Meta's non-invasive BCI still isn't great