Show HN: A modern C++20 AI SDK (GPT‑4o, Claude 3.5, tool‑calling)

50•cauchyk•3d ago

Hi all,

I’m hacking on new features for the ClickHouse native client and wanted the same “just call the model” ergonomics JavaScript and Python now enjoy. It didn’t exist for modern C++, so I wrote one.

ai‑sdk‑cpp (Apache‑2.0) gives you:

- Unified calls to OpenAI (GPT‑4o) and Anthropic (Claude 3.5) with a single C++20 API. - Streaming, multi‑turn chat, error handling—all std::optional/std::variant, no macros. - Tool calling (function‑calling) so the model can hit real APIs; sync or async, runs in parallel.

The tricky bit: C++ still lacks real reflection, so mapping plain functions → JSON schemas isn’t as automatic as, say, TypeScript decorators. I’d love fresh eyes on that part. Try the examples and tell me where it feels clunky. This is inspired by Vercel's AI SDK [1], and litellm [2].

Repo live here: https://github.com/ClickHouse/ai-sdk-cpp, feedback welcome!

[1] https://github.com/vercel/ai [2] https://github.com/BerriAI/litellm

Comments

rubymamis•17h ago

Very nice! I might get inspire for my own Qt C++ LLM client[1]. Do you plan to add streaming Markdown parsing? It's a challenging problem that was very fun implementing for Vox -> it allows parsing code blocks and other such advance/custom blocks (I created a custom 'tool' block) without re-rendering. My implementation is currently tied to Qt's C++ but I might make it more generic and open source it.

[1] https://www.get-vox.com/

pjmlp•16h ago

While you will need C++26 for real reflection, you could use some of the libraries that make do with what is already possible via concepts, if constexpr and type traits.

For example,

- https://www.boost.org/doc/libs/latest/doc/html/boost_pfr.htm...

- https://github.com/getml/reflect-cpp

And kudos for using modern C++.

sylware•15h ago

I was wondering, has anybody tried to use AI to port c++ to C?

bergesenha•13h ago

The json library 'glaze' has working compile time reflection for MSVC, Clang and GCC using some tricks with aggregate initializable structs. In addition to being a performant json library, it comes with the functions glz::apply and glz::to_tie which I used for general tool calling straight from deserialized json.

fsloth•12h ago

“mapping plain functions → JSON schemas”

In general I’ve found it’s much better in C++ to be verbose and plain rather than succinct and elegant.

Javascript and python lack typing so being pithy&clever in those languages has entirely different implications than in C++.

“How can I express this in the most basic, unsurprising and plainspoken C++” is usually the right question to ask. “How can I make this more elegant” is a question better suited for other languages imho.

The best C++ API when in doubt is a C style API.

N_Lens•12h ago

Agreed! C++ is a powerful language but full of footguns.

What to build instead of AI agents

Exploiting the IKKO Activebuds "AI powered" earbuds

ASCIIMoon: The moon's phase live in ASCII art

Don’t use “click here” as link text (2001)

Show HN: CSS generator for a high-def glass effect

Couchers is officially out of beta

Physicists Start to Pin Down How Stars Forge Heavy Atoms

That XOR Trick (2020)

Vitamin C Boosts Epidermal Growth via DNA Demethylation

Evidence of a 12,800-year-old shallow airburst depression in Louisiana

The Zen of Quakerism (2016)

Gene therapy restored hearing in deaf patients

Sony's Mark Cerny Has Worked on "Big Chunks of RDNA 5" with AMD

The Evolution of Caching Libraries in Go

Features of D That I Love

Websites hosting major US climate reports taken down

A list is a monad

AI note takers are flooding Zoom calls as workers opt to skip meetings

Escher's art and computer science

How large are large language models?

MindsDB (YC W20) is hiring an AI solutions engineer

The Unseen Fury of Solar Storms

Efficient set-membership filters and dictionaries based on SAT

Private sector lost 33k jobs, badly missing expectations of 100k increase

WebAssembly Troubles part 4: Microwasm (2019)

TikTok is being flooded with racist AI videos generated by Google's Veo 3

The "personal computer" model scales better than the "terminal" model

Reuleaux Kinematic Mechanisms Collection

Cloudflare Introduces Default Blocking of A.I. Data Scrapers

More assorted notes on Liquid Glass