Ask HK: How are you building AI apps today?

4•Mnexium•3h ago

Generally curious how folks are using LLM APIs today.

Are folks doing anything bespoke, unique or different?

I think we've seen a lot of usage with harnesses, CLIs, Cursor/Windsurf etc which uses the APIs underneath.

If you are using the API itself, what does your architecture look like with said API?

Comments

late_night_fix•2h ago

I try to batch requests and reuse responses wherever possible.LLM API calls are awesome,but if you don't watch your usage,cost sneaks up fast.

Mnexium•2h ago

Agreed, are you doing anything to take advantage of cacheing?

Anything else you can share about project?

LogicCraft678•2h ago

Mostly multi-model routing and structured outputs

Ask HN: Any advice on how to learn good software architecture practices?

Ask HK: How are you building AI apps today?

Ask HN: What Is an "AI Engineer"?

Ask HN: Does Claude Code remove the need for so many front-end frameworks?

Ask HN: Are Tech Meetups Dead?

A disk-first C++ vector engine

Ask HN: I found out that I'm about to be laid off. How do people find jobs?

Garnix, the Nix CI, is shutting down

Do not use Cloudflare DNS regsitrar

Ask HN: How do you feel about posts about GenAI taking over the HN front page?

Train 1T parameter LLM with 8 GPUs?

Ask HN: Why not have an EU browser?

Ask HN: Is anyone working at least 4 hours daily on an Apple Vision Pro?

Sqlit – A lazygit-style TUI for SQL databases

Ask HN: How do you model temporarily invalid data structures

Did the Linux memory management maintainer "just quit"?

Ask HN: When and why did you start believing in God?

Ask HN: Why didn't the C64 come with Simons' BASIC in the box from 1983 onward?

Ask HN: Did Messages get removed from Google Takeout?

Amdahl's Law for LLM generated code

Ask HN: Any advice on how to learn good software architecture practices?

Ask HK: How are you building AI apps today?

Ask HN: What Is an "AI Engineer"?

Ask HN: Does Claude Code remove the need for so many front-end frameworks?

Ask HN: Are Tech Meetups Dead?

A disk-first C++ vector engine

Ask HN: I found out that I'm about to be laid off. How do people find jobs?

Garnix, the Nix CI, is shutting down

Do not use Cloudflare DNS regsitrar

Ask HN: How do you feel about posts about GenAI taking over the HN front page?

Train 1T parameter LLM with 8 GPUs?

Ask HN: Why not have an EU browser?

Ask HN: Is anyone working at least 4 hours daily on an Apple Vision Pro?

Sqlit – A lazygit-style TUI for SQL databases

Ask HN: How do you model temporarily invalid data structures

Did the Linux memory management maintainer "just quit"?

Ask HN: When and why did you start believing in God?

Ask HN: Why didn't the C64 come with Simons' BASIC in the box from 1983 onward?

Ask HN: Did Messages get removed from Google Takeout?

Amdahl's Law for LLM generated code

Ask HK: How are you building AI apps today?

Comments