frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Ask HN: How are you using LLMs in production?

3•Anon84•11h ago
I’m curious how people are leveraging LLMs in production. We’re all familiar with using them to write code through your IDE, or agent, etc… but what applications have you built that use LLMs as part of the functionality?

    - What applications/industries have you found them to be the most useful in?
    - What tools do you use for orchestration? LangGraph/CrewAI/built your own/etc?
    - What models? Centralized or locally deployed?

Comments

sdevonoes•9h ago
We are not. We are still making money and providing payslips for real humans. We are doing fine
Leomuck•9h ago
I'm a full-stack software dev, proficient in AI but also sceptical. I've found that staying away from the hype is key. Stop thinking about "WHAT COULD THIS DO", but rather try to find cases where LLMs actually benefit. I've seen so many projects trying to throw LLMs at things that could have been solved deterministically.

My personal opinion is: LLMs give you the power of language. So far we could define rules, based on structured data, we couldn't process unstructed data that well. Now we can use LLMs to take any kind of input and either create responses to it or transform it to structured data. That is a huge leap of advance. But also, there are a million cases where it's not necessary.

On the side, I'm working for a NGO caring about sustainable finance. They have a manually gathered database, they have lots of resources, but most users couldn't care enough to actually click through everything. So offering a chatbot to make that data available seemed reasonable. It works, quite well, and still most requests are so trivial you could have just blocked them.

On my paid job, I'm working for a german radio/tv broadcast station and they're trying to involve AI in solving simple internal user issues. It seems to work quite well. We've built a RAG system based on Qdrant and LlamaIndex and it provides all available information in a format users couldn't find before - because the systems were chaotic and complciated. So in my book, that's a good use case. Users in a very complicated environment with lots of information.

I've worked with OpenAI API, Anthropic API, Azure Foundry, local models, IONOS Model Hub, etc. One thing that keeps coming up is privacy and (in Europe) GDPR-compliance. Use the capabilities of LLMs without sacrificing data that should not go into the next training round.

Anyway, I think LLMs offer a lot of possibilities, but many people tackle them from the wrong side - "what could we do with this?" instead of "what problems do we need to solve?".

Anon84•6h ago
Thank you for the thoughtful answer
sminchev•3h ago
I have done integration it two applications: (1) I use it to analyze behavior, sleep and still patterns, and detect frequently visited locations, based on recorded and provided data. It is an monitoring app for elderly people; (2) suggestions, parsing files, as database. The first two are clear. The third, instead of supporting and maintaining a database, I call the AI to give me the information;

Used LLMs: Gemini 2.5 Flash. ChatGPT 5

Anon84•2h ago
Thank you, that’s helpful.

Aliens.gov Resolves – To a WordPress "Site Not Found" Error

7•ascarola•54m ago•2 comments

Ask HN: How do you maintain flow when vibe coding?

16•fny•4h ago•16 comments

Ask HN: Who is using OpenClaw?

318•misterchocolat•1d ago•363 comments

Tell HN: 48 absurd web projects – one every month

66•absurdwebsite•11h ago•24 comments

Tell HN: Fiverr left customer files public and searchable

814•morpheuskafka•2d ago•230 comments

Advice for tracking down a listening device?

6•comrade1234•12h ago•5 comments

Ask HN: Who is your favourite Entrepreneur/Visionary?

11•wasimsk•16h ago•26 comments

Ask HN: How are you using LLMs in production?

3•Anon84•11h ago•5 comments

Durable Object alarm loop: $34k in 8 days, zero users, no platform warning

18•thewillmoss•23h ago•1 comments

Ask HN: How are you actively keeping your thinking sharp while using LLMs daily?

7•smonk108•12h ago•7 comments

Ask HN: How do you find motivation to do stuff?

21•RockstarSprain•1d ago•22 comments

Ask HN: SeedLegals Partnerships in London, worth it?

2•pain_perdu•18h ago•1 comments

Ask HN: How to highlight talent from untraditional backgrounds?

4•etherus•18h ago•2 comments

Tell HN: Anthropic no longer allows you to fix to specific model version

23•baobabKoodaa•1d ago•1 comments

Ask HN: As an Australian, is it possible to get a remote US role?

4•apatheticonion•1d ago•8 comments

GitHub gave webhook secrets away in webhook call

11•time4tea•2d ago•1 comments

Any engineers here with experience of clinical data standards?

2•kalturnbull•1d ago•0 comments

Ask HN: Is Claude Getting Worse?

6•sahli•1d ago•13 comments

Tell HN: GitHub might have been leaking your webhook secrets. Check your emails.

39•ssiddharth•2d ago•12 comments

Ask HN: Robotics engineers – how painful was setting up GPU sim infra?

4•nikhilol•1d ago•7 comments

Ask HN: What's the point in creating a startup when anyone can copy it in days?

17•wewewedxfgdf•1d ago•24 comments

Ask HN: I quit my job over weaponized robots to start my own venture

116•barratia•2d ago•82 comments

Ask HN: Can anyone suggest me a SaaS product idea?

4•wasimsk•1d ago•11 comments

What do you want out of a coding monospace font?

2•d0able•1d ago•7 comments

Ask HN: LeetCode, anyone still doing it?

14•kwar13•2d ago•12 comments

Ask HN: Are you negatively affected by the recent economic stagnation?

9•adinhitlore•3d ago•22 comments

Ask HN: Are Web Agencies Cooked?

10•mijustin•2d ago•9 comments

Ask HN: What's your favorite security cam system?

4•SunshineTheCat•2d ago•5 comments

Ask HN: What standards or protocols exist for AI Agent permissions

2•lyfeninja•2d ago•3 comments

PersMEM: Persistent Semantic Memory and Multi-Instance Communication for AI

3•asixicle•2d ago•0 comments