Privacy folks – what's your take on using LLMs at work?

10•adeebaslam•7h ago

Hey everyone! :wave: I’m building a product called Privacy AI, and I’m trying to learn how people think about data privacy when using AI tools at work — especially in industries like finance, healthcare, or anywhere with sensitive data. If you: - Use tools like ChatGPT, Claude, Gemini, etc. for work - Work in privacy, infosec, compliance, or deal with sensitive data …I’d love to hear how you're handling that today. No pitch, no selling — just looking to learn from real experiences. If you’re open to a quick 20-min chat, drop a comment or shoot me a DM. Really appreciate it

Comments

jart•5h ago

By using a privacy preserving local LLM like Mozilla's llamafile.

HelloUsername•5h ago

No direct answers, just wanted to say perhaps this page might interest you as well:

https://duckduckgo.com/duckduckgo-help-pages/duckai/ai-chat-...

rhabarba•5h ago

> I’m building a product called Privacy AI

Why?

> what's your take on using LLMs at work?

Don't.

carlmr•5h ago

>> what's your take on using LLMs at work?

>Don't.

The only privacy-conscious answer.

paulcole•4h ago

Do you mean you shouldn’t use LLMs at work at all? Or avoid them only if dealing with truly sensitive data (like healthcare records)?

rhabarba•4h ago

You shouldn’t use LLMs at work at all.

paulcole•4h ago

More power to you but I get so much more done with them that I can’t imagine going back.

rhabarba•3h ago

> I get so much more done with them

... poorly.

scottiebarnes•2h ago

Does the existence of Google or Stackoverflow result in poor work, or is it the way the programmer utilizes them?

hengheng•5h ago

So your cloud service intends to compete with on-premise hosted internal services on privacy?

We used to call that a honeypot.

bnolsen•5h ago

Run your own locally but beware of copyright violations. My company uses some form of copilot that supposedly is guaranteed to be copyright safe. Personally i think it's very bad policy to make your skills dependent on something proprietary, which is exactly what these llm providers are trying to do to make back their billions of investment.

fortyseven•5h ago

I avoid cloud based stuff. Though I use GitHub Copilot largely because it's from the early days and it's a great tool (and my employer pays for it). But otherwise, local LLM or gtfo.

axegon_•5h ago

Honestly? I'm somewhat OK with Mistral, in that it's a French company, therefore they need to comply (on paper anyways) with GDPR. And if they do not, there are serious consequences. But overall - locally. If it is not running on your hardware and it requires an internet connection to work, then the data is not yours. For the time being, building an AI rig at home is relatively cheap on ebay: if you play your cards well, it is doable for 1000 bucks or less.

underseacables•5h ago

I asked an LLM if it would keep my data private and it said absolutely. It wouldn't lie to me would it?

mvieira38•4h ago

This is one of those things I just gave up at, like fully "degoogling". I ran my own ollama server for a while in my machine, for code completion, but it's just garbage without GPU accel, so I just use ChatGPT and pretend I believe their privacy settings

AaronAPU•3h ago

For what it’s worth the last company I’d trust for privacy is one who calls itself Privacy AI.

rabid_turtle•3h ago

I never put any information into an LLM that I wouldn't want publicly known. I'm okay with an LLM knowing the coding projects I am working on.

gbraad•2h ago

I do not trust an agent near client code or even PII. Multiple windows of VScode still seem to active from time to time, or by forced update. This is why I do not activate them on my local machine. Only on a VM/container which only contains the codebase under edit.

whs•2h ago

I use public LLM the same way I'd use a search engine - to search public information only and never proprietary data. With Gemini in Google Workspace that can be used for proprietary information, but of course only if Gemini suits the tasks.

As for coding model my view is they're directly violating my copyright, especially that I checked some "open training data" corpus that it does confirm that my code is part of the corpus without honoring the license.

Judges Worry Trump Could Tell U.S. Marshals to Stop Protecting Them

Free Secure Coding Guidelines (Language-Agnostic, Actionable, Achievable

Google is killing software support for early Nest Thermostats

SuperGenPass – Browser Bookmarklet Password-Manager

DeepWiki – Which repo would you like to understand?

Eurorack Knob Idea

Support changes to our earliest generation Nest Learning Thermostats

The Chinese Hamster Revolutionized Medicine

AI can burn your house down, but not because it wants to

Conflating access and community considered harmful

Physicists develop compact, mid-infrared pulse generator on single chip

Data Breach at Connecticut's Yale New Haven Health Affects over 5M

Marks and Spencer pauses online orders as firm struggles with cyber-attack

Some recent changes to choice of L10n and Internationalization in Qt

Open Source Foundations Considered Helpful (2024)

USDA withdraws a plan to limit salmonella levels in raw poultry

Microsoft made an ad with generative AI and nobody noticed

Hydrotreated vegetable oil isn't an emission-free swap for diesel in datacenters

Show HN: Springus – Outfit recommendations from your real wardrobe using AI

Show HN: Magnitude – open-source, AI-native test framework for web apps

Do smartphones and social media harm teens' mental health? [audio]

Show HN: Claude Code with GUI and Block Based Prompt Editor (MIT)

Dolphins Communicate with 'Fountains of Pee'

Intel says employees must return to the office 4 days a week

Show HN: Be My First User

'Things Have Ground to a Halt': Tariff Uncertainty Paralyzes Businesses

Things Traffic Flow can teach us about software development

Advancing Secure by Design Through Security Research

Thoughts on Vibecoding

400x AI Acceleration