frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: DeepTeam – Penetration Testing for LLMs

https://github.com/confident-ai/deepteam
3•jeffreyip•1y ago
Hi HN, we’re Jeffrey and Kritin, and we’re building DeepTeam (https://trydeepteam.com), an open-source Python library to scan LLM apps for security vulnerabilities. You can start “penetration testing” by defining a Python callback to your LLM app (e.g. `def model_callback(input: str)`), and DeepTeam will attempt to probe it with prompts designed to elicit unsafe or unintended behavior.

Note that the penetration testing process treats your LLM app as a black-box - which means that DeepTeam will not know whether PII leakage has occurred in a certain tool call or incorporated in the training data of your fine-tuned LLM, but rather just detect that it is present. Internally, we call this process “end-to-end” testing.

Before DeepTeam, we worked on DeepEval, an open-source framework to unit-test LLMs. Some of you might be thinking, well isn’t this kind of similar to unit-testing?

Sort of, but not really. While LLM unit-testing focuses on 1) accurate eval metrics, 2) comprehensive eval datasets, penetration testing focuses on the haphazard simulation of attacks, and the orchestration of it. To users, this was a big and confusing paradigm shift, because it went from “Did this pass?” to “How can this break?”.

So we thought to ourselves, why not just release a new package to orchestrate the simulation of adversarial attacks for this new set of users and teams working specifically on AI safety, and borrow DeepEval’s evals and ecosystem in the process?

Quickstart here: https://www.trydeepteam.com/docs/getting-started#detect-your...

The first thing we did was offer as many attack methods as possible - simple encoding ones like ROT13, leetspeak, to prompt injections, roleplay, and jailbreaking. We then heard folks weren’t happy because the attacks didn’t persist across tests and hence they “lost” their progress every time they tested, and so we added an option to `reuse_simulated_attacks`.

We abstracted everything away to make it as modular as possible - every vulnerability, attack, can be imported in Python as `Bias(type=[“race”])`, `LinearJailbreaking()`, etc. with methods such as `.enhance()` for teams to plug-and-play, build their own test suite, and even to add a few more rounds of attack enhancements to increase the likelihood of breaking your system.

Notably, there are a few limitations. Users might run into compliance errors when attempting to simulate attacks (especially for AzureOpenAI), and so we recommend setting `ignore_errors` to `True` in case that happens. You might also run into bottlenecks where DeepTeam does not cover your custom vulnerability type, and so we shipped a `CustomVulnerability` class as a “catch-all” solution (still in beta).

You might be aware that some packages already exist that do a similar thing, often known as “vulnerability scanning” or “red teaming”. The difference is that DeepTeam is modular, lightweight, and code friendly. Take Nvidia Garak for example, although comprehensive, has so many CLI rules, environments to set up, it is definitely not the easiest to get started, let alone pick the library apart to build your own penetration testing pipeline. In DeepTeam, define a class, wrap it around your own implementations if necessary, and you’re good to go.

We adopted a Apache 2.0 license (for now, and probably in the foreseeable future too), so if you want to get started, `pip install deepteam`, use any LLM for simulation, and you’ll get a full penetration report within 1 minute (assuming you’re running things asynchronously). GitHub: https://github.com/confident-ai/deepteam

Excited to share DeepTeam with everyone here – let us know what you think!

Nasiko, the Open Runtime for Agents

https://www.nasiko.com/blogs/introducing-nasiko-openruntime-for-agents
1•Elof•1m ago•0 comments

Worse is better: async/await versus syntactic sugar for monadic composition

https://blog.ploeh.dk/2026/11/16/worse-is-better-asyncawait-versus-syntactic-sugar-for-monadic-co...
1•speckx•2m ago•0 comments

Show HN: Duplex-Safe Viterbi Compiler – mRNA optimization on a discrete torus

https://github.com/Dr-Logvinovich/codon-torus-syntax
1•DRLogvinovich•2m ago•0 comments

Show HN: Goethe – turn your computer into an inference engine

https://github.com/meshapplied/goethe
1•matteohorvath•4m ago•0 comments

Kubernetes Is Strengthening Its Position as the AI Platform of Choice

https://cloudnativenow.com/features/kubernetes-is-strengthening-its-position-as-the-ai-platform-o...
1•CrankyBear•8m ago•0 comments

Super Intelligence-Era Critical Infrastructure Cyber Defense Plan

https://www.a16z.news/p/super-intelligence-era-critical-infrastructure
1•rafaelc•8m ago•0 comments

Comcast's "fiber-powered Wi-Fi" is cable, AT&T says in false advertising case

https://arstechnica.com/tech-policy/2026/11/comcast-falsely-advertises-cable-internet-as-fiber-po...
5•jaredwiener•9m ago•0 comments

Show HN: WhiBoard – A fast Miro alternative with AI diagramming

https://whiboard.com/
1•pierreneter•9m ago•0 comments

Caltech professor no longer grades homework's because everyone uses AI

https://www.businessinsider.com/ai-math-class-university-homework-caltech-careers-2026-11
6•ishanz•9m ago•1 comments

Apple Watch Can Listen in on Conversations. Is That Useful or Creepy?

https://www.wsj.com/tech/personal-tech/apple-watch-amazon-bee-listening-wearables-9c26f1f5
2•cdrnsf•9m ago•0 comments

Show HN: A geography game where you aim a compass at cities on a real globe

https://compasspost.nodewires.com/
2•wedontneed•12m ago•0 comments

Funkycache: A Python library to cache functions in SQLite

https://alexwlchan.net/2026/funkycache/
1•wmchen•12m ago•0 comments

Show HN: Annotations for Your Obsidian Notes

https://community.obsidian.md/plugins/annotations
1•gyania•13m ago•0 comments

Carnegie Mellon is putting computer science courses on YouTube for free

https://www.cs.cmu.edu/learn/
3•pcompeau•13m ago•2 comments

The Financial Bubble Cycles Are Getting Worse

https://www.nytimes.com/2026/11/16/opinion/ai-bubble-finance-crisis-deregulation.html
2•edward•13m ago•0 comments

I took apart 221 security advisories. Six mistakes are behind 129 of them

https://nefariousplan.com/posts/221-case-files-six-mistakes
2•tsavo42•14m ago•0 comments

The Smallest Claude Is a Better Software Engineer Than the Biggest GPT

https://surgehq.ai/blog/claude-vs-gpt-software-engineering
2•yakkomajuri•14m ago•0 comments

AWS: AI Gets Physical: The Global Startups Readiness Index [pdf]

https://d1.awsstatic.com/onedam/marketing-channels/website/aws/en_US/product-categories/ai-ml/art...
1•myth_drannon•14m ago•0 comments

Show HN: T'Pico, a classless CSS library for modern browsers

https://github.com/dday9/t-pico
1•dday9•16m ago•0 comments

Trump backs return of ex-Nvidia boss after 'Bring Jensen Back' campaign launched

https://www.bbc.com/news/articles/cry49plv8v3go
5•tosh•18m ago•0 comments

Nations Must Die

https://marvindanig.com/blog/nations-must-die/
2•marvindanig•18m ago•0 comments

iPad and Mac Get Apple Intelligence in China in 27.3 Betas

https://www.macrumors.com/2026/11/16/ipad-mac-apple-intelligence-china/
1•tosh•19m ago•0 comments

Book: Agentic Engineering for Scientific Computing

https://agenticcomputingbook.com/
1•raikb•20m ago•0 comments

Make the change easy, then make the easy change

https://event-driven.io/en/make_the_change_easy_make_the_easy_change/
1•theanonymousone•20m ago•0 comments

WorldCraft

https://worldcraft.gg/
4•gmays•21m ago•1 comments

Running a Minecraft server and more on a 1960s UNIVAC 1219B – Nathan Farlow [video]

https://www.youtube.com/watch?v=BHjlEUk2ZhQ
1•oldnetguy•21m ago•0 comments

Professor Found a Faster Way to Crack Cold Cases

https://www.gsb.stanford.edu/insights/professor-found-faster-way-crack-cold-cases
2•atlasunshrugged•24m ago•0 comments

A job description disguised as a Google Doc (Manychat)

https://marketing-director.careers.manychat.com/
1•phobos44•24m ago•0 comments

Show HN: I built a alternative for Product Hunt – ShowStartup

https://showstartup.com/
1•sahil423•26m ago•0 comments

Why you can't admit you're wrong (even when you know it)

https://www.joanwestenberg.com/p/why-you-cant-admit-youre-wrong-even
1•ignoramous•26m ago•0 comments