Show HN: Prompt injection detector beats ProtectAI by 19% accuracy, 8.9x smaller

https://huggingface.co/hlyn/prompt-injection-judge-deberta-70m

3•Karan047•1d ago

ProtectAI's deberta-v3 is the most downloaded prompt injection classifier on HuggingFace. We benchmarked directly against it on Qualifire's independent dataset (excluded from our training).

* 91.68% vs 72.28% accuracy

* 95.84% vs 65.33% precision — they block 1 in 3 legitimate users

* 83MB vs 739MB ONNX size

* 101ms vs 646ms on CPU

Comments

prabhkesar•1d ago

Prompt injection will never be solved. Instruction following is the product.

Karan047•1d ago

Nothing in cybersecurity is truly solved—only made harder, Prompt injection is no different.

Repository Pattern with Hygienic Macros in Scheme – Lisp

The Music of the Spheres: SMBC 5 part comic co-authored with Terry Tao

Show HN: Go language extension with HTML templates

Show HN: The Stack, a Clay sculpture that writes poems through Wi-Fi [video]

Gender Medicine Set Itself Up for Disaster

Show HN: Polter – Agent Driven UI (react library)

The Building Block Economy – Mitchell Hashimoto

Untaxed hidden wealth surpasses wealth of the poorest half of humanity

We're Getting the Wrong Message from Mythos

Mesurer: Measure and Align Everything on Localhost

Supply chain attack on CPU-Z and HWMonitor

US plans to automatically register young men for military draft

Show HN: Open-Source MCP Servers – Twitter, Bluesky, LinkedIn, Google Ads, HN

Elastic Tabstops (2006)

Show HN: Emduke32 – duke nukem 3D native in your web browser

Show HN: Hindsight Simulator – Go back in time and get rich

Startup Focido joins the Limb accelerator

Running Terraform against Azure locally, without a subscription

Show HN: Nvim plugin to jump to concrete interface implementation for Python

TOON: Token-Oriented Object Notation

Kintify AI tool to analyze cloud issues and suggest fixes

Show HN: Mantyx – Agents that solve real problems for you and your business

Architecting the Autonomous Enterprise with Agentic Workflows

I shipped a transaction bug, so I built a linter

Surelock

LLM Wiki v2 – extends Karpathy's take on LLM wiki

For AI, energy is the final frontier

We pay you 2x back if you follow the plan and miss your goal – 30 free codes

From $11/Month to $0: How I Used AI to Reclaim My Evening

Show HN: Keeper – embedded secret store for Go (help me break it)