frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Ask HN: Which CVEs should I add to my Python security benchmark for AI agents?

https://github.com/GiovanniGatti/cve-bench
1•ggattip•42m ago

Comments

ggattip•42m ago
I wrote CVE-Bench two months ago: an open source benchmark with 20 real-world security vulnerabilities designed to test AI agents' ability to discover and repair security vulnerabilities. I'm expanding it by 10 more tasks and I'd like the community's input on what I'm building. Which CWE categories or specific CVEs should I prioritize?

===

Current CVEs are

CVE-2025-64512 (pdfminer.six)

CVE-2026-22250 (WeblateOrg/wlc)

CVE-2026-24486 (python-multipart)

CVE-2026-26331 (yt-dlp)

CVE-2026-30930 (glances)

CVE-2026-32714 (scitokens)

CVE-2026-33175 (jupyterhub/oauthenticator)

CVE-2026-33545 (MobSF)

CVE-2026-35171 (kedro)

CVE-2026-40864 (jupyterhub)

CVE-2026-42215 (GitPython)

CVE-2026-42310 (Pillow)

CVE-2026-42351 (pygeoapi)

CVE-2026-42561 (python-multipart)

CVE-2026-44307 (mako)

CVE-2026-44431 (urllib3)

CVE-2026-44432 (urllib3)

CVE-2026-44502 (bugsink)

CVE-2026-45017 (liquid)

GHSA-r758-8hxw-4845 (justhtml)

===

CWE are

CWE-22 (Path Traversal): 4

CWE-89 (SQL Injection): 3

CWE-502 (Deserialization): 2

CWE-78 (OS Command Injection): 2

CWE-287 / CWE-290 (Auth bypass): 1 each

CWE-295, CWE-94, CWE-352, CWE-835, CWE-770, CWE-200, CWE-409, CWE-918, CWE-79: 1 each

===

I know it is a bit concentrated and I'd like to bring in more relevant cases.

I'd like to have recommendations on CWEs you'd like to see in CVE-Bench or even specific CVEs you'd like added.

If you're providing specific CVEs, I have a few requirements

* Must be a pure-Python project (otherwise I'll have trouble setting up the running environment);

* Preferably a known real-world project or library;

* Local project setup should be relatively simple, not a 4h nightmare.

* The CVE description should be reasonably well documented.

Which CWEs am I missing, or what specific CVE would you add, given those constraints?

Thanks for the contribution

Show HN: Plox – Lox compiler in ~600 LOC from the 'Crafting Interpreters' book

https://github.com/eliasdejong/plox
1•eliasdejong•34s ago•0 comments

I regret to report that the AIs are weebs, too

https://www.pcgamer.com/software/ai/i-regret-to-report-that-the-ais-are-weebs-too/
1•Brajeshwar•43s ago•0 comments

Show HN: GapQuery – find app-market gaps from 35,600 apps and their reviews

https://www.gapquery.com
1•northify•1m ago•0 comments

Snapshots, copy-on-write, and the economics of agent sandboxes

https://builders.cortex.io/blog/sandboxing-agents-part-2/
1•nikhilunni•1m ago•0 comments

Show HN: Batchedits – Batch AI video editor to edit content in volume

https://batchedits.com
1•shayannadeem321•1m ago•0 comments

PasteFlow

https://chromewebstore.google.com/detail/pasteflow/paenffoomjmkonbgkmfdbnfaljoiilgm
1•rbediner•2m ago•0 comments

Sunglasses: An open-source input scanner for AI agents

https://github.com/sunglasses-dev/sunglasses
1•azrollin•4m ago•0 comments

Robots.txt – Just Crawl It

https://www.nike.com/robots.txt
1•bfoks•4m ago•0 comments

Show HN: Carta – An open-source pandoc reimplementation in Rust

https://github.com/mfkrause/carta
1•mfkrause•6m ago•0 comments

Arctic: a lock-free concurrent ordered map for Rust

https://old.reddit.com/r/rust/comments/1v4f05y/announcing_arctic_a_lockfree_concurrent_ordered/
1•arto•6m ago•0 comments

OHMG: One Hot Modular Garbling

https://eprint.iacr.org/2025/2338
1•wslh•7m ago•0 comments

Show HN: 5dive – Run a Company of Claude Code/Codex Agents (Written in Bash)

https://github.com/5dive-ai/5dive
1•lodar•7m ago•0 comments

Thoughts on Integers

https://blog.xoria.org/integers/
1•vinhnx•8m ago•0 comments

Hosted PaddleOCR-VL-1.6 API

4•TimurKramar•9m ago•0 comments

Even camels can't cope: Africa's ships of the desert hit by rising temperatures

https://www.bbc.com/news/articles/cqlxvvw06pqo
1•throw0101d•9m ago•0 comments

My Agentic Coding Setup, July 2026

https://domenic.me/agentic-coding-setup/
2•domenicd•9m ago•0 comments

15 years of hand-curated architecture, art and design as an MCP server

https://www.thisispaper.com/intelligence/api-docs
1•zaxarov•10m ago•0 comments

SwiftUI After 7 Years: A Story of Mediocrity [video]

https://www.youtube.com/watch?v=3XaHHFOZeJg
1•mpweiher•10m ago•0 comments

AI Agent: "Strongest Assistant" or "Legal Virus"

https://twitter.com/TrustKernelTech/status/2077035288799449092
1•PlugMate•11m ago•0 comments

Proton uses Rust to build secure cross-platform apps for people

https://kerkour.com/proton-apps-rust
1•arto•12m ago•0 comments

How much energy do data centers and artificial intelligence use?

https://ourworldindata.org/how-much-energy-do-data-centers-and-artificial-intelligence-use
3•surprisetalk•12m ago•0 comments

OnePanel – All your apps. One place

https://onepanel.it/
2•evhalon•12m ago•0 comments

Show HN: Whetuu – a zero-config cross-shell prompt written in Zig

https://yamafaktory.github.io/whetuu/
2•yamafaktory•15m ago•0 comments

EU approves Saudi PIF's $55B acquisition of Electronic Arts

https://www.globalbankingandfinance.com/saudi-pifs-55-billion-ea-deal-approved-eu-merger-rules/
3•theHocineSaad•15m ago•0 comments

I learned PCB design, 3D printing and C just to listen to music

https://pentaton.app/blog/2026-07-12-introducing-pentaton-lp/
1•interfeco•16m ago•1 comments

Rust service hardening and production checklist

https://kerkour.com/rust-service-hardening-and-production-checklist
1•speckx•17m ago•0 comments

Not just development, distribution of software may change as well

https://antirez.com/news/170
1•Brajeshwar•20m ago•0 comments

Show HN: macOS menu-bar manager for SSH port forwards

https://github.com/lx2026/RelayBar
1•linxy97•20m ago•0 comments

Show HN: Remux – an open-source tmux workspace designed for iPhone

https://github.com/h3nock/remux
2•bitwise42•21m ago•0 comments

Frontier model evaluation for Physical AI

https://juliahub.com/blog/frontier-models-physical-ai-evaluation
1•ViralBShah•22m ago•0 comments