But, on the other hand, I do know that LLMs have been discovering a lot of legit CVEs, and I will lay odds that the blackhats are leveraging them to the max.
In this period every part of offense and defensive cyber security changes quite rapidly.
Noisy CVEs will probably lead to agents verifying vulnerabilities before humans review them.
The problem with agent reviews from what I can think of is:
- cost to use LLMs to review things
- not necessarily easy to plug-and-play in repos: (domain knowledge + how to look for vulnerability specifically for the stack)
- especially with anthropic: able to use models defensively, without hitting guardrails.
The last one is the most interesting one to me. How does the AI providers know if you're a "good or bad" guy? And does it matter if open source is catching up?
We're in a kind of cyber arms race wether we like it or not.
Where is this one now that was hyped everywhere?
https://news.ycombinator.com/item?id=49133889
The GitHub submitter could no longer reproduce the issue and the LKML post has no replies:
https://lore.kernel.org/all/CALCETrXbj__SFQMzPZhES5y6-sh4np-...
Apparently RedHat is a CNA of last resort, so it might be possible to get your project under Redhat’s scope and go through them without having to be a CNA yourself.
I pasted this blog post from "Analysis Matrix" to the end in Gptzero, and it also says the blog post was AI-generated (71% chance of AI, 29% chance of AI-Human mix).
GPTZero AI Detection
Model 4.8bWe are moderately confident this text is a mix of AI and human
63/88Sentences likely AI generated
inigyou•39m ago
ymir_e•28m ago
The best defense I can imagine is to have an agent reproduce the issues before a human sees it, but even that will cost money.
lucideer•28m ago
SirFatty•26m ago
lucideer•14m ago
The only thing within ITAR that I'm aware of concerning itself with software supply chain is SP 800-218 requirements & that's just a load of open-to-interpretation weasel words about having CVE detection & automations in place & some defined plans for reducing the number of vulns. Pretty sure that component of it is even eligible for self-assessment.
clbrmbr•24m ago
lucideer•2m ago
- Firstly, you quickly realise how irrelevant CVSS scores are - initiatives like First's EPSS are designed to fix this but they aren't there yet
- Secondly, you need to begin implementing localised heuristics to determine exploitable code paths. This has generally been incredibly difficult to do reliably - LLMs have started to make it easier, but it's expensive.
- Lastly, you need to factor in consideration of actionable remediation pathways. A dependency upgrade for critical infrastructure might contain breaking changes that take months to fix, or two competing CVEs might be present in interdependent versions of transitive dependencies in your sbom tree.
Most orgs aren't applying any of the above three filters to reduce their CVE remediation burden, & even if they are, it's still too high to make zero a viable target.
In reality, most orgs aren't doing comprehensive detection to begin with - if you haven't discovered all of your CVEs, your remediation burden is going to be a lot more manageable.
anygivnthursday•15m ago
YeahThisIsMe•11m ago
whatevaa•25m ago
ape4•25m ago
cleansy•21m ago
smitty1110•18m ago
Something is going to give, and I suspect that the optimistic open filling is going to get canceled.