Make Trust Irrelevant: A Gamer's Take on Agentic AI Safety

https://github.com/Deso-PK/make-trust-irrelevant

9•DesoPK•2h ago

I wrote a short position paper arguing that current agentic AI safety failures are the confused deputy problem on repeat. We are handing agents ambient authority and trying to contain it with soft constraints like prompts and userland wrappers. My take: you need hard, reduce-only authority enforced at a real boundary (kernel control plane class), not something bypassable from userland. Curious how others are modeling this. What constraints do you think are truly non-negotiable?

Comments

mzajc•1h ago

Was this written with a LLM? If so, please add a note about it at the start of the README.

solidasparagus•1h ago

People want convenience more than they want security. No one wants permission grants to go away in minutes or hours. Every time the agent is stopped by permissions grant check, the average user experience is a little worse.

zb3•1h ago

> I wrote a short position

> "Reality check"

Hi GPT :)

twentyfiveoh1•1h ago

I thought "surely they wouldn't ...." The issues in the article are more blatant. You were right and caught it extremely quickly.

skybrian•49m ago

Here are some important differences:

- The players in competitive games don't write code. Coding agents do. When you copy the code outside the sandbox and run it, what permissions does it get?

- Game players usually don't have access to confidential material, so you don't need to prevent them from exfiltrating it.

OpenCiv3: Open-source, cross-platform reimagining of Civilization III

The Waymo World Model

How we made geo joins 400× faster with H3 indexes

A century of hair samples proves leaded gas ban worked

Monty: A minimal, secure Python interpreter written in Rust for use by AI

Show HN: Look Ma, No Linux: Shell, App Installer, Vi, Cc on ESP32-S3 / BreezyBox

Dark Alley Mathematics

Show HN: I spent 4 years building a UI design tool with only the features I use

Microsoft open-sources LiteBox, a security-focused library OS

Show HN: If you lose your memory, how to regain access to your computer?

Sheldon Brown's Bicycle Technical Info

Hackers (1995) Animated Experience

PC Floppy Copy Protection: Vault Prolok

Show HN: ARM64 Android Dev Kit

An Update on Heroku

Delimited Continuations vs. Lwt for Threads

How to effectively write quality code with AI

Show HN: R3forth, a ColorForth-inspired language with a tiny VM

I spent 5 years in DevOps – Solutions engineering gave me what I was missing

Learning from context is harder than we thought

Introducing the Developer Knowledge API and MCP Server

Understanding Neural Network, Visually

Female Asian Elephant Calf Born at the Smithsonian National Zoo

I now assume that all ads on Apple news are scams

FORTH? Really!?

I'm going to cure my girlfriend's brain tumor

Evaluating and mitigating the growing risk of LLM-discovered 0-days

Show HN: Smooth CLI – Token-efficient browser for AI agents

How virtual textures work

Show HN: Slack CLI for Agents