> No guardrail catches everything. Recall runs %76 - %96 depending on distribution and obfuscation; it is never 100%.
That seems incompatible to me with the example given at the top of the README where a failure results in "$84,200 is wired out".
This list of regular expressions does not inspire confidence for the methodology: https://github.com/cgrtml/reasongate/blob/91f45ae568ce53db08...
_PATTERNS: List[Tuple[str, str, float]] = [
(r"ignore\s+(all\s+)?(previous|prior|above)\s+instructions", "ignore previous instructions", 0.9),
(r"disregard\s+(the\s+)?(above|previous|system)", "disregard the above", 0.8),
# TR patterns are diacritic-tolerant: match both "onceki tum" and "önceki tüm".
(r"[öo]nceki\s+(t[üu]m\s+)?(talimatlar[ıi]|komutlar[ıi])\s+(yoksay|g[öo]zard[ıi]|unut)", "ignore previous instructions (TR)", 0.9),
(r"(reveal|show|print|repeat)\s+(your\s+)?(system\s+)?(prompt|instructions)", "reveal the system prompt", 0.9),
# ...
Those are all in English. Prompt injections can come in any spoken human language (and all sorts of other non-human languages too.)
cyanydeez•26m ago