Looks cool. What kind of delay would it add to a chatbot application?
dwa3592•4h ago
Author here. I need to calculate the timing delay but I don't feel any difference in speed in my local chatbot app, where every prompt is filtered. I am on Mac M3, 16GB.
droobytrain•4h ago
dwa3592•4h ago