I get into a regular pattern of asking Claude, ChatGPT, or a local model how I'd write a command or do something with some files or a prompt, then going back to the terminal with a mad-lib command and reasoning through it.
So I built goulash. It takes up the bottom four lines of your terminal as a place to comment on your session and suggest commands that you can select by hitting down arrow to select your "future history", staying in flow with up arrow for history in most shells. Want to ask it a direct command question? Just type "# your question" and hit enter, and it will take that inline comment and make a suggestion.
Running a suggested command is always up to the user. Hit down arrow to scroll through suggestions, modify if you want, hit enter to execute.
This is made for running with local engines hosting local-friendly models, like Ollama or LM Studio with gemma4:e4b on a Macbook Air. It relies heavily on context caching to stay snappy, but goulash doesn't block as it thinks or runs. It's a ride-along in the passenger seat.
Have a tweaky command set that your tiny model doesn't know? Use "#@ YourCommandReference.md" to give that gemma4:e4b (or whatever) a guide as a pin for the session, or use it to temporarily style your life (e.g., I have a FarmAnimals.md file that adds a barnyard joke to any comment. Hey... the tokens are local...).
Written in rust, largely with Fable and Opus 5. Tested with zsh and bash on Mac. Check out the repo, or install with "cargo install goulash".