frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Show HN: Gerbil – an open source desktop app for running LLMs locally

https://github.com/lone-cloud/gerbil
37•lone-cloud•2mo ago
Gerbil is an open source app that I've been working on for the last couple of months. The development now is largely done and I'm unlikely to add anymore major features. Instead I'm focusing on any bug fixes, small QoL features and dependency upgrades.

Under the hood it runs llama.cpp (via koboldcpp) backends and allows easy integration with the popular modern frontends like Open WebUI, SillyTavern, ComfyUI, StableUI (built-in) and KoboldAI Lite (built-in).

Why did I create this? I wanted an all-in-one solution for simple text and image-gen local LLMs. I got fed up with needing to manage multiple tools for the various LLM backends and frontends. In addition, as a Linux Wayland user I needed something that would work and look great on my system.

Comments

throwaway81998•2mo ago
Serious question, not a "what's the point of this" shitpost... My experience with local LLMs is limited.

Just installed LM Studio on a new machine today (2025 Asus ROG Flow Z13, 96GB VRAM, running Linux). Haven't had the time to test it out yet.

Is there a reason for me to choose Gerbil instead? Or something else entirely?

A4ET8a8uTh0_v2•2mo ago
Not OP, but I am running ollama as a testing ground for various projects ( separately from gpt sub ).

<< Is there a reason for me to choose Gerbil instead? Or something else entirely?

My initial reaction is positive, because it seems to integrate everything without sacrificing being able to customize it further if need be. That said, did not test it yet, but now I will.

lone-cloud•2mo ago
Holy, your machine is a beast. 96GB of VRAM is pretty insane. I've been running a single 16GB VRAM AMD GPU. At the bottom of Gerbil's readme I listed out my setup where I use a 27b text gen model (gemma 3) but you'll be able to use much larger models and everything will run super fast.

Now as for your question, I started out with LM studio too, but the problem is that you'll need to juggle multiple apps if you want to do text gen or image gen or if you want to use a custom front-end. As an example, my favorite text gen front-end is "open webui" which gerbil can automatically set up for you (as long as you have Python's uv pre-installed). Gerbil will allow you to run text, image and video gen, as well as set up (and keep updated) any of the front-ends that I listed in my original post. I could be wrong but I'm not sure if LM studio can legally integrate GLP licensed software in the same way that Gerbil can because it's a closed source app.

throwaway81998•2mo ago
Thanks for the reply, I'll give Gerbil a try.
WillAdams•2mo ago
The big feature which I would like to see is a way to easily interact with the content of the local filesystem --- I have a prompt for re-naming scans based on parsing their content which I've been using in Copilot --- recent changes require that I:

- launch Copilot

- enter a prompt to get it into Copilot Pages mode

- click a button to actually get into that mode

- paste in the prompt

- drag in 20 files

- wait for them to upload

- click the button to process the prompt on the uploaded files

- quit Copilot, launch Copilot, delete the conversation, quit, launch Copilot and have it not start, which then allows repeating from the beginning

It would be much easier if I could just paste in the prompt specifying a folder full of files for it to run on, then clear that folder out for the next day's files and repeat.

Would that be something which your front-end could do? If not, is there one which could do that now? (apparently jan.ai has something like this on their roadmap for 0.8)

lone-cloud•2mo ago
I believe what you're describing is outside of the scope of Gerbil. Gerbil is not an LLM front-end, but Gerbil will run your LLM and seamlessly integrate (orchestrate) it with a custom front-end from the list in my original message. I believe this functionality will need to live in a custom front-end. I'm curious how jan.ai is planning on handling this. I'm guessing they're writing their own custom front-ends which is probably tightly integrated with their system.
WillAdams•2mo ago
Very hopeful of the multi-file stuff from jan.ai --- in the meanwhile, it's easier using Co-pilot for this than:

- isolating 50 files at a time

- dragging them into Adobe Acrobat

- closing each w/ ctrl w

- tapping enter to confirm saving

- typing the Invoice ID

- repeating until all 50 have been done, then remembering to quite Adobe Acrobat so as to re-launch it and repeat (can't leave it running, because there is a (reported) bug where after doing this several times, it stops saving)

- running a batch file made from a concatenated column in a spreadsheet to rename the files

The next question is when there will be an LLM front-end which can:

- open each file in a folder, parsing the content

- open each file in a PDF viewer

- fill in the entry fields of a Java application

- wait for the user to review both windows, if necessary, correct/update what was entered and save, then repeat for the next file

Ah well, job secure, even when that happens (though maybe hours would be cut back?) --- the big question is when LLMs will be reliable enough that human review is no longer viewed as worth the expense of a salary.

tell_me_whai•2mo ago
Hey, funny finding you comment as I've actually recently been developing a CLI app to improve LLM integration in my filesystem. Not sure what you are doing with your files, but maybe it could be useful for you too! You can check it out on my github (https://github.com/gael-vanderlee/whai) and hopefully that can help you with your use case. Look into roles in particular, as they allow you to save and reuse specific workflows.
radial_symmetry•2mo ago
I like that it has image generation without all the complication of ComfyUI. Can it load LoRA?
lone-cloud•2mo ago
Gerbil's built-in image generation is based on "StableUI" and I also prefer its super simple UI. Yes, you can load your own LoRa from the "Image Generation" tab. Gerbil also includes the optional ComfyUI integration from the settings for very advanced users. Its graph-based UI is a bit too advanced for me personally.
tell_me_whai•2mo ago
Does this allow for mixing LLMs and Image Gen? I find LLMs really useful to generate image prompts that diffusion models understand (which can be tedious to do manually). Although you need very detailed system prompts to teach what Image Gen models expect.
lone-cloud•2mo ago
That's how the pros do it. Yes, you can load both a text and image gen models at the same time. Needless to say you'll need a very beefy GPU(s) to do this so I wouldn't recommend it unless you know exactly what you're doing as generally you'll want to max out your VRAM for one model at a time for the highest quality results. Open webui and sillytavern allow both text and image gen from the same UI although I wouldn't recommend it for advanced users. Otherwise Gerbil will give you multiple pages to toggle through via the titlebar dropdown.

Show HN: LocalGPT – A local-first AI assistant in Rust with persistent memory

https://github.com/localgpt-app/localgpt
102•yi_wang•3h ago•29 comments

Bye Bye Humanity: The Potential AMOC Collapse

https://thatjoescott.com/2026/02/03/bye-bye-humanity-the-potential-amoc-collapse/
14•rolph•1h ago•3 comments

SectorC: A C Compiler in 512 bytes (2023)

https://xorvoid.com/sectorc.html
244•valyala•11h ago•46 comments

Haskell for all: Beyond agentic coding

https://haskellforall.com/2026/02/beyond-agentic-coding
46•RebelPotato•3h ago•9 comments

Speed up responses with fast mode

https://code.claude.com/docs/en/fast-mode
159•surprisetalk•11h ago•150 comments

Software factories and the agentic moment

https://factory.strongdm.ai/
190•mellosouls•14h ago•335 comments

Homeland Security Spying on Reddit Users

https://www.kenklippenstein.com/p/homeland-security-spies-on-reddit
34•duxup•1h ago•6 comments

Brookhaven Lab's RHIC concludes 25-year run with final collisions

https://www.hpcwire.com/off-the-wire/brookhaven-labs-rhic-concludes-25-year-run-with-final-collis...
68•gnufx•10h ago•56 comments

LLMs as the new high level language

https://federicopereiro.com/llm-high/
58•swah•4d ago•105 comments

Hoot: Scheme on WebAssembly

https://www.spritely.institute/hoot/
178•AlexeyBrin•16h ago•33 comments

Stories from 25 Years of Software Development

https://susam.net/twenty-five-years-of-computing.html
168•vinhnx•14h ago•17 comments

Why there is no official statement from Substack about the data leak

https://techcrunch.com/2026/02/05/substack-confirms-data-breach-affecting-email-addresses-and-pho...
8•witnessme•35m ago•1 comments

First Proof

https://arxiv.org/abs/2602.05192
130•samasblack•13h ago•76 comments

Vocal Guide – belt sing without killing yourself

https://jesperordrup.github.io/vocal-guide/
307•jesperordrup•21h ago•96 comments

Total Surface Area Required to Fuel the World with Solar (2009)

https://landartgenerator.org/blagi/archives/127
11•robtherobber•4d ago•2 comments

Show HN: I saw this cool navigation reveal, so I made a simple HTML+CSS version

https://github.com/Momciloo/fun-with-clip-path
75•momciloo•11h ago•16 comments

Vouch

https://twitter.com/mitchellh/status/2020252149117313349
49•chwtutha•2h ago•8 comments

FDA intends to take action against non-FDA-approved GLP-1 drugs

https://www.fda.gov/news-events/press-announcements/fda-intends-take-action-against-non-fda-appro...
111•randycupertino•6h ago•229 comments

Al Lowe on model trains, funny deaths and working with Disney

https://spillhistorie.no/2026/02/06/interview-with-sierra-veteran-al-lowe/
99•thelok•13h ago•22 comments

Start all of your commands with a comma (2009)

https://rhodesmill.org/brandon/2009/commands-with-comma/
573•theblazehen•3d ago•207 comments

Show HN: A luma dependent chroma compression algorithm (image compression)

https://www.bitsnbites.eu/a-spatial-domain-variable-block-size-luma-dependent-chroma-compression-...
37•mbitsnbites•3d ago•4 comments

The AI boom is causing shortages everywhere else

https://www.washingtonpost.com/technology/2026/02/07/ai-spending-economy-shortages/
299•1vuio0pswjnm7•17h ago•475 comments

Microsoft account bugs locked me out of Notepad – Are thin clients ruining PCs?

https://www.windowscentral.com/microsoft/windows-11/windows-locked-me-out-of-notepad-is-the-thin-...
139•josephcsible•9h ago•166 comments

Selection rather than prediction

https://voratiq.com/blog/selection-rather-than-prediction/
31•languid-photic•4d ago•12 comments

I write games in C (yes, C) (2016)

https://jonathanwhiting.com/writing/blog/games_in_c/
185•valyala•11h ago•168 comments

Learning from context is harder than we thought

https://hy.tencent.com/research/100025?langVersion=en
231•limoce•4d ago•125 comments

The silent death of good code

https://amit.prasad.me/blog/rip-good-code
89•amitprasad•5h ago•81 comments

OpenCiv3: Open-source, cross-platform reimagining of Civilization III

https://openciv3.org/
900•klaussilveira•1d ago•276 comments

Where did all the starships go?

https://www.datawrapper.de/blog/science-fiction-decline
147•speckx•4d ago•229 comments

Unseen Footage of Atari Battlezone Arcade Cabinet Production

https://arcadeblogger.com/2026/02/02/unseen-footage-of-atari-battlezone-cabinet-production/
145•videotopia•4d ago•48 comments