frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Show HN: Gerbil – an open source desktop app for running LLMs locally

https://github.com/lone-cloud/gerbil
30•lone-cloud•2d ago
Gerbil is an open source app that I've been working on for the last couple of months. The development now is largely done and I'm unlikely to add anymore major features. Instead I'm focusing on any bug fixes, small QoL features and dependency upgrades.

Under the hood it runs llama.cpp (via koboldcpp) backends and allows easy integration with the popular modern frontends like Open WebUI, SillyTavern, ComfyUI, StableUI (built-in) and KoboldAI Lite (built-in).

Why did I create this? I wanted an all-in-one solution for simple text and image-gen local LLMs. I got fed up with needing to manage multiple tools for the various LLM backends and frontends. In addition, as a Linux Wayland user I needed something that would work and look great on my system.

Comments

throwaway81998•10h ago
Serious question, not a "what's the point of this" shitpost... My experience with local LLMs is limited.

Just installed LM Studio on a new machine today (2025 Asus ROG Flow Z13, 96GB VRAM, running Linux). Haven't had the time to test it out yet.

Is there a reason for me to choose Gerbil instead? Or something else entirely?

A4ET8a8uTh0_v2•10h ago
Not OP, but I am running ollama as a testing ground for various projects ( separately from gpt sub ).

<< Is there a reason for me to choose Gerbil instead? Or something else entirely?

My initial reaction is positive, because it seems to integrate everything without sacrificing being able to customize it further if need be. That said, did not test it yet, but now I will.

lone-cloud•7h ago
Holy, your machine is a beast. 96GB of VRAM is pretty insane. I've been running a single 16GB VRAM AMD GPU. At the bottom of Gerbil's readme I listed out my setup where I use a 27b text gen model (gemma 3) but you'll be able to use much larger models and everything will run super fast.

Now as for your question, I started out with LM studio too, but the problem is that you'll need to juggle multiple apps if you want to do text gen or image gen or if you want to use a custom front-end. As an example, my favorite text gen front-end is "open webui" which gerbil can automatically set up for you (as long as you have Python's uv pre-installed). Gerbil will allow you to run text, image and video gen, as well as set up (and keep updated) any of the front-ends that I listed in my original post. I could be wrong but I'm not sure if LM studio can legally integrate GLP licensed software in the same way that Gerbil can because it's a closed source app.

throwaway81998•6h ago
Thanks for the reply, I'll give Gerbil a try.
WillAdams•8h ago
The big feature which I would like to see is a way to easily interact with the content of the local filesystem --- I have a prompt for re-naming scans based on parsing their content which I've been using in Copilot --- recent changes require that I:

- launch Copilot

- enter a prompt to get it into Copilot Pages mode

- click a button to actually get into that mode

- paste in the prompt

- drag in 20 files

- wait for them to upload

- click the button to process the prompt on the uploaded files

- quit Copilot, launch Copilot, delete the conversation, quit, launch Copilot and have it not start, which then allows repeating from the beginning

It would be much easier if I could just paste in the prompt specifying a folder full of files for it to run on, then clear that folder out for the next day's files and repeat.

Would that be something which your front-end could do? If not, is there one which could do that now? (apparently jan.ai has something like this on their roadmap for 0.8)

lone-cloud•6h ago
I believe what you're describing is outside of the scope of Gerbil. Gerbil is not an LLM front-end, but Gerbil will run your LLM and seamlessly integrate (orchestrate) it with a custom front-end from the list in my original message. I believe this functionality will need to live in a custom front-end. I'm curious how jan.ai is planning on handling this. I'm guessing they're writing their own custom front-ends which is probably tightly integrated with their system.

Show HN: Akashi Notari – On-chain Proof of Existence for any file in 60s for <$1

https://akashi-notari.com/
2•takeshi_w•1h ago•0 comments

Show HN: AI Bubble Monitor

https://aibubblemonitor.com
4•itsnotmyai•2h ago•0 comments

Show HN: I made an open-source Rust program for memory-efficient genomics

https://github.com/logannye/rosalind
10•logannyeMD•8h ago•0 comments

Show HN: Gerbil – an open source desktop app for running LLMs locally

https://github.com/lone-cloud/gerbil
30•lone-cloud•2d ago•6 comments

Show HN: Cancer diagnosis makes for an interesting RL environment for LLMs

41•dchu17•18h ago•20 comments

Show HN: I built a platform where audiences fund debates between public thinkers

https://logosive.com
32•mcastle•14h ago•32 comments

Show HN: Chime – Full-screen meeting alerts for time blindess (macOS)

https://www.usechime.app/
3•tsormed•8h ago•0 comments

Show HN: Cactoide – Federated RSVP Platform

https://cactoide.org/
66•orbanlevi•1d ago•28 comments

Show HN: SkillGraph – Open-source agentic framework with skills instead of tools

https://github.com/tejassudsfp/skillgraph-backend
12•tejassuds•21h ago•0 comments

Show HN: Made MadLibs-style game to play with my kids

https://www.storygaps.org/
2•ronbenton•9h ago•0 comments

Show HN: ShellDash – Browser server dashboard with SSH and globe monitoring

https://shelldash.com
4•mannders•15h ago•0 comments

Show HN: Invisitris a Tetris-like game, where the placed pieces become invisible

https://invisitris.bitechunk.com/
4•eddguzzo•11h ago•1 comments

Show HN: Data Formulator – interactive AI agents for data analysis (Microsoft)

https://data-formulator.ai/
36•chenglong-hn•1d ago•11 comments

Show HN: Tusk Drift – Open-source tool for automating API tests

https://github.com/Use-Tusk/drift-node-sdk
53•Marceltan•1d ago•17 comments

Show HN: The Prompt Engineering Bible – Complete Guide to AI Communication

https://dimitriosmitsos.gumroad.com/l/prompt-engineering-bible
3•Cranot•12h ago•0 comments

Show HN: Open-Source LaTeX OCR, Alternative to Mathpix/SimpleTex

https://texocr.netlify.app/
3•alephpi•19h ago•0 comments

Show HN: KV Marketplace – share LLM attention caches across GPUs like memcached

https://github.com/neelsomani/kv-marketplace
2•nsomani•13h ago•1 comments

Show HN: SecurVO – Compliance management for service businesses

https://securVO.com
2•AaronKushner•13h ago•0 comments

Show HN: ChatExport Structurer – parse ChatGPT/Claude exports into queryable SQL

https://github.com/1ch1n/chat-export-structurer
2•chan1•14h ago•0 comments

Show HN: Venturu – Zillow for the market of local businesses

https://www.venturu.com
32•lifenautjoe•1d ago•36 comments

Show HN: Get an email when your favorite director releases a movie

https://www.premierepal.com/
2•samteeeee•14h ago•0 comments

Show HN: Built a tiny interpreter from scratch in C to understand how they work

https://github.com/renvins/toyforth-interpreter
4•renvins•14h ago•0 comments

Show HN: Creavi Macropad – Built a wireless macropad with a display

https://creavi.tech/blog/creavi-macropad-build-log/
31•cmpx•1d ago•7 comments

Show HN: Gametje – A casual online gaming platform

https://gametje.com
111•jmpavlec•1d ago•40 comments

Show HN: YaraDB – Lightweight open-source document database built with FastAPI

https://github.com/illusiOxd/yaradb
9•ashfromsky•1d ago•1 comments

Show HN: What Is Hacker News Working On?

https://waywo.eamag.me/
221•eamag•6d ago•51 comments

Show HN: Vibemail – AI-powered MJML email editor that runs in the browser

https://vibemail-beta.vercel.app/
2•elliotbnvl•16h ago•0 comments

Show HN: DeltaGlider – Store 4TB of build artifacts in 5GB

https://github.com/beshu-tech/deltaglider
7•sscarduzio•1d ago•2 comments

Show HN: SQL++ – 5x faster than Prisma (Rust)

https://github.com/sinisterMage/sqlpp
2•SinisterMage2•18h ago•2 comments

Show HN: JavaScript Engines Zoo

https://github.com/ivankra/javascript-zoo
2•ivankra•19h ago•0 comments