frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Ask HN: What's your top-recommended tuts for chatbot dev with local-hosted LLMs?

1•dualogy•1h ago
"Locally-runnable, CPU-not-just-GPU-permitting LLMs for chatbot dev" probably means Llama, right? Or are there other contenders on par and worth (co)considering?

I'm late to the game (no regrets), having had simply zero inspirations until now for any kind of chatbot dev. So I wanna skip all the already-outdated (or hallucinated) tuts a simple web search might probably yield (given today's web search quality especially...)

This toy I'll tinker on will be foss&fully-free, no startup stuff.. so not looking for some bleeding edge. Will be sth like SocialAI but more limited in various ways (stuff I don't care for) and yet offline-capable and with way more user-side tweakability of the nature/inclinations/worldview/opinions/conditioning of the (majority of) bots. That's the angle I wanna experiment on, to bring "make your sufficiently-plausible filter bubble of interest for entertainment value, and observe it unfolding by itself over time". So for amusement, but should be interesting.

So yeah, thanks for sharing here which blogs/videos/other-tuts take the coder from (near)zero to CustomTargetedChatbot(s)HelloWorld, are recent / current and building ideally specifically on (LLMs with) an offline / local setup. I only know these things as prompt textareas so far, not as configurable hackable API surfaces..

On the off-chance there's a pre-LLM-era or non-LLM alternative (foss lib or sdk in any lang/stack) that you'd recommend, ie. better-than-Eliza but non/pre-LLMs, I'd be interested too =)

Show HN: Factorio Machine Solver

https://rtheunissen.github.io/factorio-solver/
1•rtheunissen•1m ago•0 comments

GPT-image-1 prompted to "create the same image" 74 times

https://old.reddit.com/r/ChatGPT/comments/1n8dung/chatgpt_prompted_to_create_the_exact_replica_of/
2•SweetSoftPillow•5m ago•0 comments

Ask HN: Do businesses want to leave the cloud and return to installable apps?

1•cyrusradfar•6m ago•0 comments

PBM Drug Pricing Distortion Report

https://www.46brooklyn.com/research/welcome-to-private-label-park-nuf485-8h5kw-wk8y2
1•toomuchtodo•9m ago•1 comments

An Extreme Tree Hunt in the Sierra Nevada

https://www.ucdavis.edu/climate/news/extreme-tree-hunt-sierra-nevada
1•tomjakubowski•10m ago•0 comments

Dalhalla – a concert venue in an old quarry

https://www.dalhalla.se/infor-ditt-besok/
1•Vermin2000•12m ago•1 comments

"Captions With Attitude" in the browser from local VLM using llama.cpp in Go

https://github.com/hybridgroup/captions-with-attitude
1•deadprogram•12m ago•0 comments

From Deep Blue Mud, Unexpected Life Emerges

https://nautil.us/from-deep-blue-mud-unexpected-life-emerges-1247288/
1•curtistyr•14m ago•0 comments

Backblaze Q3 2025 Drive Stats: Failure Rates Climb and Outliers Emerge

https://www.storagereview.com/news/backblaze-q3-2025-drive-stats-failure-rates-climb-outliers-eme...
2•speckx•16m ago•0 comments

Collaboration Sucks

https://newsletter.posthog.com/p/collaboration-sucks
8•Kinrany•16m ago•0 comments

USN-7867-1: sudo-rs vulnerabilities

https://ubuntu.com/security/notices/USN-7867-1
1•transpute•18m ago•0 comments

Ask HN: How to find something to work on for myself?

2•StuckWorking•19m ago•2 comments

Microplastics: No Longer a "Maybe"

https://ibbi.io/mp
18•ibbih•19m ago•3 comments

Sniffing established BLE connections with HackRF One

https://blog.lexfo.fr/sniffing-ble-sdr.html
2•fcambus•23m ago•0 comments

The Complete Event Sourcing Guide

https://www.eventsourcing.dev/
1•patriceckhart•24m ago•2 comments

What's New in F# 10

https://learn.microsoft.com/en-us/dotnet/fsharp/whats-new/fsharp-10
1•DASD•25m ago•1 comments

Monitoring Poor Chatbot Experiences

https://napsty.com/blog/monitoring-ai-chatbot-failures-with-braintrust
1•gaieges•26m ago•0 comments

Hornchurch Cutting

https://en.wikipedia.org/wiki/Hornchurch_Cutting
2•zeristor•26m ago•0 comments

Instant Parameter Selection for Modular Systems (b, p, t, r)

1•Patternician•27m ago•0 comments

The Web We've Built: Documentary

https://archive.org/details/the-web-weve-built-documentary
1•robin_reala•27m ago•0 comments

NVMe2K – Windows NT 3.51-Windows 2000 NVMe driver

https://www.youtube.com/watch?v=gvT9-ZfW1Iw
1•nxobject•28m ago•0 comments

Google is introducing its own version of Apple's private AI cloud compute

https://www.theverge.com/news/818364/google-private-ai-compute
9•speckx•31m ago•0 comments

The Terminal of the Future

https://jyn.dev/the-terminal-of-the-future
1•miguelraz•32m ago•0 comments

PyCon US 2026 – Call for Proposals Now Open

https://pycon.blogspot.com/2025/10/pycon-us-2026-call-for-proposals-now.html
1•rbanffy•32m ago•0 comments

GitLab serves sub-second analytics to 50M users

https://clickhouse.com/blog/how-gitlab-uses-clickhouse-to-scale-analytical-workloads
1•saisrirampur•33m ago•0 comments

Xortran - A PDP-11 Neural Network With Backpropagation in Fortran IV

https://github.com/dbrll/Xortran
5•rahen•33m ago•0 comments

HBM Leads the Way to Defect-Free Bumps

https://semiengineering.com/hbm-leads-the-way-to-defect-free-bumps/
1•rbanffy•35m ago•0 comments

Do things that don't scale' is not valid anymore

1•bmadduma•37m ago•2 comments

Single-Celled Marine Organisms Resulted in an Influential Illustrated Book

https://lithub.com/how-the-discovery-of-single-celled-marine-organisms-resulted-in-one-of-the-mos...
2•PaulHoule•37m ago•0 comments

Maybe Don't Talk to the New York Times About Zohran Mamdani

https://lithub.com/maybe-dont-talk-to-the-new-york-times-about-zohran-mamdani/
4•piltdownman•39m ago•2 comments