frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Local LLM for Private Companies

2•ahendest•1h ago
what do you think to host a local LLM for company businness? ok we have ms365 subscription and built-in copilot for learn procedur, and Q/A. but to use the llm internal systems like special department softwares, which contains sensitive data, i do not have any idea other than local LLM. but so far what i found is gpus are expensive. gpt told me i can use 36B local LLM with rtx 6000 pro 96gb which costs 12k$. and i think the normal gpt that we are using on browser, gpt 5.4 extended think is much more stronger than 36B llm. i am curious if there are others that have similar ideas, or any proffessional advices.

Comments

julia-kafarska•1h ago
I run Qwen 35B on my local machine daily but also over 200B params with flash-moe occasionally. In today's world, with all the open models spending a lot of money make sense if your needs a bigger then couple of people.
ahendest•8m ago
how is your token/s for qwen and for flash-moe? and what system you are using? and do you satisfied on them? thanks for reply!!

TSMC Delays Use of ASML's High-NA EUV Machines over Cost Concerns

https://www.bloomberg.com/news/articles/2026-04-22/tsmc-says-asml-s-latest-chipmaking-gear-is-too...
1•helsinkiandrew•26s ago•0 comments

SQLite Official Vec1 Extension – Vector Search

https://sqlite.org/vec1/doc/trunk/doc/vec1.md
1•ilumanty•43s ago•0 comments

Cyber agencies share fresh advice to defend against China-linked covert networks

https://www.ncsc.gov.uk/news/international-cyber-agencies-fresh-advice-defend-against-china-linke...
1•campuscodi•1m ago•0 comments

Ombre – open-source AI infrastructure

https://github.com/pypl0/Ombre
1•38caveman•2m ago•0 comments

Show HN: Features Goldmine – Features Engineering Made Easy

https://github.com/mljar/features_goldmine
1•pplonski86•2m ago•0 comments

The U.S. Military Is Running a Bitcoin Node, Admiral Says

https://bitcoinmagazine.com/news/the-us-military-is-running-a-bitcoin-node
2•giuliomagnifico•4m ago•0 comments

How big is the Wander Console Network?

https://susam.codeberg.page/wander/wcn.html
1•susam•4m ago•0 comments

Crypto scam lures ships into Strait of Hormuz

https://arstechnica.com/security/2026/04/crypto-scam-lures-ships-into-strait-of-hormuz-falsely-pr...
1•bmitch3020•4m ago•0 comments

Cognometry: The Measurement of Machine Cognition

https://fathom.darkflobi.com/cognometry
1•darkflobi•4m ago•0 comments

Show HN: Game Server Backend – backend services for multiplayer games

https://gsb.supercraft.host/
1•supercrafthost•6m ago•0 comments

98% of all recent environmental claims can be categorized as "greenwashing"

https://www.eurekalert.org/news-releases/1124525
2•robtherobber•7m ago•0 comments

Creative Enfeeblement

https://herbertlui.net/creative-enfeeblement/
1•herbertl•9m ago•0 comments

Show HN: LazyAgent – All in one observerbility TUI app for coding agents

https://github.com/chojs23/lazyagent
2•neozz•9m ago•0 comments

HN Blackout Poetry

https://mrdee.in/vibecoding/vibecoding-019-hn-blackout-poetry/
1•cyb0rg0•11m ago•0 comments

Oshkosh council rescinds Flock camera contract after 'false statements'

https://www.wbay.com/2026/04/23/oshkosh-council-rescinds-flock-camera-contract-after-false-statem...
2•healsdata•12m ago•0 comments

AngelList Announces USVC

https://usvc.com/
1•manishfp•14m ago•0 comments

Gone but Not Forgotten: Recovering the Dead Web

https://blog.archive.org/2026/04/23/gone-but-not-forgotten-recovering-the-dead-web/
4•TangerineDream•15m ago•0 comments

AI bias can creep into online content moderation

https://news.uq.edu.au/2026-04-how-ai-bias-can-creep-online-content-moderation
2•demartini•16m ago•0 comments

Stop being honest in job interviews

https://old.reddit.com/r/jobhunting/comments/1ssj0pf/stop_being_honest_in_job_interviews_i_say_th...
2•tomcam•18m ago•0 comments

List of predictions for autonomous Tesla vehicles by Elon Musk

https://en.wikipedia.org/wiki/List_of_predictions_for_autonomous_Tesla_vehicles_by_Elon_Musk
1•xqcgrek2•20m ago•0 comments

Capital Without Labour: A Founder's Guide to the Changing VC Equation

https://felixbarbalet.com/capital-without-labour-a-founders-guide-to-the-changing-vc-equation/
1•xlfe•21m ago•1 comments

Can you MoCap a parkour video?

https://galbanis.dev/blog/viewer.html?post=climb-mocap
1•Tycho87•22m ago•0 comments

Agents CLI in Agent Platform: Create to Production in One CLI Blog

https://developers.googleblog.com/agents-cli-in-agent-platform-create-to-production-in-one-cli/
3•Anon84•22m ago•0 comments

Milla Jovovich's AI memory claims to beat all paid ones. Benchmarks disagree

https://atlas-rag.com/vs-mempalace
1•apolloraines•27m ago•0 comments

Python security headers without copy-paste policy drift

https://github.com/TypeError/secure
2•cak•28m ago•0 comments

SideQuick – A free desktop app to stop abandoning side projects

https://www.sidequick.co
3•splodgebox•35m ago•0 comments

ShadowStrike-Labs: ShadowStrike Phantom Home UI

1•Soocile•37m ago•1 comments

Kubernetes release that kills Ingress Nginx, contains Japanese poetry and art

https://www.theregister.com/2026/04/23/kubernetes_1_36_haru/
2•romaniitedomum•38m ago•0 comments

Per-Project Terminal Colours

https://andrew-jones.com/blog/per-project-terminal-colours/
1•arjones•39m ago•0 comments

Open Source Claude Mythos Reconstruction

https://firethering.com/openmythos-open-source-claude-mythos-reconstruction/
1•worldvoyageur•40m ago•0 comments