frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a hypervisor and client for inference on consumer compute

https://scalattice.com/blog/openai-sdk-scalattice/
1•RomulusHill•1h ago
I'm the founder of Scalattice, this is my second company, third total product. I'm a 2x founder building some challenging software, some easy software, and some curiosity based tools that I've just always wanted to be a part of!

So here is Scalattice.

Scalattice is an OpenAI-compatible inference API. You keep the OpenAI SDK, swap base_url + API key, and call open models (Qwen3, Llama 3.3 70B, Gemma 3, DeepSeek R1, etc.). Inference is performed by a provider node on our distributed network of consumer hosted inference machines, we run an open source agent (https://github.com/scalattice/scalattice-agent) which works in Rust to run the inference and get the provider paid.

In short, anyone can become a provider, offer up their machine with our Windows/Linux Rust agent, and earn some extra cash, or start a farm of machines to make big bucks.

I decided to build some innovative behavioural traits to the API for higher performance/security: 1. output vetting - Scalattice Cloud vets the response against replica responses requested on the API header N times. 2. security tiers - Using some split inference, the job is completed in chunks by multiple providers and in part by Scalattice Cloud hypervisor for added security/privacy (at an additional cost) 3. regional policy - I know how important data residency is to developer clients (from my experience with Digital ID Infrastructure) and so I built the platform to let developers specify the region for inference.

We pay our providers a majority share (Currently 80%) of every token spent by the developer.

We currently back the network with a failover of our own company machines which ensures we never drop a request.

If you want to give it a try in a couple of minutes, we are currently running a "Top Up $10 for UNLIMITED QWEN3" for an entire month of API calling, (terms and conditions apply).

If you want to give it a try in a couple of minutes: 1. Create a key at https://scalattice.cloud/developers 2. Use the copy-paste snippet on the linked post 3. Live rates: https://scalattice.com/pricing

Or, if you want to be a provider (We are really keen to onboard people and get them earning): 1. Create a machine at https://scalattice.cloud/providers 2. Download our Windows app, or use our on-page instructions to curl the agent installation script for Linux. 3. Attach a provider token to the app or Linux agent from the Machine created on the website. 4. Control the machine from the website, select which models you want to offer, and the physical hardware components to use for inference and the hours of operation. 5. Earn!

Happy to take feedback - especially on DX, pricing clarity, and what would make you try this instead of Together / Fireworks / OpenRouter / Salad etc.

This is my first time posting on HN, please let me know if you think the product has potential, there are obviously trade-offs with non-datacentre inference (latency, capability of cards), but I think this could serve a decent amount of developers very well, because not everyone needs H100 cards for their inference.

Thanks again.

Sequentialising Parallel Moves

https://compiler.club/parallel-moves/
1•g0xA52A2A•2m ago•0 comments

Show HN: Mousecrack – Bypass agent mouse detection with deep learning

https://github.com/puffinsoft/mousecrack
1•G3819•6m ago•0 comments

Show HN: Pg_stat_ch, a Postgres extension to export every metric to ClickHouse

https://github.com/ClickHouse/pg_stat_ch
1•saisrirampur•11m ago•0 comments

WezTerm Config Guide

https://gilbertsanchez.com/posts/my-terminal-wezterm/
1•ankitg12•12m ago•0 comments

Stack Overflow for Agents

https://stackoverflow.blog/2026/06/10/announcing-stack-overflow-for-agents/
1•taubek•14m ago•0 comments

LaunchRanks – Get actionable SEO steps for growing site authority

https://launchranks.com
1•NataliNy•20m ago•0 comments

Show HN: Record a click-through demo from a Markdown plan into one HTML file

https://github.com/justrinari/handoff
3•justrinari•22m ago•0 comments

Show HN: I built an AI that roasts GitHub profiles

https://gitroast-kappa.vercel.app/
2•hito20•24m ago•1 comments

Vision 50 Years Phone – Keeping old Android phones fast without root

https://github.com/50YearsPhone/vision-50-years-phone
1•mike5gao•25m ago•0 comments

Eve.dev: Next.js for Agents

https://eve.dev/
1•javiercr•25m ago•0 comments

Hans Moravec was right about AI

https://nymag.com/intelligencer/article/hans-moravec-interview.html
1•anath2•30m ago•0 comments

Watching Go's new garbage collector move through the heap

https://theconsensus.dev/p/2026/07/19/observing-gos-garbage-collector-old-and-new.html
1•ksec•31m ago•0 comments

GrapheneOS duress PIN could land a man in prison

https://www.androidauthority.com/grapheneos-duress-pin-us-prosecution-3691271/
1•kitd•36m ago•0 comments

The Algorithmic Atelier

https://www.doc.cc/articles/the-algorithmic-atelier
1•kaizenb•38m ago•0 comments

Operating a computer with your tongue: the Augmental MouthPad [video]

https://www.youtube.com/watch?v=xReyIF5pwRo
1•jibcage•40m ago•0 comments

'Who wants to be hired' now outnumbers 'Who is hiring'

https://ej29-r3d.github.io/hacker-news-hiring-trends/
1•Tronickle•40m ago•1 comments

Discord Must Verify Texas Users' Age Under Judge's Ruling

https://news.bloomberglaw.com/litigation/discord-must-verify-texas-users-age-under-judges-ruling
1•1vuio0pswjnm7•42m ago•0 comments

LA Social Media Trial Dismissal Leaves Landscape of Cases

https://news.bloomberglaw.com/litigation/la-social-media-trial-dismissal-leaves-vast-landscape-of...
1•1vuio0pswjnm7•45m ago•0 comments

Error Certificates for KV-Cache Eviction via Randomized Design

https://arxiv.org/abs/2607.21475
1•sbulaev•45m ago•0 comments

Show HN: Integrate any CLI agent into any terminal

https://terminai.app
2•emosenkis•46m ago•0 comments

Databrick Genie

https://www.getwren.ai/post/genie-meter-is-on-roi-of-owning-your-genbi
1•xingfu•51m ago•0 comments

Google Can't Block Ex-NPR Host Voice Suit with Copyright Shield

https://news.bloomberglaw.com/ip-law/google-cant-block-ex-npr-host-voice-suit-with-copyright-shield
1•1vuio0pswjnm7•53m ago•0 comments

Microsoft launches new in-house AI models. Cuts costs up to 89% versus OpenAI

https://venturebeat.com/infrastructure/microsoft-launches-new-in-house-ai-models-it-says-cut-cost...
2•thunderbong•53m ago•0 comments

The Two Sources of Noise Every LLM Evaluation System Must Handle

https://wilburhimself.github.io/blog/64-the-two-sources-of-noise-every-llm-evaluation-system-must...
1•wilburhimself•55m ago•0 comments

GrapheneOS protections against data extraction from locked devices

https://discuss.grapheneos.org/d/40700-grapheneos-protections-against-data-extraction-from-locked...
2•Cider9986•55m ago•0 comments

Chute – 10GB free file transfer with optional E2E encryption

https://chute.codecraftsol.org/
1•sasenb•59m ago•1 comments

Shediy

https://shediy.app/
1•gr3ggg•1h ago•0 comments

Show HN: I built a hypervisor and client for inference on consumer compute

https://scalattice.com/blog/openai-sdk-scalattice/
1•RomulusHill•1h ago•0 comments

Jedi Knight fansite has been running consistently for almost 30 years

https://www.pcgamer.com/games/action/conceived-in-a-secure-military-facility-this-jedi-knight-fan...
3•Apocryphon•1h ago•0 comments

Show HN: Hydra, a local-first trust control plane that routes AI by confidence

https://hydra.uvansa.com/
1•jhaankit373•1h ago•0 comments