frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

UK sovereign LLM inference

https://relax.ai/docs
81•benjamintnorris•2h ago

Comments

benjamintnorris•2h ago
Hi HN, I'm Ben, founding engineer at relaxAI.

We built a UK sovereign inference provider for developers who are either paying too much for OpenAI/Claude tokens or can't use US hyperscalers due to data residency requirements.

The short version: drop-in OpenAI-compatible API, latest open source models (Kimi K2.6, DeepSeek V4 Pro, Nemotron 3 Super, GPT OSS 120b), running on NVIDIA Blackwell GPUs in the UK. Zero code changes to switch from OpenAI. Up to 80% cheaper per token cost saving!

We built it on fully UK sovereign cloud infrastructure, so data never leaves UK jurisdiction. For anyone building in regulated sectors — finance, legal, health, defence — that matters a lot. But honestly, most of our early users just came for the huge cost savings.

We're looking for developers to kick the tyres. Check out our API docs at relax.ai/docs. I'd love your feedback and happy to answer any questions.

jstummbillig•1h ago
Hey Ben. I find communication like this fairly off-putting. In so far the 80% cheaper per token (or any part of it) is something of your own making/ingenuity, by all means, do tell, but it requires comparing token cost fairly with comparable models on i.e. OpenRouter and not across different models and pretending it's the same thing.
graemep•1h ago
So the pricing is 12.50/month for unlimited chat, or 60p per million tokens output/10p per million input? For use with a coding assistant it would be the latter?
spacebanana7•1h ago
Is your business plan essentially to run mid tier models on hardware in the UK?

I do see the value in this as some enterprises need local data residency, the UK energy grid realistically can't handle new multi GW xAI-style data centres, and many applications don't need frontier models (but do need more than small local ones).

hathym•1h ago
why use this over openrouter?
imdsm•1h ago
good question, it's going to take a lot to dislodge openrouter from my workflows
raesene9•1h ago
I'd expect for workflows where there is value in knowing that the data is processed in the UK. From a contractual/data protection standpoint, that could be very useful, depending on the use case.
nicce•1h ago
Avoiding routing through US or US-based companies.
bocytron•18m ago
openrouter is an US based company, so falls under CLOUD Act
imdsm•1h ago
Marketing aside, why are you using the term "UK sovereign"?

I assume UK based DCs, so why not just say that, UK based LLM inference.

Is it a DC owned/ran by HM Gov? Is that why it's sovereign?

Not a criticism, more of a critique.

StilesCrisis•1h ago
He does say that? "running on NVIDIA Blackwell GPUs in the UK" is in there and that's pretty unambiguous.
pu_pe•19m ago
The problem is if those GPUs are running on an AWS server (or any other American provider), even if it the server is in the UK the sovereignty claim is null and void.
StilesCrisis•7m ago
Doesn't "We built it on fully UK sovereign cloud infrastructure, so data never leaves UK jurisdiction" cover that?
drawfloat•1h ago
Much the same way the word "patriotism" is more common in US national discourse, "sovereignty" is very common in UK national discourse.
bcjdjsndon•1h ago
You're thinking of when chavs used to wear sovereign rings... it's fell out of fashion now tbh
raesene9•1h ago
Data Sovereignty as a term is now fairly well established term that doesn't have specific government connotations e.g. https://events.linuxfoundation.org/kubecon-cloudnativecon-eu...
greenchair•1h ago
Congrats on the launch. More options for consumers in this space the better!
timruffles•1h ago
Firstly, congrats! As a Brit this looks cool, and I'm happy to see it. I wish you every success.

Secondly: I get that 'sovereign' is probably an important sales term for your company. But this, in common with the government's 'sov/ai' fund, does not deserve to be described as sovereign. This is other countries' models served on chips designed and manufactured abroad, powered by a grid which imports 44% of its power.

Of course this isn't your company's fault. Last week I went to an event where the sovereignai.gov.uk people presented. In a very Keir Starmer way (spiritually, he wasn't there), they said in as many words 'oh but I'm sure all reasonable people would agree _really_ sovereign AI would be too hard. So let's all agree to pretend that just popping a bit more money into the AI startup ecosystem is a sovereign AI strategy'.

I'm unsure if the UK does need to be sovereign in anything; it certainly doesn't seem to want to be. But I will continue to poke fun at anything using the pompous phrase 'sovereign' for anything that isn't.

If sovereign AI is a problem you're in earnest about, I hope you go after it seriously, and fix the rest of the stack. I'll cheer you on!

bcjdjsndon•1h ago
If I could give prizes for comments you'd get one. Too much fart sniffing goes on in these parts, it's always a pleasant change to see dissent
jonplackett•59m ago
Tbf the title only says sovereign _inference_
quietbritishjim•14m ago
Sovereign capability just means that no foreign government can pull the plug. Who cares where it was copied from?

If it were somehow legal for a company to provide MS Office (not a clone) fully in the UK with no control from Microsoft, that would also count as a sovereign capability, even though none of the code was written in the uk.

Maybe that's not how you like the term to be used but it's widely used that way and widely understood.

carderne•2m ago
The UK does not import 44% of its energy.

Gell-Mann suggests I should treat the rest of your post with skepticism.

robertlagrant•42m ago
Hi Ben - how are you positioning yourself vs LocAI? I had a few chats with them and they have a fairly similar pitch.
benjamintnorris•6m ago
We’re closely partnered with the LocAI model lab, we’re looking forward to running their models on the platform in the next few months!
ltr_•14m ago
good prices, but I don't see info on the token cache hits prices (in/out), are they available?.
amelius•1h ago
This looks very interesting.

I have no idea why you got downvoted so much.

iso1631•1h ago
HN doesn't like data sovereignty. AMERICA NUMBER ONE and all that.
pjc50•1h ago
Could we have a bit more "who and where" on this please? "Relax.ai by Civo", great, who are Civo? Where's the datacenter? What's the corporate structure? UK resident founders?
dagi3d•1h ago
what's preventing you from going to their website? op has linked directly to the documentation, so that info is not necessary expected to be there
Planktonne•1h ago
OP should have linked to the website rather than the documentation; that would have provided more immediate context for the discussion.
dagi3d•1h ago
It depends on who you ask
pornel•1h ago
> what's preventing you from going to their website?

Lack of links.

It's a common annoyance when subsections of a site fail to link back to the parent.

fmajid•1h ago
Civo is a UK cloud provider known mostly for its low-cost Kubernetes hosting service (albeit with fairly expensive storage).
iLoveOncall•1h ago
Why would smaller and worse models not be 80% cheaper?

If I can run those models on my consumer hardware, I'd better believe they are 80% cheaper than the models that need 1 TB of RAM.

graemep•1h ago
Comment from poster says they are offering Deepseek v4-Pro. Cannot find any details on website.
ttoinou•1h ago
Its written

Input Price: £1.17 Output Price: £2.33

So, slightly cheaper than Fireworks AI

anentropic•59m ago
click "Models and Pricing" in the left menu https://relax.ai/docs/getting-started/pricing
walthamstow•1h ago
> Civo isn’t just another cloud and AI platform, it’s a whole new way of thinking.

come on now

asddubs•1h ago
well, at least we know they're using their own product
sph•1h ago
When in Rome…
blitzar•1h ago
Classic LinkedIn copy and paste line you see on someone with "Founder, CEO and Cereal Entrepreneur" in the job description.
junaru•1h ago
A trailer[1] from a decade comes to mind, even the name almost matches

[1] https://www.youtube.com/watch?v=uBBB-m9peMQ

imdsm•1h ago
While I'm British, based in the UK, seeing prices in £ really throws me

Token prices should be in $ as that's how our brains work

gregjw•1h ago
Likewise, strange right. I live in Japan now, but even living here, I just expect all online provider pricing to be in USD.
imdsm•1h ago
Personal take: terrible name. RelaxAI feels like you trawled for available .ai domains with dictionary words and landed on this. But it doesn't work, unless it's a relaxed AI. Is it slower, but cheaper, we'll process your requests when we get to them, so relax!

You could have bought languagemodels.co.uk off me and used that!

virtualritz•1h ago
Personal take: terribly disguised pitch to get someone to buy that way too long domain name from you.
r_lee•1h ago
> You could have bought languagemodels.co.uk off me and used that!

this is a joke, right?

blitzar•1h ago
Relax, don't do it, when you want to go to it.
Cakez0r•1h ago
UK sovereign data? Land of arrests for posts on social media? Member of five eyes, "you spy on our citizens and we'll spy on yours and call it intelligence sharing"? Land of the infamous Online Safety act? That UK? Why would anyone want their data in the UK?
yanis_t•1h ago
Just my curiosity. Is (insert country) sovereign X is an efficient marketing strategy these days?
fmajid•1h ago
https://www.forbes.com/sites/iainmartin/2026/04/16/how-franc...
stevesimmons•1h ago
It is if your country isn't in the US and (a) GDPR requires data residency in UK/EU; (b) you're concerned about capricious actions by the US govt cutting off access to US-controlled services (cloud, payments systems, etc).
dewey•1h ago
I'm not sure if you are asking for hard numbers, but I would say it's definitely "a thing" for people to reduce their reliance on certain countries.
bcjdjsndon•1h ago
I mean, it's pretty rich for coloniser like the British empire to be talking about soverign anything
ttoinou•1h ago
Have you heard about companies training LLMs on your data ?
PaulRobinson•56m ago
Yes.

Some people might interpret this comment as political commentary, but it’s actually just the reality of what people are saying and doing.

There’s a lot of data to suggest that America’s recent policy of reducing its soft power around the World & decoupling itself from alignment with interests of allies is causing increased interest and prioritisation of sovereign capability across tech, defence, public health and policy programs.

This was a campaign strategy/promise for the US President. I’m not going to comment on whether it’s good for the US or for the allies, but I will note it could have been better anticipated by all: the only real surprise is the speed and depth.

It raises some interesting questions - it’s one thing to say you don’t want Microsoft or Starlink in your infra tech stack, or don’t want to use AWS or GCP, but where does the line stop? Does the UK get out of Trident? Does the UN General Assembly get out of New York? No idea, but the fact these are conversations probably happening right now is remarkable.

pbhjpbhj•8m ago
>This was a campaign strategy/promise for the US President.

I don't remember seeing "if you elect me I'll destroy NATO, threaten allies, and make sure even USA's oldest allies hate us" as part of the campaign.

Perhaps you could link that promise from the time before the election?

As to your questions, I think people are hoping that rule of law returns and there is an outbreak of common sense. No-one really expected US president will align with Russia and a cult of pseudo-Christian white-supremacist nationalists will worship him as the second coming as an expectation. That the Senate, SC, and tech leaders have fallen in place behind that (the latter literally paying fealty to their god-king) is complete insanity.

rcxdude•50m ago
Yes, at least in certain sectors.
Havoc•36m ago
Suspect it depends on the sentiment.

Don't think you'd have much luck convincing say a German that they shouldn't use Mistral because it isn't German sovereign. But you might have luck with that line against china or america.

Or put differently depends more on the fault lines in public perception than strict borders

littlestymaar•31m ago
US tech is currently being weaponized against the ICC and its member judges in Europe[1], and the US is threatening to annex Greenland, as a result all (former) US allies are scrambling to get rid of their strategic dependency.

[1]: https://www.lemonde.fr/en/international/article/2025/11/19/n...

Havoc•1h ago
Nice. All for seeing more geographically diverse options.

BTW don’t see opencode in the docs yet much less known tools are?

benjamintnorris•7m ago
Hi! We support OpenCode, as well as any other coding tools accepting OpenAI compatible endpoints. For example, take a look at: https://relax.ai/docs/integrations/developer-productivity-to...
benjamintnorris•5m ago
Also worth checking out https://github.com/jmesout/relax-claude
bflesch•1h ago
As The Crown is sovereign of the United Kingdom, is this running in Buckingham Palace or in City of London?

Can the user choose which sovereign is doing the computation?

I'd personally prefer not to have the weird uncle do the computation, maybe the younger ones living abroad can do it.

;)

00deadbeef•1h ago
5 minutes to load and it just dumps me to a documentation site with no useful information about that this is, who made it, what it can do, etc.
tomaytotomato•42m ago
Congrats, its a small step in the right direction.

The UK it seems has dropped the ball on the whole training and building models part, although we are punching up in other areas now.

We really need to get our own equivalent to Mistral, and fast!

mrdw•29m ago
btw, you can claim "relax" name instead of "relaxai" on pypi

pypi.org/project/relax is abandoned library, which owner registered via email with expired custom domain, so you can claim this domain and reset owner's account by email.

Explore Wikipedia Like a Windows XP Desktop

https://explorer.samismith.com/
168•smusamashah•2h ago•38 comments

O(x)Caml in Space

https://gazagnaire.org/blog/2026-05-14-borealis.html
25•yminsky•48m ago•0 comments

Show HN: Find the best local LLM for your hardware, ranked by benchmarks

https://github.com/Andyyyy64/whichllm
98•andyyyy64•2h ago•11 comments

Steve Jobs Next Computer: His Forgotten Exile Years

https://spectrum.ieee.org/steve-jobs-next-computer
15•rbanffy•1h ago•5 comments

Removing the modem and GPS from my 2024 RAV4 hybrid

https://arkadiyt.com/2026/05/13/removing-the-modem-and-gps-from-my-rav4/
908•arkadiyt•18h ago•468 comments

UK sovereign LLM inference

https://relax.ai/docs
81•benjamintnorris•2h ago•67 comments

Show HN: GlycemicGPT – Open-source AI-powered diabetes management

https://github.com/GlycemicGPT/GlycemicGPT
43•jlengelbrecht•6h ago•25 comments

UK government replaces Palantir software with internally-built refugee system

https://www.bbc.com/news/articles/c2l2j1lxdk5o
284•cdrnsf•13h ago•93 comments

A few words on DS4

https://antirez.com/news/165
337•caust1c•13h ago•141 comments

Building ML framework with Rust and Category Theory

https://hghalebi.github.io/category_theory_transformer_rs/
48•adamnemecek•19h ago•13 comments

Details of the Daring Airdrop at Tristan Da Cunha

https://www.tristandc.com/government/news-2026-05-11-airdrop.php
166•kspacewalk2•7h ago•50 comments

RTX 5090 and M4 MacBook Air: Can It Game?

https://scottjg.com/posts/2026-05-05-egpu-mac-gaming/
613•allenleee•19h ago•145 comments

First public macOS kernel memory corruption exploit on Apple M5

https://blog.calif.io/p/first-public-kernel-memory-corruption
380•quadrige•17h ago•91 comments

Gyroflow: Video stabilization using gyroscope data

https://github.com/gyroflow/gyroflow
104•nateb2022•2d ago•18 comments

New Nginx Exploit

https://github.com/DepthFirstDisclosures/Nginx-Rift
393•hetsaraiya•18h ago•88 comments

Where's Ed: Anthropic Told Court $5B but Public $19B

https://www.flyingpenguin.com/wheres-ed-anthropic-told-court-5-billion-but-public-19-billion/
13•jorisw•3h ago•6 comments

Codex is now in the ChatGPT mobile app

https://openai.com/index/work-with-codex-from-anywhere/
356•mikeevans•15h ago•174 comments

Mullvad exit IPs are surprisingly identifying

https://tmctmt.com/posts/mullvad-exit-ips-as-a-fingerprinting-vector/
423•RGBCube•9h ago•251 comments

Solar-based sleep patterns compared to modern norms

https://dylan.gr/1775146616
80•James72689•7h ago•68 comments

Tesla Wall Connector bootloader bypasses the firmware downgrade ratchet

https://www.synacktiv.com/en/publications/exploiting-the-tesla-wall-connector-from-its-charge-por...
105•p_stuart82•15h ago•46 comments

HDD Firmware Hacking

https://icode4.coffee/?p=1465
194•jsploit•19h ago•26 comments

Claude for Legal

https://github.com/anthropics/claude-for-legal
106•Einenlum•14h ago•97 comments

Access to frontier AI will soon be limited by economic and security constraints

https://writing.antonleicht.me/p/cut-off
174•thoughtpeddler•10h ago•164 comments

RISC-V Router

https://router.start9.com/
126•janandonly•15h ago•73 comments

Porting 3D Movie Maker to Linux

https://benstoneonline.com/posts/porting-3d-movie-maker-to-linux/
135•speckx•3d ago•27 comments

What's in a GGUF, besides the weights – and what's still missing?

https://nobodywho.ooo/posts/whats-in-a-gguf/
157•bashbjorn•18h ago•46 comments

Geography is four-dimensional

https://sive.rs/4d
23•galfarragem•1h ago•9 comments

New arXiv policy: 1-year ban for hallucinated references

https://twitter.com/tdietterich/status/2055000956144935055
528•gjuggler•15h ago•181 comments

How Claude Code works in large codebases

https://claude.com/blog/how-claude-code-works-in-large-codebases-best-practices-and-where-to-start
183•shenli3514•7h ago•131 comments

Infracost (YC W21) Is Hiring Sr Dev Advocate to make agents cloud cost-aware

https://www.ycombinator.com/companies/infracost/jobs/NzwUQ7c-senior-developer-advocate
1•akh•14h ago