frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Getting tired of Helm – any better way to handle deployments in Kubernetes?

25•DeborahEmeni_•1y ago
I’ve been deep in Helm templates lately and it’s starting to feel like YAML hell. It was fine when we had a few services, but now it’s just hard to manage. Anyone found a workflow that avoids Helm altogether? Or made Helm manageable at scale?

Comments

LarsLarson•1y ago
We are using kustomize to create the yaml and argocd for deployment. All via ci and git-ops.

works really well

GauntletWizard•1y ago
I'm a huge fan of Kustomize. I'm ambivalent towards argocd, but Kustomize is as close to a DWIM tooling as it's possible to get for Kubernetes.
OhSoHumble•1y ago
Also using Kustomiza and Argo. It's really good imo.
natbennett•1y ago
I prefer ytt for templating and kapp for deployments.

https://github.com/carvel-dev/carvel

johnjungles•1y ago
ArgoCD
dvektor•1y ago
Yeah the whole 'git repo = helm chart' just does not feel great at all. As we all know, the only thing worse is not using helm and having to deal with writing all those service, pv, pvc, ingress yaml files individually :)
haiku2077•1y ago
ArgoCD for relatively simple stuff.

For complex stuff I write Python or Go programs to build manifests, then shell out to kubectl apply. An old example - deploying a multi-instance modded Arma 3 server on k3s: https://github.com/dharmab/homelab-k3s/tree/main/lab

a-saleh•1y ago
Why just simple?

T.b.h. if I were to write a manifest generator, I would still probably commit the thing into a repo and let argo do the rest. Maybe even fiddled around to make the generator into a config-management-plugin ... but that feels like over-doing it.

Nerudite•1y ago
Helmsman works great:

https://github.com/mkubaczyk/helmsman

b11484•1y ago
I've been working on improving a tool called kr8+, which uses jsonnet to combine cluster config and apply it to components: https://github.com/ice-bergtech/kr8
arlcode•1y ago
My recommendation is fluxcd for a great gitops based workflow (incorporates soap for secrets)
atmosx•1y ago
Kustomize is easier to manage at scale, but some upfront effort is required. Many charts are distributed as Helm packages, so you’ll often need to export them as raw YAML manifests. In an ideal setup, ArgoCD combined with Kustomize should cover most deployment needs. However, depending on your workflow, you may eventually need a way to dynamically replace variables. If the built-in tools in recent Kustomize versions aren’t sufficient, consider using envsubst as a fallback.
GauntletWizard•1y ago
I handle deploy time dynamic variables with `sed`. You shouldn't need more complexity than that.

(Not that I haven't had the need, I've use jsonnet with libk8s at scale. But if you're asking the question this simply, you probably don't need it)

atmosx•1y ago
> I handle deploy time dynamic variables with `sed`

I brought up envsubst because it’s a simpler, cleaner, and often overlooked option for variable substitution.

> Not that I haven't had the need, I've use jsonnet with libk8s at scale. But if you're asking the question this simply, you probably don't need it

In my view, Jsonnet isn’t an improvement - it’s complicated to learn, cumbersome to use, and prone to mistakes.

That said, if an organization decides to adopt any specific tool, I believe consistency in tooling, design, and practices is more important than the tool itself.

arccy•1y ago
if you only work with your own stuff, helm is easily (and best) avoided.

i like generating k8s yaml with cue, example: https://github.com/cue-labs/cue-by-example/tree/main/003_kub...

there's also https://timoni.sh/ if you want a helm-like experience, but with cue instead of templating.

If you're working with upstream projects, unfortunately many of them will only provide helm charts, so you got to decide between rewriting them to suit your env/tool, or just live with the crappiness of helm.

mococa•1y ago
+1 for Kustomize
bithavoc•1y ago
I use Pulumi native package for Kubernetes, no more YAML, only instances of Typescript classes.
Kerbonut•1y ago
I built my own tooling around templated manifest files (jinja2) and management via ansible playbooks (templated).
1024kb•1y ago
What exactly are you doing with Helm that's making it so painful to use, and what does your development workflow look like? I've certainly had my fair share of issues with Helm, especially when trying to get a bit too fancy with creating Helm libraries, and standardised charts. I've also found that trying to aggregate multiple charts into a single chart for deploying an environment can also become a nightmare to manage.

I'm currently looking at Helmfile so that I don't need to aggregate charts into a 'parent chart', and i'd also like to move towards a single standardised chart that all microservices can use, rather than spin up a new chart for each service.

Open-Sourcery•1y ago
Holos.run for my homelab cluster. Cuelang has a learning curve but works well with argo unlike Timoni and let's you import existing charts, bare manifests, and use kustomize. Let's me abstract config with custom types and unification/(inheritance if that is easier to think about but a bit wrong)
gtirloni•1y ago
https://github.com/apple/pkl-k8s
uaas•1y ago
IMHO at scale (both in terms of complexity and org level) having something consistent helps more than trying to fight the de-facto standard. Since most upstream projects are mainly distributed as Helm charts, going with anything else will require more effort eventually.
a-saleh•1y ago
Recently I have been writing more stings in jsonnet. If I were with more haskell-friendly team, might even try dhall. In general, I feel like writing the yaml in something else than yaml is the way to go, and as long as you get imports and way to do templating that is not just string interpolation, you are good.

Ask HN: Who's still keeping a DOS machine up because the business depends on it?

248•mlaux•1d ago•268 comments

Ask HN: Who is the inspiration for your thinking?

2•SMAAART•3h ago•8 comments

Ask HN: Any nerds out there who've read a lot of research papers?

28•shriy-singh•2d ago•27 comments

Ask HN: Hypothesis: Cellular providers are deprioritizing voice calls?

20•tkdb•2d ago•38 comments

Ask HN: IEEE expulsion of Fei-Yue Wang?

11•sathomasga•2d ago•1 comments

Ask HN: Is Opus 5.5 another step change?

12•consumer451•1d ago•14 comments

Tell HN: OpenAI $500 ProMax plan listed in API

26•GustavHartz•1d ago•46 comments

How to Freelance Now?

9•Alexadar•16h ago•11 comments

Ask HN: How do you deal with cyber attacks once you scale?

5•cehgmaster•3d ago•2 comments

Ask HN: Which model do you use for work?

5•george_max•1d ago•10 comments

Ask HN: What vendor you'd switch out if a better option was available?

6•jviotti•1d ago•16 comments

FYI: OpenAI "spend limits" aren't always limits

2•iambateman•1d ago•0 comments

Tell HN: Chrome 154 corrupt Fontconfig cache and crash KDE Plasma

6•vdfs•1d ago•0 comments

Ask HN: LM Studio Bionic with Python?

3•HoldOnAMinute•1d ago•0 comments

Ask HN: Has anyone built a leaderless multi-agent system?

3•har-ki•1d ago•2 comments

Ask HN: Anyone else's OpenAI and Claude API keys mysteriously leaked last night?

2•par•1d ago•1 comments

Ask HN: Indie hackers on X (Twitter) feels like a mega bubble these days

8•sankalpdomore•19h ago•3 comments

Ask HN: How do you use LLMs to secure your code and services?

4•cpa•1d ago•1 comments

Tell HN: Substack obfuscating text to break reading mode

18•xnx•4d ago•4 comments

Ask HN: Are .shop domains down?

6•esher•2d ago•8 comments

Anyone using a Wispr Flow alternative that is non-cloud?

22•itsjeremiahs•4d ago•17 comments

Ask HN: Migrating personal email domain from Gmail to iCloud?

4•osener•1d ago•5 comments

Ask HN: What job boards are good these days?

23•phendrenad2•3d ago•16 comments

Ask HN: Where to look for jobs?

6•0x737368•2d ago•1 comments

Ask HN: How do you feel about the new $500 OpenAI subscription?

4•preommr•2d ago•12 comments

Ask HN: Does a startup need both founder and company X accounts?

3•OnionLayers•2d ago•1 comments

Ask HN: Do you cuss at your agent?

4•ak39•2d ago•11 comments

Ask HN: Folks familiar with infections after TKA

3•zafka•2d ago•1 comments

Ask HN: Does spec-driven development still pay off with frontier coding models?

5•sarangk90•2d ago•2 comments

Ask HN: When is fine-tuning a small LLM worth it?

10•kooldeep7•4d ago•14 comments