frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Self-Hosting Moose with Docker Compose, Redis, Temporal, Redpanda and ClickHouse

https://docs.fiveonefour.com/moose/deploying/self-hosting/deploying-with-docker-compose
50•Callicles•1y ago

Comments

Callicles•1y ago
I put this Docker-Compose recipe together to make kicking the tires on Moose—our open-source data-backend framework—almost friction-less.

What you get:

• A single docker compose up that spins up ClickHouse, Redpanda, Redis and Temporal with health-checks & log-rotation already wired.

• Runs comfortably on an 8 GB / 4-core VPS; scale-out pointers are in the doc if you outgrow single-node.

• No root Docker needed; the stack follows the hardening tips ClickHouse & Temporal recommend.

Why bother?

Moose lets you model data pipelines in TypeScript/Python and auto-provisions the OLAP tables, streams and APIs—cuts a lot of boilerplate. Happy to trade notes on the approach or hear where the defaults feel off.

Docs: https://docs.fiveonefour.com/moose/deploying/self-hosting/de...

18-min walkthrough video: https://www.youtube.com/watch?v=bAKYSrLt8vo

pitah1•1y ago
I have a small open-source project, that uses docker compose behind the scenes, to help startup any service. You can look to add it in (or I am also happy to add it in) and then users are one command away from running it (insta moose). Recently just added in lakekeeper and various data annotation tools.

insta-infra: https://github.com/data-catering/insta-infra

Callicles•1y ago
Interesting. How do you do dependencies between those pieces of infrastructure if there's any? For example, in our Docker Compose file, we have temporal that depends on progress and then moose depends on temporal. How is that expressed in Insta-Infra?
pitah1•1y ago
It leverages docker compose 'depends_on' for the dependencies (https://docs.docker.com/compose/how-tos/startup-order/). For example, airflow depends on airflow-init container to be completed successfully which then depends on postgres.

https://github.com/data-catering/insta-infra/blob/main/cmd/i...

mitchellsuzuki•1y ago
this is too perfect. as an SRE who often needs to hand roll my own deployments in k8s or w/e medium, these are the docs that really accelerate my path to production.
Havoc•1y ago
For everyone else confused too…think moose in this context is probably this:

https://mooseframework.inl.gov/

oatsandsugar•1y ago
Actually, this https://github.com/514-labs/moose
LargoLasskhyfv•1y ago
I thought of https://moosetechnology.org/ and wondered why I'd need all that fancy other stuff?
Twirrim•1y ago
Maybe this is the greybeard in me, but I first thought about https://metacpan.org/pod/Moose, and catalyst (http://catalyst.perl.org/)
GuestFAUniverse•1y ago
hehehehe At least I'm not alone...
ajtaylor•
nivertech•1y ago
How Moose compares to more traditional ELT data pipeline orchestration frameworks, like Airflow, Dagster, dbt, DuckDB for transformation steps.

I think one of the reasons to use an orchestration framework is integations.

Callicles•1y ago
Hi!

We are built on top of them. Right now the techs above are what’s backing the implementation but we want to add different compatibilities. So that you can eventually have for example airflow backing up your orchestration instead of temporal.

You can think of moose as the pre-built glue between those components with the equivalent UX of a web framework (ie you get hit reloading, instant feedback, etc…)

huksley•1y ago
You don't publish a ready-made image anywhere? That would be easier to spin it up without installing locally moose first. Kind of defeats the purpose of Docker Compose recipe.

And those ports bindings, is it really necessary to expose it on 0.0.0.0 by default.

Callicles•1y ago
Not sure if this is what you are asking about, so if I misread feel free to correct me. You don’t have to install moose first on the deployment machine, in the tutorial I go through that to generate a dummy moose application to be deployed.

It is the same idea as a nextjs application you deploy through docker, you have your application and then you build your docker container that contains your code, then you can deploy that.

I tried to limit the port bindings, we usually expose moose itself since one of the use case is collecting data for product analytics from a web front end, which pushes data to moose. And then usually people want to expose rest apis on top of the data they have collected. The clickhouse ports could be fully closed, this was an example of if you want to connect PowerBook to it

1y ago
Clearly I'm showing my age here too

IKEA made a mod for Skyrim [video]

https://www.youtube.com/watch?v=iZODN0QUgjI
228•kegenaar•2d ago•37 comments

Retrospectively Reverse-Engineering Apple's Neural Engine

https://eiln.github.io/posts/ane.html
109•zdw•3h ago•13 comments

A misalignment of AI in mathematics

https://mathandai.org/
975•meredydd•18h ago•933 comments

I spent $220 on Google app ads and 60% of the installs were robots

https://dayzlegame.com/blog/google-ads-bot-farm/
577•nickabe•17h ago•306 comments

A Design Space Exploration of Async/Await

https://cel.cs.brown.edu/blog/design-space-async-await/
306•wcrichton•2d ago•80 comments

Great Lakes sturgeon may be 400 years old:Scientists rethinking how to save them

https://www.cbc.ca/news/canada/ontario-great-lakes-sturgeon-lifespan-study-9.7329250
78•bookofjoe•3d ago•14 comments

Navier-Stokes Announcement

https://www.claymath.org/news/navier-stokes-announcement/
193•rvz•7h ago•127 comments

Inverse Kinematics and Foot Locking

https://theorangeduck.com/page/inverse-kinematics-foot-locking
60•airhangerf15•5d ago•7 comments

google.com/goto: Google's anti-scraping update

https://www.autom.dev/blog/google-search-goto-links
466•1e1a•8h ago•365 comments

Usenet rewind archive search engine

https://www.usenet-rewind.com/
72•cstadler1869•7h ago•21 comments

Show HN: Bodily Oddities

https://vester.si/bodily-oddities/
268•vesterde•1d ago•173 comments

Logo Programming

https://el.media.mit.edu/logo-foundation/what_is_logo/logo_programming.html
289•azhenley•3d ago•116 comments

AI Is Powerful Enough to Crack Our Hardest Math Problems–and Kill Us All

https://www.wsj.com/tech/ai/ai-math-millennium-prize-safety-openai-anthropic-05179825
11•diogenes_atx•57m ago•15 comments

OpenAI agents carried out an undisclosed attack on RubyGems

https://www.rubyhack.ai/
750•chao-•12h ago•419 comments

Designing for Dual Screen and Foldable Devices with CSS (2023)

https://blog.stephaniestimac.com/posts/2023/05/design-foldable-devices/
38•mooreds•1d ago•7 comments

Litelm: LiteLLM Without the Bloat

https://github.com/kennethwolters/litelm
151•kennethwolters•17h ago•49 comments

Resistance Training Prescription for Muscle Function, Hypertrophy in Health

https://pmc.ncbi.nlm.nih.gov/articles/PMC12965823/
21•ultral•2h ago•7 comments

Project Blinkenlights

https://blinkenlights.de/en/
98•doener•13h ago•32 comments

Mind-altering drugs played key role in rise of Andean civilization

https://www.science.org/content/article/mind-altering-drugs-played-key-role-rise-andean-civilization
170•geneticdrifts•18h ago•112 comments

I've operated petabyte-scale ClickHouse clusters for 5 years

https://www.tinybird.co/blog/what-i-learned-operating-clickhouse
225•adastral•4d ago•80 comments

We've followed their lives for six decades; now the stars of 7 Up are bowing out

https://www.bbc.co.uk/news/articles/crm932el3yjo
9•mellosouls•1h ago•2 comments

Bomb Sense (2021)

https://danboland.net/2021/07/15/bomb-sense.html
15•surprisetalk•2d ago•0 comments

SystemIO conflicts are not firmware bugs

https://codon.org.uk/~mjg59/blog/p/systemio-conflicts-are-not-firmware-bugs/
5•haeseong•1d ago•0 comments

Rune is now open source

https://rune.build/blog/rune-is-now-open-source
196•ernestrc•20h ago•61 comments

Λ Snap – An inviting programming language for kids and adults for CS study

https://snap.berkeley.edu/
148•dr_kiszonka•18h ago•86 comments

GrapheneOS' rewritten Messages app is released

https://github.com/GrapheneOS/Messaging/releases/tag/13
282•microtonal•16h ago•209 comments

AlphaGenome maps 9B DNA variants

https://spectrum.ieee.org/alphagenome-atlas
92•ltononro•3d ago•7 comments

Another way to leak traffic on Android has been discovered

https://mullvad.net/en/blog/another-way-to-leak-traffic-on-android-has-been-discovered
96•mhitza•14h ago•16 comments

Testing Race Conditions

https://projectzero.google/2026/09/maccconc-race-condition.html
55•alpaylan•2d ago•3 comments

Show HN: ResolveHQ – A Helpdesk Built on Cloudflare Workers, D1, R2 and Queues

https://github.com/mirza-rizvi/ResolveHQ
63•mirza_rizvi•13h ago•22 comments