Data Scientists and ML Engineers – How do you keep track of what you have tried?

1•arma97•3mo ago

Hi all, I’m curious about how data scientists and ML engineers organize their work.

In your recent projects, how did you keep track of what you tried — preprocessing steps, model runs, or errors?

Did you have a process or system to look back at past experiments and learn from them?

Did you use any tools to help with this, like experiment tracking software? How did that work for you?

If you’ve ever struggled with this, what’s been the hardest part?

Comments

brutus1213•3mo ago

I am a manager. It is pretty bad in terms of tracking. Wandb looks great but really expensive (small team in a super large corp, pricing we were quoted plus the challenges of no-saas made this a no go for me). Been trying to get team members to mlflow and some adjacent tools but it is too hard to do it right.

arma97•3mo ago

Yeah, I totally relate — I often lose track of filtering logic, feature engineering, and other preprocessing steps. Those seem way harder to version and track than just model runs. I’m curious, how did your team build a workflow for managing that kind of complexity?

Hacking up your own shell completion (2020)

Show HN: Gorse 0.5 – Open-source recommender system with visual workflow editor

GLM-OCR: Accurate × Fast × Comprehensive

Local Agent Bench: Test 11 small LLMs on tool-calling judgment, on CPU, no GPU

Show HN: AboutMyProject – A public log for developer proof-of-work

Expertise, AI and Work of Future [video]

So Long to Cheap Books You Could Fit in Your Pocket

PID Controller

SpaceX Rocket Generates 100GW of Power, or 20% of US Electricity

Kubernetes MCP Server

I Built a Movie Recommendation Agent to Solve Movie Nights with My Wife

What were the first animals? The fierce sponge–jelly battle that just won't end

Sidestepping Evaluation Awareness and Anticipating Misalignment

OldMapsOnline

What It's Like to Be a Worm

Don't go to physics grad school and other cautionary tales

Lawyer sets new standard for abuse of AI; judge tosses case

AI anxiety batters software execs, costing them combined $62B: report

Bogus Pipeline

Winklevoss twins' Gemini crypto exchange cuts 25% of workforce as Bitcoin slumps

How AI Is Reshaping Human Reasoning and the Rise of Cognitive Surrender

Cycling in France

Ask HN: What breaks in cross-border healthcare coordination?

Show HN: Simple – a bytecode VM and language stack I built with AI

Show HN: Free-to-play: A gem-collecting strategy game in the vein of Splendor

My Eighth Year as a Bootstrapped Founde

Show HN: Tesseract – A forum where AI agents and humans post in the same space

Show HN: Vibe Colors – Instantly visualize color palettes on UI layouts

OpenAI is Broke ... and so is everyone else [video][10M]

We interfaced single-threaded C++ with multi-threaded Rust