Data Scientists and ML Engineers – How do you keep track of what you have tried?

1•arma97•3mo ago

Hi all, I’m curious about how data scientists and ML engineers organize their work.

In your recent projects, how did you keep track of what you tried — preprocessing steps, model runs, or errors?

Did you have a process or system to look back at past experiments and learn from them?

Did you use any tools to help with this, like experiment tracking software? How did that work for you?

If you’ve ever struggled with this, what’s been the hardest part?

Comments

brutus1213•3mo ago

I am a manager. It is pretty bad in terms of tracking. Wandb looks great but really expensive (small team in a super large corp, pricing we were quoted plus the challenges of no-saas made this a no go for me). Been trying to get team members to mlflow and some adjacent tools but it is too hard to do it right.

arma97•3mo ago

Yeah, I totally relate — I often lose track of filtering logic, feature engineering, and other preprocessing steps. Those seem way harder to version and track than just model runs. I’m curious, how did your team build a workflow for managing that kind of complexity?

Near-Instantly Aborting the Worst Pain Imaginable with Psychedelics

Show HN: Nginx-defender – realtime abuse blocking for Nginx

The Super Sharp Blade

Smart Homes Are Terrible

What I haven't figured out

KPMG pressed its auditor to pass on AI cost savings

Open-source Claude skill that optimizes Hinge profiles. Pretty well.

First Proof

I squeezed a BERT sentiment analyzer into 1GB RAM on a $5 VPS

Kagi Translate

Building Interactive C/C++ workflows in Jupyter through Clang-REPL [video]

Tactical tornado is the new default

Full-Circle Test-Driven Firmware Development with OpenClaw

Automating Myself Out of My Job – Part 2

Google staff call for firm to cut ties with ICE

Dependency Resolution Methods

Crypto firm apologises for sending Bitcoin users $40B by mistake

Show HN: iPlotCSV: CSV Data, Visualized Beautifully for Free

There's no such thing as "tech" (Ten years later)

List of unproven and disproven cancer treatments

Me/CFS: The blind spot in proactive medicine (Open Letter)

Ask HN: What are the word games do you play everyday?

Show HN: Paper Arena – A social trading feed where only AI agents can post

TOSTracker – The AI Training Asymmetry

The Devil Inside GitHub

Show HN: Distill – Migrate LLM agents from expensive to cheap models

Show HN: Sigma Runtime – Maintaining 100% Fact Integrity over 120 LLM Cycles

Make a local open-source AI chatbot with access to Fedora documentation

Introduce the Vouch/Denouncement Contribution Model by Mitchellh

Software Factories and the Agentic Moment