frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Ask HN: How do you handle logging and evaluation when training ML models?

2•calepayson•2h ago
Hi all, I'm currently in a few ML classes and, while they do a great job covering theory, they don't cover application. At least not past some basic implementations in a Jupyter Notebook.

One friction point I keep running into is how to handle logging and evaluation of the models. Right now I'm using Jupyter Notebook, I'll train the model, then produce a few graphs for different metrics with the test set.

This whole workflow seems to be the standard among the folks in my program but I can't shake the feeling that it seems vibes-based and sub optimal.

I've got a few projects coming up and I want to use them as a chance to improve my approach to training models. What method works for you? Are there any articles or libraries that you would recommend? What do you wish Jr. Engineers new about this?

Thanks!

Comments

calepayson•1h ago
For now, the plan is to move from Jupyter back to a text editor. Jupyter is very forgiving of mistakes. The model didn't work? Change some parameters and rerun the training cell. This is amazing for new folks, who are being bombarded by new information, and (it sounds like) for experienced folks who have already developed great habits around ML projects. But I think intermediate folks need a little friction to help hammer home why best practice is best practice.

I'm hoping the text editor + project directory approach helps force ML projects away from a single file and towards some sort of codified project structure. Sometimes it just feels like there's too much information in a file and it becomes hard to assign it to a location mentally (a bit like reading a physical copy of a tough book vs a kindle copy). Any advice or thoughts on this would be appreciated!

Ask HN: Is Computer Science still a good choice?

12•speedylight•4h ago•12 comments

Ask HN: How do you handle logging and evaluation when training ML models?

2•calepayson•2h ago•1 comments

Ask HN: What Are You Working On? (Nov 2025)

454•david927•4d ago•1329 comments

Ask HN: What's your solution to tech addiction?

4•asim•4h ago•6 comments

Ask HN: How to learn concurrency?

32•shivajikobardan•14h ago•18 comments

Ask HN: How common is banning Docker?

9•martypitt•7h ago•11 comments

Ask HN: Looking for a good course to learn proof assistant Lean 4

4•rabarbers•9h ago•0 comments

Ask HN: What metrics do you track in a Conversational Agent?

4•shubhamintech•10h ago•0 comments

Ask HN: How does one stay motivated to grind through LeetCode?

84•blutoot•2d ago•101 comments

Starting Debugging Session from CLI

2•regular8901•12h ago•0 comments

Ask HN: Could Microsoft replace its CEO with ChatGPT?

23•nothrowaways•1d ago•36 comments

The Lotus program analysis framework

2•cutelimination•1d ago•0 comments

Ask HN: How would you set up a child’s first Linux computer?

220•evolve2k•5d ago•296 comments

Ask HN: Senior people, how did your career evolve?

80•Seb-C•3d ago•50 comments

Ask HN: What do you do while LLM is writing code

7•me551ah•1d ago•13 comments

Tell HN: X is opening any tweet link in a webview whether you press it or not

647•stillatit•1w ago•519 comments

Ask HN: My family business runs on a 1993-era text-based-UI (TUI). Anybody else?

315•urnicus•1w ago•308 comments

Ask HN: Who is hiring? (November 2025)

400•whoishiring•1w ago•579 comments

Ask HN: How do you get over the fear of sharing code?

74•sodokuwizard•5d ago•90 comments

Ask HN: What open source LLM agent do you guys use and why?

6•_345•1d ago•2 comments

Ask HN: Effective way to deal with mosquitoes?

19•simonebrunozzi•2d ago•34 comments

You've reached the end!