- SAM 3.1 to segment the barbell weight plate
- ViTPose+ Large to measure the hip hinge angle, which serves as a backup for segmenting the reps. The pose data can definitely be used more later.
- Gemma 4 26B through the Gateway's TypeSafe-compatible API to output the probability of the back being rounded or not. The predictions line up well with how I intentionally performed each rep.
Of course, there are many caveats to what is good form, as it depends on the individual. All said, this has the pieces in place to quickly make adjustments to fit the individual better.
In short, a tool like this gives people data to assess their form and improve over time.
Let me know what you think!
Demo video: https://www.youtube.com/watch?v=917J5oOvcBM