Methodology doesn't support the conclusion.

Try using images that it wasn't trained on.

So that is obviously a significant relationship between ChatGPT estimate and the Henselman Guide BFP numbers. But just being a significant relationship doesn't necessarily mean it's useful. I'd bet that BMI (which the author repeatedly mentions is outdated and not very useful), is almost certainly also significantly correlated with BFP values.

Eyeballing that plot, it looks like ChatGPT estimates are +/- 10%. I'm wondering what the cutoff for usefulness is. I wouldn't' be surprised if BMI is that level of correlated or better.

I just fed 4o and o4 mini a photo of my torso and gave it my height and asked it to estimate my body weight and body fat %. It was 20-40 lbs too low, so way off.

Given the images and text are definitely in the model training set, I'm surprised the results are this inaccurate.

Dexa is expensive, you can get a modern smart scale for 50€, the cheapest accurate method would be the Caliper tongs.

What can it be good for? Video surveillance with metadata enrichment? Profiling? Losing body fat takes time. A smart mirror that displays body fat?

Just by looking at the graph I know that this will be rubbish - because of the line

When you draw a line this means that your model expects a linear relationship between the variables. Otherwise this is either a feel good line, or incompetence.

Can AI estimate psychological profile based on a photo of the face (face structure)?