I think the article is somewhat over-representing the difficulty here. Once you're at the team selection screen and choosing your lineup, there are only 15 possible combinations to choose from. Once you factor in that many/most teams are designed around one or two specific synergies, and that your opponent's team is only partially known (you see their Pokemon species but not the moves, stat distributions, etc), which puts huge error bars around whatever prediction you're trying to make, it usually turns out that you're really only picking from 1-3 realistic choices, and there's a very paper-scissors-rock nature to it that you can't really "learn" in the ML sense.

I think you could have gotten equivalent results on such a predictor using much simpler regressions and/or heuristics, once you've already fixed the matchup.

(Also, I just think it's funny how the paper keeps citing "(Zheng, 2020)", etc, like it's a scholarly article or something. Aaron Zheng is a VGC YouTuber and what is being cited is just an online guide a la GameFAQs)

I think even though there are limited choices given the teams the problem of learning these teams are interesting given the sheer variety of possibly teams. A good model would probably need to be learn something useful about competitiveness Pokémon.

I might try my hand at this problem using the open sheet format for more data.

Oh Yes, I am so excited seeing this!

I have recently started watching a lot of WolfeyVGC and so the graph of incineroar being the most used etc. are so true.

There are a lot of other things that smogon does like the best hacked pokemon (ie. you can get abilities / movesets but not anything else, and some are banned like wonder guard) and there blissy with the transform ability is the strongest.

Honestly, Pokemon VGC isn't that balanced. Incineroar / IIRC before it, there was thundrous. But still its decently balanced that the game works. WolfeyVGC is an absolute delight to watch!