By the way, the OrangePi 5 is a pretty good SBC. Much better bang/bucks than RPi, and the mainline kernel support is pretty good and getting better with every release thanks to the folks at Collabora.

https://gitlab.collabora.com/hardware-enablement/rockchip-35...

Pretty much that is where most of these SBCs fall off my list. Without an active OS development its only 1/2 of the puzzle.

> Sadly, but this was almost expected, there does not seem to be any kind of GPU support in the version that I have chosen. A quick check with glxgears confirms that there is just a software pipe for rendering.

Stuff like this is why people keep picking Raspberry Pi. There's tons and tons of alternative SBCs that have better price to performance on paper, but the software support is always awful. You're always limited to a few distro images released by the SBC vendor, and there's no effort spent by them on getting everything working. This product came out in December 2024, and they STILL don't have images with working GPU acceleration.

For a quick bring-up and implementation, take a look at this repo: https://github.com/Pelochus/ezrknpu

I have a Radxa Rock 5C (on Armbian) and it runs various models rather well. Trying to convert models is kind of a pain, though, so watch out.