For the character's movement, I filmed myself on my phone, used AI pose estimation to turn the footage into SMPL-X body motion, then retargeted that onto a 3D character. The movement is my performance, and the voice is mine. The face is a 3D character model, not a scan of me.
At the end, you can talk to the character live with your voice, and he answers in character using LiveKit and OpenAI realtime voice. There's also a guide mode at https://film.jashtechno.com/?director where you can ask how it was made. Talk directly at https://film.jashtechno.com/?talk. Quality tiers adapt to the device; best on desktop Chrome with headphones. I'd appreciate feedback on the motion, performance on lower-end devices, and the voice conversation.