Christopher Moonlight Productions

Christopher Moonlight Productions

Breakthroughs and Roadblocks on the path to Escape From Planet Omega-12

Fighting with Open-Source AI to Make It Work Properly

Christopher Moonlight's avatar
Christopher Moonlight
Aug 20, 2024
∙ Paid
Share

Whoever says AI takes no effort either doesn’t know what they’re talking about or is a straight-up liar and more likely a bit of both because people often like to pretend they’re an expert on things they know nothing about. Sorry, I’m just frustrated because I’ve been spending weeks trying to get Stable Diffusion, the open-source AI software chosen to create certain character animations for Omega-12, to do what all the nifty tutorials I’ve been watching show me it doing. From what I can tell these functions are as complex and involved as any CGI pipeline and I’m using a bit of that, too. I’m currently trying to use the ComfyUI interface with AnimateDiff and IPAdapter to create the same kind of animations you see people creating with TikTok dancers. I figure if it can create animations with those complex moves then character actions should be no problem but all it’s been is weeks of error messages.

It hasn’t all been bottlenecks in the production pipeline, though. Thanks to the amazing Aitrepreneur I’ve gotten some installs up and running and after some funny tests, I can now get people and creatures to emote and talk.

Okay, so that particular test was only successful in being horrifying but that’s an alien creature that the AI has no reference for. If you want to see a rough but successful text, it’ll be after the subscription break for my supporters. Be warned, a lot of my experiments for animating Tara are NSFW because we have to animate her clothes on, later.

Keep reading with a 7-day free trial

Subscribe to Christopher Moonlight Productions to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 Christopher "Moonlight" Cooksey
Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture