A lot of testing went into the motion capture for my models. My first test was with the cat model. V-Tube Studio works with the parameters you've set and uses webcam tracking and inputs + outputs to get the head to move correctly with your own motions. The main issues that come up with the motion tracking is the user not editing the inputs correctly to ensure the model moves smoothly which was the issue with my first model test. If I went back and edited these inputs better I think Hazel would move much better. But due to time constraints I left her as she was.
(Fig 1. Hazel Rig Test)
(Fig 2. A look at the parameter settings in V-Tube Studio)
(Fig 3. How the webcam tracking works)
For my second test with my main model I went the extra mile and purchased V-Bridger, an additional plug in that utilises iPhones ARKit which allows more fluid movement and extra mouth parameters such as Funnel, Pucker, Mouth Z, etc. Originally I thought this software just worked with V-Tube studio on the phone but I soon discovered you actually have to purchase iFacialMoCap for the iphone to use V-Bridger so I made that extra purchase as well. I followed a tutorial by a famous rigger who is known for very good mouth movements through V-Bridger below;
(Fig 4. VBridger Tutorial by PiPuProductions / Youtube)
I immediately found that once I plugged in VBridger there was a notable difference in how model 2 tracked compared to model 1. I spent a lot more time carefully setting the inputs and outputs for my model and was surprised at how well the outcome was. She isnt perfect by any means, Mike gave me feedback in my final presentation on her mouth being too small on opening which I hope to fix after submission and I still think her head XYZ angles could be improved on but in comparison to a lot of newbie Live2D users I think I did exceptionally well.
(Fig 5. Testing Hazel on V-Tube Studio with V-Bridger Plug In)
I even went as far as to rig the toggles for her reactions. Below you can see the concept sketches and a video of the final reactions in use. Each reaction is toggled by a key on the keyboard, however streamers normally purchase a seperate streamdeck keyboard for these.
(Fig 6. Gallery of Expression Sketches)
(Fig 7. Expression on Motion Capture minus shocked expression)
And seen previously in my other blog post I had an arm wave and peace sign also rigged up to keyboard toggles. I was really happy with the final out come of Hazel and her tracking. I think I was able to develop a lot of my personal skills like decision making, time management, etc. further than before since this was a solo project. I managed to get it done on time and to a significant level!
The final addition to my portfolio would be a Debut video exploring motion graphics on After Effects. Originally I was going to attempt to rig the cat model on Duik however with only 2 weeks left of my deadline trying to learn another new software wasn't feasible so I opted to try and improve skills in a software I already knew. The last time I touched After Effects properly was back in 2017 during my film studies classes so I was trying to re-introduce myself to the software. Since there was little time left I didnt want to go too extreme with motion graphics so I opted to just keep it as simple as I could. I watched several types of debut videos and based my own around theirs.
(Fig 8. Millie Parfait Debut Video / Youtube)
(Fig 9. Squiiiishhh Debut Video / Youtube)
(Fig 10. Megalodon Debut Video / Youtube)
(Fig 11. Smitherooniee Debut Video / Youtube)
I spent some of my own money and commissioned an artist on Fiverr to create a theme song for Hazel which would also give me full commercial usage over the song. Using this song I broke down my video into sections to allow me time to plan, I ended up breaking it down into 10 second parts so I would work on one section per day while balancing other work.
I followed loads of different tutorials and just messed around with different features on After Effects. I re-learnt the graph editor and how to ease-in and out keyframes. I went as far as to get some expression codes for certain text effects. There was a lot of frustrations while using the software though, particularly with making repeating background elements. Knowing me I choose the hardest way to make them by trying to use motion tiles and repeaters, theres probably an easier way to do it but I had to fumble around with the short time I had. Overall though I'm happy with the debut video and I think I captured Hazel in a way that is engaging and exciting for her future audience. The debut video teases her without revealing too much and shows off all the hard work that went into her model.
(Fig 12. Final Render of Debut Video)
Final Reflections
Now that I'm putting the final pieces together and getting ready to submit I'm reflecting back on my entire project. I had a lot of worries on whether or not this was enough of a project to submit for my degree, most others did animations or 3D environments. I now realise that this project is just as valid as all the others. I learnt so much and utilised my animation skills and learnt new ones that are transferrable into other areas of our discipline. Not only did I learn animation skills but I also pushed my own personal development skills. I have a better guage on time management, learning to put ideas behind me if they arent within the time scope while juggling extracurricular areas like class rep and being a committee member of a society . I've learnt how to set attainable and SMART goals with my project. I pushed myself and not only enhanced my Character Design skills but I went as far as to learn a completely new software and re-learnt an old one. This portfolio captures so many different areas of animation. I know I could improve lots of different areas but with the time constraints I worked with what I had. Over the summer I'll take the feedback from this project and my own observations and work hard to continue improving my skills further.
Thank you to the Staff in the Animation Department and most importantly my studies advisor Henry Melki for pushing me to reach farther with my projects than I had originally planned. Without their guidance I wouldn't of had the confidence in my skills to have attempted something as grand as this project. I know I will take their advice with me throughout my career within animation and beyond.
Comments