For my independent learning experience, I learned how to use Rogo Digital's Lipsync, an external plugin for Unity (like Playmaker). This plugin allows you to sync an audio file with facial animations, allowing your characters to come to life with dialogue. The plugin has some issues and a bit of a learning curve, but it is very powerful and has excellent developer support. Lipsync works by mapping "phonemes," or specific sounds, to different facial movements. Sometimes, different sounds are produced by making the same mouth shape (i.e., M, B, and P...
Assignment 6 – Josh Daghir
by Joshua Daghir
- November 19
- in
In the complexities of crafting a visually compelling virtual world, it is easy to forget the importance of sound in creating a fully immersive experience. If virtual reality is meant to transport the user to a new world, then the more senses involved, the more complete the experience feels. Much like video, capturing sound for VR purposes is extremely different from traditional audio recording. How sound is captured in 3D space greatly impacts the polish of the final product. There are many tools to capture 3D sound. I find binaural...
Assignment 4 made me realize that animation is crucial for an experience to feel immersive. Animations make characters feel real. Despite their importance, applying animations is the trickiest Unity process that I have encountered so far. One of the reasons why adding animation is so complicated is because there are so many external programs involved. Mixamo and Fuse are incredible resources, and I cannot believe that they are currently free. The Mixamo library of animations is massive, and they work with all humanoid characters. I also created my own character...
Assignment 2 – Josh Daghir
- September 25
- in
Josh Daghir I expected using Unity to be extremely difficult for me, but after creating my first scene, I realized that I have done things like this before. When Prof. Pacheco was mentioning the student who brought his origami to class, I thought, “I must not be a 3-D thinker, I’ve always been terrible with origami and sculpture and any other 3-D project that students do in a high school art class.” But after working with the software, I realized that this type of work is what I loved to...