3D Vtubing with mtion worlds

You can import your 3D avatars (both humanoids and none-humanoids) into your mtion world. You can either use motion tracking with the avatars (via VMC) or create NPCs with the models. Currently, we support both VRM and VSF model formats.

Import Avatars Into Your mtion world

VSF Avatar Import

To add a VSF model, you can click on the avatar button on the Hang Tool Bar, it will bring you to the avatar asset browser, and from there, you can directly import the VSF model from your PC.

Click on "import" to upload your VSF avatar

VRM Avatar Import

If you want to import a VRM model, you will need the mtion Unity SDK to import it. Here's a quick video guide on how to:

Step by step guide on VRM and VSF avatar import

Note: The VMC location for avatar has moved to a different location since the recording of this tutorial. You can find the VMC now located on the third tab down on the left side of the app labeled VMC Connections, it will have your Local Port + use the dropdown Avatars menu to select the character you just imported.

If you don't have the mtion SDK, visit the mtion SDK page to get started!

Set Up Camera Tracking For Your Avatars

In mtion, you can configure the virtual camera to follow, attach to, or focus on any object in the worlds, including your avatar. For VTubing, the "camera focus" feature ensures that the camera continually tracks your model, enhancing immersion—perfect for vlogs or livestreams! Here's how to set up Camera Focus.

Video guide: track your model with camera

1. Select or Create a Camera Choose an existing camera or create a new one in your scene.

2. Add "Focus on Object" Action Navigate to the node graph, locate the "Focus on Object" action node under your selected camera's available actions, and drag it into the graph.

3. Set Up the Target Object Use Force Clickthrough (Ctrl + click) to open the avatar's context menu. From the menu, choose "Head Reference" if you want the camera to track the avatar's head. Alternatively, select "Hand Reference" if you prefer the camera to track the avatar’s hands.

4. Connect the Target Node Connect the "Head Reference" (or "Hand Reference") node to the "Target" input on the "Focus on Object" node.

5. Configure the Trigger Set up a trigger for the camera focus. In this example, a hotkey trigger is used to activate the camera focus.

Camera focus on model's head

Set Up Interactions For Your Avatars

Set up Ragdoll mode on your avatars

Once you imported your avatars into the world, you can turn on Ragdoll mode in it's options. Once enabled, your avatar will react to things that interact with it. You can take advantage of mtion's interaction features to set up some interesting experiences for you and your community. Here's a video to help you get started on this:

Setting up ragdoll in mtion

Set up interactive TTS to your avatars

You can set up TTS to any avatar models you uploaded inside of your mtion world. The TTS can be triggered by yourself, or by your chat. It can be pre-defined text or real-time text input by your chat. Here's a quick tutorial guide on how to set it up 👇

Setting up 3D TTS

Setting up NPC mode on your avatars

You can turn on NPC mode on any of your avatar models. Once the NPC mode is on, you can also set a pre-defined area for your NPCs to move about. Here's a quick tutorial guide on how to set it up 👇

https://youtu.be/lEbAUcmTzdM?si=LxFLY_J02ukjirXfyoutu.be

Setting up NPC mode

Setting up interactive avatar animations & emotes

You can set up custom animations and emotes for your avatars and NPCs in mtion. Here's a quick tutorial guide on how to set it up 👇

Setting up animations and emotes