OscLiveLink

Warning The System currently supports Degrees, which can be selected in Project Settings. Radians will be supported in the next update.

Using the Hallway Tile standard, this plugin receives OSC messages and applies them as a LiveLink source to animate MetaHumans in Unreal.

Example using web platform and local Bridge application on Windows

Installation

• To install the plugin, download the latest release from the Releases page on Github.

• Create a new folder named "Plugins" in the root of your Unreal Engine Project.

• Unzip the contents of the latest release ZIP file downloaded from Github into the Plugins folder.

Note: If you're working with a different version of Unreal (such as on Mac instead of PC), you'll need your project to be a C++ project in order to compile the binaries for your platform. Adding a new C++ class before installing the plugin will convert a Blueprint-only project to a C++ project.

• Open your Unreal project and navigate to Edit>Plugins>Project. If installed properly, the plugin will appear and be enabled by default.

Usage

Note: Be sure to read through both this section and AR Kit Bugfix if your are using Unreal 5.0.1.

• To use the plugin, start the Hallway Tile application and enable OSC Streaming.

• This plugin acts as a host for the Hallway application client. This means you will need to configure the correct IP address and port in both the Hallway application and Unreal Engine to share information between the two. You can configure the plugin's settings by navigating to Edit > Project Settings > Plugins > LiveLink OSC.

• If both applications are on the same computer, then you can use the localhost address: 127.0.0.1 for Hallway Tile's Host, and 0.0.0.0 for Unreal's Listening Address. (0.0.0.0 represents any possible address.)

• If Hallway and Unreal are running on different computers in the same network, use 0.0.0.0 or the IP address for the Hallway computer as Unreal's _Listening Address; and use the Unreal computer's IP address as Hallway's Host.

Note: Look up how to find your local IP address online if you're not familiar.

• The default port is 9001. This can remain unchanged unless another application requires that port.

• To use the OSC source, once per project you will need to navigate to Window > Virtual Production > LiveLink

• Add the source by pressing + Source > Message Bus Source > Hallway Tile OSC

• It will appear in the bottom left list of LiveLink sources. If the dot is green, everything is working properly. If the dot is yellow, there may be a address/port misconfiguration or a firewall blocking the OSC stream.

• Halway Tile OSC will now appear as an option in the list of possible options when you view your Metahuman's Detail's panel in Outliner > Default > LLink Face Subj.

• Use the Simulate play mode to control your camera while projecting face shapes on your Metahuman Character. You're all set!

_Subject selected, running in simulate mode with AR Kit Bugfix_

AR Kit Bugfix

There is a bug in Unreal's 5.0.1 version of Metahumans that has a missing blenshape name. This offsets most blendshapes to the wrong order, completely breaking the effect of face capture. This is not unique to Hallway Tile, it applies to AR Kit LiveLink as well. The solution to this bug involves copying the pose library from Unreal 4.27 to Unreal 5.0.1 and is described here.

Web Demo

If you’re running on Windows you can use the web version of Hallway + Bridge app. This is temporary and the Hallway team is working on a dedicated Windows app right now.

If you're running the web-version of Hallway, you'll need to contact Hallway and request the Bridge application to convert from the web's TCP to the UDP protocol. (If you're using the Mac version of HallwayTile, it will broadcast UDP directly.)

The web demo will broadcast TCP to port 9000, and the bridge application will convert it from TCP to UDP and forward to port 9001 by default.