In this class, we will explore setting up a 3D billboard and virtual production using Unreal Engine’s nDisplay technology. We will also focus on using Unreal to create immersive 3D visuals that work perfectly for projects like brand activations and virtual environments. The main idea is to project a 3D scene onto LED screens, where perspective is crucial; the 3D effect works only from a specific angle. This setup is similar to what brands like Balenciaga have done, integrating Unreal Engine into their marketing campaigns.
We begin by setting up the physical and virtual spaces in Unreal. nDisplay is the main tool we use for managing multi-screen setups, and it’s essential for rendering 3D scenes onto LED screens. Once you have the Unreal project open, we must create the nDisplay configuration by navigating to the nDisplay Config option. This configuration controls the virtual camera and determines how the project is rendered and displayed on the LED screens. We will import the curved wall meshes or other screen setups (like dual monitors), and start creating viewports based on how you want to project the 3D scene.
The key to achieving the 3D billboard effect is projection mapping. Unreal Engine allows you to map the scene onto the LED screens by using specific viewports, which are created under Cluster Nodes in the nDisplay settings. These nodes are essentially the IP-based connections, where each screen you use gets its IP address. Once you have the screens set up, the system will project the scene in real-time, which is perfect for virtual production.
For a more in-depth look at rendering, the ICVFX Camera is crucial. We will add this camera to the scene to help render the right perspective, especially when dealing with curved or angled screens. The camera helps to align the scene with the LED screens accurately. This allows you to create realistic virtual environments, where the perspective shifts as the viewer changes their position, giving a true 3D effect.
As for the step-by-step Unreal workflow, start by opening an Unreal project and selecting the nDisplay option. From there, we will create a new configuration file and import the meshes — you can either use pre-existing assets or create your own, like curved screens or flat panels. Once imported, drag these meshes into the scene and set them up to match the desired display configuration.
Next, we need to create a Cluster Node for each of the screens, ensuring that each one has its own configuration. From here, we will use the viewport settings to adjust the screen outputs, defining the region where the content will appear. By doing this, we will make sure that the projection is mapped correctly onto the screens and adjusted for the angle of view. After setting the screen positions and projections, you can then import an ICVFX Camera to finalize the setup.
One of the most important steps is using Switchboard — Unreal’s tool for managing live IP connections. With Switchboard, you can connect the project to external devices, like the LED screens, and ensure that everything is running in real time. It helps you manage the live feed and monitor the connections for each screen. The final step is rendering the scene using Movie Render Queue, which allows you to capture what’s projected onto the screens and ensure the output matches the setup.
By the end of the class, you should have a solid understanding of how to set up a 3D billboard in Unreal Engine, using nDisplay for multi-screen projections, and rendering in real-time with Switchboard. This is an essential workflow for anyone looking to integrate Unreal Engine into commercial applications or virtual production environments. It’s all about creating a seamless experience where the virtual world feels as real as the physical one, and with these tools, it’s easier than ever to make that happen.