A Step-by-Step Guide to Configuring End Display for LED Walls

Presented by Drew Smith, ICVFX Technical Director at Vū Studios

Virtual production has transformed the way studios create content, merging real and virtual elements to produce stunning, seamless visuals. At the heart of this technology lies nDisplay configuration, a crucial element that ensures smooth integration between digital content and physical LED walls or volumes.

This guide, inspired by Drew Smith’s detailed video tutorial, will walk you through the process of setting up an nDisplay configuration using Unreal Engine. By following these steps, you’ll be able to get your virtual production projects up and running, whether you’re a seasoned professional or new to the world of ICVFX (In-Camera Visual Effects).

Introduction to nDisplay Configuration

nDisplay configuration is essential for anyone looking to utilize LED walls or volumes in their virtual production setups. It involves setting up screens within Unreal Engine, configuring networks, and using tools like Switchboard to manage multi-user environments. Through this guide, we’ll outline how to prepare your setup and ensure all elements, from tracking systems to visual projections, are in sync.

What You'll Need:

• Unreal Engine (v5.3.2 or higher recommended)

• Epic Games Launcher

• Vū One hardware setup

• Tracking systems (e.g., Vive Mars)

• Switchboard application for multi-user management

Step 1: Setting Up Unreal Engine for Virtual Production

The first step in your virtual production journey is to ensure your Unreal Engine environment is correctly configured. Here’s how:

1. Install Epic Games Launcher: If you don’t already have it installed, download it from the Epic Games website.

2. Log In: Create a free Epic Games account or log into your existing account.

3. Access Unreal Engine: Navigate to the Unreal Engine tab on the left side and switch to the Library section.

4. Select Your Engine Version: Make sure you are using Unreal Engine 5.3.2 or above. You can add or change versions by clicking Add Engine Versions.

With Unreal Engine ready, it’s time to create a project specifically for virtual production.

Creating a Project with the ICVFX Template

Unreal Engine provides a specialized ICVFX template that comes pre-packaged with plugins needed for virtual production, such as DMX and in-camera VFX. Here’s how you can start:

1. Start a New Project: Select Film, Video, and Live Events from the new project categories.

2. Choose the ICVFX Template: This template integrates essential plugins and settings for virtual production. Enable Ray Tracing for enhanced lighting quality.

3. Name Your Project: Keep names short (under 20 characters) and avoid spaces. Use underscores or dashes if needed.

Step 2: Building Your nDisplay Configuration

Now that your project is set up, it's time to configure your nDisplay. This involves creating a screen representation of your physical LED wall within Unreal Engine, allowing for accurate visual outputs.

Organizing the Content Browser

1. Navigate to Your Content Browser: Locate the In Camera VFX BP folder. This is where you’ll manage your nDisplay configurations.

2. Remove Unnecessary Configurations: If there are existing setups, remove them to avoid confusion.

3. Create a New nDisplay Configuration:

   • Right-click in the content browser and select nDisplay Config.

   • Name your configuration appropriately (e.g., Vu_Demo_NDC).

Setting Up the Display Screen

To accurately replicate your LED wall in Unreal Engine:

1. Adjust Screen Size: Ensure the dimensions match your actual LED wall. For instance, if you have a 16x9-meter screen, set these dimensions in centimeters (Unreal uses cm as a unit).

2. Position the Display Screen: Place the screen at the zero-point (origin) to maintain uniformity.

Adding Additional Components

For a functional virtual production setup, include the following:

1. ICVFX Camera Component: This camera will sync with your tracking system. Ensure it is not childed to the nDisplay screen, but rather to the root component.

2. Lighting and Environment Setup: Configure lighting for accurate rendering. Use Ray Tracing to enhance the quality of reflections and shadows.

Step 3: Network and Cluster Configuration

The network cluster is vital for connecting your control systems, render nodes, and LED walls. Here’s how to set it up correctly:

Configuring the Cluster IP

1. Add a New Cluster: Define the cluster IP to match your render node’s IP address.

2. Enable Full Screen Mode: Ensure your visuals display correctly across the LED wall.

3. Name Your Components: Properly label components (render nodes, host, viewports) to make future configurations easier to manage.

Understanding Node and Viewport Setup

• Node Resolution: Set the node size based on the resolution of your LED wall (e.g., 3840x2160 for 4K).

• Viewport Configuration: Align the viewport to your node, ensuring that visuals are correctly projected onto the LED mesh.

Step 4: Multi-User Environment with Switchboard

Switchboard helps manage multiple systems, allowing control and render nodes to communicate seamlessly. Drew walks through the process in the video, and here’s a summary:

Setting Up Switchboard

1. Add Devices: Include both control and render devices, and assign them to correct IPs.

2. Adjust Settings:

   • Core Usage: Use all available cores for optimal performance.

   • Sync Policy: Set to NVIDIA for smoother rendering across nodes.

Launching Your Multi-User Session

The multi-user environment allows different systems to sync and operate together, akin to a LAN party setup:

1. Start the Multi-User Server: Ensure the control node can communicate with render nodes.

2. Verify Connections: Check that both devices are connected properly. Handshake errors can be resolved by verifying IP settings.

3. Launch the Control and Render Nodes: Once everything is synced, you’re ready to project visuals onto your LED wall.

Step 5: Final Checks and Running Your Project

Testing the Tracking System

To ensure accurate motion capture, verify that your tracking system is properly connected:

• Use tools like Vive Mars for precise camera tracking.

• Check for a green status in the live link window. Yellow or red indicates connection issues that need troubleshooting.

Launch and Monitor Performance

1. Compile and Export: Compile your nDisplay configurations and export them for future use.

2. Use Switchboard for Final Launch: With everything set, launch the final render configuration from Switchboard, ensuring the LED wall displays correctly.

3. Monitor the Display: Make real-time adjustments as needed, using the editor to control the display output.

Conclusion: Simplifying Complex Setups with Vū One

Virtual production doesn’t need to be intimidating. With the right tools and step-by-step guidance, even the most complex setups can be simplified. Vū One offers a streamlined approach that brings together advanced Unreal Engine capabilities with easy-to-follow configurations. By setting up a robust nDisplay configuration and leveraging multi-user environments, studios can enhance their storytelling capabilities, delivering stunning visuals on LED walls with unparalleled ease.

For more detailed visual guidance, be sure to watch the full video tutorial by Drew Smith, where he demonstrates each step live. Happy filming!

About Vū Studios

Vū Studios empowers creators to elevate their content production with state-of-the-art virtual production technology. Learn more about our solutions and how they can transform your next project by visiting Vū Studios.