Unreal Engine 5.7: Billions Of Triangles, In Real Time

Key Concepts

• Substrate: A new material creation system in Unreal Engine 5.7 that allows for multi-layered material properties and realistic light interaction.
• Nanite Foliage: An enhancement to Nanite that enables the rendering of millions of small elements like plants with efficient Level of Detail (LOD) management, eliminating popping artifacts.
• MegaLights: A system for real-time rendering of hundreds of lights with soft shadows, directional lights, shadow-casting particles, and shadowing on hair.
• Metahuman: A realistic character creation tool, with updates focusing on hair simulation, skin appearance, and deformation.
• Metahuman Animator: A feature allowing users to scan themselves and have their virtual character mimic their gestures.
• Live Link Face: A real-time facial expression capture system that maps facial movements to virtual characters.
• Virtual Haircut System: A new tool for creating and animating virtual hairstyles using sliders and imagined joints.
• Physics Interactions: Improved physics for characters, enabling more realistic simulations.

Unreal Engine 5.7: A Blockbuster Release

Unreal Engine 5.7 has been officially released, offering an all-in-one solution for creating animations, virtual characters, video games, and movies. A significant aspect highlighted is that these advanced features are available for free for most users and applications. The release focuses on three core technologies that significantly enhance realism and efficiency.

1. Substrate: Next-Level Material Realism

Main Topic: Substrate is a revolutionary material creation system that elevates the realism of rendered objects.

Key Points:

• Advanced Light Simulation: Substrate leverages Unreal Engine's ability to simulate millions of light rays interacting with an object, dictating how the material should respond.
• Imaginary Material Properties: Users can define a wide range of material properties for objects, going beyond physical limitations.
• Multi-Layered Materials: The system allows for the creation of materials with multiple distinct layers. For example, a metal core can be covered with a smooth colored coat, and the light interaction between these layers can be simulated.
• Production Ready: Previously a concept explored in research papers, Substrate is now practical and production-ready for industry use.
• Impact: This brings complex multi-layer simulators, previously confined to research, to millions of users for free.

Technical Terms:

• Light Simulation: The process of calculating how light behaves in a virtual environment.
• Material Properties: Characteristics that define how a surface appears and interacts with light (e.g., color, reflectivity, roughness).

2. Nanite Foliage: Seamless Geometry Detail

Main Topic: Nanite Foliage enhances the rendering of detailed environments, particularly foliage, by improving Level of Detail (LOD) management.

Key Points:

• Rendering Millions of Elements: Nanite Foliage can render vast numbers of small, detailed elements like plants on screen.
• Efficient Level of Detail (LOD): The system intelligently swaps between simpler and more complex versions of an object based on the viewer's distance.
  • Far Distance: Renders fewer triangles for performance.
  • Close Distance: Swaps to more detailed geometry.
• Elimination of Popping Artifacts: A significant improvement over traditional LOD systems, Nanite Foliage seamlessly transitions between geometry levels, eliminating visible "popping" or sudden changes.
• Resource Saving: This seamless swapping significantly reduces computational resources required by the engine.

Methodology/Framework:

• Level of Detail (LOD) System: A technique where different versions of an asset are used based on distance to optimize performance. Nanite Foliage refines this by making the transitions imperceptible.

Technical Terms:

• Nanite: Unreal Engine's virtualized micropolygon geometry system that allows for unprecedented detail.
• Foliage: Vegetation, such as trees, plants, and grass.
• Triangles: The basic building blocks of 3D models in computer graphics.
• Popping Artifacts: Visual glitches that occur when an object's geometry suddenly changes due to LOD transitions.

3. MegaLights: Real-Time Lighting Powerhouse

Main Topic: MegaLights is a system that dramatically improves real-time lighting capabilities, enabling hundreds of lights with soft shadows.

Key Points:

• Hundreds of Lights in Real-Time: The system allows for the rendering of numerous lights simultaneously, even in complex scenes like a "black market scene."
• Soft Shadows: Each light casts realistic soft shadows, enhancing scene depth and realism.
• Advanced Lighting Features: MegaLights supports directional lights, shadow-casting particles, and shadowing on hair.
• Performance and Quality: It offers higher visual quality, improved performance, and reduced noise compared to previous lighting solutions.
• Efficiency in Ray Tracing: The system is a masterclass in efficient ray tracing, addressing the challenge of rays finding light sources in complex scenes.
• Beta Stage: MegaLights has moved from experimental to beta, indicating increased stability and readiness for wider use, though not yet final.

Argument/Perspective:

• The development of MegaLights represents a significant step forward in overcoming the computational challenges of real-time ray tracing for lighting.

Technical Terms:

• Ray Tracing: A rendering technique that simulates the physical behavior of light to create highly realistic images.
• Soft Shadows: Shadows with blurred edges, which appear more natural than hard-edged shadows.
• Directional Lights: Lights that emit rays in a single direction, simulating distant light sources like the sun.
• Shadow-Casting Particles: Small visual elements that can cast shadows.

Other Notable Features in Unreal Engine 5.7

Beyond the three core technologies, Unreal Engine 5.7 includes several other impressive updates:

1. Metahuman Enhancements

Main Topic: Significant improvements to Metahuman, the realistic character creator.

Key Points:

• Hair Simulation: More accurate strand-by-strand hair simulation.
• Skin Appearance and Deformation: Correct simulation of skin appearance and how it deforms.
• Metahuman Animator: This feature, previously showcased, allows users to scan themselves and have their virtual character mimic their gestures.
• Real-Time Facial Capture with Live Link Face: The ability to capture facial expressions in real-time via a camera and apply them to a Metahuman character. This is presented as a crucial real-time test for the technology.

Technical Terms:

• Metahuman: A tool for creating highly realistic digital humans.
• Metahuman Animator: A component of Metahuman for capturing and applying facial performances.
• Live Link Face: An application that enables real-time facial motion capture.

2. Virtual Haircut System

Main Topic: A new, intuitive system for creating and animating virtual hairstyles.

Key Points:

• Slider-Based Creation: Users can easily assemble new hairstyles by adjusting sliders.
• Animation Capabilities: Hairstyles can be animated as if they were part of a character's body, using imagined joints.

3. Realistic Physics Interactions

Main Topic: Enhanced physics simulations for characters.

Key Points:

• More Realistic Interactions: Characters exhibit more lifelike physics behaviors.
• Perturbation Tests: The system supports advanced "perturbation tests," a common practice for computer graphics researchers to analyze physics simulations.

Conclusion and Takeaways

Unreal Engine 5.7 represents a significant leap forward in real-time rendering and content creation. The release emphasizes making cutting-edge technologies, previously confined to research, accessible and production-ready for a broad audience, often for free.

Main Takeaways:

• Substrate offers unparalleled material realism through multi-layered simulations and advanced light interaction.
• Nanite Foliage provides highly detailed environments with seamless and efficient geometry management, eliminating visual artifacts.
• MegaLights brings powerful real-time lighting capabilities, including hundreds of lights with soft shadows, to complex scenes.
• Metahuman continues to evolve with improved character realism and real-time performance capture.
• The availability of these advanced features for free underscores Unreal Engine's commitment to democratizing high-end content creation.

The video encourages users to explore these new features and share their creative projects.