Introduction to the XVERSE 3D-GS UE Plugin
XVERSE 3D Gaussian Splatting UE Plugin is an innovative tool developed by XVERSE Technology Inc., based in Shenzhen, China. This plugin is specifically designed for Unreal Engine 5 (UE5) and is crafted to offer users real-time visualization, management, editing, and scalable hybrid rendering of 3D Gaussian Splatting models. This new technique emerges as a powerful method for reconstructing 3D scenes from multiple photographs and details about its origin can be found here.
Features
The plugin is built using UE5 Niagara, which capitalizes on the advanced features of Unreal Engine to efficiently render and manage Gaussian Splatting models. Although the project is in its early access phase, it currently offers a variety of features including:
- Niagara-Based Rendering: High-quality real-time visualization and rendering of 3D Gaussian Splatting models.
- Easy Importation and Conversion: Simple transformation from original Gaussian Splatting scenes (.ply file) into the plugin’s environment.
- Hybrid Rendering: Compatibility with other Unreal Engine assets for a seamless experience.
- RTS and Volume-based Cropping: Easily crop and manage the view of Gaussian models.
- Dynamic Illumination: Support for varying lighting settings within the Gaussian Splatting scenes.
- Automatic LOD Generation: Supports scenes with over 200,000 point clouds in Niagara.
- Training Tools: On Windows systems, users can train i.e. convert, a given MP4 video into a Gaussian Splatting ply file using XV3DTools.
Future Enhancements
XVERSE 3D-GS UE Plugin is set to expand its capabilities with several new features planned for future updates:
- Dynamic LOD Rendering.
- Automatic collision generation.
- Support for preview windows.
- Interactive editing of 3D-GS assets.
- 3D-GS asset compression.
Getting Started
Interested users can easily begin with this plugin via video tutorials available on platforms like YouTube and Bilibili. The tutorials are especially helpful for beginners looking to understand the application of 3D Gaussian Splatting in Unreal Engine 5.
System Requirements
To run XVERSE 3D-GS UE Plugin, one needs a Windows 10 or 11 operating system with Unreal Engine versions 5.1.x, 5.2.x, or 5.3.x, and CUDA 11 or higher if using the XV3DTools.
Download and Usage
Users can download the plugin from the GitHub release page. The installation involves downloading a version-appropriate zip file, extracting it, and placing the XV3dGS folder into the Plugins directory of Unreal Engine. Additionally, users can download demo data as sample projects to experiment and learn from.
Local Training on Windows Platform
The plugin offers training tools (XV3DTools v1.1.1) for converting MP4 videos into Gaussian Splatting ply files. This feature, however, requires CUDA version 11 or higher. Users can refer to the provided tutorials for detailed guidance on setting up and using these tools.
Integrating and Enhancing Projects
With XVERSE 3D-GS UE Plugin, users can enjoy the following advanced features for project enhancement:
- RTS Transform: Easily transform 3D assets in a scene using intuitive controls.
- Model Clipping: Precisely crop models for specific visual effects.
- Dynamic Illumination: Engage different UE light types for a rich visual dynamic.
- Color Adjustment: Modify overall color schemes for specific aesthetic preferences.
- LOD Management: Automatically adjusts the level of details for optimal performance.
Packaging and Distribution
The plugin supports packaging of Unreal Engine levels into executable files, allowing for easy distribution of projects on Windows systems.
Conclusion
XVERSE 3D-GS UE Plugin is a powerful tool for developers working with Unreal Engine 5, offering a rich set of features that increase the ease with which 3D scenes can be constructed, visualized, and manipulated. As development continues, more features and updates are anticipated to further enhance what the plugin can offer to developers and artists around the world.