A Deep Dive Into UModeler X & Its New AI-Texturing Toolset

The Beginning of UModeler

Our journey in the world of game development began while working at a game company, where I was introduced to the exhilaration of 3D modeling within game engines. The explosion in smartphone usage, coupled with the rising popularity of the Unity engine among developers, highlighted the growing market for 3D assets and plug-ins. This trend was particularly evident with the expansion of the Unity Asset Store, a platform for Unity developers worldwide to sell 3D assets and plug-ins.

In the mid-2010s, I noticed a modeling-based 3D prototyping plug-in that was gaining significant traction among Unity developers. Recognizing a potential market opportunity, I decided to develop a Unity-specific 3D modeling tool. This led to the creation of UModeler, whose beta version I released in March 2017 on the Unity Asset Store. In December 2017, the official version of UModeler, complete with a UV editor, was launched and received a warm welcome from the Unity dev.

A demonstration of UModeler posted on Reddit in December 2017 garnered considerable attention, and the tool soon became one of the best-selling assets in its category.

Team Formation and Growth

Initially, I single-handedly managed the development of UModeler until the end of 2019. In November 2019, following our first seed investment, I began to expand the team. By 2020, the development of UModeler X necessitated further team expansion. I onboarded team members through a combination of hiring former colleagues and conducting open recruitments.

The Current Team Structure

Today, the UModeler team is composed of five core members: three programmers, a content developer, and a business/finance manager. Together, we are dedicated to the development of UModeler X, striving to enhance its capabilities and cater to the evolving needs of Unity developers.

UModeler

UModeler is a comprehensive tool that provides an exceptionally convenient environment for low-poly 3D modeling and prototyping directly within Unity. It's designed to streamline and simplify the 3D asset creation process, especially tailored for use in Unity.

Capabilities in 3D Asset Creation:

• Seamless Integration in Unity: UModeler eliminates the traditional export and import processes, allowing you to edit and manipulate 3D meshes directly within the Unity environment. This integration means you can see shader and VFX results in real-time as you modify the base mesh.
• Sketch-Based 3D Modeling: The toolkit includes various drawing tools and a PushPull tool, facilitating the intuitive creation of 3D shapes. This is particularly useful for quickly prototyping levels and bringing concepts to life.
• Robust Modeling Tools and UV Editor: With nearly 150 versatile tools, UModeler provides a comprehensive suite for creating 3D assets and levels. It includes adjustable 3D primitive shapes for added flexibility and a built-in UV Editor that allows for unwrapping any mesh and editing UVs directly in Unity.

Proprietary 3D Engine Development

The development of UModeler's 3D engine is focused on optimizing the tool for Unity's ecosystem. All the engine code is written in C#, aligning seamlessly with Unity's primary scripting language. This approach ensures high compatibility and performance within Unity, making it a natural extension of the Unity engine's capabilities.

Advantages for Unity Developers

• Efficiency: Unity developers can greatly benefit from the streamlined workflow UModeler offers, as it integrates seamlessly with Unity's environment. This integration reduces the need for switching between different software tools, saving time and resources,
• Real-Time Feedback: The ability to see changes in real-time, especially with Unity's shader and VFX, is a significant advantage. It allows for immediate iteration and improvement during development.
• Flexibility: UModeler's comprehensive toolset, from modeling to UV editing, gives developers the flexibility to create a wide range of 3D assets and levels, accommodating various styles and requirements.
• Accessibility: It's accessible not just to 3D modelers but also to indie game developers, level designers, concept artists, technical artists, VFX artists, programmers, and others involved in game development and asset creation.

UModeler X

UModeler X Development Timeline:

• Work on UModeler X commenced in August 2019, marking the beginning of a new chapter in 3D modeling within Unity.
• By mid-2020, with the addition of newly recruited team members, intensive development began.
• Verified Solutions Partnership with Unity in 2021
• A closed beta phase was conducted around mid-2022, which allowed for targeted testing and refinement.
• In September 2023, the open beta for UModeler X was launched, inviting broader participation and feedback.

Major Features of UModeler X

• Highend 3D Modeling

• Built-in UV Editor with LSCM Unwrapping

• Modifiers for non-destructive Modeling

• Deformation with Brush Tools

• Basic Rigging Tools

• Auto Rigging

• 3D Painting with the Layer system

Key Differences Between UModeler and UModeler X

The primary motivation behind developing UModeler X, despite the existing UModeler, stemmed from the limitations of the latter in editing high-polygon models. The original UModeler was architected with a focus on 3D modeling, which posed challenges in implementing advanced rigging and painting functionalities. Thus, UModeler X was developed to offer higher performance and greater extensibility.

The table representing the difference between the open beta version of UModeler X and the existing UModeler below clearly outlines the enhancements and new capabilities of UModeler X, including support for high-polygon modeling, advanced UV unwrapping using the LSCM algorithm, comprehensive rigging tools, and the addition of 3D painting and AI texturing.

In summary, UModeler X represents a significant upgrade from the regular UModeler, addressing the needs for high-polygon modeling and providing a suite of advanced tools for rigging, painting, and texturing, reinforcing its position as a comprehensive 3D modeling toolkit within the Unity ecosystem.

Introduction to AI-Powered Texturing in UModeler X

UModeler X now includes a powerful AI texturing feature, allowing users to generate images that seamlessly complement 3D models within the view. With AI assistance, you can create textures that are directly mapped onto the models, offering an immediate view of the final result. This feature is further enhanced by the painting mode's layer function, which enables the synthesis of various images, enriching the 3D models with a more complex and detailed appearance.

For more in-depth information, users are encouraged to consult the AI Texturing Online Manual.

Development Motivation

The AI texturing tool was conceived following the open-source release of Stable Diffusion and its WebUI, which provided a foundation for advanced texturing capabilities. UModeler X, equipped with a 3D painting mode, was perfectly poised to integrate this technology, facilitating the quick and easy creation and projection of textures. This integration process was refined through valuable feedback received during the development of the 4Ground9 game by nerdystar, where UModeler X's AI texturing feature played a pivotal role.

The 3D level created in collaboration with nerdystar received a positive response on Reddit's Stable Diffusion channel:

AI Training Process

Unique to UModeler X is that it doesn't require a separate AI training process. By connecting Stable Diffusion and the WebUI installed on a personal computer with UModeler X, the integration is instantaneous. This approach provides users the freedom to utilize their desired AI models without additional cost burdens.

Plans for the future include the introduction of a server-based AI texturing service, emphasizing the provision of high-quality AI models that are free from copyright constraints. Further details on this innovative service will be shared when more information becomes available.

In summary, the AI-powered texturing feature in UModeler X represents a significant leap forward in 3D asset creation, offering users a sophisticated, cost-effective tool that enriches the visual fidelity and detail of their models with the help of artificial intelligence.

Integration with Local Tools

UModeler X's AI texturing function operates by integrating with locally installed Stable Diffusion and its WebUI. This integration allows for a seamless and efficient texturing workflow.

For more information on this, refer to the Install Guide.

Capabilities of AI Texturing

• Dynamic Texture Generation: It can generate textures from the scene view's camera perspective, applicable to various types of 3D models. This includes background objects, character faces, character outfits, and much more.
• Real-Time Projection: The generated textures can be projected directly onto the respective models, allowing for immediate visualization and adjustments using the built-in 3D painting tools.

Efficiency in Development Workflow

For artists and developers working on real-time 3D content in Unity, this AI texturing provides a more efficient workflow. It simplifies the process of creating detailed and realistic textures, reducing the time and effort required for manual texturing.

The Usage Guide will help you understand the workflow better.

Practical Applications

Character Faces

Generating and applying textures for character faces becomes streamlined, as demonstrated in the provided video links and images. This allows for the quick creation of diverse and detailed facial textures.

Background Buildings

Applying varied AI-generated textures to background buildings enhances the environmental aesthetics, as seen in the linked video. This feature is particularly useful for adding depth and realism to game environments.

Character Outfits

Creating and applying textures to character outfits is another application. The linked videos showcase how different textures can be easily generated and applied to enhance the visual appeal of character clothing.

In summary, UModeler X's AI texturing feature offers Unity artists and developers an innovative tool to create rich, detailed textures for characters, backgrounds, and other 3D models. This feature not only enhances the visual quality of the content but also streamlines the development process, making it more efficient and user-friendly.

Release Plan for UModeler X

UModeler X is currently in a free open beta phase. The transition from this open beta to the full release is planned to coincide with the launch of a paid subscription model. This release is anticipated to occur around mid-2024. Even after the introduction of the paid subscription model, all the features that were available during the open beta will continue to be free, with the exception of AI texturing.

Following Progress and Getting Started

To stay updated on the progress of UModeler X, including the release of the paid subscription model and other updates, you can follow their official channels, such as our website, social media, or Unity Asset Store page. We may also provide updates through our Discord server or newsletters.

To begin using UModeler X, you can download the UModeler Hub from the Unity Asset Store's UModeler X page. UModeler Hub is a plugin that assists in the installation and updating of UModeler X. Additionally, plans are in place to offer a wider range of 3D assets through this hub in the future.

Future Roadmap Highlights

• Integration of Features: Features like Sketch-based Smart Modeling and Hotspot Texturing from the original UModeler will be integrated into UModeler X.
• New Capabilities: New capabilities set to be introduced in 2024 include curve-based modeling, a voxel editor, collider editor using UModeler X mesh editing functionalities, expanded UV editor features, and more.
• Packages: UModeler X will feature the **Basic 3D Editor Package** that includes all functionalities from the open beta (except AI texturing) for free. The **Extended 3D Editor Package** will offer additional functionalities, with more details to be shared later.

In summary, UModeler X aims to become an all-in-one 3D asset creation solution for Unity users, offering a range of advanced features. With the open beta currently available for free, it provides an excellent opportunity for Unity artists and developers to explore its capabilities and contribute feedback to shape its future development.

The UModeler Team

Interview conducted by Theodore McKenzie