Browsing by Author "Wang, Jingwu"

Now showing 1 - 1 of 1
  • No Thumbnail Available
    Item
    sMoRe: Spatial Mapping and Object Rendering Environment
    (2025) Xing, Yunhao; Liu, Que; Wang, Jingwu; Gómez Zara, Diego Alonso
    In mixed reality (MR) environments, understanding space and creating virtual objects is crucial to providing an intuitive user experience. This paper introduces sMoRe (Spatial Mapping and Object Rendering Environment), an MR application that combines Generative AI (GenAI) to assist users in creating, placing, and managing virtual objects within physical spaces. sMoRe allows users to use voice or typed text commands to create and place virtual objects using GenAI while specifying spatial constraints. The system employs Large Language Models (LLMs) to interpret users’ commands, analyze the current scene, and identify optimal locations. Additionally, sMoRe integrates a text-to-3D generative model to dynamically create 3D objects based on users’ descriptions. Our user study demonstrates the effectiveness of sMoRe in enhancing user comprehension, interaction, and organization of the MR environment.