sMoRe: Spatial Mapping and Object Rendering Environment

dc.catalogadorjlo
dc.contributor.authorXing, Yunhao
dc.contributor.authorLiu, Que
dc.contributor.authorWang, Jingwu
dc.contributor.authorGómez Zara, Diego Alonso
dc.date.accessioned2025-04-29T19:58:34Z
dc.date.available2025-04-29T19:58:34Z
dc.date.issued2025
dc.description.abstractIn mixed reality (MR) environments, understanding space and creating virtual objects is crucial to providing an intuitive user experience. This paper introduces sMoRe (Spatial Mapping and Object Rendering Environment), an MR application that combines Generative AI (GenAI) to assist users in creating, placing, and managing virtual objects within physical spaces. sMoRe allows users to use voice or typed text commands to create and place virtual objects using GenAI while specifying spatial constraints. The system employs Large Language Models (LLMs) to interpret users’ commands, analyze the current scene, and identify optimal locations. Additionally, sMoRe integrates a text-to-3D generative model to dynamically create 3D objects based on users’ descriptions. Our user study demonstrates the effectiveness of sMoRe in enhancing user comprehension, interaction, and organization of the MR environment.
dc.description.funderMicrosoft’s Accelerating Foundation
dc.description.funderAFMR
dc.description.funderAlfred P. Sloan Foundation
dc.format.extent5 páginas
dc.fuente.origenSCOPUS
dc.identifier.doi10.1145/3708557.3716337
dc.identifier.scopusidSCOPUS_ID:105001670668
dc.identifier.urihttps://doi.org/10.1145/3708557.3716337
dc.identifier.urihttps://repositorio.uc.cl/handle/11534/103529
dc.information.autorucEscuela de Ingeniería; Gómez Zara, Diego Alonso; 0000-0002-4609-6293; 162316
dc.language.isoen
dc.nota.accesocontenido parcial
dc.pagina.final119
dc.pagina.inicio115
dc.revistaInternational Conference on Intelligent User Interfaces, Proceedings IUI
dc.rightsacceso restringido
dc.subjectGenerative AI
dc.subjectLarge Language Models
dc.subjectSpace Manipulation
dc.subject.ddc600
dc.subject.deweyTecnologíaes_ES
dc.titlesMoRe: Spatial Mapping and Object Rendering Environment
dc.typeconferencia
sipa.codpersvinculados162316
sipa.trazabilidadSCOPUS;2025-04-20
Files