Multisensory Trajectory Control at One Interaction Point, with Rhythm

Simple item page
dc.catalogadorjca
dc.contributor.authorBellino, Alessio
dc.contributor.authorRocchesso, Davide
dc.contributor.authorMule, Rosario
dc.contributor.authorReitano, Luca DArrigo
dc.date.accessioned2025-03-25T13:09:20Z
dc.date.available2025-03-25T13:09:20Z
dc.date.issued2024
dc.description.abstractWe investigate navigation in two dimensions with velocity control, using a single-button interface. Users adjust the controlled-object speed through rhythmic tapping and its direction by pressing and tilting, releasing the button to finalize the rotation. Feedback to control action and object motion is provided by integration of multiple sensory modalities. Tactile pulses are delivered at 30-degree intervals during rotation, emulating the detents of a rotary encoder. Simultaneously, a sonic glissando accompanies rotation, thus rendering upward or downward rotation. Both visual and auditory cues are used to provide absolute positional feedback. Discrete notes are rhythmically played, whose pitch indicates vertical position, while stereo audio panning follows horizontal position. The rhythmic pace aligns with on-screen object speed, as dictated by tapping time intervals. Two studies were designed around a target-following task, under different sensory conditions. Study 1 has shown that target tracking can be effectively performed with multisensory rhythmic interaction. This is true also when the controlled object is intermittently hidden to view, although it was not possible to measure the advantage provided by auditory-tactile feedback. In study 2, no significant performance differences were observed between auditory and tactile conditions in situations of intermittent visual feedback, indicating that, if the two kinds of non-visual feedback are effective, they are essentially equivalent.
dc.description.funderMUR-PRIN
dc.fechaingreso.objetodigital2025-03-25
dc.format.extent6 páginas
dc.fuente.origenORCID
dc.identifier.doi10.1145/3678299.3678340
dc.identifier.eisbn979-8-4007-0968-5
dc.identifier.isbn979-8400709685
dc.identifier.urihttps://doi.org/10.1145/3678299.3678340
dc.identifier.urihttps://repositorio.uc.cl/handle/11534/102975
dc.identifier.wosidWOS:001321703300035
dc.information.autorucEscuela de Ingeniería; Bellino, Alessio; S/I; 1077856
dc.language.isoen
dc.nota.accesocontenido completo
dc.pagina.final404
dc.pagina.inicio399
dc.relation.ispartofAM '24: Proceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures
dc.revistaPROCEEDINGS OF THE 19TH INTERNATIONAL AUDIO MOSTLY CONFERENCE, AM 2024
dc.rightsacceso abierto
dc.subjectMultisensory interaction
dc.subjectRhythmic interaction
dc.subjectTwo-dimensional navigation
dc.titleMultisensory Trajectory Control at One Interaction Point, with Rhythm
dc.typecomunicación de congreso
sipa.codpersvinculados1077856
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
3678299.3678340.pdf
Size:
2.22 MB
Format:
Adobe Portable Document Format
Description:
Download
Collections
Artículos de conferencia