Skip to main navigation Skip to search Skip to main content

Effects of sound volume change when squeezing a virtual soft object with a bare hand

  • Mie Sato
  • , Zentaro Kimura
  • , Yuki Tanaka
  • , Natsumi Motoura
  • , Naoki Hashimoto
  • , Arie E. Kaufman
  • Utsunomiya University
  • Stony Brook University
  • The University of Electro-Communications

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In order to improve the perception of the core part of a virtual soft object when a user squeezes it with his/her bare hand, we apply multisensory integration of visual and auditory stimuli to our proposed AR system. The visual stimuli are real-time stereoscopic images in which the user's bare hand is squeezing the virtual soft object in the actual scene. As the auditory stimuli, we focus on the sound volume change linked to the movements of the user's thumb and index finger. The present paper reports the effects of sound volume change in enhancing the pseudo-softness and the perception of the core part of a virtual soft object. The experimental results of our study statistically show that when a user squeezes a virtual soft object with his/her bare hand, multisensory integration of the visual and auditory stimuli effectively increases the feeling of grasping and facilitates handling of the virtual soft object. In addition, auditory stimuli that have a clearly audible sound volume change at the core part naturally enhance the perception of the core part of the virtual soft object.

Original languageEnglish
Title of host publicationProceedings - 2018 International Conference on Cyberworlds, CW 2018
EditorsAlexei Sourin, Olga Sourina, Marius Erdt, Christophe Rosenberger
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages439-442
Number of pages4
ISBN (Electronic)9781538673157
DOIs
StatePublished - Dec 26 2018
Event17th International Conference on Cyberworlds, CW 2018 - Singapore, Singapore
Duration: Oct 3 2018Oct 5 2018

Publication series

NameProceedings - 2018 International Conference on Cyberworlds, CW 2018

Conference

Conference17th International Conference on Cyberworlds, CW 2018
Country/TerritorySingapore
CitySingapore
Period10/3/1810/5/18

Keywords

  • Augmented reality
  • Interaction
  • Sound volume;

Fingerprint

Dive into the research topics of 'Effects of sound volume change when squeezing a virtual soft object with a bare hand'. Together they form a unique fingerprint.

Cite this