Amber Maimon, PhD

Neuroscience & Human-Computer Interaction (HCI) researcher | Co-head NeuroHCI Research Group



Contact

Amber Maimon, PhD

Research Associate, Co-Head NeuroHCI Research Group, Academic Lab Manager



Computational Psychiatry and Neurotechnology Lab | Human Computer Interaction Lab

Ben Gurion University | University of Haifa




Amber Maimon, PhD

Neuroscience & Human-Computer Interaction (HCI) researcher | Co-head NeuroHCI Research Group



Computational Psychiatry and Neurotechnology Lab | Human Computer Interaction Lab

Ben Gurion University | University of Haifa



Shape detection beyond the visual field using a visual-to-auditory sensory augmentation device


Journal article


S. Shvadron, A. Snir, Amber Maimon, O. Yizhar, S. Harel, K. Poradosu, A. Amedi
Frontiers in Human Neuroscience, 2023

Semantic Scholar DOI PubMedCentral PubMed
Cite

Cite

APA   Click to copy
Shvadron, S., Snir, A., Maimon, A., Yizhar, O., Harel, S., Poradosu, K., & Amedi, A. (2023). Shape detection beyond the visual field using a visual-to-auditory sensory augmentation device. Frontiers in Human Neuroscience.


Chicago/Turabian   Click to copy
Shvadron, S., A. Snir, Amber Maimon, O. Yizhar, S. Harel, K. Poradosu, and A. Amedi. “Shape Detection beyond the Visual Field Using a Visual-to-Auditory Sensory Augmentation Device.” Frontiers in Human Neuroscience (2023).


MLA   Click to copy
Shvadron, S., et al. “Shape Detection beyond the Visual Field Using a Visual-to-Auditory Sensory Augmentation Device.” Frontiers in Human Neuroscience, 2023.


BibTeX   Click to copy

@article{s2023a,
  title = {Shape detection beyond the visual field using a visual-to-auditory sensory augmentation device},
  year = {2023},
  journal = {Frontiers in Human Neuroscience},
  author = {Shvadron, S. and Snir, A. and Maimon, Amber and Yizhar, O. and Harel, S. and Poradosu, K. and Amedi, A.}
}

Abstract

Current advancements in both technology and science allow us to manipulate our sensory modalities in new and unexpected ways. In the present study, we explore the potential of expanding what we perceive through our natural senses by utilizing a visual-to-auditory sensory substitution device (SSD), the EyeMusic, an algorithm that converts images to sound. The EyeMusic was initially developed to allow blind individuals to create a spatial representation of information arriving from a video feed at a slow sampling rate. In this study, we aimed to use the EyeMusic for the blind areas of sighted individuals. We use it in this initial proof-of-concept study to test the ability of sighted subjects to combine visual information with surrounding auditory sonification representing visual information. Participants in this study were tasked with recognizing and adequately placing the stimuli, using sound to represent the areas outside the standard human visual field. As such, the participants were asked to report shapes’ identities as well as their spatial orientation (front/right/back/left), requiring combined visual (90° frontal) and auditory input (the remaining 270°) for the successful performance of the task (content in both vision and audition was presented in a sweeping clockwise motion around the participant). We found that participants were successful at a highly above chance level after a brief 1-h-long session of online training and one on-site training session of an average of 20 min. They could even draw a 2D representation of this image in some cases. Participants could also generalize, recognizing new shapes they were not explicitly trained on. Our findings provide an initial proof of concept indicating that sensory augmentation devices and techniques can potentially be used in combination with natural sensory information in order to expand the natural fields of sensory perception.



Tools
Translate to