Colour in Context
Research group
Computer Vision Center

Coloresia: An Interactive Colour Perception Device for the Visually Impaired

Springer-Verlag, Volume 48, page 47--66 - 2013
 
Download the publication : Preprint Interactive Color Perception.pdf [7.1Mo]  
A significative percentage of the human population suffer from impairments in their capacity to distinguish or even see colours. For them, everyday tasks like navigating through a train or metro network map becomes demanding. We present a novel technique for extracting colour information from everyday natural stimuli and presenting it to visually impaired users as pleasant, non-invasive sound. This technique was implemented inside a Personal Digital Assistant (PDA) portable device. In this implementation, colour information is extracted from the input image and categorised according to how human observers segment the colour space. This information is subsequently converted into sound and sent to the user via speakers or headphones. In the original implementation, it is possible for the user to send its feedback to reconfigure the system, however several features such as these were not implemented because the current technology is limited.We are confident that the full implementation will be possible in the near future as PDA technology improves.

Images and movies

 

BibTex references

@InBook\{GBP2013,
  author       = "Abel Gonzalez and Robert Benavente and Olivier Penacchio and Javier Vazquez-Corral and Maria Vanrell and C. Alejandro Parraga",
  title        = "Coloresia: An Interactive Colour Perception Device for the Visually Impaired",
  chapter      = "47--66",
  series       = "Multimodal Interaction in Image and Video Applications",
  volume       = "48",
  pages        = "47--66",
  year         = "2013",
  publisher    = "Springer-Verlag",
  address      = "Berlin, Heidelberg",
  note         = "http://www.springer.com/engineering/computational+intelligence+and+complexity/book/978-3-642-35931-6",
  keywords     = "multimodal interaction; colour vision impairments; ",
  abstract     = "A signi\ficative percentage of the human population suffer from impairments in their capacity to distinguish or even see colours. For them, everyday tasks like navigating through a train or metro network map becomes demanding. We present a novel technique for extracting colour information from everyday natural stimuli and presenting it to visually impaired users as pleasant, non-invasive sound. This technique was implemented inside a Personal Digital Assistant (PDA) portable device. In this implementation, colour information is extracted from the input image and categorised according to how human observers segment the colour space. This information is subsequently converted into sound and sent to the user via speakers or headphones. In the original implementation, it is possible for the user to send its feedback to recon\figure the system, however several features such as these were not implemented because the current technology is limited.We are con\fident that the full implementation will be possible in the near future as PDA technology improves.",
  keywords     = "multimodal interaction; colour vision impairments; ",
  url          = "http://www.cat.uab.cat/Public/Publications/2013/GBP2013"
}

Other publications in the database

  2008 Colour in context Group | Computer Vision Center. All rights reserved | Contact webmaster |  Last updated: Monday 11 May 2009     eXTReMe Tracker