Free Republic
Browse · Search
Topics · Post Article

Skip to comments.

Blind "See With Sound" ^ | Oct. 7,2003 | Lakshmi Sandhana

Posted on 10/08/2003 4:00:29 AM PDT by foolscap

Michelle Thomas is learning to "see", not with her eyes but her ears.

Blind since birth, Ms Thomas is able to recognize the walls and doors of her house, discern whether the lights are on or off and even distinguish a CD from a floppy disk after only a week using a revolutionary new system.

She is "seeing with sound".

Developed by Dr Peter Meijer, a senior scientist at Philips Research Laboratories in the Netherlands, the system is called The vOICe (the three middle letters standing for "Oh I See").

It works by translating images from a camera on-the-fly into highly complex soundscapes, which are then transmitted to the user over headphones.

Watch the 'spikes'

A wearable setup consists of a head-mounted camera, stereo headphones and a notebook PC.

In total it costs about $2,500. The software is available as a free download.

He hopes that blind users will ultimately learn to mentally reconstruct the visual content of the live camera views, as carried by the soundscapes, so that they experience something akin to meaningful vision.

"Our assumption here is that the brain is ultimately not interested in the information 'carrier' (here sound) but only in the information 'content'," says Meijer.

"After all, the signals in the optic nerve of a normally sighted person are also 'just' neural spiking patterns. What you think you 'see' is what your brain makes of all those firing patterns."

Easy 'tongue'

Enabling users to get an audio snapshot of what is visually in front of them, The vOICe is taking a very different route from "bionic eyes" - retinal and brain implants.

It is non-invasive, offering a higher image resolution (up to several thousand pixels) and does not necessarily rely on the visual cortex.

The system's developer hopes ability will come with practice "Everything has its own unique sound and once you learn the principles involved you can know what you're seeing," says Thomas.

Right now brighter areas sound louder, height is indicated by pitch and a built-in colour identifier speaks out colour names when activated.

While it can't track fast cars or read small print efficiently, it does allow blind users to trace out buildings, read a graph and even watch television.

Comparing it in terms of difficulty to learning a foreign language, Meijer hopes that in the long run, users will become more "fluent" in the mental translation so that it becomes more like natural perception, without conscious effort.

Mobile vision

Kevin O'Regan, of the CNRS (National Centre for Scientific Research) in Paris, France, and an expert in the area of sensory consciousness, is currently evaluating The vOICe.

This headset connects to a mobile PC He believes that if perfected, the software could at least partially evoke vision-like sensations in even the congenitally blind.

"The problem is that vision is a very high bandwidth system, and it's not clear whether we can achieve sufficient bandwidth via other modalities," he stated.

To suit user preferences, Blue Edge Bulgaria has developed a simplified but highly portable mobile phone version of The vOICe for the Nokia 3650 camera phone.

It is available as a free download at The vOICe site.

TOPICS: Extended News; News/Current Events
KEYWORDS: blindness

1 posted on 10/08/2003 4:00:30 AM PDT by foolscap
[ Post Reply | Private Reply | View Replies]

To: foolscap
The adaptabillity of the human brain is practically limitless.
I once read a Scientific American article about experiments with goggles.

If you put two prisms in front of someone's eyes (like eyeglasses), such that the prisms invert up and down, the person will be confused and have trouble walking, as you might imagine.

But after 48 hours, they start to "learn", and after a week or so, they can walk almost normally. Their brain has adapted to the new way of seeing.

When you take them off, the person is disoriented again, and has to re-adapt back to normal.

2 posted on 10/08/2003 5:29:14 AM PDT by Izzy Dunne (Hello, I'm a TAGLINE virus. Please help me spread by copying me into YOUR tag line.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: All
LOOK! Another Freeper Just Gave To The Cause! WAY TO GO!
We Salute Free Republic's Donors! Be one! Donate Here By Secure Server
Or mail checks to FreeRepublic , LLC PO BOX 9771 FRESNO, CA 93794
or you can use
PayPal at
STOP BY AND BUMP THE FUNDRAISER THREAD- It is in the breaking news sidebar!

3 posted on 10/08/2003 5:29:54 AM PDT by Support Free Republic (Your support keeps Free Republic going strong!)
[ Post Reply | Private Reply | To 1 | View Replies]

To: 2sheep
4 posted on 10/08/2003 6:59:56 AM PDT by TrueBeliever9
[ Post Reply | Private Reply | To 3 | View Replies]

To: foolscap
Interesting but not new. Years ago sonic devices were attached to cameras to auto focus. The use of these sonic radar devices would be coupled to blind people with the idea that a sensor pad would be placed on the person's back, much like a mustard plaster. The sonic signals, not unlike a radar readout, would be transmitted to the skin receptors throught the sensor pad and the person would learn to "see" using the touch sense.

Of course, recent reports of the "occular implant", (from the same MIT lab that designed the cochlear implant that now serves Rush so well), promises a future where certain types of blindness will be treated with a "bionic" eye.

This month's Scientific American has a cover story about artificial muscles. Special rubber like materials have been developed which contract when electrically stimulated. Ipso facto, amputees will eventually be fitted with prosthectics which will act as a full limb replacement. So now we have Steve's bionic eye , Steve and Jaime's bionic limbs and Jaime's bionic ear! It won't be long before we have a working Data as well!

5 posted on 10/08/2003 7:12:26 AM PDT by Young Werther
[ Post Reply | Private Reply | To 1 | View Replies]

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794 is powered by software copyright 2000-2008 John Robinson