Software uses fMRI brain scans to identify what a person is seeing

Aug. 30, 2013
A team of researchers has developed a system that utilizes functional magnetic resonance imaging (fMRI), imaging software, and a specialized algorithm to identify through a person’s brain scan exactly what they are looking at.

A team from Radboud University in the Netherlands has developed a system that utilizes functional magnetic resonance imaging (fMRI), imaging software, and a specialized algorithm to identify through a person’s brain scan exactly what they are looking at.

Functional MRI scans, which are typically used to measure changes in brain activity, are used in this study to zoom in on smaller (2 x 2 x 2 mm), more specific regions of the brain in the occipital lobe called voxels, according to The Daily Mail.

Scientists had participants look at a series of letters—B, R, A, I, N, and S— while wired up to an fMRI scanner. By recording the specific changes that occurred in each person’s brain after each letter was shown, the scientists were able to show how the brain visualized the different shapes. The images captured of these changes in the brain were then run through an algorithm that was designed to work in a similar way to how brains build images of objects from sensory information.

An image of what the person is looking at is reconstructed when the algorithm converts the voxels and their relevant changes into image pixels. As of now, the model is only designed to compare letters, but it could be used for other imagery, such as a person’s face, and could also become more accurate, Marcus Van Gerven, co-author of the study, Linear reconstruction of perceived images from human brain activity, told The Daily Mail.

He also claims that the algorithm could be used to reconstruct any image, and that his team is working to build more advanced machines that can build images from 15,000 voxels. (The “letter” experiment used information obtained from 1,200 voxels).

View The Daily Mail article.

Also check out:
Researchers create 3D infrared images in full color
Researchers hoping to mimic vision of dragonflies in robots
Image processing software identifies animal gender and age from footprint

Share your vision-related news by contacting James Carroll, Senior Web Editor, Vision Systems Design

To receive news like this in your inbox, click here.

Join our LinkedIn group | Like us on Facebook | Follow us on Twitter | Check us out on Google +

About the Author

James Carroll

Former VSD Editor James Carroll joined the team 2013.  Carroll covered machine vision and imaging from numerous angles, including application stories, industry news, market updates, and new products. In addition to writing and editing articles, Carroll managed the Innovators Awards program and webcasts.

Voice Your Opinion

To join the conversation, and become an exclusive member of Vision Systems Design, create an account today!