Want To Watch Your Dreams on YouTube? Scientists Take The First Step

Reconstructing movie images from our brains

Get the WebProNews Newsletter:

Want To Watch Your Dreams on YouTube? Scientists Take The First Step
[ Technology]

Well this just might be the coolest thing you’ll see all month.

UC Berkeley scientists have found a way to use brain activity to recreate moving images, i.e. movies. Basically, they were able to record signals in people’s brains, and then they used that data to reconstruct visual images.

The researchers used functional Magnetic Resonance Imaging to see how the subject’s brains processed visual stimuli, and applied that knowledge to the recreation of images using existing YouTube clips.

Here’s how they did it:

[The subjects] watched two separate sets of Hollywood movie trailers, while fMRI was used to measure blood flow through the visual cortex, the part of the brain that processes visual information. On the computer, the brain was divided into small, three-dimensional cubes known as volumetric pixels, or “voxels.”

“We built a model for each voxel that describes how shape and motion information in the movie is mapped into brain activity,” lead author of the study Shinji Nishimoto said.

The brain activity recorded while subjects viewed the first set of clips was fed into a computer program that learned, second by second, to associate visual patterns in the movie with the corresponding brain activity.

Brain activity evoked by the second set of clips was used to test the movie reconstruction algorithm. This was done by feeding 18 million seconds of random YouTube videos into the computer program so that it could predict the brain activity that each film clip would most likely evoke in each subject.

Finally, the 100 clips that the computer program decided were most similar to the clip that the subject had probably seen were merged to produce a blurry yet continuous reconstruction of the original movie.

Here’s the amazing video showing what those recreations looked like as compared with the original film clip –

As of now, the science can only reconstruct images from movie clips that people have already viewed. It can’t simply pull images right out of the brain and create a video of what someone is thinking.

But imagine the possibilities – dream mapping, reconstructing memories, and helping people with neurodegenerative diseases or people in a coma who can’t communicate verbally. The prospect of being able to record and then see a visual manifestation of your mind’s eye is terrifyingly awesome.

The researchers say that they are decades for the scientific breakthroughs to do this, however. It will be quite awhile before you’ll be able to read someone’s thoughts by monitoring their visual cortex.

But damn, isn’t this fascinating?

Want To Watch Your Dreams on YouTube? Scientists Take The First Step
Top Rated White Papers and Resources
  • http://truthtrough.wordpress.com/ S

    ThoughtCrime moves one step closer to being a reality.

  • Kris Rohde

    Great, now the MPAA will be after me even after I’ve paid to see a movie.

  • Matt

    So can this process be used in reverse? taking a scene that is in front of say, a blind person, and presenting it to their brain so that it can be interpreted as sight?

    • Michael

      I don’t think so. You gotta remember that this is the interpretation the brain has for a stimuli. So you’d be sticking an interpretation that isn’t fully focused into the brain of someone who probably can’t interpret it. In other words, not matter how clear the initial video/brain image is, the blind person may only see blobs and light.

  • Join for Access to Our Exclusive Web Tools
  • Sidebar Top
  • Sidebar Middle
  • Sign Up For The Free Newsletter
  • Sidebar Bottom