AI Algorithm Can Read Your Mind

Researchers from ATR Computational Neuroscience Laboratories and Kyoto University in Japan developed a deep learning-based algorithm that can generate images from brain activity.  

“The reconstruction algorithm starts from a random image and iteratively optimize the pixel values so that the DNN (deep neural network) features of the input image become similar to those decoded from brain activity across multiple DNN layers,” mentioned the researchers in their paper ‘Deep image reconstruction from human brain activity’. “The resulting optimized image is taken as the reconstruction from the brain activity.”

Using a GTX 1080Ti and Tesla K80 GPU with the cuDNN-accelerated Caffe deep learning framework, the researchers trained their decoders on fMRI data measured while human subjects looked at images over a ten-month period. The images included geometric shapes, natural phenomena and letters of the alphabet.

Overview of deep image reconstruction. The pixels’ values of the input image are optimized so that the DNN features of the image are similar to those decoded from fMRI activity. A deep generator network (DGN) is optionally combined with the DNN to produce natural-looking images, in which optimization is performed at the input space of the DGN.

Below are the results of the algorithm.

“Our brain processes visual information by hierarchically extracting different levels of features or components of different complexities,” Kyoto University Graduate School of Informatics Professor Yukiyasu Kamitani shared about the impact of their work, “These neural networks or AI models can be used as a proxy for the hierarchical structure of the human brain.”

Read more >


11 thoughts on “AI Algorithm Can Read Your Mind

  1. Heaven on January 22, 2018 at 8:24 pm said:

    privacy concerns :()

    • wordsforthewise on January 24, 2018 at 3:53 pm said:

      not really, you have to have a huge/expensive/immobile fMRI headset on, be sitting still in a magnetically-shielded room, and sit there while they take the measurement

      • Ian Walker on January 26, 2018 at 3:56 pm said:

        now, soon it will be a helmet, screwed on as deemed fit…

        • wordsforthewise on January 26, 2018 at 5:27 pm said:

          yes and then we will stick thermometers in our butts to check for hepatitis

          • Ian Walker on January 27, 2018 at 3:21 pm said:

            nah, y’all will synaesthetically lick your butts via the Jepson Brain Beanie (hmm tastes like HepC, with a spicy undertone of CDiff), and will telaesthetically transmit such via tensorflow graph protocol employed by the telepathic infra-red lcd panels stitched into the beanie. And I am not making this up (much) – literally; Google the Jepson Brain Beanie…

          • Ian Walker on January 27, 2018 at 3:28 pm said:

            It’s a modern day odyssey – JSON and the Uberpants…

  2. kbhit on January 26, 2018 at 12:50 pm said:

    Imagine applying this during dreams… you can pull back old memories/pictures/videos you never captured before on physical media

    • Kinar R on March 5, 2018 at 11:26 pm said:

      just like that episode in black mirror

  3. Dat Boi on January 26, 2018 at 2:01 pm said:

    Cool, I want to try this with BCi

  4. Kommando Kodiak on January 27, 2018 at 12:20 am said:

    Ah let the thoughtcriming begin

    • Ian Walker on January 27, 2018 at 3:41 pm said:

      trouble is that not only can they read dem thoughts, hopes, dreams, crimes, and asspirations; they can put the buggers in there! – constructed holographically by infra-red LCD panels stitched into a Jepson Brain Beanie… So you can be thoughtcrimed for a thoughtcrime you never thought, in a simulation of whatever it thought you thought in… think of that! Moreover, the thoughtcrime can be implanted via retarded potentials that travel in a direction opposite to the arrow of time, via an entangled quantum holographic retro-time crystal. Talk about goats in the machine! Herd them, IARPA!