Artificial Intelligence Generates Christmas Song From Holiday Image

Researchers from University of Toronto developed an AI system that creates and then sings a Christmas song based by analyzing the visual components of an uploaded image.

With the help of CUDA, Tesla K40 GPUs and cuDNN to train their deep learning models, the researchers trained their neural network on 100 hours of online music. Once trained, the program can take a musical scale and melodic profile and produce a simple 120-beats-per-minute melody — it then adds chords and drums.

The next step was to train their ‘Neural karaoke’ program on a collection of pictures and their captions to learn how specific works can be linked to visual patterns and objects – once fed an image, the program can compile relevant lyrics and sing them.

Neural Story Singing Christmas from Hang Chu on Vimeo.

“We are used to thinking about AI for robotics and things like that. The question now is what can AI do for us?” said Raquel Urtasun, an associate professor in machine learning and computer vision at Toronto’s computer science lab. “You can imagine having an AI channel on Pandora or Spotify that generates music, or takes people’s pictures and sings about them,” adds her colleague, Sanja Fidler. “It’s about what can deep learning do these days to make life more fun?”

Read more >

8 thoughts on “Artificial Intelligence Generates Christmas Song From Holiday Image

  1. thecity2 on December 1, 2016 at 8:08 am said:

    Yeah, some work left to do.

    • CoD511 on December 26, 2016 at 2:54 am said:

      Honestly, considering the questionable source material I bet was in those 100 hours it trained on… I’m surprised it didn’t turn out worse considering.

  2. ddevito on December 1, 2016 at 8:12 am said:

    Better than listening to Mariah Carey’s “All I want for Christmas is You”

  3. DionisioVivo on December 1, 2016 at 11:23 am said:

    Instant holiday classic.

  4. Archarious Man on December 2, 2016 at 3:51 am said:

    Sounds like Glados from Portal PC Game.
    Awesome!

    • David Lee on December 8, 2016 at 5:48 am said:

      Sounds like the turrets trying to get into the spirit, but don’t understand how XD

  5. Aaron Alsept on December 25, 2016 at 11:56 pm said:

    This change the everythings.

  6. CoD511 on December 26, 2016 at 3:00 am said:

    I’d be interested what the differences in calculation speed/continued learning would make if they used a cluster of a modern P100 for example instead of some Tesla K40 more closely akin to the Titan released over three years ago…

    But I guess Christmas songs don’t get the priority and hardware..