MIT researchers built an AI that predicts what the world sounds like

In the video above, a scientist hits a bush with a drumstick. The sounds that accompany it are what you’d expect: a rustling of leaves and some light swishing of branches. Those sounds are also completely faked. They were added to the video, which had no sound, by a deep-learning algorithm created by MIT researchers. Over several months, the researchers made over a thousand recordings of different things getting hit with a drumstick. When they were done, they had a library of 46,000 sounds, each one bundled with a few frames of video. Then they fed all that data to a deep-learning computer, which analyzed the relationship between every piece of audio and the physical properties it could perceive in the videos. The resulting algorithm is capable of predicting what…


Link to Full Article: MIT researchers built an AI that predicts what the world sounds like