Machines can generate sound effects that fool humans

Researchers used a drumstick (chosen for consistency and because it doesn’t obscure the video) to hit various objects, including railings, bushes and metal gratings. The algorithm was fed 978 videos with 46,620 actions, helping it recognize patterns in the audiovisual signal. “Training a model to synthesize plausible impact sounds from silent videos, [is] a task that requires implicit knowledge of material properties and physical interactions,” according to the paper. The AI uses deep learning to figure out how sounds relate to video, meaning it finds the patterns on its own without intervention from scientists. Then, when it’s shown a new, silent video, “the algorithm looks at the properties of each frame of that video, and matches them to the most similar sounds in the database,” says lead author…


Link to Full Article: Machines can generate sound effects that fool humans