Andrew Smith
August 17th, 2020, 05:55 AM
If the latest A.I. ("machine learning" in reality) software developments continue, doing foley might be possible with merely a plugin.
From https://spectrum.ieee.org/tech-talk/artificial-intelligence/machine-learning/new-ai-dupes-humans-into-believing-synthesized-sound-effects-are-real
"Using machine-learning, AutoFoley determines what actions are taking place in a video clip and creates realistic sound effects"
and more specifically ...
"In a more recent plot twist, researchers have created an automated program that analyzes the movement in video frames and creates its own artificial sound effects to match the scene. In a survey, the majority of people polled indicated that they believed the fake sound effects were real. The model, AutoFoley, is described in a study published June 25 in IEEE Transactions on Multimedia (https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6046)."
The first linked article comes with embedded YouTube samples.
Andrew
From https://spectrum.ieee.org/tech-talk/artificial-intelligence/machine-learning/new-ai-dupes-humans-into-believing-synthesized-sound-effects-are-real
"Using machine-learning, AutoFoley determines what actions are taking place in a video clip and creates realistic sound effects"
and more specifically ...
"In a more recent plot twist, researchers have created an automated program that analyzes the movement in video frames and creates its own artificial sound effects to match the scene. In a survey, the majority of people polled indicated that they believed the fake sound effects were real. The model, AutoFoley, is described in a study published June 25 in IEEE Transactions on Multimedia (https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6046)."
The first linked article comes with embedded YouTube samples.
Andrew