When sound hits an object it causes that
object to vibrate the motion of this vibration creates a
subtle visual signal that's usually invisible to the
naked eye in our work we show how using only a video of
the object and a suitable processing algorithm
we can extract these minute vibrations and
partially recover the sounds that produce them letting us
turn everyday visible objects into visual microphones in
the silent high-speed video.
So as you see in the first experiment shown in the video
the leaves of a potted plant was
recorded while a nearby loudspeaker played the notes to
mary had a little lamb' even when they play the
video in slow motion, the vibrations caused by the music
are so subtle that they move the plant's leaves by
less than a hundredth of a pixel making the plant appear
still to the naked eye but by combining and filtering
all of the tiny motion happening across the image that you
see they are able to recover the sound.
So what's happening here ?
(If you dont want to go down scientific lane, you can skip
this part. )
I'll try to be as layman as possible about this,
When sound hits an object it causes that
object to vibrate.
The motion of this vibration creates a subtle visual
signal that's usually invisible to the naked eye.
Using only a video of the object and a suitable processing
algorithm we can extract those minute vibrations
and partially recover the sounds that produce them letting
us turn everyday visible objects into visual
microphones in the silent high-speed video.
Let's say we reverse the Process now, vice-versa?
That possible ?
HECK YEAH! It's completely possible.
Another video to experiment this will give us a clear
clue to how to hack Siri, Alexa or Google Home
reversing the underlying principles we just learned.
Comments
Post a Comment