M.I.T. Computer Program Reveals Invisible Motion In Video
The Accurate Source To Find Transcript To M.I.T. Computer Program Reveals Invisible Motion In Video.”
[M.I.T. Computer Program Reveals Invisible Motion In Video]
[William T. Freeman] Source: LYBIO.net
In our heads it’s like a big world of small motions out there. We’re excited to explore it and look at the world with this new microscope that lets us visualize the very small changes, and reveal them and it actually turns out to show us all sorts of exciting things about the world.
We’re at MIT. This lab does all sorts of things, but what we’re doing here is a particular project, at the intersection of vision and graphics that we call motion magnification.
The initial idea was to have this tool that can show us how things move in a way that we cannot see in normal ordinary videos. The algorithm itself is actually pretty simple.
[William T. Freeman] Source: LYBIO.net
This is a picture of Steve, we took this into our, algorithm, and it, looks at each color, and makes a spatial average of the color to very accurately measure what the color intensity is at every point. From that accurate measurement you can detect small variations with the pulse signal. So, we measure those, we amplify them and then add them back into the video to create a colored magnified video if you were of Steve.
Now you can see all sorts of things. You can see, how fast his heart is beating, you can also see the spatial pattern of when the blood goes where, on his face. And we’re hoping that this will be a useful diagnostic for medical doctors. Maybe if we took a photo of Steve without his shirt on, we could look for asymmetries and when the blood flowed where on his body and perhaps that will be a diagnostic of disease.
So with neonatal infants, you want to monitor their vital signs, but you want to touch them as little as possible, I’m told. And so we wanted to explore using this video method to monitor their, their pulse. So here’s an example of the raw video, this is without any amplification. And now you can see that let’s us just extract the pulse and we can do that as accurately as the conventional methods that have to touch the baby.
So to verify that what we’re measuring really is the pulse, we compare our measurement with an EKG that was attached to the baby at the same time. And they agree. So the videos we’ve been showing you are ones that we took, but you can also go and apply this method to other videos as well. So, we took a clip from the Batman video with Christian Bale. This is, now processed with our method, you can see that he has a pulse and he’s – even under the make-up presumably you can see his pulse as he wakes up.
What’s really new about this research is that we’re visualizing the tiny motions. The Computer Vision Community has been able to measure these tiny motions for some time, but there’s nothing to see unless you amplify and show what’s there. Once we amplify it and show what’s there, there’s like a whole new world, all sorts of things you can look at.
Often times parents of newborn infants wonder, is the baby breathing. And with this method you can exaggerate the motions and show very clearly that the baby is breathing.
So here’s the original video, it’s a little bit hard to tell if she is breathing or not. But in our motion amplified version it’s obvious. So, we’ve just started with these techniques, we’ve just really begun exploring them. And so we’ve posted the code online, we posted it in August. And people can download it, look at the source code, use it for non-commercial purposes and we think this is just going to explode, that there will be all sorts of uses for this technique.
M.I.T. Computer Program Reveals Invisible Motion In Video. What’s really new about this research is that we’re visualizing the tiny motions. Complete Full Transcript, Dialogue, Remarks, Saying, Quotes, Words And Text.