DimP, a direct manipulation video player, lets users drag items on the video screen to move forward and back instead of just via a scroll bar on the bottom of the video. This is not only more fun, but it also allows users to scroll through video to where they want to be “at least two times faster,” In a paper presented by Pierre Dragicevic, Gonzalo Ramos, Jacobo Bibliowicz, Derek Nowrouzezahrai, Ravin Balakrishnan, Karan Singh from the University of Toronto, the authors present their method for browsing video by directly dragging content by “1) automatically extracting motion data from videos; and 2) a new technique called relative flow dragging that lets users control video playback by moving objects of interest along their visual trajectory.”
Whatever that means, one thing’s for certain. At least some of these guys are going to be getting job offers from Adobe. Their paper and another video demonstration is below. Thanks for the tip Brian.
Video Browsing by Direct Manipulation - Get more Free Whitepapers
I do not think it is moving items. it does seem to me that it is moving the entire scene back and forth and not one object while leaving the rest intact. It is really nice to have a better control of the speed at which a video plays.
right. they aren’t changing the video, their just letting you “drag” items in the video to move forward and back.
i don’t know what else to say. that is so cool. i’ve watched it like 8 times already.
neato
Nice.
The first time I see motion detection applied to video scrolling.
Very interesting. I’d be interested in seeing more practical uses of this technology.
nobosh - yeah, well, there’s one obvious one that the digg readers figured out in about 5 seconds.
http://digg.com/programming/Di.....lash_Video
“I want to see this implemented on ***porn.com as soon as possible.”
No doubt about it - that is cool.
I wonder if that is similar to algorithm that is used in an iPhone?
Cheers - Eric
The motion extraction part is the cool part, the scroll bar on the line of motion is just a fancy feature.
The motion extraction part is the cool part, the scroll bar on the line of motion is just a fancy feature.
Nice.
The first time I see motion detection applied to video scrolling.
Very interesting. I’d be interested in seeing more practical uses of this technology.
This + multitouch interfaces = so freaking awesome.
right. they aren’t changing the video, their just letting you “drag” items in the video to move forward and back.
No doubt about it - that is cool.
Very interesting. I’d be interested in seeing more practical uses of this technology.
Dimp is awesome, I have been a huge fan of it since I first saw it. Its from the same research lab as my company’s technology BumpTop. Go University of Toronto!
Congrats Pierre, Gonzo, Jacobo and Derek on some fine work.
It’d be VERY useful in sports like Tennis, Cricket, etc., where a decision has to be made about an object-of-interest like a ball or a bat hitting something or a point.
THATS ROCKS!
I have the shitest computer in history its about 8 years old, I can run Dimp! freaking spewing, as soon as my Startup gets funded im buying a new computer for myself!
tight!
That is extremely cool!
that’s wicked! love it. rotlf for comment #7
O god, I took Karan’s course. Good stuff!!!
Too cool. Steve Jobs - please include this in the next iPhone.
Pretty cool, I can’t tell you how many times I’ve tried to stop a youtube video at a certain point to see something in slow mo like a car crash and it’ never works right…
So this would be amazing to have… Love it.
I like where technology is going these days…
“we’re sorry this video is no longer available” what is that about?
Now all we need along is touch screen see through panels as screens and things would begin to look totally sci-fi :D, this is such a cool feature, awesome for finding that exact right frame.
Interesting for use in frame-by-frame interaction. I think it would be much easier to control within the frame then below it on a forward/back control…a bit more intuitive for frame-by-frame analysis.
Harry “sure pervs will get a kick out of it too” Wang
Hey cool, Karan Singh was my Computer Graphics prof back in university.
Nice work University of Toronto!
Awesome - go Canada!
This is really cool. Imagine it integrated with popular video editing software like Apple Final Cut or Adobe Premiere. This would make aligning video sequences for cuts etc so much easier. Great work.
Peter
do you follow me @ http://twitter.com/peterurban
I was at the conference presentation for this. Absolutely cool.
To be fair there was also another team that presented almost exactly the same thing, at the same session of the same conference. They called theirs “Dragon”
http://hci.rwth-aachen.de/dragon
crazy!!! it´s like a DJ of movies
Gesture based interactions will become one of the most important UI paradigms. Nice work guys.
Very nice concept. I have an application.
It looks cool
http://www.aviz.fr/dimp/download.html
windows only
(my favorite is the slapping video)
While this is very cool, the increased accuracy and speed in locating wanted frames may just as well be due to the motion sensitivity of the “seeking” mechanism.
In other words, the slider often shifts the video forward by several frames (or more, in the case of a long video like a movie) per pixel of slider movement. In contrast, the DimP allows a much higher ratio of cursor movement to frame shift, so the system makes it easier to pinpoint a direct frame. This would mean that the performance advantage of DimP has less to do with intuitve control and more to do with motor control.
I’d suggest a trial against some kind of “secondary bar,” kind of like a video “whammy bar” to the traditional seeker’s “frets.” It would have a draggable portion in the middle and be set so that the space to each side of the draggable bit represented one or two seconds of video. At any point, a person could click the “whammy bar” and move forward or back to a specific frame.
I’m sure that there’s a better way to write that…
As Peter stated, I think this would find great application in video editing software.
Robert, what you state is true about the slider movement…but not that this only really applies to very long movies (for which a pixel’s worth of slider movement could represent more than one frame). Additionally, this could only really work if there were an adequate number of frames per second. Movies have 24, TV has 30, many games have 60….but videos on Youtube and the web commonly have a lower framerate when they’re uploaded. You’re correct about the motor control, but it only applies in high-quality situations, which isn’t always the case here on the internet.
What if there is, for example, a bouncy ball, where the upward path follows exactly the same direction as the downward path, so it gets to the point at the peak of the height, if then you moved the ball downwards, how would it know whether to fast forward or rewind the video? Because both would have the same image.
Great concept though, i wonder when YouTube would implement it.
In the demo video I do not see any motion tracking. It just looks like moving playhead mapped to mouse in timeline. A bit more control so you do not need to crab playhead with your mouse. Otherwise rather boring.
You do realize that basically it’s just a scroll bar in behavior, but linked to the mouse instead of a control. It doesn’t matter where the mouse is in relation to the video to do what turns out to be the same old standard video scroller, right?
It amuses me an entire paper was written to cover this. When it’s behavior can be described in 3 sentences
Does the ‘Hint Path’ remind anyone else of Donnie Darko?
Pretty cool, although when I first heard about it I thought it was concerning flash video and being to manipulate it. Although, this is just a forward/rewind tool I can still see some applications that this would be useful for.
The videos says no Longer AVAILABLE????????
The best thing since automatic-red-eye-removal!
looks cool
Yea it does move the hole scene. But this is really awesome. Would be good to use to track people on cameras. I saw an episode on discovery where they were making recognition shit where it will work with all cameras in unison, but its still in development. This seems to be able to get out of beta more easily and u can see where the person came from by dragging them back… And for alot of other things to do, I really think this program will get really popular, weather its for fun because it looks cool and does cool shit. Or because it will be useful for a verity of applications. Either way, good article, This program is very nice. The beta just kinda sux on vista 64 bit =/