“And the winner is…the MUST VIS System of IDIAP and Klewel’s Sandy Ingram”
This week’s post will be a little different than the ones from the last weeks. Because, we are so proud to announce that our very talented colleague, Sandy Ingram together with IDIAP as part of IM2 and an InEvent consortium has been working on creating a solution for temporal segmentation of e-learning videos for the ACM Grand Challenge. This challenge was one of the five composing the ACM Multimedia 2013 Grand Challenge plenary session, where the MUST-VIS has been presented and demonstrated. The inEvent team included members from Idiap’s Natural Language Processing group, Klewel SA, Fraunhofer’s Heinrich-Hertz Institute, and the University of Edinburgh. Mediamixer announced that their project has been selected as the winner. It offers an appealing visualization of video-to-video and segment-to-segment linking based on video analysis and tagging, and their associations.
Asking Sandy about the price that strikes some of us as too complicated to even understand the challenge, let alone the solutions, she explained it very clearly:
Sandy Ingram, Klewel: “There were three main objectives: The first was to automatically segment a video depending on what’s being discussed. The goal was to easily detect and watch your segments of interest. (collaboration: Idiap with Fraunhofer Heinrich Hertz Institute in Berlin)The second was to recommend related video segments as you watch one specific segment (responsible: Idiap) and last but not least to find an innovative way to visualize the segments of the chosen video and their related segments in the periphery. This is where I implemented the graph (the design was a collaborative work with Idiap and I implemented it).”
Sandy said that their edge in the competition came from being able to show a global view of how segments are connected with the graphical solution as oppose to merely listing of segments.
When asking about what this means for Klewel, Sandy said that this was a successful collaboration of research partners , which is so important for technology transfer as we are in discussion with other companies, like ACM.
Most importantly it means that the innovative ideas and cutting-edge technologies we are proposing are getting very positive responses.
About ACM: ACM is widely recognized as the premier membership organization for computing professionals, delivering resources that advance computing as a science and a profession; enable professional development; and promote policies and research that benefit society. ACM hosts the computing industry’s leading Digital Library, and serves its global members and the computing profession with journals and magazines, conferences, workshops, electronic forums, and Learning Center. ACM SIG CHI is a client of Klewel and has been collaborating with us over the past 6 years to webcast their CHI conference.
About inEvent: inEvent is a 36 month European research project, comprising 358 person-months of effort, with a total budget of 4.369 million Euros (and a requested EC contribution of 2.928 million Euros).
About IM2 Aroles: The AROLES project aims at transferring scientific know-how in the domains of audio-visual processing and multimedia retrieval from the IM2 NCCR to the Klewel SME dedicated to lecture capture and web-based broadcasting.
About Idiap: The Idiap Research Institute is among the most active independent research institutions in information technology. The Idiap Research Institute, based in Martigny (Valais/Switzerland), is a non-profit foundation that conducts basic research and development in the area of multimedia information management. Idiap’s activities can be divided into five complementary research themes and ten application areas.