Emme is our personal media management umbrella project, serving as a foundation for specific work like “Event Summarization”, “Composition” and “Storytelling”. Here:
Event Summarization will take events and large no of associated media and produce a more succinct representation of the same. Event structures exist in the database. An event will have some no of subevents. Composition will automatically derive attributes for the root event from the subevents. Storytelling is a semi-automatic process, where stories are created out of this event and media collection, and additional human descriptions.
We will use Asterix/Hyracks for two reasons: First, to store our data (events & media) on multiple machines. Second, for processing (parallel media processing), querying the distributed data collection.
By personal media, the types of data we are looking at are: Personal Photos, Videos, Emails, Tweets, IM Logs.
Currently, we have a prototype version running with Photo support only.
Lets show three classes in the world – with middle level containing most. The top has 1.5B people covering US, part of Europe, Australia, HongKong, Singapore, and a few percent in other countries. The middle has about 2.5B that is middle class – uses mobile and has corresponding purchasing and social power. The bottom is poor. We want to address the middle. The technology will slowly get to poor.
We should show icons/photos in this chart corresponding to the above.
We should have a chart that shows that Singapore is at the heart of World’s Middle class and has great leadership opportunity – economically-socially-politically.
We are excited by the 2 ideas ( of the web embracing real world happenings, and the next billion). We feel that we are uniquely positioned to contribute to various areas of its development.
Education networks parallel college network children learning network story sharing network
Not just a channel for communication and sharing – but a part of life.
Today: A Special Event
One of the most satisfying recognition
On a special day in my life
By my professional family
In one of my favorite location
In the presence of many of my favorite people
For doing things that I love
Dynamic Computer Vision
Computer Vision Students
Paul Besl Gopal Pingali
Computer Vision Students
Chiao Fe Shu
Most Influential Technology from My
• Image Retrieval
– Content Based Approaches
• IBM as well as Virage
– Emergent Approaches
• Emergent Semantics
• Video Retrieval
– Edit artifact detection
• MPI and Immersive Video
– Multiple Perspective Interactive Video
– Immersive Video
Arun HampapurSimone Santini
Arun Katkere Saed Moezzi
• Multimedia is important because it captures
Lot of information is there. But,
do we get what we want?
A terrible airplane crash in
Timbuktu. More than 300
Andrew Strauss hits
a Century – England
Jay Stanley wins the
MVP of the game.
Which will be on BBC and all Newspapers?
Which News is really important?
Jay is my grand-son. Does that change priorities?
Gutenberg’s influence is ending.
• Personal Media
• Personalized News
• Personalized Alerts
Finally Technology allows Personalized
Current Projects: All about Events and
EMME: Experiential Media Management Environment
• Searching for photos, videos, email, powerpoints
– ACM MM 2010
• Creating Albums:
• Telling stories
– What did I do in Florence?
• Scenario: In December 2010, I have 20,000 pictures taken in 2010. How do I
(semi-automatically) select 25 to send to
– My daughter
– The uncle that I hate
– My personal friends
– My professional friends
Middle 3 Billion
The World: Technology Perspective
Bottom 2 Billion
Middle of the Pyramid
Ready, BUT …
Most attention by
Technologists – so far.
Direct the innovation and R&D towards the
needs of the World’s middle class – the Middle
of the Pyramid (MOP).
Expand the Middle to cover the Bottom.
Highest Bang for the Buck: Tech for
the Middle of the Pyramid
Health Education Agriculture Transportation Social
For addressing all life elements.
HEATS = +
HEATS Connects People for Symbiotic Life Activities.
Some Concerns for our ACM MM
• Very conservative
• Live in Virtual World
• ACM MM has a wonderful chance to be a
leader, but …
A Dream related to my ACM Family
• We will lead the media revolution – enter new
age after the Gutenberg era.
• We will lead industry, rather than follow.
• We will take the media revolution to the
Middle of the Pyramid.
ACM Multimedia: My Professional Family
Can we be the leader? Can we go Beyond
Future of Multimedia:
• Event Based
• Experience Centric
• Centered around YOU
• No Country Left Behind
• For the supportive environment.
• For for the friendship.
• For providing me so many exciting events.
• For giving me a chance to experience a rich life.
• For letting me dream and listening to my ‘vision’.