Seyyer white paper (8 27-2012)


Published on

Published in: Technology, Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Seyyer white paper (8 27-2012)

  1. 1. Cognitive Video Regeneration:From Script to Instant VideoUsing Advanced Artificial Intelligence (A.I.) toCreate Hyper-Realistic, Human Video Avatars
  2. 2. White Paper | Cognitive Video Regeneration: From Script to Instant VideoIntroductionSeyyer, Inc. is a developer of the first, cognitive video-regeneration (CVR) platform. By blending facialmicro-expressions, human gesture-recognition technology and personalized-speech modeling, Seyyer willcreate realistic, human video avatars. The artificial intelligence (A.I.) video personalization platform enablesusers to create massive amounts of customizable, authentic video content, instantly and inexpensively.Recognizing the paradigm shift in social communications, instant information sharing and consumerism,Seyyer’s innovative, video-regeneration technology can elevate the user experience to a new level ofpersonalization. Applications range from targeted, human video marketing for advertising, branding andentertainment to education and humanitarian applications. 1
  3. 3. White Paper | Cognitive Video Regeneration: From Script to Instant VideoInstant Information Sharing andPersonalization DynamicsThe advent of social media has not only brought a new level of transparency to the way we communicate, ithas allowed the average person unprecedented access to public figures, information and news and eventsof the day. Micro blogging and Twitter in particular, have eliminated multiple degrees of separation betweencelebrity and fan. It’s no surprise that the top ten most followed people on Twitter are invariably celebrities.It is clear; audiences are hungry for more personalized information and access.In the social media arena, no one is anonymous and few want to be. This is an era where personalizationand familiarity are premium, and to a large extent, anticipated. How often do we read emails or answer textmessages that don’t address us personally? People not only want to be known by name, they expect it.Text to Video (TTV): From Ideas to RealityCognitive Video Regeneration (CVR), while still in its early stages of development, is poised tofundamentally change the way we communicate. We’re at the edge of new era in information processing;communicating through machine cognition. Google first pioneered the search space then began developingthe next generation of its technology with semantic search and contextual information. Apple pioneeredthe first intuitive user interface with interactive touch screens. Microsoft introduced Kinect to accuratelyquantify and track facial and body gestures in order to control devices. All these innovations have centeredon interpreting high-dimensional data. CVR’s unique possibilities now move high-dimensional dataprocessing into the space of original content creation. “Similar to the way a human brain processes and operates, CVR is able to create new information based on all past observations.” 2
  4. 4. White Paper | Cognitive Video Regeneration: From Script to Instant VideoThe Code on the Human FaceThe human face is capable of over 3,000 different micro expressions according to Dr. Paul Ekman, one of themore prominent experts on the human face. Most of these are hard-wired and universally recognizable acrosscultures. This gives some hint into the complexity and nuance involved with human gesture recognition. It’suseful to think of facial micro-expressions as high-dimensional signals. The fundamental question for us is: howintelligent machines can recognize, learn, interpret and ultimately generate these perceptual symbols instantly.The Path to CVRTo create a CVR generated “human” avatar, we first collect video and audio of the person talking with variousemotional expressions. The CVR engine then develops a Human model (the H-model) that incorporates thatperson’s way of talking, including unique micro-expressions, gesture patterns, and speech cadence. The H-modelis the key to further production of new dialogue. The H-model is based on advanced mathematical techniques:nonlinear estimation, Bayesian statistics, and the latest developments in machine learning.CVR represents a complete departure from speech and video synthesis techniques that splice together shortsegments of content from a dictionary. Such techniques can give realistic results when a restricted set ofutterances needs to be produced, but they do not have the generative power of CVR, which is based on themost sophisticated artificial intelligence (AI) and statistical signal processing algorithms being delivered today.Machine learning algorithms are capable of creating models that generalize from their original source material.This is what allows the CVR engine to create realistic text-to-video (TTV) clips whose text is completely unrelatedto the training material used to create the H-Model. The video output of an H-model goes well beyond lipsynthesis to generate entire facial expressions. Similarly, the text controlling audio output can be annotated tomodify how fast the person talks, how certain words are stressed, and so on. These advanced features areneeded to get the breakthrough level of realism found in CVR technology.When a user enters text copy, the CVR engine reconstructs the customized message drawing from existing H-modelmemory. By blending gesture recognition technology with personalized speech modeling, the CVR platform rendersan avatar that appears identical to its human counterpart. Once the avatar is synthesized, the A.I. video personalizationplatform can inexpensively and quickly create limitless amounts of scripted video content.If the H-model resides on the cloud/server then the server can dish out the video directly to the intendedperson. If the H-model resides on the smart phone of the intended user, then SMS text can be directlyconverted to video on the device itself. 3
  5. 5. White Paper | Cognitive Video Regeneration: From Script to Instant VideoHow Cognitive Video Regeneration willShift ParadigmsThough still in its infancy, the potential applications for CVR are limitless, particularly with the advent of moresophisticated AI technologies. “In the near future, having your own AI powered personal avatar, optimized for sound and appearance, could be as commonplace as having an email address or mobile phone number.” and operates, CVR is able to create new information based on all past observations.”Most immediately, addressing ease-of-use and quality requirements, while eliminating the time and costconstraints associated with traditional broadcast video, ushers in a new age of online personalization. News andentertainment, publishing, social media, e-learning, mobile communications and targeted advertising are just afew of the immediate potential applications. With CVR, educational content developers can create interactivepersonalized video-based curricula. Advertisers can develop highly targeted and almost instantly updatablemobile and online marketing campaigns that drive deeper consumer engagement. Retailers using the latestsocial commerce engines can create hyper-realistic, customizable avatars to further augment and complementtheir customers’ shopping experiences. 4
  6. 6. White Paper | Cognitive Video Regeneration: From Script to Instant VideoPersonalized AdvertisingCognitive Video Regeneration technology is poised to solve multiple dilemmas marketers face with personalizedvideo advertising. Personalized video effectively blends the impact of a high- quality video experience withthe delivery of highly personalized messages to specific audience segments—or even individuals. Researchhas proven that personalized advertising has emerged as the most effective and powerful form of advertisingavailable in today’s cluttered media landscape. A recent study shows that purchase intent and brand loyalty aresignificantly higher with video ad personalization, yielding a 100% lift in brand favorability. (Source: PersonalizedVideo Ad Testing: Knowledge Networks, September, 2011)While it is evident that personalization resonates when delivered in the form of online video ads, videopersonalization remains a difficult proposition for advertisers. Personalized video ads are costly, time consuming,and in many cases not practical. Production costs alone easily could run over tens of thousands of dollars for asimple commercial video clip.With Cognitive Video Regeneration, advertisers will have the tools to build personalized video ad campaignsefficiently and effectively. Personalized video advertising will continue gaining momentum with its unique abilityto add real human interaction into marketing campaigns, and enable advertisers to develop positive relationshipswith their customers. 5
  7. 7. White Paper | Cognitive Video Regeneration: From Script to Instant VideoAdvertising is Only the BeginningCVR enables advertisers to deliver branded content and develop targeted and almost instantly updatable mobileand on-line marketing campaigns, but that’s only the beginning. • ducational Content Developers -- Create personalized video-based curricula E to enhance the learning process. • etailers – Enhance value of latest social commerce engines by creating R hyper-realistic, customizable avatars to further augment and complement their customers’ shopping experiences. • Social Media Sites – Create fun, customizable, shareable video experiences and viral videos such as personalized video-SMS messages. • Personalized Video Mail – Increase open and conversion rates with personalized video mail. Industry reports suggest 21% higher conversion rates in emails that included video. • Branded Video eCards and Fan Cards – CVR powered eCards will feature a branded dashboard that enables users to create fun, high-quality, personalized video cards. • ublishers – Enhance content in V-books, V-publishing, V- Entertainment, on-line P books, magazines and blogs. • Video Personal Assistant – By combining Seyyer’s CVR platform with speech recognition technology, imagine a personal assist mobile app.Future Text to Video ApplicationsAdvanced patterning in gesture recognition, voice tonality and contextual learning will bring increasing levelsof interactivity and responsive functionality to CVR powered AI avatars. This poses broad possibilities forapplications from the seemingly mundane to interactive agents that act to profoundly enhance the quality of lifefor their human counterparts. 6