The Art and Science of Computer Conversation: Talkabot 2016
•Download as PPTX, PDF•
1 like•675 views
PullString Platform offers a professional authoring environment, hosted AI and machine learning runtime, and integrated conversation analytics to enterprises, agencies, and startups across diverse verticals. Try out the free version, PullString Author, which lets you develop and publish your creations. Learn more here: https://www.pullstring.com/features#panel-pullstring-author
Recommended
Recommended
More Related Content
Viewers also liked
Viewers also liked (6)
Similar to The Art and Science of Computer Conversation: Talkabot 2016
Similar to The Art and Science of Computer Conversation: Talkabot 2016 (20)
Recently uploaded
Recently uploaded (20)
The Art and Science of Computer Conversation: Talkabot 2016
- 1. The Art and Science of Conversation 1 Sarah Wulfeck / @skwulf Lucas Ives / @lri www.pullstring.com @pullstringinc
- 2. Sarah Wulfeck 2 • Head of Conversation Engineering (tools, AI, publishing) • Former Pixar R&D, 2001-2010(ish) • Technology to help artists achieve their vision • PullString Creative Director • Head Writer for Hello Barbie, Hello Dreamhouse • Former Digital Agency Creative Director Lucas Ives
- 3. Our mission is to develop lasting emotional connections between characters and audiences through the art and science of computer conversation. 3 Incorporated in 2011. San Francisco, California. Founding team mostly from Pixar’s software group.
- 5. What We Do: Creative Input 5 Screenwriting, Playwriting and Acting Backgrounds drive the bot-writing process - “Breaking the fourth wall” / Scripted Improv - Asking deliberately worded questions to elicit responses - Predicting how people will interact and engage, and honing the narrative around them - Creating empathy in our Characters - Turning human interactions into technical features and capabilities
- 6. What We Do: Characters First 6 Character Narratives, stakes and motivations and POV - Who is the character and what is their specific way of speaking? - What does the character want? (Motivations of the bot) - What is the character’s relationship to the user? - What should the character have an opinion or response to and what should they ignore? - How should the character respond to off-topic, inflammatory or other non-narrative interactions from the user?
- 7. Hello Barbie: A Bot Wrapped In Plastic Underneath all that plastic is the most sophisticated, scripted, interactive conversational experience ever published.
- 8. Hello Barbie: “You’re My Best Friend!” The Goals: Give the illusion of listening, display empathy, and remember information “like a friend” through 8000+ lines of dialogue and conversational tracks
- 9. Hello Barbie: All You Can Content What’s Under The Hood: Known character, long backstory, point of view, areas of expertise, etc.
- 10. Hello Barbie: Conversational “Neural Network” - I remember you said you love horses - have you ever ridden one? - Speaking of animals, what other pets do you have? - I always wished my pets could go to school with me.. Do you? - What class do you like most? - Do you have a best friend at school? - Hey, speaking of.... I’m having a problem with a friend. Can you help me out?
- 11. Hello Dream House: The “Smartest” House Ever Voice-Controlled, Smart Mansion. Open/Close doors, operate elevator, create lighting concepts, turn the stairs into a slide, create custom sounds for everything, and more! (No, it doesn’t have temperature control. Dolls don’t need that.)
- 12. Hello DreamHouse: Your House, Your Rules The Goal: The user drives the play / experience.
- 13. Hello DreamHouse: Anticipation Network Thousands of extremely specific voice commands and intents the user can say to drive the behavior of the house.
- 14. Fast Forward Case Studies 14
- 15. Humani: Jessie’s Story Millennial adrift in a SF-esque environment Built to be your friend on the other end of the line Real events unspooling in pseudo-real time ~3000 lines of dialog Try it! http://m.me/jessiehumani 15
- 16. Humani: Jessie’s Story 16 Launch partner w/ FaceBook for f8 First text-only experience NLP: Text speak vs. natural spoken language — when is a typo not a typo?
- 17. Call of Duty: Lt Reyes Guerrilla marketing / ARG in conjunction with AKQA and Activision Smaller experience, ~400 lines of dialog Traffic wise, one of the largest FB Messenger bots More than 6M conversations on day 1 Most media impressions for a CoD campaign ever Required a custom scaling solution to be built by FaceBook 17
- 18. Humans Built in conjunction with Channel 4 UK / 4Creative ~750 lines of dialog Huge underground marketing campaign in London Help your synth understand emotion, escape Try it! http://m.me/PersonaSynthetics 18
- 20. We now live in the world of computer conversation. Personality, language, tone, mood, and style are the ways to give your character a unique and authentic voice. Content, Intent, and Context together. The PullString Platform is the world’s best way to author computer conversation. 20
- 21. Available now. Professional authoring environment. Fully integrated AI and machine learning. Rapid iteration. Team collaboration workflows. Enterprise scale, analytics, and extensibility. PullString Platform 21
- 22. We trade in the atoms of actual human conversation These are tools for creative professionals The world’s best way to create organic, natural, believable computer conversation. PullString Platform 22
- 23. Machine Learning and Rules Based AI AI Engine Precision of rules based pattern matching and the power of machine learned intent Intents Model high level user goals or use built-in libraries to get started quickly Entities Extract entities like names, addresses, dates, and times and store them in state across conversations Rules Maintain full control and precision over the conversation with powerful pattern matching Synonyms Easily define related concepts and phrases, and automatically generate suggestions for new synonyms with powerful machine learning Dialog Management Easy access to all the fundamental building blocks of conversation like time-based responses, interjections, segues, activities, conditions, and priorities 23
- 25. Make anything talk. Anywhere. Voice-enable IoT devices, apps, games, and other custom integrations Simple RESTful HTTPS interface PullString web APIs 25 External web APIs Connect to other web services Simple JSON payload protocol Embed Javascript in your content and we’ll execute it in a secure cloud sandbox
- 26. Thank you! 26 www.pullstring.com @pullstringinc @lri / lri@pullstring.com @skwulf / sarah@pullstring.com
Editor's Notes
- PullString Author has been designed from day one with creative dialogue writers involved in its development. We’ve had continuous input into the platform’s evolution, and many of the additions have come from our creative writing process and translated into engineering features. What constitutes “human interactions?” -- Listening, Memory, Empathy, Emotional States, Sharing Strong Opinions. These are just a few things the creative team needed to have the ability to script via PullString Author.
- Intrinsic to our company's mission, the PullString Author platform has been created with the core objective of bringing believable characters to life through interactive dialogue. It has not been created to serve as just another basic voice or text-based command line platform, but as something meant to go much further in order to produce more humanistic experiences. This is why for our experiences, we start from a creative, character-driven place.
- “Hello Barbie” is a bot, in a fancy plastic outfit. But… she’s so much more than that, when you consider the immense amount of scripted and recorded dialogue lines, rules, intents and behaviors, and complex line reference chains she’s got making up her “brain.”
- Barbie doesn’t actually “listen,” but she behaves like she’s listening, through a combination of her scripted dialogue, authored word / phase recognition and human recorded vocal performance.
- Barbie has A LOT to say. There are bazillion things she could talk about, refer to, remember, have opinions on, etc. We’re fortunate that this brand has such a strong presence and vast content history to draw from. But.. that presented its own challenge of both choosing what kind of content prioritize and write, and how to connect it all together to form a believable conversational narrative.
- Regardless of whether your bot is a character with 50+ years of personality and story lines, or a more recent brand voice with a consumer-focused agenda, you need to be “human” when organizing its individual “train of thought” process.
- Let’s take a second to think of the implications for this. We’ve been able to do this on the 4 foot, plastic “dollhouse” scale - what’s next could be your house, your car, your appliances, etc.
- Unlike Hello Barbie, a “person” with a narrative agenda who drives the content from topic to topic, the Hello Dream House is “passive” in that the child drives the experiences, decides what to say and when, with limited prompting from the “character” of the house.
- Instead of a Conversational Neural Network that needed to be connected as organically as possible, here, we had to create an “Anticipation Network” so that users can say any number of thousands of commands you’d expect a fancy mansion like this to fulfill. Working with Mattel, we went room by room, thinking about everything you could do in that room and what needed to be addressed. That was a couple thousand ways of saying those commands. Then there’s an additional number of “imagination”-driven command conversations per room - let’s have a mermaid party (turn all the lights in the house blue and play aquatic music), let’s bake a cake, let’s order a pizza, etc. The additional layer on top of everything is a complex mechanism of state persistence. The house needs to be constantly aware of which lights are on / off, what timers are set, what physical modes are on / off, and so on. SO… as you can see.. in terms of the PullString Creative Process, whether we’re building a persona bot like Hello Barbie that contains thousand of lines of character-driven dialogue, games, etc., or building a functional, user driven experience like the Dream House… we first come at these things from the same place of character development and user relationship to the character.
- technical challenges partner w/ Facebook for Messenger platform launch @f8 — super cool, but SDK was a bit of a moving target “the opposite of love is indifference, not hate” the level of quality of Jessie on Messenger got the attention of Activision and the agency AKQA ….
- july 2016 ARG to promote CoD : Infinite Warfare burst traffic was a huge concern july 2016 ARG to promote CoD : Infinite Warfare that brings us to just last week ….
- (list 3 key differentiators) the head, the heart, and the vision
- (list 3 key differentiators) the head, the heart, and the vision terry gross world’s best way to create organic, natural, believable computer conversation. full stop.
- a HYBRID APPROACH machine learning / AI as a black box is the wrong way to approach art
- we’ve been doing this for a while, now we want to see what you guys will create. please try, feedback, etc. come talk to us, come get a demo at the break , grey couches over there —->