Voice Controlled Robots<br />Robert Daniel<br />SL: Quincey Dagger<br />
Introduction<br />Adjunct Professor at GWU<br />10 Teaching Telecommunications<br />SecondLife 4 years<br />OpenSim for th...
Description<br />Voice Controlled Robots<br />Learn how to make your Plain Old Telephone Service (POTS) or cell phone into...
Plain Old Telephone Service  & Voice Over IP<br />“More than 18 billion minutes of voice chat have been used in Second Lif...
FreeSWITCH<br />Architecture<br />Very Module<br />We are using<br />Dial Plans Route Plans<br />ASR/TTS <br />SPHINX<br /...
PocketSphinx<br />Architecture<br />Voice Recognition<br />adjustable, modifiable recognizer written in Java<br />Referenc...
PocketSphinx<br />Architecture<br />Voice Recognition<br />adjustable, modifiable recognizer written in Java<br />Referenc...
Voice Architecture<br />Second Life<br />Remote User<br />SL Client<br />Land Line<br />Cell Phone<br />Robot<br />FreeSwi...
Phone: <br />Dial 571-490-8981<br />Dialplan<br />File: /usr/local/freeswitch/conf/dialplan/public/public.xml<br /><extens...
Java Speech Grammar Format JSGF Grammar<br />File: pizza_yesno.gram<br />#JSGF V1.0;<br />/* JSGF Grammer for pizza_size *...
Let’s test the Voice Robot<br />Call Me:<br />571 – 490 - 8981<br />
Upcoming SlideShare
Loading in...5
×

Voice Controlled SL Robots

2,247

Published on

Voice Controlled SL Robots by Quincy Dagger.

Voice Controlled Robots
Learn how to make your Plain Old Telephone Service (POTS) or cell phone into a voice controller for your virtual world robots. Using your landline or cell phone, your voice can control your robots hands free, while allowing you to use the SecondLife Viewer for text chatting. The tools you will learn about are FreeSwitch, an open source voice switch for voice-over-IP (VoIP), and PocketSphinx, an open source continuous speech recognition system.

When: 3-4 PM SLT/PST
Where: AILC at IEEE2 Island, Second Life
http://slurl.com/secondlife/IEEE%202/56/162/27

Published in: Technology
2 Comments
1 Like
Statistics
Notes
  • Slideshare is a highly content site. If you want to take any information you should read this site with attentively.
    How to setup Ozeki VoIP SIP SDK with FreeSWITCH
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Voice Controlled SL Robots by Quincy Dagger.

    Learn how to make your Plain Old Telephone Service (POTS) or cell phone into a voice controller for your virtual world robots. Using your landline or cell phone, your voice can control your robots hands free, while allowing you to use the SecondLife Viewer for text chatting. The tools you will learn about are FreeSwitch, an open source voice switch for voice-over-IP (VoIP), and PocketSphinx, an open source continuous speech recognition system. When: 3-4 PM SLT/PST Where: AILC at IEEE2 Island, Second Life http://slurl.com/secondlife/IEEE%202/56/162/27

    Published on Slideshare with permission.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total Views
2,247
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
2
Likes
1
Embeds 0
No embeds

No notes for slide
  • http://www.industrygamers.com/news/second-life-transactions-reach-1-billion/
  • http://hackaday.com/2010/07/11/adding-speach-recognition-to-your-embedded-platform/
  • Transcript of "Voice Controlled SL Robots"

    1. 1. Voice Controlled Robots<br />Robert Daniel<br />SL: Quincey Dagger<br />
    2. 2. Introduction<br />Adjunct Professor at GWU<br />10 Teaching Telecommunications<br />SecondLife 4 years<br />OpenSim for the past 3 years<br />FreeSwitch for the past 2 year<br />Intelligence Training <br />Using AI for training<br />1st winner at the FVWC 2011 for AI Concepts<br />
    3. 3. Description<br />Voice Controlled Robots<br />Learn how to make your Plain Old Telephone Service (POTS) or cell phone into a voice controller for your virtual world robots.  <br />Using your landline or cell phone, your voice can control your robots hands free, while allowing you to use the SecondLife Viewer for text chatting.  <br />The tools you will learn about are FreeSwitch, an open source voice switch for voice-over-IP (VoIP), and PocketSphinx, an open source continuous speech recognition system.<br />[1] Dyna 1984 <br />[2] iPhone<br />Reference:<br />[1]http://en.wikipedia.org/wiki/File:DynaTAC8000X.jpg<br />[2] http://en.wikipedia.org/wiki/File:Apple_iPhone_3G_front.jpg<br />
    4. 4. Plain Old Telephone Service & Voice Over IP<br />“More than 18 billion minutes of voice chat have been used in Second Life since voice was introduced in 2007. Voice minutes grew 44% year-over-year from Q2 2008 to Q2 2009, and more than 6 billion minutes of voice have been delivered in 2009 alone, making Linden Lab a major VoIP provider.” <br />[1] Posted Sept 23, 2009 by James Brightman INDUSTRY GAMERS<br />[2]A Telephone Exchange operator 1900<br />Second Life Clients with built-in VoIP<br />Reference:<br />[1] http://www.industrygamers.com/news/second-life-transactions-reach-1-billion/<br />[2] http://en.wikipedia.org/wiki/File:TexasRichardson_telephoneExchangeOperator.jpg<br />
    5. 5. FreeSWITCH<br />Architecture<br />Very Module<br />We are using<br />Dial Plans Route Plans<br />ASR/TTS <br />SPHINX<br />Reference:<br />[1]from freeswitchwebsite http://wiki.freeswitch.org<br />
    6. 6. PocketSphinx<br />Architecture<br />Voice Recognition<br />adjustable, modifiable recognizer written in Java<br />Reference:<br />http://cmusphinx.sourceforge.net/2010/03/pocketsphinx-0-6-release/<br />
    7. 7. PocketSphinx<br />Architecture<br />Voice Recognition<br />adjustable, modifiable recognizer written in Java<br />Reference:<br />http://cmusphinx.sourceforge.net/2010/03/pocketsphinx-0-6-release/<br />http://wiki.freeswitch.org/wiki/Mod_pocketsphinx<br />
    8. 8. Voice Architecture<br />Second Life<br />Remote User<br />SL Client<br />Land Line<br />Cell Phone<br />Robot<br />FreeSwitch<br />Database<br />Voice Commands<br />0 NOTHING <br />1 EAST <br />2 WEST<br />3 SOUTH <br />4 NORTH<br />5 REVERSE <br />6 FORWARD<br />7 FAST<br />8 FASTER<br />9 SLOW<br />10 SLOWER<br />Apache<br />PocketSphinx<br />llHTTPrequest<br />PHP<br />http_response<br />
    9. 9. Phone: <br />Dial 571-490-8981<br />Dialplan<br />File: /usr/local/freeswitch/conf/dialplan/public/public.xml<br /><extension name=“vitel-inbound”><br /> <condition field=“destination_number” expression=“”/><br /> <action application=“transfer” data=“74992 XML default“/><br /> </condition><br /></extension><br />File: /usr/local/freeswitch/conf/dialplan/default.xml<br /><extension name=“vitel-outbound”><br /> <condition field=“destination_number” expression=“^(d{10})$”><br /> <action application=“set” data=“effective_caller_id_number=“5714908981” /><br /> <action application=“bridge” data =“sofia/gateway/vitelity-outbound/$1” /><br /> </condition><br /></extension><br />File: conf/dialplan/default/00_pizza_demo.xml<br /><extension name=“pizza_demo”><br /> <condition field=“destination_number” experssion=“^(pizza|74992)$”/><br /> <condition field=“${module_exists(mod_spidermonkey)}” expression=“true”/><br /> <condition field=“${module_exists(mod_pocketsphinx)}” expression=“true”><br /> <action application=“javascript” data=“ps_pizza2.js “/><br /> </condition><br /></extension><br />File: /usr/local/freeswitch/conf/dialplan/default/01_UAV_demo.xml<br /><extension name=“pizza_demo”><br /> <condition field=“destination_number” experssion=“^(pizza|74993)$”/><br /> <condition field=“${module_exists(mod_spidermonkey)}” expression=“true”/><br /> <condition field=“${module_exists(mod_pocketsphinx)}” expression=“true”><br /> <action application=“javascript” data=“uav_demo.js “/><br /> </condition><br /></extension><br />Directory: /usr/local/freeeswitch/scripts/<br />Js_modules/<br />ps_pizza2.js<br />ps_pizza.js<br />uav_demo.js<br />Directory: /usr/local/freeeswitch/sounds/en/us/callie/en/us/pizza/<br />WelcomeGovGrid_8.wav<br />ConfirmUp.wav<br />ConfirmDown.wav<br />Directory: /usr/local/freeeswitch/grammar/<br />default.dic<br />uav_leftright.gram<br />
    10. 10. Java Speech Grammar Format JSGF Grammar<br />File: pizza_yesno.gram<br />#JSGF V1.0;<br />/* JSGF Grammer for pizza_size */<br />grammar pizza_yes_no;<br /><yes> = [ yes | yep | correct ];<br /><no> = [ no | nope ];<br />Public <yesno> = <yes> <no>;<br />File: pizza_crust.gram<br />#JSGF V1.0;<br />/* JSGF Grammer for pizza_crust */<br />grammar pizza_crust;<br /><handtossed> = [ hand [ tossed] ];<br /><deepdish> = [ [ chicago style ] | deep [dish] ];<br /><panbaked> = [ pan [ baked] [ pizza] ];<br /><thin> = [ thin [crust] | new york [ style] ];<br />Public <crust> = <handtossed> <deepdish> <panbaked> <thin>;<br />File: pizza_order.gram<br />#JSGF V1.0;<br />/* JSGF Grammer for pizza_order */<br />grammar pizza_order;<br />public <delivery> = [takeout | pickup | delivery ];<br />File: pizza_arso.gram<br />#JSGF V1.0;<br />/* JSGF Grammer for pizza_type*/<br />grammar pizza_type;<br /><arso> = [ deliver | start over | crust | add [ a ] topping | remove [ a ] topping ];<br />Public <type> = <arso>;<br />File: uav_control.gram<br />#JSGF V1.0;<br />/* JSGF Grammer for uav_control */<br />grammar uav_control;<br />public <delivery> = [up | down | left | right | forward | backward ];<br />File: pizza_type.gram<br />#JSGF V1.0;<br />/* JSGF Grammer for pizza_type */<br />grammar pizza_type;<br /><specialty> = [ specialty [ pizza] ];<br /><custom> = [ pick [ my own] [ pizza] ];<br />public <type> = <specialty> <custom>;<br />Reference:<br />http://wiki.freeswitch.org/wiki/Mod_pocketsphinx<br />http://java.sun.com/products/java-media/speech/forDevelopers/JSGF/<br />
    11. 11. Let’s test the Voice Robot<br />Call Me:<br />571 – 490 - 8981<br />

    ×