TS-1679 Excerpt

523 views

Published on

JavaOneKaraokePresentation

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
523
On SlideShare
0
From Embeds
0
Number of Embeds
18
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

TS-1679 Excerpt

  1. 1. Java ™ Technology Sounds Good Manoel Lemos CEO/CTO—Singularity Systems, Brazil Dan Sharoni President/CTO—brazIP, Inc., USA Prof. Jônatas Manzolli Director—NICS, UNICAMP, Brazil Designing Very Low-Cost Embedded Java Software Solution for MIDI-Based Interactive Music Game Devices (Java Technology-Based Karaoke Is Everywhere)
  2. 2. Interactive Audio Game in Embedded J2ME ™ Platform-Based Solution for Low Income Families <ul><ul><li>Learn how: </li></ul></ul><ul><ul><li>HARDWARE product idea is cost reduced using an embedded Java ™ technology-based solution </li></ul></ul><ul><ul><li>Java technology provides general MIDI (GM) full capability, quality audio, and feature-set flexibility </li></ul></ul><ul><ul><li>Disputing common perception of slowness of Java technology, software, and off-the-shelf CPU solutions </li></ul></ul>Academy and Industry in Brazil Research a Karaoke Console That Plays General MIDI Files to Any TV
  3. 3. Presentation Agenda <ul><li>Brazil beyond soccer and Carnaval </li></ul><ul><li>Academy: General MIDI (GM) role in research </li></ul><ul><li>Industry: Motivations for using GM commercially </li></ul><ul><li>Architecting low-cost, stand-alone Karaoke game </li></ul><ul><li>System design, implement: HW, SW components </li></ul><ul><li>Java technology MIDP sound issues </li></ul><ul><li>Demo </li></ul><ul><li>What’s next? </li></ul>
  4. 4. Cordas—Interactive Virtual Strings Right Hand Rhythm and Gesture Control Web Connection Settings Left Hand Melody Control Java technology-based simulation of fretted strings instruments
  5. 5. Cordas—Interactive Virtual Strings Java Class Diagram TablatureMusical Data Unit fretNotesArray:int[] fretNotes:ArrayList JFrame TuneEditor +TuneEditor +configChanged:void +notifyChangeToSons:void MusicalDataUnit ready:boolean note:int velocity:int duration:int delay:int PlayStyleMusical DataUnit +PlayStyle +getTrioString:int +getTrioDuration:int +getTrioVelocity:int +addTrio:void numberOfTrios:int strings:int[] durations:int[] velocities:int[] Composition Thread Conductor Config
  6. 6. Rabisco— Musical Composition in a Sketch Composing Pad Current Music Frequency (notes) Intensity Instruments Rhythm Mask Volume Control Tempo Java technology and MIDI based, web connected, interactive, graphical, music composition tool
  7. 7. Presenting Online Musical Jamming “ Distributed Musical Instruments” @ SIGGRAPH2002 MIDI Server Rabisco Client Rabisco Client Rabisco Client Cordas Virtuais Client Cordas Virtuais Client Rabisco Client
  8. 8. JaVox: Psychoacoustics Composition ROBOSER: ROBot CompOSER Java technology-based interactive evolutionary computation Environmental based interactive composition
  9. 9. Presentation Agenda <ul><li>Brazil beyond soccer and Carnaval </li></ul><ul><li>Academy: General MIDI (GM) role in research </li></ul><ul><li>Industry: Motivations for using GM commercially </li></ul><ul><li>Architecting low-cost, stand-alone Karaoke game </li></ul><ul><li>System design, implement: HW, SW components </li></ul><ul><li>Java technology MIDP sound issues </li></ul><ul><li>Demo </li></ul><ul><li>What’s next? </li></ul>
  10. 10. Industry: Low-Cost Karaoke Product <ul><li>Very low cost (<US$40) stand-alone MIDI console </li></ul><ul><li>Only ONE external audio/video device: A standard TV </li></ul><ul><li>MIDI ROM cartridges provides after market revenues </li></ul><ul><li>MIDI music is extremely compact, low-cost fun </li></ul><ul><li>Karaoke MIDI files (.Kar) are available on the web </li></ul>Goals of commercializing GM
  11. 11. Presentation Agenda <ul><li>Brazil beyond soccer and Carnaval </li></ul><ul><li>Academy: General MIDI (GM) role in research </li></ul><ul><li>Industry: Motivations for using GM commercially </li></ul><ul><li>Architecting low-cost, stand-alone Karaoke game </li></ul><ul><li>System design, implement: HW, SW components </li></ul><ul><li>Java technology MIDP sound issues </li></ul><ul><li>Demo </li></ul><ul><li>What’s next? </li></ul>
  12. 12. Java Technology MIDI Solution— Software Based HEX Basic Sound Banks < 4MBytes Music Events Analog Audio Analog Video MIDI .Kar ROM Composite Video Video Mixer D/A Converter Audio Mixer Standard CPU ($5) JVM CLDC MIDP MMAPIs Lyrics Exp. Timing & Syncing Char. Gen. G U I ♪♫♪♫♪ ♪♫♪♫♪ ♫♪♫♪ ♫♪♫♪ Quality Sound Banks Optional
  13. 13. Presentation Agenda <ul><li>Brazil beyond soccer and Carnaval </li></ul><ul><li>Academy: General MIDI (GM) role in research </li></ul><ul><li>Industry: Motivations for using GM commercially </li></ul><ul><li>Architecting low-cost, stand-alone Karaoke game </li></ul><ul><li>System design, implement: HW, SW components </li></ul><ul><li>Java technology MIDP sound issues </li></ul><ul><li>Demo </li></ul><ul><li>What’s next? </li></ul>
  14. 14. System Design Software Components Proposed use case diagram Lyrics Display Midi Karaoke Console Music Event Lyrics Event Synchronization Sound Out
  15. 15. System Design Software Components Proposed sequence diagram Sync Delay Timer MIDI Decoder Karaoke Sound Out Lyrics Display MIDI.kar ROM Lyrics Explorer SylabelObj 1.1: Play Event X 1: Music Event X 3:[If Event Y <= Music Event X] //Display Event Y Sylabel 2.1: Sylabel Event Y 100mSec 2: Sylabel Event Y
  16. 16. System Design Software Components Proposed class diagram CPhrases #start:int #end:int +CPhrases posEnd:int posBeg:int LyricsExplorer #karFile:InputStream -delta:int -event:int -acumDelta:int -sUsPQNote:Vector -sTicksPerQtrN:int -sylabels:Vector -acumUSec:long #sylabelsIndex:int #phrases:Vector +LyricsExplorer -extrHeader:int -extrNunTrks:int -extrTimingRef:int -extrDelta:int -extrMidiEvents:int #cnvTcksTUsec:long +curSylabel:String +nxtEventTime:long +nxtEvSylabel:String +getPhrase:String GetDataFor TimePerBeat delta:long tickPerUsec:long SylabelObject +SylabelObject txt:String time:long MIDlet CommandListener KaraokeApp -fe:Command -msg:Ticker #player:Player -clk:StringItem -nxtLtr:StringItem -curLtr:StringItem -totTm:StringItem #tskTm:TimerTask #timer:Timer #timeClk:String #startApp:void -updateAll:void
  17. 17. Mobile Phone Karaoke Memory monitored during emulation
  18. 18. Hardware Implementations (Prototypes) Velocity Typhon Nokia 3650 Palm Tungsten C MicriumC/OS-II KVM CLDC 1.0 MIDP 1.0 No MMAPI Proprietary API Symbiam OS KVM CLCD 1.0 MIDP 2.0 MMAPI Nokia MMAPI Palm OS IBM J9 VM CLDC 1.0 MIDP 1.0 No MMAPI
  19. 19. What Can You Take Away From This Presentation? <ul><ul><li>4 Main Points: </li></ul></ul><ul><ul><li>Cost reduction using embedded Java technology </li></ul></ul><ul><ul><li>Feature-set flexibility using SW General MIDI (GM) </li></ul></ul><ul><ul><li>Java technology, software, and low-cost off-the-shelf CPU solutions have the speed/quality for multimedia </li></ul></ul><ul><ul><li>Multimedia is everywhere with Java technology </li></ul></ul>
  20. 20. Acknowledgements: Keep in Touch <ul><li>brazIP </li></ul><ul><ul><li>Dan Sharoni <dsharoni@brazip.com> </li></ul></ul><ul><ul><li>Marcos Lazarini <lazarini@brazip.com> </li></ul></ul><ul><ul><li>http://www.brazip.com </li></ul></ul><ul><li>IgnisCom </li></ul><ul><ul><li>Gean Breda <gean@igniscom.com.br> </li></ul></ul><ul><ul><li>Marcelo Cubas <marcelo@igniscom.com.br> </li></ul></ul><ul><ul><li>http://www.igniscom.com.br </li></ul></ul><ul><li>LaRCom / FEEC / UNICAMP </li></ul><ul><ul><li>Prof. Leonardo Mendes <lmendes@decom.fee.unicamp.br> </li></ul></ul><ul><ul><li>Davisson Gonzaga da Silva <davisson@decom.fee.unicamp.br> </li></ul></ul><ul><ul><li>http://www.mc21.fee.unicamp.br </li></ul></ul><ul><li>NICS / UNICAMP </li></ul><ul><ul><li>Prof. Jônatas Manzolli <jonatas@nics.unicamp.br> </li></ul></ul><ul><ul><li>Márcio Saragiotto <sgiotto@nics.unicamp.br> </li></ul></ul><ul><ul><li>http://www.nics.unicamp.br </li></ul></ul><ul><li>Singularity Systems </li></ul><ul><ul><li>Manoel Lemos <mlemos@singularitysystems.com> </li></ul></ul><ul><ul><li>Georges Benatti <gbenatti@singularitysystems.com> </li></ul></ul><ul><ul><li>http://www.singularitysystems.com </li></ul></ul>
  21. 21. Thanks ;-) ♪♫♪ Manoel Lemos CEO/CTO—Singularity Systems, Brazil Dan Sharoni President/CTO—brazIP, Inc., USA Prof. Jônatas Manzolli Director—NICS, UNICAMP, Brazil
  22. 22. Java ™ Technology Sounds Good Designing Very Low-Cost Embedded Java Software Solution for MIDI-Based Interactive Music Game Devices (Java Technology-Based Karaoke Is Everywhere) Manoel Lemos CEO/CTO—Singularity Systems, Brazil Dan Sharoni President/CTO—brazIP, Inc., USA Prof. Jônatas Manzolli Director—NICS, UNICAMP, Brazil

×