MIT 628: Multimedia Technology Dr. Kritsada Sriphaew Master of Science in Information Technology Rangsit University
1 Multimedia Systems, Standards and Trends MPEG and Visual Display Unit2 MPEG-4 standards3 Image Technology, JPEG standards4 Encoding and Compression5 Video Indexing and Retrieval Content-Based Image Retrieval6 Speech/Audio Processing for Multimedia Applications7 Speech Recognition8
9 Handwritten Recognition10 Interactive Multimedia Systems11 Multimedia Hardware, Software and Authoring Tools12 Design, Development and Evaluation of Interactive Multimedia Systems13 Open Topic 1 (tentative HTML5/CSS3 or Flash)14 Open Topic 2 (tentative HTML5/CSS3 or Flash)15 Mobile Multimedia Technology1617
What is Multimedia?• Multimedia: a working definition – A combination of two or more categories of information having different transport signal characteristics – Typically, one medium is a continuous medium while another is discrete – Image, audio, video and graphics are examples of media
Videos• Some issues – How are the temporal relations between the media represented? – What do I need to stream video across the network? – Are the different media synchronized? – How can I describe a video retrieval request like a query?
Background• MPEG : Moving Picture Experts Group “Compactly representing digital video and audio signal for consumer distribution” ISO/IEC Standard• ITU-T : International Telecom Union The ITU Telecommunication Standardization Sector Some standards for MPEG and ITU-T are duplicate
MPEG Standards• MPEG-1: (1993) Standard for VCD “Coding of moving pictures and associated audio for digital storage media at up to about 1.5 Mbit/s”• MPEG-2: (1995) Standard for SVCD, DVD, digital TV “Generic coding of moving pictures and associated audio information”• MPEG-3: intention for Standard of HDTV – Found Redundant and merge with MPEG-2, there is no MPEG-3 standard – It is not MP3, which is MPEG-1 Audio Layer III.
MPEG Standards• MPEG-4: (1998) “Coding of audio-visual objects for 3D or more efficient video” “closer to computer graphics applications”• MPEG-4 Part 2: visual objects format vdo – DivX – XviD• MPEG-4 Part 3: audio – AAC (Advance Audio Coding) Implemented by Apple Inc. AAC is referred to have low bitrate at kbps with the quality equal to MP3 at kbps and applying in iTunes Music Store with the file format as aac, .mp4 and m4a• MPEG-4 Part 10: Advanced Video Coding (AVC) – H.264 (ITU-T) or AVC (MPEG) Higher standard for vdo codec than MPEG-4 part 2. Applying in QuickTime 7 MacOSX 10.4 Tiger, and broadcasting digital TV in Japan and Europe and next generation of disk for Blu-ray and HD-DVD
MPEG Standards• MPEG-7: (2002) Standard for Adding Contents (Semantic) to the Media “Multimedia content description interface”• MPEG-21: (2001) Standard for Adding Contents to the Media in a more detail (Frame by Frame) “Multimedia Framework”
MPEG-1 MPEG-2 MPEG-4 1993 1995 1998 352 x 288 720 x 576 1920 x 1152 352 x 288 720 x 576 720 x 576PAL) 352 x 288 640 x 480 640 x 480NTSC) 48 kHz 96 kHz 96 kHz 2 8 8 3 Mbit/sec 5 to 10 Mbit/sec 80 Mbit/sec . 1380 kbit/s 880 kbit/s 6500 kbit/s (352 x 288) (720 x 576) (720 x 576) 25 25 25PAL) 30 30 30NTSC) satisfactory good to very good verygood