Building an IMS MRFP using SurfStream TM Framework www.surf-com.com

Presentation Highlights Multimedia Resource Function Processor ( MRFP) Development Challenges SurfStream Framework Overview Building an MRFP using SurfStream Framework SurfStream Feature Support SurfStream Hardware Integration Surf’s Value Propositions

Multimedia Resource Function Processor ( MRFP) Development Challenges

SurfStream Framework Overview

Building an MRFP using SurfStream Framework

SurfStream Feature Support

SurfStream Hardware Integration

Surf’s Value Propositions

MRFP Development Challenges

IMS Service Provider Needs Deliver highest quality media processing to support mobile and IP services Audio/video mail Video portal Video conferencing Multimedia servers Recording servers Support multiple formats for multiple devices Combine traditional TDM-based applications with next-generation IP Audio/Video services Simple migration path for supporting future formats

Deliver highest quality media processing to support mobile and IP services

Audio/video mail

Video portal

Video conferencing

Multimedia servers

Recording servers

Support multiple formats for multiple devices

Combine traditional TDM-based applications with next-generation IP Audio/Video services

Simple migration path for supporting future formats

IMS Service Provider Needs A single solution for all media types Flexible channel media type assignment is required to reach entire audience Price and ROI Smooth and flexible migration from ‘audio’ systems to ‘audio and video’ systems Fast integration into current infrastructure

A single solution for all media types

Flexible channel media type assignment is required to reach entire audience

Price and ROI

Smooth and flexible migration from ‘audio’ systems to ‘audio and video’ systems

Fast integration into current infrastructure

MRFP Development Challenges Growing number of codecs Interoperability Each media type has its own interoperability issues New media formats are introduced – i.e., iLBC, H.264, WMA9, WMV9 Quality issues due to environmental changes DSP code optimization Application type optimization System bottlenecks New hardware standards

Growing number of codecs

Interoperability

Each media type has its own interoperability issues

New media formats are introduced – i.e., iLBC, H.264, WMA9, WMV9

Quality issues due to environmental changes

DSP code optimization

Application type optimization

System bottlenecks

New hardware standards

MRFP Services and Architecture Video Audio Application Server Layer SIP SIP Megaco/H.248 or SIP with MSML+MOML / MSCML+NETANN Session Control Layer Media Processing Layer Audio codecs & Transcoding Tones-Gen/Detect TDM/IP VAD/CNG/PLC Play & Record Fax detect & process N-Way Conf M- dominant speaker detect Video codecs & Transcoding Frame rate / resolution change Background / Forground manipulation Different format per conf destination Video mixing/conf Streaming & recording Application Server S-CSCF MRFC MRFP UDP/RTP

Buying Boards or Chips Why Boards? Pre-requisite: Standard form factor or Standard mezzanine-card connector Lowest risk Lowest initial investment Cheapest solution in the long run Negotiation Change vendor Easiest migration path to next generation DSPs Why Chips? Proprietary form factor Single-DSP solutions Very high volumes (10K+) Prediction: By 2008 all new Tier-I infrastructure solutions will be based on standard boards and modules that are made by third parties.

Why Boards?

Pre-requisite:

Standard form factor or

Standard mezzanine-card connector

Lowest risk

Lowest initial investment

Cheapest solution in the long run

Negotiation

Change vendor

Easiest migration path to next generation DSPs

Why Chips?

Proprietary form factor

Single-DSP solutions

Very high volumes (10K+)

New Hardware Standards Well defined control mechanism in spec No defined control mechanism Up to 30 Watt Up to 15 Watt Hot swap Non hot swap Rapid I/O TDM GB Ethernet MII PCI Express PCI AMC PTMC Megs of traffic 10s of Megs in back plane Gigs of traffic 10 Gig per AMC in back plane Not Ready for next generation DSPs Ready for more powerful DSPs

Why Put Audio & Video on the Same Chip/Module? Easy migration path from 0% video / 100% audio to 100% video / 0% audio and anything in-between Minimal system delay -> higher overall quality No need to separate audio from video and send each to a separate chip/module Easier to establish lip-sync between audio and video when packets are lost or delayed Lower operational expenses Only need to support one chip/board Lower integration efforts Single API for audio and video No need for an aggregation device to combine/split audio and video

Easy migration path from 0% video / 100% audio to 100% video / 0% audio and anything in-between

Minimal system delay -> higher overall quality

No need to separate audio from video and send each to a separate chip/module

Easier to establish lip-sync between audio and video when packets are lost or delayed

Lower operational expenses

Only need to support one chip/board

Lower integration efforts

Single API for audio and video

No need for an aggregation device to combine/split audio and video

MRFP Development Challenges A typical MRFP is composed of four components: Media processing DSP code Host-based state machines and APIs Hardware platform MRFP application Generic Generic Generic All generic components are provided by Surf, allowing our customers to focus their resources on the application specific part . Application-Specific

A typical MRFP is composed of four components:

Media processing DSP code

Host-based state machines and APIs

Hardware platform

MRFP application

SurfStream Framework Overview

SurfStream Framework Principles All application development needs in one SW package Host-based library for DSP control and monitoring OS-specific drivers for all boards Windows-based diagnostic tool for easy debugging Short development cycle Feature rich for maximal flexibility User-friendly APIs & sample applications Comprehensive documentation Technical support

All application development needs in one SW package

Host-based library for DSP control and monitoring

OS-specific drivers for all boards

Windows-based diagnostic tool for easy debugging

Short development cycle

Feature rich for maximal flexibility

User-friendly APIs & sample applications

Comprehensive documentation

Technical support

SurfStream Framework Principles (cont’d) Best of Breed High capacity Efficient implementation Optimized for all type of telecom/IMS media processing needs Field-proven Standards compliant Intensively tested Flexible

Best of Breed

High capacity

Efficient implementation

Optimized for all type of telecom/IMS media processing needs

Field-proven

Standards compliant

Intensively tested

Flexible

Application 1: Audio & Video Mail Video : MPEG4 -> H.263 CIF  QCIF 30FPS -> 10FPS Audio: WB-AMR  NB-AMR Transport: H.223 Audio, Video & Control multiplexed in 3G-324M using H.223 Audio/Video message stored as .MP4 file parsed and sent to media board Legacy Phone IP Mobile PSTN MRFC MRFP SIP Phone Fax 3G-324M Video Phone H.324 Video Phone SIP Video Phone MGW MGW

Application 2: MRFP Audio/Video 3G-324M Audio/Video Over RTP Audio Over RTP Voice Over PSTN Audio/Video Over H.324 (V.34 modem) Prompt for file transfer Legacy Phone IP Mobile PSTN MRFC MRFP SIP Phone Fax 3G-324M Video Phone H.324 Video Phone SIP Video Phone MGW MGW

Building a Cross-platform MRFP with the SurfStream Framework

Step 1: Initializing HW Devices API concept: Controls = C-callable functions Monitors = Callback functions Steps: Reset DSP Download DSP software Activate DSP Reset layer-2 switch Set layer-2 switch to default mode Set DSP and channel callback functions Establish logical Host-DSP connection Packet-switched Peripherals Layer IV Switch Layer II Switch DSP Elements DSP DSP Framework Channel SurfUP System Elements User Application SurfStream System Elements SurfStream Host API FEP - File End Point POTS Interfaces H.100 Matrix Sample Application

API concept:

Controls = C-callable functions

Monitors = Callback functions

Steps:

Reset DSP

Download DSP software

Activate DSP

Reset layer-2 switch

Set layer-2 switch to default mode

Set DSP and channel callback functions

Establish logical Host-DSP connection

Step 2: Initialize Channels and Routing of Audio and Video Packet Interface Layer II switch FEP Video channel MPEG4->H.263 QCIF->CIF RTP JB Audio channel AMR<->G729 RTP JB Host API File system SurfStream API Step 2.1: Create & Configure Video channel Audio channel Audio & video mixing channels Channels can be located on the same DSP or on separate DSPs mixing channels Audio mixing Video mixing SIP Video Phones

Video channel

MPEG4->H.263

QCIF->CIF

RTP

JB

Audio channel

AMR<->G729

RTP

JB

Step 2.1: Create & Configure

Video channel

Audio channel

Audio & video mixing channels

mixing channels

Audio mixing

Video mixing

Step 2: Initialize Channels and Routing for Media Streaming and Conferencing Packet Interface Layer II switch FEP Video channel MPEG4->H.263 QCIF->CIF RTP JB Voice channel AMR<->G729 RTP JB Host API File system SurfStream API Step 2.2: Configure packet routing Video channel Audio channel Mixing channel Routing is identical whether or not channels are on the same DSP mixing channels Audio mixing Video mixing SIP Video Phones

Video channel

MPEG4->H.263

QCIF->CIF

RTP

JB

Voice channel

AMR<->G729

RTP

JB

Step 2.2: Configure packet routing

Video channel

Audio channel

Mixing channel

mixing channels

Audio mixing

Video mixing

Step 3: Play Video & Audio .3gp or .mp4 Streams in the Conference Circuit Switch Interface Packet Interface Layer II switch FEP Video channel MPEG4->H.263 QCIF->CIF RTP JB Voice channel AMR<->G729 RTP JB Host API File system SurfStream API Associate Video channel with a FEP Associate Voice channel with a FEP Associate a file with a FEP Command for FEP to start streaming FEP = File End Point mixing channels Audio mixing Video mixing SIP Video Phones

Video channel

MPEG4->H.263

QCIF->CIF

RTP

JB

Voice channel

AMR<->G729

RTP

JB

Associate Video channel with a FEP

Associate Voice channel with a FEP

Associate a file with a FEP

Command for FEP to start streaming

mixing channels

Audio mixing

Video mixing

SurfStream Framework Feature Support

General Features Dynamic port assignment for Audio/Video/Fax/Modem Direct DSP  network interface, resulting in lowest possible delay DSPs connected to Ethernet eliminate the need for an aggregation unit that causes excessive delay Inter DSP communication for running algorithms across multiple DSPs (i.e. large conference) Open Framework Vendors can build a user-defined channel to create a competitive advantage or re-use in-house algorithms Diagnostics included in release version allow easy bug analysis and resolution

Dynamic port assignment for Audio/Video/Fax/Modem

Direct DSP  network interface, resulting in lowest possible delay

DSPs connected to Ethernet eliminate the need for an aggregation unit that causes excessive delay

Inter DSP communication for running algorithms across multiple DSPs (i.e. large conference)

Open Framework

Vendors can build a user-defined channel to create a competitive advantage or re-use in-house algorithms

Diagnostics included in release version allow easy bug analysis and resolution

Play/Record Features Enables playing/recording of audio and video streams from Host file system to IP, TDM, or 3G networks Supports real-time video streaming of proprietary optimized SRF file format Standard and proprietary file formats MP4 3GP SRF Reliable Host-DSP communication over UDP Supports .WAV audio file format with G.711 A-law/ µ-law encoding

Enables playing/recording of audio and video streams from Host file system to IP, TDM, or 3G networks

Supports real-time video streaming of proprietary optimized SRF file format

Standard and proprietary file formats

MP4

3GP

SRF

Reliable Host-DSP communication over UDP

Supports .WAV audio file format with G.711 A-law/ µ-law encoding

Audio Features Audio Codecs G.711, G.729, G.723.1, G.729AB, GSM FR, GSM EFR, GSM NB-AMR, EVRC Up to 32 TDM or IP Audio conferencing participants Block size 5-30ms (5ms resolution) Echo cancellation G.168 2002 Echo tail up to 128ms VAD, CNG, Packet Loss Concealment RTP/RTCP RFC 3550, 3551, 3389 Fixed/Adaptive Jitter Buffer Up to 300 ms Caller ID Detection & Generation Tone and Events Monitoring, Relay and Generation

Audio Codecs

G.711, G.729, G.723.1, G.729AB, GSM FR, GSM EFR, GSM NB-AMR, EVRC

Up to 32 TDM or IP Audio conferencing participants

Block size

5-30ms (5ms resolution)

Echo cancellation

G.168 2002

Echo tail up to 128ms

VAD, CNG, Packet Loss Concealment

RTP/RTCP

RFC 3550, 3551, 3389

Fixed/Adaptive Jitter Buffer

Up to 300 ms

Caller ID Detection & Generation

Tone and Events Monitoring, Relay and Generation

Video Features Video Codecs Current: MPEG-4 and H.263 Roadmap: H.264, H.263 + , H.263 ++ , H.261 Resolution CIF QCIF Frame Rate 1-30FPS Video Toolbox (advanced features) Configurable frame rate Bit rate change Any resolution resize Video codec change Logo insertion

Video Codecs

Current: MPEG-4 and H.263

Roadmap: H.264, H.263 + , H.263 ++ , H.261

Resolution

CIF

QCIF

Frame Rate

1-30FPS

Video Toolbox (advanced features)

Configurable frame rate

Bit rate change

Any resolution resize

Video codec change

Logo insertion

Video Features (cont’d) Bit rate CBR (Constant Bit Rate): 10–768Kbps VBR (Variable Bit Rate): Minimum – Maximum Quality (automatic bit rate adjustment) Configurable deblocking levels RTP Encapsulation Multiple destination support Jitter Buffer - Supporting packet rearranging and packet loss handling

Bit rate

CBR (Constant Bit Rate): 10–768Kbps

VBR (Variable Bit Rate): Minimum – Maximum Quality (automatic bit rate adjustment)

Configurable deblocking levels

RTP Encapsulation

Multiple destination support

Jitter Buffer - Supporting packet rearranging and packet loss handling

Video Conferencing Features Video conferencing Up to 16 participants on a single DSP Up to 96 participants when using inter DSP communication Dynamic participants display Addition/removal of participants during video conference User-defined screen layout defining size and location for each picture component Pre-defined layouts (roadmap feature) Dynamic configuration of layout Background and foreground setting in run-time Transparency alpha blending per picture (roadmap) Picture overlap support Raw video interface YUV format

Video conferencing

Up to 16 participants on a single DSP

Up to 96 participants when using inter DSP communication

Dynamic participants display

Addition/removal of participants during video conference

User-defined screen layout defining size and location for each picture component

Pre-defined layouts (roadmap feature)

Dynamic configuration of layout

Background and foreground setting in run-time

Transparency alpha blending per picture (roadmap)

Picture overlap support

Raw video interface

YUV format

SurfStream Framework Hardware Integration

Chip-Level SurfSTP-10/12/14/15/55 (based on TI C64xx) Supports audio/video/fax/modem Ideal for various applications: Gateway Conferencing Streaming Supports simultaneous TDM  IP interfaces for VOIP gateway SurfDetect for real-time streaming diagnostics from DSP Open Framework for integration of customer technology Solution is also available on other TI C64x-based DSPs Chip-Level Solution C64x-based

SurfSTP-10/12/14/15/55 (based on TI C64xx)

Supports audio/video/fax/modem

Ideal for various applications:

Gateway

Conferencing

Streaming

Supports simultaneous TDM  IP interfaces for VOIP gateway

SurfDetect for real-time streaming diagnostics from DSP

Open Framework for integration of customer technology

Solution is also available on other TI C64x-based DSPs

Board-Level - PCI SurfAce-112 Form Factor: PCI Number of STP-12 DSPs: 1 on board/2,4 or 8 with daughter card Interfaces: Ethernet E1/T1 (optional) PCI H.100 Software features: same as SurfSTP-xx Modes of operation: Control through PCI Stand-alone mode: Control through Ethernet Board-Level Solutions PCI, PTMC & AMC

SurfAce-112

Form Factor: PCI

Number of STP-12 DSPs: 1 on board/2,4 or 8 with daughter card

Interfaces:

Ethernet

E1/T1 (optional)

PCI

H.100

Software features: same as SurfSTP-xx

Modes of operation:

Control through PCI

Stand-alone mode: Control through Ethernet

Board-Level - PTMC SurfRider-812/PTMC Form Factor: PTMC (cPCI mezzanine) Number of 6412 DSPs: 2,4,or 8 Interfaces: Ethernet PCI H.100 Software features: same as SurfSTP-xx Modes of operation: Control through PCI, Media through Ethernet Stand-alone mode: Control & Media through Ethernet Board-Level Solutions PCI, PTMC & AMC

SurfRider-812/PTMC

Form Factor: PTMC (cPCI mezzanine)

Number of 6412 DSPs: 2,4,or 8

Interfaces:

Ethernet

PCI

H.100

Software features: same as SurfSTP-xx

Modes of operation:

Control through PCI, Media through Ethernet

Stand-alone mode: Control & Media through Ethernet

Board-Level - AMC SurfRider/AMC Fully compliant, half-height, single-size AMC form factor 2,4,6,8 DSPs of C64xx or any other processor/logic type Supports all next-generation TI DSPs High capacity of audio/video Very high throughputs Up to 10Gb between external interface and any DSP, and between the DSPs Supports ALL types of external interfaces: GbEthernet, PCI_Express, Advanced switching, Rapid IO, Fiber channel, Infiniband and others Mounted on ATCA (up to 8 boards) or MicroTCA Board-Level Solutions PCI, PTMC & AMC

SurfRider/AMC

Fully compliant, half-height, single-size AMC form factor

2,4,6,8 DSPs of C64xx or any other processor/logic type

Supports all next-generation TI DSPs

High capacity of audio/video

Very high throughputs

Up to 10Gb between external interface and any DSP, and between the DSPs

Supports ALL types of external interfaces:

GbEthernet, PCI_Express, Advanced switching, Rapid IO, Fiber channel, Infiniband and others

Mounted on ATCA (up to 8 boards) or MicroTCA

SurfRider-812/PTMC Integrated with cPCI Carrier board provided by Surf Partners

SurfRider-812/PTMC Integrated with ATCA Carrier board provided by Surf Partners

Roadmap: Version 4.2 Release date Q2/06 Contents: TMS320C6455, AMC & Video Enhancements AMC DSP farm board TI TMS320C6455 TM support H.264 encoding/decoding/transcoding Audio/video sync enhancements More…

Release date

Q2/06

Contents: TMS320C6455, AMC & Video Enhancements

AMC DSP farm board

TI TMS320C6455 TM support

H.264 encoding/decoding/transcoding

Audio/video sync enhancements

More…

Surf’s Value Propositions

Surf’s Value Propositions Unique approach: integrated audio/video platform (instead of separate systems) Next Generation DSPs Open Framework Seamless integration of video into audio infrastructures Easy integration of third-party technology Optimized architecture and APIs for a wide range of applications

Unique approach: integrated audio/video platform (instead of separate systems)

Next Generation DSPs

Open Framework

Seamless integration of video into audio infrastructures

Easy integration of third-party technology

Optimized architecture and APIs for a wide range of applications

Surf’s Value Propositions, cont’d Strategic partnership with TI Market presence Established customer base Field-hardened solutions Credibility Market-proven since 1996 Well-known and reputable provider of Universal Port solutions Field-hardened Patents 26 pending 4 approved

Strategic partnership with TI

Market presence

Established customer base

Field-hardened solutions

Credibility

Market-proven since 1996

Well-known and reputable provider of Universal Port solutions

Field-hardened

Patents

26 pending

4 approved

Thank You www.surf-com.com