Enabling-technology for Multimedia Applications and services Market-proven since 1996 Avi Fisher, CTO

Targets for the Webinar Surf Proprietary Information Review the main market trends in the multi-media telecom market and their impact on leading applications and services Indentify the dominant applications in the fixed-line and mobile telecom market For each of the above application a description of the main media-processing related challenges The Surf products Software/Hardware architecture Competitive advantages and differentiators for each vertical application A detailed list of media processing features

Review the main market trends in the multi-media telecom market and their impact on leading applications and services

Indentify the dominant applications in the fixed-line and mobile telecom market

For each of the above application a description of the main media-processing related challenges

The Surf products

Software/Hardware architecture

Competitive advantages and differentiators for each vertical application

A detailed list of media processing features

Trends in the telecom market drive applications and services Trend 1: Promote increased usage of network bandwidth Trend 2: Replace legacy (PSTN) core network equipment with NGN/IMS Trend 3: Introduce 3G value added services (VAS) as a means to promote usage of 3G networks Trend 4: Enterprises move to VoIP as a means for cost reduction Trend 5: Ride the success of the social networks Trend 6: Rich (multimedia) content owners seek new ways to increase customer base and revenues Each of the above trends (individually and as a whole) are the key to driving multimedia applications and services into the marketplace Surf Proprietary Information

Trend 1: Promote increased usage of network bandwidth

Trend 2: Replace legacy (PSTN) core network equipment with NGN/IMS

Trend 3: Introduce 3G value added services (VAS) as a means to promote usage of 3G networks

Trend 4: Enterprises move to VoIP as a means for cost reduction

Trend 5: Ride the success of the social networks

Trend 6: Rich (multimedia) content owners seek new ways to increase customer base and revenues

Each of the above trends (individually and as a whole) are the key to driving multimedia applications and services into the marketplace

Trends in the telecom market drive applications and services (cont.) Trend 1: Promote increased usage of network bandwidth  High quality, high bandwidth video conferencing  wideband telephony as a means to differentiate Trend 2: Replace legacy (PSTN) core network equipment with NGN/IMS  IMS infrastructure: media server ( MRF )  media gateway for voice/video  session boarder controller ( SBC ) and security gateway Trend 3: Introduce 3G value added services (VAS) as a means to promote usage of 3G networks  Mobile TV & other Video streaming services to mobile  Video mail  Interactive Video services ( IVVR ) including Mobile banking, Video portal, video blog, video dating, participation TV, video search Surf Proprietary Information

Trend 1: Promote increased usage of network bandwidth

 High quality, high bandwidth video conferencing

 wideband telephony as a means to differentiate

Trend 2: Replace legacy (PSTN) core network equipment with NGN/IMS

 IMS infrastructure: media server ( MRF )

 media gateway for voice/video

 session boarder controller ( SBC ) and security gateway

Trend 3: Introduce 3G value added services (VAS) as a means to promote usage of 3G networks

 Mobile TV & other Video streaming services to mobile

 Video mail

 Interactive Video services ( IVVR ) including

Mobile banking, Video portal, video blog, video dating, participation TV, video search

Trends in the telecom market drive applications and services (cont.) Trend 4: Enterprises move to VoIP as a means for cost reduction  Integrated IP-PBX (PBX+fax+conferencing+video) Trend 5: Ride the success of the social networks  Video chat , Video dating including animation (uses IVVR capabilities) Trend 6: Rich (multimedia) content owners seek new ways to increase customer base and revenues  Mobile to web and Web to mobile content gateway  Monetization through mobile video advertisement Surf Proprietary Information

Trend 4: Enterprises move to VoIP as a means for cost reduction

 Integrated IP-PBX (PBX+fax+conferencing+video)

Trend 5: Ride the success of the social networks

 Video chat , Video dating including animation (uses IVVR capabilities)

Trend 6: Rich (multimedia) content owners seek new ways to increase customer base and revenues

 Mobile to web and Web to mobile content gateway

 Monetization through mobile video advertisement

Product Lines Surf Proprietary Information Chip level Software for multimedia processing embedded in DSPs for board and system developers Board level Boards + embedded software for multimedia processing for system developers

Board level SurfExpress ™ / PCIe Single-lane PCI Express card SurfDocker architecture with up to 8 TI C64x family DSPs 2 x 1Gb Ethernet ports H.100 Dockers: C6482, C6486 (Multi-core) SurfRider ™/AMC AMC form factor half/full size SurfDocker architecture with up to 8 TI C64x family DSPs iTDM Pre-integrated with leading xTCA vendors Dockers: C6482, C6486 (Multi-core)

SurfExpress ™ / PCIe

Single-lane PCI Express card

SurfDocker architecture with up to 8 TI C64x family DSPs

2 x 1Gb Ethernet ports

H.100

Dockers: C6482, C6486 (Multi-core)

SurfRider ™/AMC

AMC form factor half/full size

SurfDocker architecture with up to 8 TI C64x family DSPs

iTDM

Pre-integrated with leading xTCA vendors

Dockers: C6482, C6486 (Multi-core)

Software Architecture [1] Roadmap feature

SurfExpress™ - Hardware Architecture

Media Processing highlights Surf Proprietary Information Video: Transcoding from any-to-any codec Multi-party conferencing with split-screen capabilities On the fly Bit-rate adaptation capabilities Support for H.264, MPEG4, H.263, WMV/VC1 All resolutions from SD (4CIF/D1) down to SQCIF Advertisement injection Logo and text overlays 3G-324M Voice/Audio : Enhanced and complete high capacity VoIP media processing (Up to 3000 channels per board) Wireline and wireless codecs including wideband codecs Multi-party conferencing, up to 3000 participants in a single conference. Streaming and recording with transcoding of up to 2000 concurrent streams per board. Data : Modem relay: V.150.1 Modem: Up to V.92 Fax relay (T.38) and Fax termination (T.32)…

Video:

Transcoding from any-to-any codec

Multi-party conferencing with split-screen capabilities

On the fly Bit-rate adaptation capabilities

Support for H.264, MPEG4, H.263, WMV/VC1

All resolutions from SD (4CIF/D1) down to SQCIF

Advertisement injection

Logo and text overlays

3G-324M

Voice/Audio :

Enhanced and complete high capacity VoIP media processing (Up to 3000 channels per board)

Wireline and wireless codecs including wideband codecs

Multi-party conferencing, up to 3000 participants in a single conference.

Streaming and recording with transcoding of up to 2000 concurrent streams per board.

Data :

Modem relay: V.150.1

Modem: Up to V.92

Fax relay (T.38) and Fax termination (T.32)…

Competitive Edges/product advantages For video telephony (video conferencing, IVVR, video mail, Video ringback): Any resolution from SQCIF to D1/VGA All major video/audio codecs: H.264, MPEG4, H.263, AAC, …. On-the-fly transcoding from any to any Continues presence (multi-video sources on same frame) Video on video Text/logo overlay with transparancy (Alpha blending) Interoperability with more then a hundred of mobile phones, dozens of desktop and soft video clients Surf Proprietary Information For IMS/NGN infrastructure (MRF, MGW, SBC): Highest density (up to 3000 concurrent sessions per board for transcoding and streaming) Up to 250 new calls per second (10 second hold time) per board iTDM – interoperable with leading linecards Texas Instruments Echo canceller Security (SRTP) IPv6 VoIP, T.38 – 12 years deployment SurfExpress™ and SurfRider™/AMC share the same API’s

For video telephony (video conferencing, IVVR, video mail, Video ringback):

Any resolution from SQCIF to D1/VGA

All major video/audio codecs: H.264, MPEG4, H.263, AAC, ….

On-the-fly transcoding from any to any

Continues presence (multi-video sources on same frame)

Video on video

Text/logo overlay with transparancy (Alpha blending)

Interoperability with more then a hundred of mobile phones, dozens of desktop and soft video clients

For IMS/NGN infrastructure (MRF, MGW, SBC):

Highest density (up to 3000 concurrent sessions per board for transcoding and streaming)

Up to 250 new calls per second (10 second hold time) per board

iTDM – interoperable with leading linecards

Texas Instruments Echo canceller

Security (SRTP)

IPv6

VoIP, T.38 – 12 years deployment

SurfExpress™ and SurfRider™/AMC share the same API’s

Competitive Edges/product advantages For IP-PBX: The only chip level product supporting: VoIP GW Fax server and fax relay Voice bridge Prompt announcement IVR Video ready Support for video conferencing Surf Proprietary Information For Content streaming (Mobile TV, web-to-mobile, mobile-to-web, mobile ads) High capacity on-the-fly bitrate adaptation Any to any on-the-fly transcoding Advertisement injection Video on video Scrolling Text and logo overlay with transparency Wideband audio codec processing

For IP-PBX:

The only chip level product supporting:

VoIP GW

Fax server and fax relay

Voice bridge

Prompt announcement

IVR

Video ready

Support for video conferencing

For Content streaming (Mobile TV, web-to-mobile, mobile-to-web, mobile ads)

High capacity on-the-fly bitrate adaptation

Any to any on-the-fly transcoding

Advertisement injection

Video on video

Scrolling Text and logo overlay with transparency

Wideband audio codec processing

Thank You

Detailed media processing features [1] Roadmap feature

Video Features Video Codecs MPEG4 (Enc/Dec) H.263 (Enc/Dec) H.264 (Enc/Dec) – BP, MP* WMV9 (Dec) MPEG2* Any to any transcoding Resolution Any up to VGA/D1/4CIF Frame Rate 1-30FPS Bit Rate Constant and variable Adaptation On-the-fly Transport RTP 3G-324M MPEG-TS* Quality Configurable deblocking levels Multiple destination support Packet Loss Concealment (PLC) Fixed/Adaptive Jitter Buffer Advanced Video Toolbox Dynamic text overlay (Unicode) Configurable frame rate Bit rate change Any resolution resize Superimposed logos and icons Animated banners Picture-in-picture advertising supporting video-on-video * Roadmap feature

Video Codecs

MPEG4 (Enc/Dec)

H.263 (Enc/Dec)

H.264 (Enc/Dec) – BP, MP*

WMV9 (Dec)

MPEG2*

Any to any transcoding

Resolution

Any up to VGA/D1/4CIF

Frame Rate

1-30FPS

Bit Rate

Constant and variable

Adaptation On-the-fly

Transport

RTP

3G-324M

MPEG-TS*

Quality

Configurable deblocking levels

Multiple destination support

Packet Loss Concealment (PLC)

Fixed/Adaptive Jitter Buffer

Advanced Video Toolbox

Dynamic text overlay (Unicode)

Configurable frame rate

Bit rate change

Any resolution resize

Superimposed logos and icons

Animated banners

Picture-in-picture advertising supporting video-on-video

Voice/Audio Features Wireline & Wireless Speech Codecs G.711 G.726 G.723.1A G.722.2 (WB-AMR) G.729AB EVRC GSM FR GSM EFR GSM NB-AMR iLBC Audio Codecs WMA9 (decode only) AAC-LC* Conferencing (for fully-populated 8xDSP board) N-way: 3000 participants per board 3-way: 1000 bridges Echo Cancellation G.168 2002 echo tail up to 128ms Quality Voice Activity Detection (VAD) Comfort Noise Generation (CNG) Packet Loss Concealment (PLC) Fixed/Adaptive Jitter Buffer up to 1000 ms Auto Gain / Level Control (AGC / ALC) Transport RTP/RTCP: RFC 3550, 3551, 3389 Security: SRTP Configurable packet size: 5-60ms (5ms resolution) Single or multiple frames per packet Tone and Events Monitoring Relay (RFC 2833) Caller ID detection and generation Detection/Generation User-defined tones * Roadmap feature

Wireline & Wireless Speech Codecs

G.711

G.726

G.723.1A

G.722.2 (WB-AMR)

G.729AB

EVRC

GSM FR

GSM EFR

GSM NB-AMR

iLBC

Audio Codecs

WMA9 (decode only)

AAC-LC*

Conferencing (for fully-populated 8xDSP board)

N-way: 3000 participants per board

3-way: 1000 bridges

Echo Cancellation

G.168 2002 echo tail up to 128ms

Quality

Voice Activity Detection (VAD)

Comfort Noise Generation (CNG)

Packet Loss Concealment (PLC)

Fixed/Adaptive Jitter Buffer up to 1000 ms

Auto Gain / Level Control (AGC / ALC)

Transport

RTP/RTCP: RFC 3550, 3551, 3389

Security: SRTP

Configurable packet size: 5-60ms (5ms resolution)

Single or multiple frames per packet

Tone and Events

Monitoring

Relay (RFC 2833)

Caller ID detection and generation

Detection/Generation

User-defined tones

Conferencing & Streaming Conferencing Up to 384 TDM or IP audio conferencing participants on a single DSP Dominant speakers detection Up to 96 active video participants Up to 16 displayed participants Configurable video conference layouts Text and image overlay on conference output Streaming Play/Record of any channel from/to file Supported file formats 3GP MP4 ASF (WMV9) AVI Supports more than 2000 concurrent G.711 streams

Conferencing

Up to 384 TDM or IP audio conferencing participants on a single DSP

Dominant speakers detection

Up to 96 active video participants

Up to 16 displayed participants

Configurable video conference layouts

Text and image overlay on conference output

Streaming

Play/Record of any channel from/to file

Supported file formats

3GP

MP4

ASF (WMV9)

AVI

Supports more than 2000 concurrent G.711 streams

Video Conferencing Main challenges Bridge between various types of endpoints (soft clients, desktop, Mobile phones, MS Messenger, Skype..) with diverse codecs and resolutions Support various transport layers (RTP, 3G-324M) High density/low cost Video Phone (Desktop phone) SurfExpress PCI/e IP Video Phone (Soft phone) H.264/VGA Video Phone (LCD, TV) MPEG4/D1 H.264/CIF 3G-324M/MPEG4/QCIF

Main challenges

Bridge between various types of endpoints (soft clients, desktop, Mobile phones, MS Messenger, Skype..) with diverse codecs and resolutions

Support various transport layers (RTP, 3G-324M)

High density/low cost

Wideband Telephony Main challenges High density transcoding and streaming (150MIPS for AAC compared to 10MIPS for G.729) Wideband conferencing  optimize voice quality Interoperability Conference bridge Announcement server Transcoder IP RTP/G711.1 RTP/AAC IP phone WB-AMR (G.722.2)

Main challenges

High density transcoding and streaming (150MIPS for AAC compared to 10MIPS for G.729)

Wideband conferencing  optimize voice quality

Interoperability

Conference bridge

Announcement server

Transcoder

IMS Infrastructure: MRF Main challenges High density and bottleneck-free architecture (move away from the TDM based architecture of legacy boards) High call-per-second (CPS) score. At least 100 per board for a 10 second call duration. Multiple services including voice/video, streaming, conferencing Support for distributed conferencing – at least 1000 participants on the same bridge IP/NGN RTP/G.729 IP phone DTMF IP phone RTP/G.729 Announcement Server Prompts in G.711 (example) SurfExpress PCI/e Storage Servers

Main challenges

High density and bottleneck-free architecture (move away from the TDM based architecture of legacy boards)

High call-per-second (CPS) score. At least 100 per board for a 10 second call duration.

Multiple services including voice/video, streaming, conferencing

Support for distributed conferencing – at least 1000 participants on the same bridge

IMS Infrastructure: Media Gateway Main challenges Field hardened with top class echo canceller, T.38, interoperable Use the same box for other IMS infrastructure (MRF, SBC) iTDM for ATCA IP/NGN Media Gateway PSTN SurfRider/AMC 3G-324m/H.263 SIP IP phone SIP Video phone RTP/SIP H.264 RTP/SIP

Main challenges

Field hardened with top class echo canceller, T.38, interoperable

Use the same box for other IMS infrastructure (MRF, SBC)

iTDM for ATCA

IMS Infrastructure: SBC Main challenges Packet to packet architecture (not the TDM  IP based architecture of legacy telephony boards) High density, high CPS, security, IPv6 Use the same box for other IMS infrastructure (MRF, MGW) IP Operator A SBC SurfRider/AMC SIP IP phone G.729/SRTP IP Operator B IPv6 G.711/RTP IPv4

Main challenges

Packet to packet architecture (not the TDM  IP based architecture of legacy telephony boards)

High density, high CPS, security, IPv6

Use the same box for other IMS infrastructure (MRF, MGW)

Mobile TV & Other Streaming Video Services Main challenges Adaptive bitrate adaptation based on RTCP Ads injection Each phone get his own oprimized codec and optimized bitrate Text overlay with transparency Banners and logos SurfExpress PCI/e Web Ad Server Live feed Storage Servers Streaming Server 3GPP flv RTP HTTP RTP/UDP/IP (unicast) RTCP

Main challenges

Adaptive bitrate adaptation based on RTCP

Ads injection

Each phone get his own oprimized codec and optimized bitrate

Text overlay with transparency

Banners and logos

Video Mail Main challenges Record in one format, play in another format (transcoding) Resolution adjustment, transport adjustment (3G-324M  RTP) Generate I-frames so that recorded message starts with an I-frame Diverse resolutions and codecs (from VGA/D1 to QCIF phones)  high quality rescaling Audio-video synchronization Fixed Video Phone SurfExpress PCI/e IP Storage Video Phone (Soft Client) Server 3G-324M/H.263 QCIF Leave message RTP/H.263/CIF RTP/H.264/VGA Play message in a different format

Main challenges

Record in one format, play in another format (transcoding)

Resolution adjustment, transport adjustment (3G-324M  RTP)

Generate I-frames so that recorded message starts with an I-frame

Diverse resolutions and codecs (from VGA/D1 to QCIF phones)  high quality rescaling

Audio-video synchronization

IVVR Main challenges Various video content in different formats: requires transcoding Video quality especially in 3G-324M Low latency SurfExpress PCI/e Server 3G-324M or RTP Storage Prompts in various formats Play prompt information Receive DTMF Mobile banking video dating Video search Mobile TV Video blog

Main challenges

Various video content in different formats: requires transcoding

Video quality especially in 3G-324M

Low latency

Mobile banking

video dating

Video search

Mobile TV

Video blog

Integrated IP-PBX Main challenges Low cost per port / high functionality Integration of: VoIP gateway, Fax server, conferencing bridge, analog modem backup connection, voice mail Video conferencing bridge (option) PSTN IP Surf DSP chip PSTN Phone Fax Modem PBX IP Phone Printer VoIP GW Conference bridge Fax server Modem backup connection Codec transcoder

Main challenges

Low cost per port / high functionality

Integration of:

VoIP gateway, Fax server, conferencing bridge, analog modem backup connection, voice mail

Video conferencing bridge (option)

VoIP GW

Conference bridge

Fax server

Modem backup connection

Codec transcoder

Web to Mobile, Mobile to Web Gateway Main challenges Interworking/transcoding between Flash (web) and 3GPP (mobile) Support for FLV file format and 3GPP file format Support for H.264 (rapidly increasing), Sorenson/spark (declining), VP6 Support for AAC codec SurfExpress PCI/e Web Server HTTP/flv/VP6 3GPP/RTP/ H.264  Real time uploads of mobile video to the web  Streaming of web originated video to the mobile

Main challenges

Interworking/transcoding between Flash (web) and 3GPP (mobile)

Support for FLV file format and 3GPP file format

Support for H.264 (rapidly increasing), Sorenson/spark (declining), VP6

Support for AAC codec

Dinnovan - Korea

Winnerstek

Matrix - India

NEC - Japan

Newgrid - Korea

VoxPilot

Ethrix