3G & Beyond:
What lies ahead for
Performance Management?


Host:                               Speaker:
Frank Colletta                      Yaacov Burak
Sr. Manager, Solution Engineering   Director, Solution Engineering



    TTI Telecom © 2009
Agenda

3G and Beyond – Key Concepts
  Operational Challenges
  Inter Domain Performance Correlation
  Key Performance Indicators for E-UTRAN

Audience Poll

“When Things Go Wrong…” - Based on a True Story
  Radio-to-IP Inter Domain Correlation
  Assuring Mobility with Tracking Area
  LTE Multi-Service Monitoring

Q&A



                                 2
3G & Beyond: Operational Challenges
 A new era in information processing
   Massive data collection, intensive data processing

 Radio/IP Inter-Domain Correlation
    Disassociation between radio / IP backhaul domains affect
   customer experience

 Maintain QoS in Packet Switching/ all-IP network
   Prioritize mixed services over shared bearer
   Recognized by 3GPP 'Key Performance Indicators (KPI) for E-
   UTRAN Definitions’




                                  3
Coping with Significantly High Data Volumes

          Data                      Data                    Ad-Hoc
        Collection               Processing               investigation
   Distributed collection    Flexible KPI/KQI         Ad-hoc reporting
    architecture               Creation and              functionalities
                               modification              (BusineesObjects)
   Early data processing
    (collection stage)        Time and hierarchal      Ad-hoc threshold
                               aggregation functions     definition
   Data prospecting           at this phase
    Consider the relevancy
    of data prior to the      Auto-learning
    collection                 thresholds




                                        4
Inter-Domain Performance Correlation

                     UMTS
                     Domain




         IT/ VAS
         Domain                GPRS
                               Domain




                      IP
                     Core


                       5
LTE: Key Performance Indicators for E-UTRAN

                                                Accessibility
                                               Handover Success
                                                                              Integrity
                                                Rate
                        Retainability                                     Throughput
                                               Handover Failure
                                                                          Block ACK ratio
                        SAEB Bearer Release
                                                Rate                                             Mobility
  Availability          SAE Bearer
                                               Tracking Area             Block ERR ratio
                                                Configuration Score       HARQ Failures     Inter/Intra Handover
Cell Availability       modification          Hanover Interruption                          Success/Failure Rate
                                                                          Latency
Network Availability   SAE Bearer activity   S1 Handover Rate                             Tracking Area
                                                                          Packet Loss        Configuration Score
Service Availability   Added SAE Bearers     RRC Connection            Jitter            Hanover Interruption
                         Attempts               Establishment Rate
                                                                          MOS               S1 Handover Rate
                        SAE Bearer number     SAEB initial connection
                                                Establishment Rate




                        Bridging the Gap Between RF Performance
                                 and End-User IP Services


                                                          6
When Things Go Wrong…




  TTI Telecom © 2009   7
Dropped Calls, Spotty Service, Delayed
Text…

                       The average iPhone owner can also use 10
                       times the network capacity used by the
                       average smartphone user…

                       The result is dropped calls, spotty service,
                       delayed text and voice messages and
                       glacial download speeds as … cellular
                       network strains to meet the demand.
                       Another result is outraged customers.




  TTI Telecom © 2009              8
Inter-Domain Performance Correlation



                                  UMTS
                                  Domain
Radius Authentication
    Failure Rate


                        IT/ VAS
                        Domain             GPRS
                                           Domain
                                                    Failed PDP Context
                                                         Activation




                                   IP
                                  Core




                                    9
Radio-to-IP Inter Domain Correlation

Radio-to-IP Correlation
dramatically Reduce
Mean-Time-To-Identify




         UMTS Domain                                IP Core
                                                                 • VAS
                                                          RADIUS • Portal
                                                                 • WWW

                             Iu-ps        Gn   Gi
                       RNC




                                     10
Integrated Thresholds Alarm Definition
                                                         1     10
 1. GGSN FAILED_PDP_ACTIVATION_PCT:        Exceed                    2      %


                                                         1     30
 2. GGSN FAILED_PDP_ACTIVATION_PCT:        Exceed                    Average    7   Days


                                                         1   10000
 3.            GGSN ATTEMPT_PDP_ACT:       Exceed                    3000


                                                         1     10
 4.          Radius AUTH_REQ_REJ_PCT:      Exceed                    1      %


                                                         1     30
 5.               Radius AUTH_REJ_REQ:     Exceed                    Average    7   Days



 Advanced Alarm Condition:   1 AND 2 AND 3 AND 4 AND 5




  Aggregated set of rules identify customer experience degradation
Getting on 3G During Peak Times…


                       “It’s almost worthless to try and get on 3G
                       during peak times in those cities…When
                       too many users get in the area, the call
                       drops.”

                       The problems seem particularly
                       pronounced in New York and San
                       Francisco, where (senior analyst) estimates
                       …network shoulders as much as 20 percent
                       of all the iPhone users in the United States.




  TTI Telecom © 2009              12
Tracking Area Optimization

  Small Tracking Area                     Large Tracking Area

                                                                eNB




                                                         eNB

                 eNB




                                                        eNB



   Minimum paging, Many TA updates         Maximum paging, Few TA updates




        Need to find an optimum between these two extremes



                                     13
What is Tracking Area Configuration Score?
                          E-RAB
                      accessibility



  Customer Traffic                                       UL/DL Signaling
      Bitrate                                                Bitrate




        Tracking Area Configuration Score is Directly Associated
                        with User Experience

                                      14
LTE Tracking Area: Weekdays Configuration




               AREA A




                      15
LTE Tracking Area: Weekend Configuration



            AREA A1




                   AREA A2




                      16
Tracking Area & Customer Experience
 TA design must be revised over time in order to adapt to changes
 and trends in user location and mobility patterns.

 TA Conf’ Score KQI reflects
                                                             Tracking Area Weekly Score
 QoE in a measureable way                          9

                                                   8

 Actionable short term KQI vs.                     7




                                  TA Conf’ Score
 long term QoE optimization                        6

                                                   5

                                                   4
 Predefined usage scenarios for
                                                   3
 configuration changes                             2

                                                   1

                                                   0
                                                       Sun    Mon   Tue   Wed   Thurs   Fri   Sat

        Tracking Area
       Reconfiguration
           Triggering




                                   17
Analyzing Network-Wide Implications


        30.00

        25.00

        20.00

         15.00                                                                       25.00-30.00
                                                                                     20.00-25.00
         10.00
                                                                                     15.00-20.00
           5.00                                                                      10.00-15.00
                                                                                     5.00-10.00
           0.00
             20
                                                                                     0.00-5.00
               60
                  100
                    140




                                                                               320
                        180




                                                                              300
                                                                             280
                                                                            260
                          220




                                                                           240
                                                                          220
                                                                         200
                                                                        180
                              260
                                                                       160
                                                                      140
                                                                120


                                300
                                                          100
                                                     80
                                                60
                                           40
                                      20




                                                      18
LTE Multi-Service Monitoring

                       …. a 27-year-old systems administrator in
                       San Francisco, checks his iPhone 10 to 15
                       times a day.

                       But he is not making calls. He checks the
                       scores of last night’s baseball game and
                       updates his Twitter stream. He checks the
                       local weather report …then he picks a
                       restaurant on Yelp and maps the quickest
                       way to get there.
                       Or at least, he tries to.




  TTI Telecom © 2009              19
LTE Multi-Service Monitoring




“The success or failure of a call(/session) setup directly impacts
 the quality level for delivering the service by the networks, and
 also the feeling of the end user.
 So the success or failure of call(/session) setup needs be
 monitored.”                                         (3GPP TS 32.425)




                                  20
LTE QCI (QoS Class Identifier)
                     Packet     Packet
  QCI   Priority                                                 Service Example
                     Delay     Loss Rate

   1       2          100 ms      10-2        Conversational Voice

   2       4          150 ms      10-3        Conversational Video (Live Streaming)

   3       3          50 ms       10-3        Real-Time Gaming

   4       5          300 ms      10-6        Non Conversational Video (Buffered Streaming)

   5       1          100 ms      10-6        Control Plane Signaling

   6       6          300 ms      10-6        Video (Buffered Streaming)

   7       7          100 ms      10-3        Voice, Video (Live Streaming), Interactive Gaming

   8       8          300 ms      10-6        Premium Bearer for Video

   9       9          300 ms      10-6        Default Bearer for non-privileged subscribers




        Keep Backward Compatibility with UMTS QoS
               (From 4 classes in UMTS/CDMA to 9 classes in LTE)


                                         21
A1  A2 (per QCI) Accesability




                       22
Closing Notes




      23
Operating 3G/4G:
Integrated Management Approach
 New approach to Performance data collection, processing
and investigation
 Integrative inter-domain process significantly shortens MTTI

 Network configuration quality directly affects
customers’ QoE

 Prioritizing traffic per service characteristics
can no longer be over looked




                                24
Questions and Answers




                        25
Thank You,
                                                            & See You Soon!

                                                       For more information about our products and services
                                                                               www.tti-telecom.com


 This presentation, its content, materials ideas and know-how are the property of TTI Team Telecom International Ltd. (and its affiliates together “TTI Telecom”) and are designated as confidential. This presentation may not be
reproduced, altered or distributed in whole or in part, without the express written permission of TTI Telecom. The content is provided “As Is", and in no way imply warranty or commitment . This is a Legal Notice and may not be
removed or altered in any way.                                                                                                                                              Copyright © 2007 TTI Team Telecom International, Ltd.

3g-lte-oss-performance-management

  • 1.
    3G & Beyond: Whatlies ahead for Performance Management? Host: Speaker: Frank Colletta Yaacov Burak Sr. Manager, Solution Engineering Director, Solution Engineering TTI Telecom © 2009
  • 2.
    Agenda 3G and Beyond– Key Concepts Operational Challenges Inter Domain Performance Correlation Key Performance Indicators for E-UTRAN Audience Poll “When Things Go Wrong…” - Based on a True Story Radio-to-IP Inter Domain Correlation Assuring Mobility with Tracking Area LTE Multi-Service Monitoring Q&A 2
  • 3.
    3G & Beyond:Operational Challenges A new era in information processing Massive data collection, intensive data processing Radio/IP Inter-Domain Correlation Disassociation between radio / IP backhaul domains affect customer experience Maintain QoS in Packet Switching/ all-IP network Prioritize mixed services over shared bearer Recognized by 3GPP 'Key Performance Indicators (KPI) for E- UTRAN Definitions’ 3
  • 4.
    Coping with SignificantlyHigh Data Volumes Data Data Ad-Hoc Collection Processing investigation  Distributed collection  Flexible KPI/KQI  Ad-hoc reporting architecture Creation and functionalities modification (BusineesObjects)  Early data processing (collection stage)  Time and hierarchal  Ad-hoc threshold aggregation functions definition  Data prospecting at this phase Consider the relevancy of data prior to the  Auto-learning collection thresholds 4
  • 5.
    Inter-Domain Performance Correlation UMTS Domain IT/ VAS Domain GPRS Domain IP Core 5
  • 6.
    LTE: Key PerformanceIndicators for E-UTRAN Accessibility Handover Success Integrity Rate Retainability Throughput Handover Failure Block ACK ratio SAEB Bearer Release Rate Mobility Availability SAE Bearer Tracking Area Block ERR ratio Configuration Score HARQ Failures Inter/Intra Handover Cell Availability modification Hanover Interruption Success/Failure Rate Latency Network Availability SAE Bearer activity S1 Handover Rate Tracking Area Packet Loss Configuration Score Service Availability Added SAE Bearers RRC Connection Jitter Hanover Interruption Attempts Establishment Rate MOS S1 Handover Rate SAE Bearer number SAEB initial connection Establishment Rate Bridging the Gap Between RF Performance and End-User IP Services 6
  • 7.
    When Things GoWrong… TTI Telecom © 2009 7
  • 8.
    Dropped Calls, SpottyService, Delayed Text… The average iPhone owner can also use 10 times the network capacity used by the average smartphone user… The result is dropped calls, spotty service, delayed text and voice messages and glacial download speeds as … cellular network strains to meet the demand. Another result is outraged customers. TTI Telecom © 2009 8
  • 9.
    Inter-Domain Performance Correlation UMTS Domain Radius Authentication Failure Rate IT/ VAS Domain GPRS Domain Failed PDP Context Activation IP Core 9
  • 10.
    Radio-to-IP Inter DomainCorrelation Radio-to-IP Correlation dramatically Reduce Mean-Time-To-Identify UMTS Domain IP Core • VAS RADIUS • Portal • WWW Iu-ps Gn Gi RNC 10
  • 11.
    Integrated Thresholds AlarmDefinition 1 10 1. GGSN FAILED_PDP_ACTIVATION_PCT: Exceed 2 % 1 30 2. GGSN FAILED_PDP_ACTIVATION_PCT: Exceed Average 7 Days 1 10000 3. GGSN ATTEMPT_PDP_ACT: Exceed 3000 1 10 4. Radius AUTH_REQ_REJ_PCT: Exceed 1 % 1 30 5. Radius AUTH_REJ_REQ: Exceed Average 7 Days Advanced Alarm Condition: 1 AND 2 AND 3 AND 4 AND 5 Aggregated set of rules identify customer experience degradation
  • 12.
    Getting on 3GDuring Peak Times… “It’s almost worthless to try and get on 3G during peak times in those cities…When too many users get in the area, the call drops.” The problems seem particularly pronounced in New York and San Francisco, where (senior analyst) estimates …network shoulders as much as 20 percent of all the iPhone users in the United States. TTI Telecom © 2009 12
  • 13.
    Tracking Area Optimization Small Tracking Area Large Tracking Area eNB eNB eNB eNB Minimum paging, Many TA updates Maximum paging, Few TA updates Need to find an optimum between these two extremes 13
  • 14.
    What is TrackingArea Configuration Score? E-RAB accessibility Customer Traffic UL/DL Signaling Bitrate Bitrate Tracking Area Configuration Score is Directly Associated with User Experience 14
  • 15.
    LTE Tracking Area:Weekdays Configuration AREA A 15
  • 16.
    LTE Tracking Area:Weekend Configuration AREA A1 AREA A2 16
  • 17.
    Tracking Area &Customer Experience TA design must be revised over time in order to adapt to changes and trends in user location and mobility patterns. TA Conf’ Score KQI reflects Tracking Area Weekly Score QoE in a measureable way 9 8 Actionable short term KQI vs. 7 TA Conf’ Score long term QoE optimization 6 5 4 Predefined usage scenarios for 3 configuration changes 2 1 0 Sun Mon Tue Wed Thurs Fri Sat Tracking Area Reconfiguration Triggering 17
  • 18.
    Analyzing Network-Wide Implications 30.00 25.00 20.00 15.00 25.00-30.00 20.00-25.00 10.00 15.00-20.00 5.00 10.00-15.00 5.00-10.00 0.00 20 0.00-5.00 60 100 140 320 180 300 280 260 220 240 220 200 180 260 160 140 120 300 100 80 60 40 20 18
  • 19.
    LTE Multi-Service Monitoring …. a 27-year-old systems administrator in San Francisco, checks his iPhone 10 to 15 times a day. But he is not making calls. He checks the scores of last night’s baseball game and updates his Twitter stream. He checks the local weather report …then he picks a restaurant on Yelp and maps the quickest way to get there. Or at least, he tries to. TTI Telecom © 2009 19
  • 20.
    LTE Multi-Service Monitoring “Thesuccess or failure of a call(/session) setup directly impacts the quality level for delivering the service by the networks, and also the feeling of the end user. So the success or failure of call(/session) setup needs be monitored.” (3GPP TS 32.425) 20
  • 21.
    LTE QCI (QoSClass Identifier) Packet Packet QCI Priority Service Example Delay Loss Rate 1 2 100 ms 10-2 Conversational Voice 2 4 150 ms 10-3 Conversational Video (Live Streaming) 3 3 50 ms 10-3 Real-Time Gaming 4 5 300 ms 10-6 Non Conversational Video (Buffered Streaming) 5 1 100 ms 10-6 Control Plane Signaling 6 6 300 ms 10-6 Video (Buffered Streaming) 7 7 100 ms 10-3 Voice, Video (Live Streaming), Interactive Gaming 8 8 300 ms 10-6 Premium Bearer for Video 9 9 300 ms 10-6 Default Bearer for non-privileged subscribers Keep Backward Compatibility with UMTS QoS (From 4 classes in UMTS/CDMA to 9 classes in LTE) 21
  • 22.
    A1  A2(per QCI) Accesability 22
  • 23.
  • 24.
    Operating 3G/4G: Integrated ManagementApproach New approach to Performance data collection, processing and investigation Integrative inter-domain process significantly shortens MTTI Network configuration quality directly affects customers’ QoE Prioritizing traffic per service characteristics can no longer be over looked 24
  • 25.
  • 26.
    Thank You, & See You Soon! For more information about our products and services www.tti-telecom.com This presentation, its content, materials ideas and know-how are the property of TTI Team Telecom International Ltd. (and its affiliates together “TTI Telecom”) and are designated as confidential. This presentation may not be reproduced, altered or distributed in whole or in part, without the express written permission of TTI Telecom. The content is provided “As Is", and in no way imply warranty or commitment . This is a Legal Notice and may not be removed or altered in any way. Copyright © 2007 TTI Team Telecom International, Ltd.