IEEE Conformity Assessment
        Program (ICAP) for SIEPON

                Ravi Subramaniam – Technical
                       Director, ICAP

                         20 April 2012
                       Prague, Czech Republic

20 April 2012                                   1
Why Does SIEPON need a Conformity Assessment Program?

  • Conformity assessment is the accepted way of
    demonstrating that a product adheres to a
    standard
  • Opportunity for participants to demonstrate
    adherence to Testing requirements
  • IEEE 1904.1 standards based
  • New Technology – Instill consumer or end-user
    confidence
  • Supports free flow of SIEPON related products
    and services across national boundaries
  • Increased adoption
3 possible models
                                      • 1st Party – Vendor
                                      • 2nd Party – Buyer or
                Independent
                    Lab
                                        User
                              Buyer
                                      • 3rd Party –
                  Vendor                Independent Entity



      Conformity Assessment
             System


20 April 2012                                                  3
2nd Party Testing

            IEEE/SIEPON
              Certified   • Logo Usage with TMLA
              Product

              Buyer or            • ICAP Review Prior to Certification
                                  • ICAP to Determine Surveillance
              Network               Needs
           Operator Tested

                                            • 2nd Party Lab tested
              Product                       • Authorized Tools
3rd Party Testing

              SIEPON
              Certified   • Logo Usage with TMLA

              Product
                                    • Independent lab recommends for
            3rd
              Party                   Certification
                                    • ICAP Issues Certification
          Declaration               • ICAP to Determine Surveillance Needs



                                              • Authorized Labs
             Product                          • 3rd Party Lab tested
                                              • Authorized Tools
Self vs. 3rd Party Certification


  •   Speed of Implementation
  •   Time to Market
  •   Cost of Test Tools
  •   Vendor Misrepresentation
  •   Regulatory Risks
  •   End-Buyer confidence
Why interoperability is hard in digital communications?



                                           Are the “1”s
                                            and “0”s
                      Interoperability        right?


                                         Performance
                  Conformance
                                             “Can you
                                              hear me
                     Is transmission           now?”
                      and reception
                      good enough?

  20 April 2012                                           7
Considerations for a harmonized technical approach

• Harmonized test procedures, use cases and derived test sets
  may enhance confidence in fielded interoperability
• There may be no clear regulatory or coordinated marketplace
  demand driver to drive technical harmonization
• Lots of choices and unique system implementation – I am
  special!
• Testing – “to infinity and beyond”
   • performance
   • digital conformance (may be lots of permutations)
   • interoperability testing (for all equipment models –
     software changes)



  28 April 2012                                             8
SIEPON Certification Scheme


                   ISO/IEC Guide
                   65 Best Practices
                                 Certification Authority
                                         (ICAP)

            ISO/IEC 17025 +
            competency
            requirements
                                       Laboratories


Performance/Design
Requirements
                                        Products




   20 April 2012                                           9
Roles of Entities
                            ICAP (Certification Authority)
                            •Entry/Exit Point for Certification Process
                            •Policies & Procedures
                            •TMLA
                            •Test Labs Facilitation
                            •Market Certification Program
                            •Certified Product Registry
                            •Committee of Experts
     P1904 WG                                                             Test Laboratories
     • IEEE 1904 Standard                                                 • Independent
     • Test Specification                                                 • 2nd Party
                                                                          • Test bed/tools
                                                                            implementation




                                       IEEE
                                   1904/SIEPON
                                     Certified
                                     Products
A Scenario to consider

                                                      Vendor submits
                                                     application to ICAP


                                                                                       ICAP – Initiates
                        ICAP publishes on
                                                                                         Certification
                         Certified Product
                                                                                        Agreement &
                             Registry
                                                                                      invoices vendor




                                                            SIEPON
                                                          Certification
                   ICAP delivers
                                                                                              Vendors choose
                  certificate and
                                                                                               lab from list of
                  authorizes logo
                                                                                               approved labs
                       usage




                                      Test Lab delivers
                                                                         Test Program
                                      Final Test Report
                                                                       starts at Test Lab
                                     to ICAP for Review




  20 April 2012                                                                                                   11
Role of Committee of Experts

 • Entity based participation
 • Major responsibilities will include
      – Determine compliance levels
      – Act as advisors on test methods and interpretation of
        standards
      – Test Lab Requirements/Audits
      – Test Tool Validation
      – Time required for implementation
      – Validate Test Report template



  20 April 2012                                                 12
Current Labs that participate in WG

 • CableLabs (3rd Party)
 • RITT (3rd Party)
 • Shanghai Institute of China Telecom (2nd Party)
 • University of New Hampshire –Interoperability
   Lab (3rd Party)
 • Future Lab in Japan




     20 April 2012                                   13
SIEPON Brand Awareness

 • Tested products will be awarded a certification mark
 • The “SIEPON Certified” mark will convey trust in
   the device and the certification program.
 • Drive to ensure that End-Users are committed to
   purchase certified products to minimize negative
   impact on the network
 • Certified Product Registry to be maintained




  20 April 2012                                     14
Questions & Discussion




 20 April 2012           15

IEEE Conformity Assessment Program (ICAP) for SIEPON

  • 1.
    IEEE Conformity Assessment Program (ICAP) for SIEPON Ravi Subramaniam – Technical Director, ICAP 20 April 2012 Prague, Czech Republic 20 April 2012 1
  • 2.
    Why Does SIEPONneed a Conformity Assessment Program? • Conformity assessment is the accepted way of demonstrating that a product adheres to a standard • Opportunity for participants to demonstrate adherence to Testing requirements • IEEE 1904.1 standards based • New Technology – Instill consumer or end-user confidence • Supports free flow of SIEPON related products and services across national boundaries • Increased adoption
  • 3.
    3 possible models • 1st Party – Vendor • 2nd Party – Buyer or Independent Lab User Buyer • 3rd Party – Vendor Independent Entity Conformity Assessment System 20 April 2012 3
  • 4.
    2nd Party Testing IEEE/SIEPON Certified • Logo Usage with TMLA Product Buyer or • ICAP Review Prior to Certification • ICAP to Determine Surveillance Network Needs Operator Tested • 2nd Party Lab tested Product • Authorized Tools
  • 5.
    3rd Party Testing SIEPON Certified • Logo Usage with TMLA Product • Independent lab recommends for 3rd Party Certification • ICAP Issues Certification Declaration • ICAP to Determine Surveillance Needs • Authorized Labs Product • 3rd Party Lab tested • Authorized Tools
  • 6.
    Self vs. 3rdParty Certification • Speed of Implementation • Time to Market • Cost of Test Tools • Vendor Misrepresentation • Regulatory Risks • End-Buyer confidence
  • 7.
    Why interoperability ishard in digital communications? Are the “1”s and “0”s Interoperability right? Performance Conformance “Can you hear me Is transmission now?” and reception good enough? 20 April 2012 7
  • 8.
    Considerations for aharmonized technical approach • Harmonized test procedures, use cases and derived test sets may enhance confidence in fielded interoperability • There may be no clear regulatory or coordinated marketplace demand driver to drive technical harmonization • Lots of choices and unique system implementation – I am special! • Testing – “to infinity and beyond” • performance • digital conformance (may be lots of permutations) • interoperability testing (for all equipment models – software changes) 28 April 2012 8
  • 9.
    SIEPON Certification Scheme ISO/IEC Guide 65 Best Practices Certification Authority (ICAP) ISO/IEC 17025 + competency requirements Laboratories Performance/Design Requirements Products 20 April 2012 9
  • 10.
    Roles of Entities ICAP (Certification Authority) •Entry/Exit Point for Certification Process •Policies & Procedures •TMLA •Test Labs Facilitation •Market Certification Program •Certified Product Registry •Committee of Experts P1904 WG Test Laboratories • IEEE 1904 Standard • Independent • Test Specification • 2nd Party • Test bed/tools implementation IEEE 1904/SIEPON Certified Products
  • 11.
    A Scenario toconsider Vendor submits application to ICAP ICAP – Initiates ICAP publishes on Certification Certified Product Agreement & Registry invoices vendor SIEPON Certification ICAP delivers Vendors choose certificate and lab from list of authorizes logo approved labs usage Test Lab delivers Test Program Final Test Report starts at Test Lab to ICAP for Review 20 April 2012 11
  • 12.
    Role of Committeeof Experts • Entity based participation • Major responsibilities will include – Determine compliance levels – Act as advisors on test methods and interpretation of standards – Test Lab Requirements/Audits – Test Tool Validation – Time required for implementation – Validate Test Report template 20 April 2012 12
  • 13.
    Current Labs thatparticipate in WG • CableLabs (3rd Party) • RITT (3rd Party) • Shanghai Institute of China Telecom (2nd Party) • University of New Hampshire –Interoperability Lab (3rd Party) • Future Lab in Japan 20 April 2012 13
  • 14.
    SIEPON Brand Awareness • Tested products will be awarded a certification mark • The “SIEPON Certified” mark will convey trust in the device and the certification program. • Drive to ensure that End-Users are committed to purchase certified products to minimize negative impact on the network • Certified Product Registry to be maintained 20 April 2012 14
  • 15.
    Questions & Discussion 20 April 2012 15