SlideShare a Scribd company logo
1 of 22
The Making of the Census Bureau’s First Official Mobile App




Alec Permison, ADIT/ASD
Paul Milbourne, ADIT/ASD
Gustavo Torrico, ADEP/EPD
Agenda
• Overview
• Front-end Architecture
• Back-end Architecture
• Project Challenges
• Lessons Learned
Overview
• First Census Bureau mobile app for
  Android/iOS both phone & tablet
• Developed as part of ongoing Web
  Transformation effort
• Displays 16 economic indicators
   •   13 from Census Bureau Central
       Indicators Database Repository

   •   2 from Bureau of Economic Analysis

   •   1 from Bureau of Labor Statistics
Overview
• Collaborative team effort
   • Communications Directorate – product owner & manager

   • Contractor – front-end development

   • Economics Directorate – data experts and back-end
     development

   • IT Directorate – technical guidance, back-end development,
     and technical support
Overview
• Mobile app front-end displays data
• Three back-end API‟s supply data at
                                                          App
  startup, refresh, and indicator release
   •   CIDR Private API developed by Econ
   •   BLS Private API developed by IT
   •   BEA Public API
• Config file on server queried at          CIDR          BLS   BEA

startup
                                            BoC Private
Front End Architecture
• Adobe Flex 4.6
• Adobe AIR 3.3
• SWIZ 1.4
• iOS 4+
• Android 2.2+
Front End Architecture
Front End Architecture
Front End Architecture
Front End Architecture
Front End Architecture
Phone         Core       Tablet
Front End Architecture
• Skills Required   • Tools Required
                       – Adobe Flash Builder 4.6
   – ActionScript
                       – Xcode and Eclipse for some
   – CSS                 native components

   – XML
Front End Architecture
• Pros of Adobe Flex          • Cons of Adobe Flex
   – Device agnostic from a     – Larger footprint
     single code base             (especially on iOS)

   – Easier than native         – Android support varies by
     development                  device

   – Broad developer            – Slower performance
     community
                                – Requires AIR runtime
Back End Architecture (CIDR)
• LAMP stack:                    • JSON-based :
   – RHEL 5.8                       – Economic dashboard data
                                    – Historical economic indicator
   – Apache 2.2.3
                                      data
   – Mysql 5.0.95                   – Simple format derived from
   – PHP 5.1.6                        mobile application mockups.
                                    – Private through hash based
                                      “authentication”
• Zend Framework 1.6
                                    – Text-based, easily parse-
   – Simple, loosely-coupled          able.
     component library for web
                                    – Data available as soon as
     applications                     upload process is completed
                                      on internal Census servers.
Back End Architecture (CIDR)

     dashboard_data


                                   category



             time_slot                                  data_type
                                  display_cell




                      geo_level                  error_type
Back End Architecture (CIDR)
• JSON export of dashboard_data table
Back End Architecture (CIDR)
• Historical data available in CIDR database (display_cell table)
Back End Architecture (CIDR)
•   Basic hash-key based authentication
•   Example URL:
     – http://www.census.gov/econ/currentdata/api/dashboard?id=sapient&ha
       sh=89704299208e7e9d16380e4384861396f3398cb0

•   Calculating hash:
     – sha1(secret key + time stamp + path requested)

     1.   Secret key – a 40 character alpha-numeric string

     2.   Time stamp – in the format YYYY-MM-DD 24HH (e.g. „2012-05-14 17‟)
          using UTC timestamp.

     3.   Path requested – excluding id and hash parameters.
          „/econ/currentdata/api/dashboard‟
Back End Architecture
• Skills Required             • Tools Required
                                 – Dev/test environment
   – LAMP web dev
                                 – IDE
   – Enterprise-scale
     development experience
     (not for newbie‟s)

   – REST interface design
Back End Architecture
• Pros of Private API         • Cons of Private API
   – Fast performance for        – Additional skilled
     database on our server        resources required

   – Customized to need of       – Additional application to
     front-end developer           support

   – Access more data than       – Dependent on your
     public API                    infrastructure

   – Under your control
Project Challenges
• Limited insight into technical design and code at handoff
  (25,000+ LOC, few comments or technical docs initially)
• Security framework still under development
• Lack of dev/test tools & environment for mobile
• Standardizing data formats from 3 API‟s (e.g. timestamps)
• Timely technical support from other agencies
• Coordination with external contractor (e.g. config updates)
Lessons Learned
• Early involvement with contractor on technical design
• Schedule time for review and feedback at milestones
• Early engagement from security to address framework
• Identify and procure tools far in advance
• Test external API‟s for reliability/accuracy

More Related Content

What's hot

Design & Deploy a data-driven Web API in 2 hours
Design & Deploy a data-driven Web API in 2 hoursDesign & Deploy a data-driven Web API in 2 hours
Design & Deploy a data-driven Web API in 2 hoursRestlet
 
Getting Started, Low Hanging Fruit: Our First Experiences with Oracle Managem...
Getting Started, Low Hanging Fruit: Our First Experiences with Oracle Managem...Getting Started, Low Hanging Fruit: Our First Experiences with Oracle Managem...
Getting Started, Low Hanging Fruit: Our First Experiences with Oracle Managem...Lucas Jellema
 
Automating Rackspace with ONE Automation
Automating Rackspace with ONE AutomationAutomating Rackspace with ONE Automation
Automating Rackspace with ONE AutomationCA | Automic Software
 
Entity Framework Core 2.1: Simple, Powerful Data Access for .NET
Entity Framework Core 2.1: Simple, Powerful Data Access for .NETEntity Framework Core 2.1: Simple, Powerful Data Access for .NET
Entity Framework Core 2.1: Simple, Powerful Data Access for .NETMicrosoft Tech Community
 
Oracle web-applications
Oracle web-applicationsOracle web-applications
Oracle web-applicationsurskeshav
 
G.Bs Presentation Of 23rd Iaslic National Seminar,Goutam.
G.Bs Presentation Of 23rd Iaslic National Seminar,Goutam.G.Bs Presentation Of 23rd Iaslic National Seminar,Goutam.
G.Bs Presentation Of 23rd Iaslic National Seminar,Goutam.Goutam Biswas
 
Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...
Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...
Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...Flink Forward
 
Infor Process Automation Developer
Infor Process Automation DeveloperInfor Process Automation Developer
Infor Process Automation DeveloperPierce Morton
 
Extending_EBS_12_1_3_with_APEX_5_0_COLLABORATE16
Extending_EBS_12_1_3_with_APEX_5_0_COLLABORATE16Extending_EBS_12_1_3_with_APEX_5_0_COLLABORATE16
Extending_EBS_12_1_3_with_APEX_5_0_COLLABORATE16Alfredo Abate
 
FlexDeploy Product Technical Overview
FlexDeploy Product Technical OverviewFlexDeploy Product Technical Overview
FlexDeploy Product Technical OverviewDalibor Blazevic
 
Android System Architecture And  Pen-testing of Android applications
Android System Architecture  And  Pen-testing of Android applications Android System Architecture  And  Pen-testing of Android applications
Android System Architecture And  Pen-testing of Android applications yavuzwb
 
FIWARE Global Summit - Professional Dashboards for Dummies
FIWARE Global Summit - Professional Dashboards for DummiesFIWARE Global Summit - Professional Dashboards for Dummies
FIWARE Global Summit - Professional Dashboards for DummiesFIWARE
 
CIS14: Early Peek at PingFederate Administrative REST API
CIS14: Early Peek at PingFederate Administrative REST APICIS14: Early Peek at PingFederate Administrative REST API
CIS14: Early Peek at PingFederate Administrative REST APICloudIDSummit
 
CIS14: Best Practices You Must Apply to Secure Your APIs
CIS14: Best Practices You Must Apply to Secure Your APIsCIS14: Best Practices You Must Apply to Secure Your APIs
CIS14: Best Practices You Must Apply to Secure Your APIsCloudIDSummit
 
Database projects within visual studio
Database projects within visual studioDatabase projects within visual studio
Database projects within visual studioRonnie Hicks
 
Introducing ADF Mobile - and Luc Bors(AMIS SIG, 12th November 2012)
Introducing ADF Mobile - and Luc Bors(AMIS SIG, 12th November 2012)Introducing ADF Mobile - and Luc Bors(AMIS SIG, 12th November 2012)
Introducing ADF Mobile - and Luc Bors(AMIS SIG, 12th November 2012)Lucas Jellema
 

What's hot (20)

Evaluating Koha
Evaluating KohaEvaluating Koha
Evaluating Koha
 
Design & Deploy a data-driven Web API in 2 hours
Design & Deploy a data-driven Web API in 2 hoursDesign & Deploy a data-driven Web API in 2 hours
Design & Deploy a data-driven Web API in 2 hours
 
Getting Started, Low Hanging Fruit: Our First Experiences with Oracle Managem...
Getting Started, Low Hanging Fruit: Our First Experiences with Oracle Managem...Getting Started, Low Hanging Fruit: Our First Experiences with Oracle Managem...
Getting Started, Low Hanging Fruit: Our First Experiences with Oracle Managem...
 
Automating Rackspace with ONE Automation
Automating Rackspace with ONE AutomationAutomating Rackspace with ONE Automation
Automating Rackspace with ONE Automation
 
Apex ace update
Apex ace updateApex ace update
Apex ace update
 
Entity Framework Core 2.1: Simple, Powerful Data Access for .NET
Entity Framework Core 2.1: Simple, Powerful Data Access for .NETEntity Framework Core 2.1: Simple, Powerful Data Access for .NET
Entity Framework Core 2.1: Simple, Powerful Data Access for .NET
 
Oracle web-applications
Oracle web-applicationsOracle web-applications
Oracle web-applications
 
G.Bs Presentation Of 23rd Iaslic National Seminar,Goutam.
G.Bs Presentation Of 23rd Iaslic National Seminar,Goutam.G.Bs Presentation Of 23rd Iaslic National Seminar,Goutam.
G.Bs Presentation Of 23rd Iaslic National Seminar,Goutam.
 
Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...
Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...
Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...
 
Infor Process Automation Developer
Infor Process Automation DeveloperInfor Process Automation Developer
Infor Process Automation Developer
 
Extending_EBS_12_1_3_with_APEX_5_0_COLLABORATE16
Extending_EBS_12_1_3_with_APEX_5_0_COLLABORATE16Extending_EBS_12_1_3_with_APEX_5_0_COLLABORATE16
Extending_EBS_12_1_3_with_APEX_5_0_COLLABORATE16
 
FlexDeploy Product Technical Overview
FlexDeploy Product Technical OverviewFlexDeploy Product Technical Overview
FlexDeploy Product Technical Overview
 
Android System Architecture And  Pen-testing of Android applications
Android System Architecture  And  Pen-testing of Android applications Android System Architecture  And  Pen-testing of Android applications
Android System Architecture And  Pen-testing of Android applications
 
FIWARE Global Summit - Professional Dashboards for Dummies
FIWARE Global Summit - Professional Dashboards for DummiesFIWARE Global Summit - Professional Dashboards for Dummies
FIWARE Global Summit - Professional Dashboards for Dummies
 
DEEPAK SHARMA
DEEPAK SHARMADEEPAK SHARMA
DEEPAK SHARMA
 
CIS14: Early Peek at PingFederate Administrative REST API
CIS14: Early Peek at PingFederate Administrative REST APICIS14: Early Peek at PingFederate Administrative REST API
CIS14: Early Peek at PingFederate Administrative REST API
 
CIS14: Best Practices You Must Apply to Secure Your APIs
CIS14: Best Practices You Must Apply to Secure Your APIsCIS14: Best Practices You Must Apply to Secure Your APIs
CIS14: Best Practices You Must Apply to Secure Your APIs
 
eGrove Systems - "SOLR" An Apache Product
eGrove Systems - "SOLR" An Apache ProducteGrove Systems - "SOLR" An Apache Product
eGrove Systems - "SOLR" An Apache Product
 
Database projects within visual studio
Database projects within visual studioDatabase projects within visual studio
Database projects within visual studio
 
Introducing ADF Mobile - and Luc Bors(AMIS SIG, 12th November 2012)
Introducing ADF Mobile - and Luc Bors(AMIS SIG, 12th November 2012)Introducing ADF Mobile - and Luc Bors(AMIS SIG, 12th November 2012)
Introducing ADF Mobile - and Luc Bors(AMIS SIG, 12th November 2012)
 

Similar to U.S. Census presentation at DC API Meetup 12/13/12 by Alec Permison

aip_developer_overview_icar_2014
aip_developer_overview_icar_2014aip_developer_overview_icar_2014
aip_developer_overview_icar_2014Matthew Vaughn
 
Back to the Future: Containerize Legacy Applications - Rob Tanner, Northern T...
Back to the Future: Containerize Legacy Applications - Rob Tanner, Northern T...Back to the Future: Containerize Legacy Applications - Rob Tanner, Northern T...
Back to the Future: Containerize Legacy Applications - Rob Tanner, Northern T...Docker, Inc.
 
PEARC17: Live Integrated Visualization Environment: An Experiment in General...
PEARC17: Live Integrated Visualization Environment: An Experiment in General...PEARC17: Live Integrated Visualization Environment: An Experiment in General...
PEARC17: Live Integrated Visualization Environment: An Experiment in General...moneyjh
 
Hpc lunch and learn
Hpc lunch and learnHpc lunch and learn
Hpc lunch and learnJohn D Almon
 
2014 09-12 lambda-architecture-at-indix
2014 09-12 lambda-architecture-at-indix2014 09-12 lambda-architecture-at-indix
2014 09-12 lambda-architecture-at-indixYu Ishikawa
 
Bquery Reporting & Analytics Architecture
Bquery Reporting & Analytics ArchitectureBquery Reporting & Analytics Architecture
Bquery Reporting & Analytics ArchitectureCarst Vaartjes
 
(ATS6-DEV02) Web Application Strategies
(ATS6-DEV02) Web Application Strategies(ATS6-DEV02) Web Application Strategies
(ATS6-DEV02) Web Application StrategiesBIOVIA
 
VMworld 2013: What's New with VMware Horizon Workspace: Technical Deep Dive
VMworld 2013: What's New with VMware Horizon Workspace: Technical Deep DiveVMworld 2013: What's New with VMware Horizon Workspace: Technical Deep Dive
VMworld 2013: What's New with VMware Horizon Workspace: Technical Deep DiveVMworld
 
Kubernetes Robotics Edge Cluster System
Kubernetes Robotics Edge Cluster SystemKubernetes Robotics Edge Cluster System
Kubernetes Robotics Edge Cluster SystemTomoya Fujita
 
Beginners guide on how to start exploring IoT 2nd session
Beginners  guide on how to start exploring IoT 2nd sessionBeginners  guide on how to start exploring IoT 2nd session
Beginners guide on how to start exploring IoT 2nd sessionveerababu penugonda(Mr-IoT)
 
An Open Source Workbench for Prototyping Multimodal Interactions Based on Off...
An Open Source Workbench for Prototyping Multimodal Interactions Based on Off...An Open Source Workbench for Prototyping Multimodal Interactions Based on Off...
An Open Source Workbench for Prototyping Multimodal Interactions Based on Off...Jean Vanderdonckt
 
Headless cms architecture
Headless cms architectureHeadless cms architecture
Headless cms architectureKevin Wenger
 
Docker & aPaaS: Enterprise Innovation and Trends for 2015
Docker & aPaaS: Enterprise Innovation and Trends for 2015Docker & aPaaS: Enterprise Innovation and Trends for 2015
Docker & aPaaS: Enterprise Innovation and Trends for 2015WaveMaker, Inc.
 
APEX Alpe Adria Mike Hichwa Keynote April 11th 2019- Zagreb
APEX Alpe Adria Mike Hichwa Keynote April 11th 2019- ZagrebAPEX Alpe Adria Mike Hichwa Keynote April 11th 2019- Zagreb
APEX Alpe Adria Mike Hichwa Keynote April 11th 2019- ZagrebMichael Hichwa
 
Automated Data Synchronization: Data Loader, Data Mirror & Beyond
Automated Data Synchronization: Data Loader, Data Mirror & BeyondAutomated Data Synchronization: Data Loader, Data Mirror & Beyond
Automated Data Synchronization: Data Loader, Data Mirror & BeyondJeremyOtt5
 

Similar to U.S. Census presentation at DC API Meetup 12/13/12 by Alec Permison (20)

aip_developer_overview_icar_2014
aip_developer_overview_icar_2014aip_developer_overview_icar_2014
aip_developer_overview_icar_2014
 
Back to the Future: Containerize Legacy Applications - Rob Tanner, Northern T...
Back to the Future: Containerize Legacy Applications - Rob Tanner, Northern T...Back to the Future: Containerize Legacy Applications - Rob Tanner, Northern T...
Back to the Future: Containerize Legacy Applications - Rob Tanner, Northern T...
 
PEARC17: Live Integrated Visualization Environment: An Experiment in General...
PEARC17: Live Integrated Visualization Environment: An Experiment in General...PEARC17: Live Integrated Visualization Environment: An Experiment in General...
PEARC17: Live Integrated Visualization Environment: An Experiment in General...
 
Lick my Lollipop
Lick my LollipopLick my Lollipop
Lick my Lollipop
 
Hpc lunch and learn
Hpc lunch and learnHpc lunch and learn
Hpc lunch and learn
 
2014 09-12 lambda-architecture-at-indix
2014 09-12 lambda-architecture-at-indix2014 09-12 lambda-architecture-at-indix
2014 09-12 lambda-architecture-at-indix
 
Oow2016 review--paas-microservices-
Oow2016 review--paas-microservices-Oow2016 review--paas-microservices-
Oow2016 review--paas-microservices-
 
Bquery Reporting & Analytics Architecture
Bquery Reporting & Analytics ArchitectureBquery Reporting & Analytics Architecture
Bquery Reporting & Analytics Architecture
 
Mihai_Nuta
Mihai_NutaMihai_Nuta
Mihai_Nuta
 
(ATS6-DEV02) Web Application Strategies
(ATS6-DEV02) Web Application Strategies(ATS6-DEV02) Web Application Strategies
(ATS6-DEV02) Web Application Strategies
 
VMworld 2013: What's New with VMware Horizon Workspace: Technical Deep Dive
VMworld 2013: What's New with VMware Horizon Workspace: Technical Deep DiveVMworld 2013: What's New with VMware Horizon Workspace: Technical Deep Dive
VMworld 2013: What's New with VMware Horizon Workspace: Technical Deep Dive
 
Kubernetes Robotics Edge Cluster System
Kubernetes Robotics Edge Cluster SystemKubernetes Robotics Edge Cluster System
Kubernetes Robotics Edge Cluster System
 
Beginners guide on how to start exploring IoT 2nd session
Beginners  guide on how to start exploring IoT 2nd sessionBeginners  guide on how to start exploring IoT 2nd session
Beginners guide on how to start exploring IoT 2nd session
 
An Open Source Workbench for Prototyping Multimodal Interactions Based on Off...
An Open Source Workbench for Prototyping Multimodal Interactions Based on Off...An Open Source Workbench for Prototyping Multimodal Interactions Based on Off...
An Open Source Workbench for Prototyping Multimodal Interactions Based on Off...
 
My androidpresentation
My androidpresentationMy androidpresentation
My androidpresentation
 
Headless cms architecture
Headless cms architectureHeadless cms architecture
Headless cms architecture
 
Docker & aPaaS: Enterprise Innovation and Trends for 2015
Docker & aPaaS: Enterprise Innovation and Trends for 2015Docker & aPaaS: Enterprise Innovation and Trends for 2015
Docker & aPaaS: Enterprise Innovation and Trends for 2015
 
AMIS OOW Review 2012 - Deel 7 - Lucas Jellema
AMIS OOW Review 2012 - Deel 7 - Lucas JellemaAMIS OOW Review 2012 - Deel 7 - Lucas Jellema
AMIS OOW Review 2012 - Deel 7 - Lucas Jellema
 
APEX Alpe Adria Mike Hichwa Keynote April 11th 2019- Zagreb
APEX Alpe Adria Mike Hichwa Keynote April 11th 2019- ZagrebAPEX Alpe Adria Mike Hichwa Keynote April 11th 2019- Zagreb
APEX Alpe Adria Mike Hichwa Keynote April 11th 2019- Zagreb
 
Automated Data Synchronization: Data Loader, Data Mirror & Beyond
Automated Data Synchronization: Data Loader, Data Mirror & BeyondAutomated Data Synchronization: Data Loader, Data Mirror & Beyond
Automated Data Synchronization: Data Loader, Data Mirror & Beyond
 

U.S. Census presentation at DC API Meetup 12/13/12 by Alec Permison

  • 1. The Making of the Census Bureau’s First Official Mobile App Alec Permison, ADIT/ASD Paul Milbourne, ADIT/ASD Gustavo Torrico, ADEP/EPD
  • 2. Agenda • Overview • Front-end Architecture • Back-end Architecture • Project Challenges • Lessons Learned
  • 3. Overview • First Census Bureau mobile app for Android/iOS both phone & tablet • Developed as part of ongoing Web Transformation effort • Displays 16 economic indicators • 13 from Census Bureau Central Indicators Database Repository • 2 from Bureau of Economic Analysis • 1 from Bureau of Labor Statistics
  • 4. Overview • Collaborative team effort • Communications Directorate – product owner & manager • Contractor – front-end development • Economics Directorate – data experts and back-end development • IT Directorate – technical guidance, back-end development, and technical support
  • 5. Overview • Mobile app front-end displays data • Three back-end API‟s supply data at App startup, refresh, and indicator release • CIDR Private API developed by Econ • BLS Private API developed by IT • BEA Public API • Config file on server queried at CIDR BLS BEA startup BoC Private
  • 6. Front End Architecture • Adobe Flex 4.6 • Adobe AIR 3.3 • SWIZ 1.4 • iOS 4+ • Android 2.2+
  • 12. Front End Architecture • Skills Required • Tools Required – Adobe Flash Builder 4.6 – ActionScript – Xcode and Eclipse for some – CSS native components – XML
  • 13. Front End Architecture • Pros of Adobe Flex • Cons of Adobe Flex – Device agnostic from a – Larger footprint single code base (especially on iOS) – Easier than native – Android support varies by development device – Broad developer – Slower performance community – Requires AIR runtime
  • 14. Back End Architecture (CIDR) • LAMP stack: • JSON-based : – RHEL 5.8 – Economic dashboard data – Historical economic indicator – Apache 2.2.3 data – Mysql 5.0.95 – Simple format derived from – PHP 5.1.6 mobile application mockups. – Private through hash based “authentication” • Zend Framework 1.6 – Text-based, easily parse- – Simple, loosely-coupled able. component library for web – Data available as soon as applications upload process is completed on internal Census servers.
  • 15. Back End Architecture (CIDR) dashboard_data category time_slot data_type display_cell geo_level error_type
  • 16. Back End Architecture (CIDR) • JSON export of dashboard_data table
  • 17. Back End Architecture (CIDR) • Historical data available in CIDR database (display_cell table)
  • 18. Back End Architecture (CIDR) • Basic hash-key based authentication • Example URL: – http://www.census.gov/econ/currentdata/api/dashboard?id=sapient&ha sh=89704299208e7e9d16380e4384861396f3398cb0 • Calculating hash: – sha1(secret key + time stamp + path requested) 1. Secret key – a 40 character alpha-numeric string 2. Time stamp – in the format YYYY-MM-DD 24HH (e.g. „2012-05-14 17‟) using UTC timestamp. 3. Path requested – excluding id and hash parameters. „/econ/currentdata/api/dashboard‟
  • 19. Back End Architecture • Skills Required • Tools Required – Dev/test environment – LAMP web dev – IDE – Enterprise-scale development experience (not for newbie‟s) – REST interface design
  • 20. Back End Architecture • Pros of Private API • Cons of Private API – Fast performance for – Additional skilled database on our server resources required – Customized to need of – Additional application to front-end developer support – Access more data than – Dependent on your public API infrastructure – Under your control
  • 21. Project Challenges • Limited insight into technical design and code at handoff (25,000+ LOC, few comments or technical docs initially) • Security framework still under development • Lack of dev/test tools & environment for mobile • Standardizing data formats from 3 API‟s (e.g. timestamps) • Timely technical support from other agencies • Coordination with external contractor (e.g. config updates)
  • 22. Lessons Learned • Early involvement with contractor on technical design • Schedule time for review and feedback at milestones • Early engagement from security to address framework • Identify and procure tools far in advance • Test external API‟s for reliability/accuracy