apidays London 2023 - Open Standards, AI and Data for better business decisions, Dr Ravinder Singh, Government Digital Service

apidays
apidaysapidays
Dr. Ravinder Singh
Modernising Technology Programme Manager
Cabinet Office-Central Digital and Data Office
ravinder.singh@digital.cabinet-office.gov.uk
Open Standards, AI and Data
for better business decisions
Source: domo
CDDO
>2.6 quintillion bytes
Data Generated everyday
By 2025 : 463 exabytes per day
Instagram photos and videos : 95 million
Every day, 306.4 billion emails are sent, and 500 million Tweets are made.
Year Data Generated Change Over
Previous Year
2020* 64.2 zettabytes ↑ 23.2 zettabytes
2021* 79 zettabytes ↑ 14.8 zettabytes
2022* 97 zettabytes ↑ 18 zettabytes
2023* 120 zettabytes ↑ 23 zettabytes
CDDO
Every minute of the day:
• Number of Google Searches: 5.9mn
• WhatsApp Messages: 41.7mn
• TikTok Videos: 167 mn
• $3805 for mobile Apps
• On Facebook: 510 K comments are posted, 293 K statuses are updated, and 136 K photos are uploaded.
• Instagram photos: 55 K
• Twitter Tweets: 0.5 mn
• Youtube videos seen: 4.5 mn
• Instagram posts: 277 K
• Tinder: 1.4 mn Swipes
• 188 mn emails
• 103 mn spam mails
• 18 mn text messages
Every Day:
• 2.9 bn email users
• Number of Facebook users: 2.38 bn
• Facebook logon daily: 1.56 bn
• Mobile Facebook users: 1.74 bn
• Fake profiles: 83 mn
• Instagram users: 600 mn (400 mn active every day)
• 95 mn photos and videos shared in Instagram
• 100 mn use stories on Instagram
• 232 K skype calls
BI to AI
Image: University of Wisconsin
Ø Transparency and accountability:
AI-ML remains a black box
Ø Data Quality and Algorithm
Ø Data Availability and integrity
Ø Data privacy and security issues.
Ø Resource / lack of expertise
Ø Workforce development
Ø Regulations
Ø Legal and ethical considerations
Ø Security
Ø Legacy systems and Integration
CDDO
Current challenges
Ø Enhanced Efficiency and productivity
Ø Improved service delivery to citizens
Ø Data-Driven Decision Making
Ø Citizen Engagement and Participation
Ø Cost savings and resource optimization
Ø Enhanced transparency and accountability
Ø Policy Writing
Ø Writing Business case
Ø Writing Project reports
Ø Software coding to develop bespoke or
customisation of existing services
Ø Medical field
CDDO
Opportunities
$5bn to $30bn £1bn
China (2017-2030) UK, backed by £300mn of private investment
Beijing - $2bn
Tanjin $16bn
$1.8bn $ 1bn
France USA
47%
Employment opportunities taken by machines
It has been estimated that AI could add an additional USD $814 billion (£630bn) to the UK economy by 2035,
increasing the annual growth rate of GVA from 2.5 to 3.9%.
Estimated that AI has the potential to add $957 billion to India’s GDP by 2035 and boost India’s annual growth by
1.3 percentage points by 2035.
CDDO
CDDO
Stages of the
Machine Learning
Process
CDDO
Continuous ML Model and
Control Framework
Judgement Based
Rules Based
Programmed
Strictly Controlled
Contained
Transformational
Tactical
Business
Impact
Self-Learning
Autonomous
Unbounded
Automation
Platform
Foundation Automation
VB Scripts, Excel Macros,
Hotkeys, Unified
Desktop
Artificial Intelligence
Virtual Assistance
Robotics Process Automation
CDDO
“By 2021, The RPA Market value,
While Large, It's Only A Subset Of
The $48.5 Billion Broader AI
Cubicle Spend”, Forrester 2017
of the world’s leading
organizations will implement a
Chief Robotics Officer role
and/or define a robotics-
specific function within the
business by 2019.
IDC Worldwide Robotics 2017
Predictions-Jing Bing Zhang
30%
3M
workers globally will be
supervised by a “roboboss” by
2018, GARTNER
A world in which your organisation is 15% human and 85% robots?
$2.9B
of all customer
interactions will be
handled without a
human agent by
2020, GARTNER
85%
$9T
1/3
of the workforce
may be replaced by
robots by the year
2025, GARTNER
“Employment costs could be cut with AI-
enabled automation of knowledge work by
2020”, Everest, Bank of America
CDDO
CDDO
Generative AI and LLM
• A branch of AI/ML that focuses on creating or
generating new content, such as images, text,
audio, or even entire virtual worlds, based on
patterns and data it has been trained on.
• Unlike traditional AI systems that primarily focus
on recognizing patterns and making predictions
based on existing data, generative AI goes a
step further by generating new and original
content that closely resembles the data it has
learned from.
• Generative AI techniques typically rely on deep
learning models, such as generative adversarial
networks (GANs), variational autoencoders
(VAEs), or transformers.
• Generative AI has various applications across
different domains. It can be used for creative
purposes, such as generating artwork, music, or
storytelling
Image: BCV
Internet of Things (IoT)
CDDO
Three Key components
• Things/Devices: physical objects or
devices equipped with sensors,
actuators, and connectivity capabilities.
• Connectivity: Wi-Fi, Bluetooth, cellular
networks, low-power wide-area
networks (LPWAN), or other wireless
protocols.
• Cloud and Data Processing: The data
collected by IoT devices is sent to cloud-
based platforms or edge computing
systems, where it is processed,
analysed, and stored.
IoT
• Smart Homes
• Industrial IoT (IIoT)
• Healthcare IoT
• Agriculture IoT
CDDO
Interoperability
We support and encourage the use of
open standards in government
CDDO
"Open Standards" are standards made available to the general public
and are developed (or approved) and maintained via a collaborative
and consensus driven process.
"Open Standards" facilitate interoperability and data exchange among
different products or services and are intended for widespread
adoption.
CDDO
• Lower Costs, Vendor Neutrality and no Lock-in
• No boundaries, more choices and variety
• Interoperability and Collaboration
• Increases Innovation
• No Licence Management
• Easier portability of application
• Regular Updates and Quick Fixes
• Flexibility and easier customisation
• Robustness and durability
• Increased available skills
• Efficient use of existing resources
• Higher Quality Software
• More options provide more opportunities to optimise
Advantages of
using Open
Standard
CDDO
CDDO
• Digital transformation engagement models
• Integration of applications, data and
systems
• Optimise channel performance while still
maintaining business continuity
CDDO
• Address disparity
• Take advantage of expertise of the back-
end systems -Increased productivity
• Enable innovation with data with more
accurate and trustworthy data
• Derive enterprise-grade artifacts
• Faster decision-making
• Cost-effectiveness
CDDO
• Legacy system integration
• Enterprise application integration (EAI)
• Third-party system integration
• Business-to-business integration
Ways to connect systems
• Middleware
• Webhooks and Message Queues
• Electronic Data Interchange (EDI)
• Application Programming Interfaces (APIs)
CDDO
System integration Approaches
• Point-to-point integration model (P2P) Star/Spaghetti
• Hub-and-spoke model
• Enterprise Service Bus (ESB) model
• Integration Platform as a Service (iPaaS)
CDDO
Application
Programming
Interface (API)
Why we need APIs
• Improved collaboration: The average enterprise uses almost 1,200 cloud
applications
• Easier innovation and flexibility: A company began as an API with just seven
lines of code. The company has since partnered with many of the biggest
enterprises in the world, diversified to offer loans and corporate cards, and was
recently valued at USD 36 billion
• Data monetisation: API economy initially free and then charge. When
AccuWeather launched its self-service developer portal to sell a wide range of API
packages, it took just 10 months to attract 24,000 developers, selling 11,000 API
keys and building a thriving community in the process.
• Added security: APIs create an added layer of protection between your data and
a server. Developers can further strengthen API security by using tokens,
signatures and Transport Layer Security (TLS) encryption; by implementing API
gateways to manage and authenticate traffic
CDDO
How do APIs work
CDDO
Traditional integration architecture
Centrally provisioned and administered
Modern integration architecture
Fine-grained deployment, decentralized ownership,
and cloud native infrastructure
CDDO
Common API examples
• Universal logins
• Third-party payment processing
• Travel booking comparisons
• Google Maps
• Twitter
CDDO
• Open APIs are open source application programming interfaces you can access with the
HTTP protocol. Also known as public APIs, they have defined API endpoints and request and
response formats.
• Partner APIs are application programming interfaces exposed to or by strategic business
partners. Typically, developers can access these APIs in self-service mode through a public
API developer portal. Still, they will need to complete an onboarding process and get login
credentials to access partner APIs.
• Internal APIs are application programming interfaces that remain hidden from external
users. These private APIs aren't available for users outside of the company and are instead
intended to improve productivity and communication across different internal development
teams.
• Composite APIs combine multiple data or service APIs. These services allow developers to
access several endpoints in a single call. Composite APIs are useful in microservices
architecture where performing a single task may require information from several sources.
Types of APIs
CDDO
Types of API Protocol
• SOAP (Simple Object Access Protocol) is an API protocol built with XML, enabling users to
send and receive data through SMTP and HTTP. With SOAP APIs, it is easier to share
information between apps or software components that are running in different environments
or written in different languages.
• XML-RPC is a protocol that relies on a specific format of XML to transfer data, whereas SOAP
uses a proprietary XML format. XML-RPC is older than SOAP, but much simpler, and
relatively lightweight in that it uses minimum bandwidth.
• JSON-RPC is a protocol similar to XML-RPC, as they are both remote procedure calls
(RPCs), but this one uses JSON instead of XML format to transfer data. Both protocols are
simple. While calls may contain multiple parameters, they only expect one result.
• REST (REpresentational State Transfer) is a set of web API architecture principles, which
means there are no official standards (unlike those with a protocol). To be a REST API (also
known as a RESTful API), the interface must adhere to certain architectural constraints. It’s
possible to build RESTful APIs with SOAP protocols, but the two standards are usually viewed
as competing specifications.
CDDO
API Standard
Ten Commandments
• Have you considered whether the need for your API endpoint is most appropriately served
by a new API or an existing API (or extending existing functionality)?
• Have you got confidence that an external developer with no additional context can
understand and integrate with your API?
• Have you defined appropriate Authorisation requirements for your API?
• Have you considered the risks and potential impact associated with exposing your API?
• Have you established owners for the key processes required for your API?
• Have you built a mature understanding of volumetrics (or expected volumetrics) of your API
and what requirements you have to meet them?
• Have you comprehensively defined the performance metrics that your API needs
to capture?
• Have you defined Transaction Monitoring / Auditing events that are appropriate for
your API?
• Have you considered support model requirements for your API?
• Have you ensured that your API has been built with the expected level of technical quality?
CDDO
Government guidelines on APIs
• API technical and data standards - https://www.gov.uk/guidance/gds-api-technical-and-data-
standards
• API Catalogue: UK public sector APIs –
https://www.api.gov.uk/#uk-public-sector-apis
https://github.com/co-cddo/api-catalogue
• Governments border related Application Programming Interfaces (APIs)
https://www.gov.uk/government/publications/apis
CDDO
• ONS - Integrated Data Services
• UKRI – Administrative Data Research
• Amazon uses Big Data, and the warehouse closest to the customer is
selected and shipping costs to be considerably reduced by 10-40%
• 1.71 bn Facebook users- targeted marketing and influences
• Election result influence
• Open Data
• Open API
CDDO
Microservice Architecture
A microservices architecture consists of a collection of small, autonomous services. Each service is self-
contained and should implement a single business capability within a bounded context
CDDO
Big data architecture
A big data architecture is designed to handle the ingestion, processing, and analysis of data that is too large
or complex for traditional database systems
IoT architecture
Internet of Things (IoT) is a specialized subset of big data solutions. The following diagram shows a possible
logical architecture for IoT. The diagram emphasizes the event-streaming components of the architecture
CDDO
CDDO
CDDO
CDDO
Thanks..
ravinder.singh@digital.cabinet-office.gov.uk
1 of 45

Recommended

NUS-ISS Learning Day 2018- Harnessing the power of cloud solutions in urban a... by
NUS-ISS Learning Day 2018- Harnessing the power of cloud solutions in urban a...NUS-ISS Learning Day 2018- Harnessing the power of cloud solutions in urban a...
NUS-ISS Learning Day 2018- Harnessing the power of cloud solutions in urban a...NUS-ISS
103 views30 slides
CCC-Internet of Things Foundation by
CCC-Internet of Things FoundationCCC-Internet of Things Foundation
CCC-Internet of Things FoundationITpreneurs
792 views21 slides
Without App Standards, There's No Internet of Anything by
Without App Standards, There's No Internet of AnythingWithout App Standards, There's No Internet of Anything
Without App Standards, There's No Internet of AnythingOpen Interconnect Consortium
1.1K views51 slides
Vertex perspectives ai optimized chipsets (part i) by
Vertex perspectives   ai optimized chipsets (part i)Vertex perspectives   ai optimized chipsets (part i)
Vertex perspectives ai optimized chipsets (part i)Yanai Oron
1.1K views12 slides
Vertex Perspectives | AI-optimized Chipsets | Part I by
Vertex Perspectives | AI-optimized Chipsets | Part IVertex Perspectives | AI-optimized Chipsets | Part I
Vertex Perspectives | AI-optimized Chipsets | Part IVertex Holdings
1.7K views12 slides
IoT: Understanding its potential and what makes it tick! by Mark Torr by
IoT: Understanding its potential and what makes it tick! by Mark TorrIoT: Understanding its potential and what makes it tick! by Mark Torr
IoT: Understanding its potential and what makes it tick! by Mark TorrBosnia Agile
664 views50 slides

More Related Content

Similar to apidays London 2023 - Open Standards, AI and Data for better business decisions, Dr Ravinder Singh, Government Digital Service

PRG Symposium From Idea to Scale vF by
PRG Symposium From Idea to Scale vFPRG Symposium From Idea to Scale vF
PRG Symposium From Idea to Scale vFAlex Blanter
429 views17 slides
Top 10 Most Demand IT Certifications Course in 2020 - MildainTrainings by
Top 10 Most Demand IT Certifications Course in 2020 - MildainTrainingsTop 10 Most Demand IT Certifications Course in 2020 - MildainTrainings
Top 10 Most Demand IT Certifications Course in 2020 - MildainTrainingsMildain Solutions
355 views38 slides
apidays LIVE Hong Kong - The Future of Legacy - How to leverage legacy and on... by
apidays LIVE Hong Kong - The Future of Legacy - How to leverage legacy and on...apidays LIVE Hong Kong - The Future of Legacy - How to leverage legacy and on...
apidays LIVE Hong Kong - The Future of Legacy - How to leverage legacy and on...apidays
46 views15 slides
The Internet of Things - beyond the hype and towards ROI by
The Internet of Things - beyond the hype and towards ROIThe Internet of Things - beyond the hype and towards ROI
The Internet of Things - beyond the hype and towards ROIPerry Lea
153 views30 slides
Introduction to IoT development by
Introduction to IoT developmentIntroduction to IoT development
Introduction to IoT developmentYar Naumenko
64 views18 slides
Big data for Telco: opportunity or threat? by
Big data for Telco: opportunity or threat?Big data for Telco: opportunity or threat?
Big data for Telco: opportunity or threat?Swiss Big Data User Group
4.6K views19 slides

Similar to apidays London 2023 - Open Standards, AI and Data for better business decisions, Dr Ravinder Singh, Government Digital Service(20)

PRG Symposium From Idea to Scale vF by Alex Blanter
PRG Symposium From Idea to Scale vFPRG Symposium From Idea to Scale vF
PRG Symposium From Idea to Scale vF
Alex Blanter429 views
Top 10 Most Demand IT Certifications Course in 2020 - MildainTrainings by Mildain Solutions
Top 10 Most Demand IT Certifications Course in 2020 - MildainTrainingsTop 10 Most Demand IT Certifications Course in 2020 - MildainTrainings
Top 10 Most Demand IT Certifications Course in 2020 - MildainTrainings
Mildain Solutions355 views
apidays LIVE Hong Kong - The Future of Legacy - How to leverage legacy and on... by apidays
apidays LIVE Hong Kong - The Future of Legacy - How to leverage legacy and on...apidays LIVE Hong Kong - The Future of Legacy - How to leverage legacy and on...
apidays LIVE Hong Kong - The Future of Legacy - How to leverage legacy and on...
apidays46 views
The Internet of Things - beyond the hype and towards ROI by Perry Lea
The Internet of Things - beyond the hype and towards ROIThe Internet of Things - beyond the hype and towards ROI
The Internet of Things - beyond the hype and towards ROI
Perry Lea153 views
Introduction to IoT development by Yar Naumenko
Introduction to IoT developmentIntroduction to IoT development
Introduction to IoT development
Yar Naumenko64 views
Build a Mobile Foundation to Drive Digital Transformation Initiatives by Perficient, Inc.
Build a Mobile Foundation to Drive Digital Transformation InitiativesBuild a Mobile Foundation to Drive Digital Transformation Initiatives
Build a Mobile Foundation to Drive Digital Transformation Initiatives
Perficient, Inc.1.4K views
Cubitic: Predictive Analytics by huguk
Cubitic: Predictive AnalyticsCubitic: Predictive Analytics
Cubitic: Predictive Analytics
huguk600 views
Microsoft cloud profitability scenarios by Medhy Sandjak
Microsoft cloud profitability scenariosMicrosoft cloud profitability scenarios
Microsoft cloud profitability scenarios
Medhy Sandjak563 views
IoT-Fundamentals-And-Digital-Tranformation-Repaired.pptx by Aurelia JQ
IoT-Fundamentals-And-Digital-Tranformation-Repaired.pptxIoT-Fundamentals-And-Digital-Tranformation-Repaired.pptx
IoT-Fundamentals-And-Digital-Tranformation-Repaired.pptx
Aurelia JQ36 views
Top Digital Transformation Trends (2020) by Cygnet Infotech
Top Digital Transformation Trends (2020)Top Digital Transformation Trends (2020)
Top Digital Transformation Trends (2020)
Cygnet Infotech1.4K views
CL2015 - Datacenter and Cloud Strategy and Planning by Cisco
CL2015 - Datacenter and Cloud Strategy and PlanningCL2015 - Datacenter and Cloud Strategy and Planning
CL2015 - Datacenter and Cloud Strategy and Planning
Cisco179 views
Black Box Global Corproate deck.pdf by Black Box
Black Box Global Corproate deck.pdfBlack Box Global Corproate deck.pdf
Black Box Global Corproate deck.pdf
Black Box38 views
Key Data Management Requirements for the IoT by MongoDB
Key Data Management Requirements for the IoTKey Data Management Requirements for the IoT
Key Data Management Requirements for the IoT
MongoDB8.1K views
Design - Start Your API Journey Today by LaurenWendler
Design - Start Your API Journey TodayDesign - Start Your API Journey Today
Design - Start Your API Journey Today
LaurenWendler246 views
Rise of Machines: How Industrial Equipment Can Join the Supply Chain by Covisint
Rise of Machines: How Industrial Equipment Can Join the Supply ChainRise of Machines: How Industrial Equipment Can Join the Supply Chain
Rise of Machines: How Industrial Equipment Can Join the Supply Chain
Covisint1.1K views
Building a reliable and scalable IoT platform with MongoDB and HiveMQ by Dominik Obermaier
Building a reliable and scalable IoT platform with MongoDB and HiveMQBuilding a reliable and scalable IoT platform with MongoDB and HiveMQ
Building a reliable and scalable IoT platform with MongoDB and HiveMQ
Dominik Obermaier662 views
API and App Ecosystems - Build The Best: a deep dive by Cisco DevNet
API and App Ecosystems - Build The Best: a deep diveAPI and App Ecosystems - Build The Best: a deep dive
API and App Ecosystems - Build The Best: a deep dive
Cisco DevNet603 views

More from apidays

apidays Australia - The Swiss Cheese Model of Layered API Security, Leon Andr... by
apidays Australia - The Swiss Cheese Model of Layered API Security, Leon Andr...apidays Australia - The Swiss Cheese Model of Layered API Security, Leon Andr...
apidays Australia - The Swiss Cheese Model of Layered API Security, Leon Andr...apidays
64 views50 slides
apidays Australia - No API is an island, Erik Tveitnes, REA by
apidays Australia - No API is an island, Erik Tveitnes, REAapidays Australia - No API is an island, Erik Tveitnes, REA
apidays Australia - No API is an island, Erik Tveitnes, REAapidays
42 views17 slides
apidays Australia - How We Built Our Generative AI Assistant; New Relic Grok,... by
apidays Australia - How We Built Our Generative AI Assistant; New Relic Grok,...apidays Australia - How We Built Our Generative AI Assistant; New Relic Grok,...
apidays Australia - How We Built Our Generative AI Assistant; New Relic Grok,...apidays
59 views32 slides
apidays Australia - Discovering APIs And More With An Internal Developer Port... by
apidays Australia - Discovering APIs And More With An Internal Developer Port...apidays Australia - Discovering APIs And More With An Internal Developer Port...
apidays Australia - Discovering APIs And More With An Internal Developer Port...apidays
42 views24 slides
Using APIs in a Design Thinking Approach to Problem Solving.pdf by
Using APIs in a Design Thinking Approach to Problem Solving.pdfUsing APIs in a Design Thinking Approach to Problem Solving.pdf
Using APIs in a Design Thinking Approach to Problem Solving.pdfapidays
41 views24 slides
apidays Australia - Transforming Your Network To Secure, Control And Observe ... by
apidays Australia - Transforming Your Network To Secure, Control And Observe ...apidays Australia - Transforming Your Network To Secure, Control And Observe ...
apidays Australia - Transforming Your Network To Secure, Control And Observe ...apidays
31 views43 slides

More from apidays(20)

apidays Australia - The Swiss Cheese Model of Layered API Security, Leon Andr... by apidays
apidays Australia - The Swiss Cheese Model of Layered API Security, Leon Andr...apidays Australia - The Swiss Cheese Model of Layered API Security, Leon Andr...
apidays Australia - The Swiss Cheese Model of Layered API Security, Leon Andr...
apidays64 views
apidays Australia - No API is an island, Erik Tveitnes, REA by apidays
apidays Australia - No API is an island, Erik Tveitnes, REAapidays Australia - No API is an island, Erik Tveitnes, REA
apidays Australia - No API is an island, Erik Tveitnes, REA
apidays42 views
apidays Australia - How We Built Our Generative AI Assistant; New Relic Grok,... by apidays
apidays Australia - How We Built Our Generative AI Assistant; New Relic Grok,...apidays Australia - How We Built Our Generative AI Assistant; New Relic Grok,...
apidays Australia - How We Built Our Generative AI Assistant; New Relic Grok,...
apidays59 views
apidays Australia - Discovering APIs And More With An Internal Developer Port... by apidays
apidays Australia - Discovering APIs And More With An Internal Developer Port...apidays Australia - Discovering APIs And More With An Internal Developer Port...
apidays Australia - Discovering APIs And More With An Internal Developer Port...
apidays42 views
Using APIs in a Design Thinking Approach to Problem Solving.pdf by apidays
Using APIs in a Design Thinking Approach to Problem Solving.pdfUsing APIs in a Design Thinking Approach to Problem Solving.pdf
Using APIs in a Design Thinking Approach to Problem Solving.pdf
apidays41 views
apidays Australia - Transforming Your Network To Secure, Control And Observe ... by apidays
apidays Australia - Transforming Your Network To Secure, Control And Observe ...apidays Australia - Transforming Your Network To Secure, Control And Observe ...
apidays Australia - Transforming Your Network To Secure, Control And Observe ...
apidays31 views
apidays Australia - Consuming And Building APIs During Hackathons, William Mc... by apidays
apidays Australia - Consuming And Building APIs During Hackathons, William Mc...apidays Australia - Consuming And Building APIs During Hackathons, William Mc...
apidays Australia - Consuming And Building APIs During Hackathons, William Mc...
apidays11 views
apidays Australia - Building On-Premise Hybrid API Platforms, David Freeman, ... by apidays
apidays Australia - Building On-Premise Hybrid API Platforms, David Freeman, ...apidays Australia - Building On-Premise Hybrid API Platforms, David Freeman, ...
apidays Australia - Building On-Premise Hybrid API Platforms, David Freeman, ...
apidays18 views
apidays Australia - Enable Faster Delivery With Collaborative Platform Teams,... by apidays
apidays Australia - Enable Faster Delivery With Collaborative Platform Teams,...apidays Australia - Enable Faster Delivery With Collaborative Platform Teams,...
apidays Australia - Enable Faster Delivery With Collaborative Platform Teams,...
apidays28 views
apidays Australia - Building Trust Brick by Brick, Dasith Wijesiriwardena, Ju... by apidays
apidays Australia - Building Trust Brick by Brick, Dasith Wijesiriwardena, Ju...apidays Australia - Building Trust Brick by Brick, Dasith Wijesiriwardena, Ju...
apidays Australia - Building Trust Brick by Brick, Dasith Wijesiriwardena, Ju...
apidays39 views
apidays Australia - The Playful Bond Between REST And Data Streams, Warren Ve... by apidays
apidays Australia - The Playful Bond Between REST And Data Streams, Warren Ve...apidays Australia - The Playful Bond Between REST And Data Streams, Warren Ve...
apidays Australia - The Playful Bond Between REST And Data Streams, Warren Ve...
apidays37 views
apidays Australia - Unlocking The Power: The Importance Of API Registration, ... by apidays
apidays Australia - Unlocking The Power: The Importance Of API Registration, ...apidays Australia - Unlocking The Power: The Importance Of API Registration, ...
apidays Australia - Unlocking The Power: The Importance Of API Registration, ...
apidays17 views
apidays Australia - API Strategy In The Era Of Generative AI,Shreshta Shyamsu... by apidays
apidays Australia - API Strategy In The Era Of Generative AI,Shreshta Shyamsu...apidays Australia - API Strategy In The Era Of Generative AI,Shreshta Shyamsu...
apidays Australia - API Strategy In The Era Of Generative AI,Shreshta Shyamsu...
apidays71 views
apidays London 2023 - How APIs support the democratization of FAIR data and d... by apidays
apidays London 2023 - How APIs support the democratization of FAIR data and d...apidays London 2023 - How APIs support the democratization of FAIR data and d...
apidays London 2023 - How APIs support the democratization of FAIR data and d...
apidays69 views
apidays London 2023 - Revolutionising fitness and well-being, David Turner, V... by apidays
apidays London 2023 - Revolutionising fitness and well-being, David Turner, V...apidays London 2023 - Revolutionising fitness and well-being, David Turner, V...
apidays London 2023 - Revolutionising fitness and well-being, David Turner, V...
apidays34 views
apidays London 2023 - Let's make "true" impact happen!, Sandra Sydow, Climate... by apidays
apidays London 2023 - Let's make "true" impact happen!, Sandra Sydow, Climate...apidays London 2023 - Let's make "true" impact happen!, Sandra Sydow, Climate...
apidays London 2023 - Let's make "true" impact happen!, Sandra Sydow, Climate...
apidays24 views
apidays London 2023 - 7 pillars of an API Factory, Patrick Brosse, Amadeus by apidays
apidays London 2023 - 7 pillars of an API Factory, Patrick Brosse, Amadeusapidays London 2023 - 7 pillars of an API Factory, Patrick Brosse, Amadeus
apidays London 2023 - 7 pillars of an API Factory, Patrick Brosse, Amadeus
apidays52 views
apidays London 2023 - Meeting Relentless Business Change in a Post API Econom... by apidays
apidays London 2023 - Meeting Relentless Business Change in a Post API Econom...apidays London 2023 - Meeting Relentless Business Change in a Post API Econom...
apidays London 2023 - Meeting Relentless Business Change in a Post API Econom...
apidays20 views
apidays London 2023 - Overengineering Weakens your API Security, Dr. David Va... by apidays
apidays London 2023 - Overengineering Weakens your API Security, Dr. David Va...apidays London 2023 - Overengineering Weakens your API Security, Dr. David Va...
apidays London 2023 - Overengineering Weakens your API Security, Dr. David Va...
apidays39 views
apidays London 2023 - When to soar and when to dive, Claire Barrett, APIsFirst by apidays
apidays London 2023 - When to soar and when to dive, Claire Barrett, APIsFirst apidays London 2023 - When to soar and when to dive, Claire Barrett, APIsFirst
apidays London 2023 - When to soar and when to dive, Claire Barrett, APIsFirst
apidays22 views

Recently uploaded

Applied physics letters journal.pdf by
Applied physics letters journal.pdfApplied physics letters journal.pdf
Applied physics letters journal.pdfaqsamukhtiyar88
5 views8 slides
PRIVACY AWRE PERSONAL DATA STORAGE by
PRIVACY AWRE PERSONAL DATA STORAGEPRIVACY AWRE PERSONAL DATA STORAGE
PRIVACY AWRE PERSONAL DATA STORAGEantony420421
7 views56 slides
LIVE OAK MEMORIAL PARK.pptx by
LIVE OAK MEMORIAL PARK.pptxLIVE OAK MEMORIAL PARK.pptx
LIVE OAK MEMORIAL PARK.pptxms2332always
7 views6 slides
Penetration testing by Burpsuite by
Penetration testing by  BurpsuitePenetration testing by  Burpsuite
Penetration testing by BurpsuiteAyonDebnathCertified
5 views19 slides
Data Journeys Hard Talk workshop final.pptx by
Data Journeys Hard Talk workshop final.pptxData Journeys Hard Talk workshop final.pptx
Data Journeys Hard Talk workshop final.pptxinfo828217
11 views18 slides
Inawsidom - Data Journey by
Inawsidom - Data JourneyInawsidom - Data Journey
Inawsidom - Data JourneyPhilipBasford
8 views38 slides

Recently uploaded(20)

PRIVACY AWRE PERSONAL DATA STORAGE by antony420421
PRIVACY AWRE PERSONAL DATA STORAGEPRIVACY AWRE PERSONAL DATA STORAGE
PRIVACY AWRE PERSONAL DATA STORAGE
antony4204217 views
LIVE OAK MEMORIAL PARK.pptx by ms2332always
LIVE OAK MEMORIAL PARK.pptxLIVE OAK MEMORIAL PARK.pptx
LIVE OAK MEMORIAL PARK.pptx
ms2332always7 views
Data Journeys Hard Talk workshop final.pptx by info828217
Data Journeys Hard Talk workshop final.pptxData Journeys Hard Talk workshop final.pptx
Data Journeys Hard Talk workshop final.pptx
info82821711 views
Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language... by patiladiti752
Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language...Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language...
Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language...
patiladiti7528 views
Lack of communication among family.pptx by ahmed164023
Lack of communication among family.pptxLack of communication among family.pptx
Lack of communication among family.pptx
ahmed16402315 views
Pydata Global 2023 - How can a learnt model unlearn something by SARADINDU SENGUPTA
Pydata Global 2023 - How can a learnt model unlearn somethingPydata Global 2023 - How can a learnt model unlearn something
Pydata Global 2023 - How can a learnt model unlearn something
Games, Queries, and Argumentation Frameworks: Time for a Family Reunion by Bertram Ludäscher
Games, Queries, and Argumentation Frameworks: Time for a Family ReunionGames, Queries, and Argumentation Frameworks: Time for a Family Reunion
Games, Queries, and Argumentation Frameworks: Time for a Family Reunion
OPPOTUS - Malaysians on Malaysia 3Q2023.pdf by Oppotus
OPPOTUS - Malaysians on Malaysia 3Q2023.pdfOPPOTUS - Malaysians on Malaysia 3Q2023.pdf
OPPOTUS - Malaysians on Malaysia 3Q2023.pdf
Oppotus31 views
Data about the sector workshop by info828217
Data about the sector workshopData about the sector workshop
Data about the sector workshop
info82821729 views
AZConf 2023 - Considerations for LLMOps: Running LLMs in production by SARADINDU SENGUPTA
AZConf 2023 - Considerations for LLMOps: Running LLMs in productionAZConf 2023 - Considerations for LLMOps: Running LLMs in production
AZConf 2023 - Considerations for LLMOps: Running LLMs in production

apidays London 2023 - Open Standards, AI and Data for better business decisions, Dr Ravinder Singh, Government Digital Service

  • 1. Dr. Ravinder Singh Modernising Technology Programme Manager Cabinet Office-Central Digital and Data Office ravinder.singh@digital.cabinet-office.gov.uk
  • 2. Open Standards, AI and Data for better business decisions
  • 4. >2.6 quintillion bytes Data Generated everyday By 2025 : 463 exabytes per day Instagram photos and videos : 95 million Every day, 306.4 billion emails are sent, and 500 million Tweets are made. Year Data Generated Change Over Previous Year 2020* 64.2 zettabytes ↑ 23.2 zettabytes 2021* 79 zettabytes ↑ 14.8 zettabytes 2022* 97 zettabytes ↑ 18 zettabytes 2023* 120 zettabytes ↑ 23 zettabytes CDDO
  • 5. Every minute of the day: • Number of Google Searches: 5.9mn • WhatsApp Messages: 41.7mn • TikTok Videos: 167 mn • $3805 for mobile Apps • On Facebook: 510 K comments are posted, 293 K statuses are updated, and 136 K photos are uploaded. • Instagram photos: 55 K • Twitter Tweets: 0.5 mn • Youtube videos seen: 4.5 mn • Instagram posts: 277 K • Tinder: 1.4 mn Swipes • 188 mn emails • 103 mn spam mails • 18 mn text messages Every Day: • 2.9 bn email users • Number of Facebook users: 2.38 bn • Facebook logon daily: 1.56 bn • Mobile Facebook users: 1.74 bn • Fake profiles: 83 mn • Instagram users: 600 mn (400 mn active every day) • 95 mn photos and videos shared in Instagram • 100 mn use stories on Instagram • 232 K skype calls
  • 8. Ø Transparency and accountability: AI-ML remains a black box Ø Data Quality and Algorithm Ø Data Availability and integrity Ø Data privacy and security issues. Ø Resource / lack of expertise Ø Workforce development Ø Regulations Ø Legal and ethical considerations Ø Security Ø Legacy systems and Integration CDDO Current challenges
  • 9. Ø Enhanced Efficiency and productivity Ø Improved service delivery to citizens Ø Data-Driven Decision Making Ø Citizen Engagement and Participation Ø Cost savings and resource optimization Ø Enhanced transparency and accountability Ø Policy Writing Ø Writing Business case Ø Writing Project reports Ø Software coding to develop bespoke or customisation of existing services Ø Medical field CDDO Opportunities
  • 10. $5bn to $30bn £1bn China (2017-2030) UK, backed by £300mn of private investment Beijing - $2bn Tanjin $16bn $1.8bn $ 1bn France USA 47% Employment opportunities taken by machines It has been estimated that AI could add an additional USD $814 billion (£630bn) to the UK economy by 2035, increasing the annual growth rate of GVA from 2.5 to 3.9%. Estimated that AI has the potential to add $957 billion to India’s GDP by 2035 and boost India’s annual growth by 1.3 percentage points by 2035. CDDO
  • 11. CDDO Stages of the Machine Learning Process
  • 12. CDDO Continuous ML Model and Control Framework
  • 13. Judgement Based Rules Based Programmed Strictly Controlled Contained Transformational Tactical Business Impact Self-Learning Autonomous Unbounded Automation Platform Foundation Automation VB Scripts, Excel Macros, Hotkeys, Unified Desktop Artificial Intelligence Virtual Assistance Robotics Process Automation CDDO
  • 14. “By 2021, The RPA Market value, While Large, It's Only A Subset Of The $48.5 Billion Broader AI Cubicle Spend”, Forrester 2017 of the world’s leading organizations will implement a Chief Robotics Officer role and/or define a robotics- specific function within the business by 2019. IDC Worldwide Robotics 2017 Predictions-Jing Bing Zhang 30% 3M workers globally will be supervised by a “roboboss” by 2018, GARTNER A world in which your organisation is 15% human and 85% robots? $2.9B of all customer interactions will be handled without a human agent by 2020, GARTNER 85% $9T 1/3 of the workforce may be replaced by robots by the year 2025, GARTNER “Employment costs could be cut with AI- enabled automation of knowledge work by 2020”, Everest, Bank of America
  • 15. CDDO
  • 16. CDDO Generative AI and LLM • A branch of AI/ML that focuses on creating or generating new content, such as images, text, audio, or even entire virtual worlds, based on patterns and data it has been trained on. • Unlike traditional AI systems that primarily focus on recognizing patterns and making predictions based on existing data, generative AI goes a step further by generating new and original content that closely resembles the data it has learned from. • Generative AI techniques typically rely on deep learning models, such as generative adversarial networks (GANs), variational autoencoders (VAEs), or transformers. • Generative AI has various applications across different domains. It can be used for creative purposes, such as generating artwork, music, or storytelling Image: BCV
  • 17. Internet of Things (IoT) CDDO Three Key components • Things/Devices: physical objects or devices equipped with sensors, actuators, and connectivity capabilities. • Connectivity: Wi-Fi, Bluetooth, cellular networks, low-power wide-area networks (LPWAN), or other wireless protocols. • Cloud and Data Processing: The data collected by IoT devices is sent to cloud- based platforms or edge computing systems, where it is processed, analysed, and stored. IoT • Smart Homes • Industrial IoT (IIoT) • Healthcare IoT • Agriculture IoT
  • 18. CDDO
  • 20. We support and encourage the use of open standards in government CDDO
  • 21. "Open Standards" are standards made available to the general public and are developed (or approved) and maintained via a collaborative and consensus driven process. "Open Standards" facilitate interoperability and data exchange among different products or services and are intended for widespread adoption. CDDO
  • 22. • Lower Costs, Vendor Neutrality and no Lock-in • No boundaries, more choices and variety • Interoperability and Collaboration • Increases Innovation • No Licence Management • Easier portability of application • Regular Updates and Quick Fixes • Flexibility and easier customisation • Robustness and durability • Increased available skills • Efficient use of existing resources • Higher Quality Software • More options provide more opportunities to optimise Advantages of using Open Standard CDDO
  • 23. CDDO
  • 24. • Digital transformation engagement models • Integration of applications, data and systems • Optimise channel performance while still maintaining business continuity CDDO
  • 25. • Address disparity • Take advantage of expertise of the back- end systems -Increased productivity • Enable innovation with data with more accurate and trustworthy data • Derive enterprise-grade artifacts • Faster decision-making • Cost-effectiveness CDDO
  • 26. • Legacy system integration • Enterprise application integration (EAI) • Third-party system integration • Business-to-business integration
  • 27. Ways to connect systems • Middleware • Webhooks and Message Queues • Electronic Data Interchange (EDI) • Application Programming Interfaces (APIs) CDDO
  • 28. System integration Approaches • Point-to-point integration model (P2P) Star/Spaghetti • Hub-and-spoke model • Enterprise Service Bus (ESB) model • Integration Platform as a Service (iPaaS) CDDO
  • 30. Why we need APIs • Improved collaboration: The average enterprise uses almost 1,200 cloud applications • Easier innovation and flexibility: A company began as an API with just seven lines of code. The company has since partnered with many of the biggest enterprises in the world, diversified to offer loans and corporate cards, and was recently valued at USD 36 billion • Data monetisation: API economy initially free and then charge. When AccuWeather launched its self-service developer portal to sell a wide range of API packages, it took just 10 months to attract 24,000 developers, selling 11,000 API keys and building a thriving community in the process. • Added security: APIs create an added layer of protection between your data and a server. Developers can further strengthen API security by using tokens, signatures and Transport Layer Security (TLS) encryption; by implementing API gateways to manage and authenticate traffic CDDO
  • 31. How do APIs work CDDO
  • 32. Traditional integration architecture Centrally provisioned and administered Modern integration architecture Fine-grained deployment, decentralized ownership, and cloud native infrastructure CDDO
  • 33. Common API examples • Universal logins • Third-party payment processing • Travel booking comparisons • Google Maps • Twitter CDDO
  • 34. • Open APIs are open source application programming interfaces you can access with the HTTP protocol. Also known as public APIs, they have defined API endpoints and request and response formats. • Partner APIs are application programming interfaces exposed to or by strategic business partners. Typically, developers can access these APIs in self-service mode through a public API developer portal. Still, they will need to complete an onboarding process and get login credentials to access partner APIs. • Internal APIs are application programming interfaces that remain hidden from external users. These private APIs aren't available for users outside of the company and are instead intended to improve productivity and communication across different internal development teams. • Composite APIs combine multiple data or service APIs. These services allow developers to access several endpoints in a single call. Composite APIs are useful in microservices architecture where performing a single task may require information from several sources. Types of APIs CDDO
  • 35. Types of API Protocol • SOAP (Simple Object Access Protocol) is an API protocol built with XML, enabling users to send and receive data through SMTP and HTTP. With SOAP APIs, it is easier to share information between apps or software components that are running in different environments or written in different languages. • XML-RPC is a protocol that relies on a specific format of XML to transfer data, whereas SOAP uses a proprietary XML format. XML-RPC is older than SOAP, but much simpler, and relatively lightweight in that it uses minimum bandwidth. • JSON-RPC is a protocol similar to XML-RPC, as they are both remote procedure calls (RPCs), but this one uses JSON instead of XML format to transfer data. Both protocols are simple. While calls may contain multiple parameters, they only expect one result. • REST (REpresentational State Transfer) is a set of web API architecture principles, which means there are no official standards (unlike those with a protocol). To be a REST API (also known as a RESTful API), the interface must adhere to certain architectural constraints. It’s possible to build RESTful APIs with SOAP protocols, but the two standards are usually viewed as competing specifications. CDDO
  • 36. API Standard Ten Commandments • Have you considered whether the need for your API endpoint is most appropriately served by a new API or an existing API (or extending existing functionality)? • Have you got confidence that an external developer with no additional context can understand and integrate with your API? • Have you defined appropriate Authorisation requirements for your API? • Have you considered the risks and potential impact associated with exposing your API? • Have you established owners for the key processes required for your API? • Have you built a mature understanding of volumetrics (or expected volumetrics) of your API and what requirements you have to meet them? • Have you comprehensively defined the performance metrics that your API needs to capture? • Have you defined Transaction Monitoring / Auditing events that are appropriate for your API? • Have you considered support model requirements for your API? • Have you ensured that your API has been built with the expected level of technical quality? CDDO
  • 37. Government guidelines on APIs • API technical and data standards - https://www.gov.uk/guidance/gds-api-technical-and-data- standards • API Catalogue: UK public sector APIs – https://www.api.gov.uk/#uk-public-sector-apis https://github.com/co-cddo/api-catalogue • Governments border related Application Programming Interfaces (APIs) https://www.gov.uk/government/publications/apis CDDO
  • 38. • ONS - Integrated Data Services • UKRI – Administrative Data Research • Amazon uses Big Data, and the warehouse closest to the customer is selected and shipping costs to be considerably reduced by 10-40% • 1.71 bn Facebook users- targeted marketing and influences • Election result influence • Open Data • Open API CDDO
  • 39. Microservice Architecture A microservices architecture consists of a collection of small, autonomous services. Each service is self- contained and should implement a single business capability within a bounded context CDDO
  • 40. Big data architecture A big data architecture is designed to handle the ingestion, processing, and analysis of data that is too large or complex for traditional database systems
  • 41. IoT architecture Internet of Things (IoT) is a specialized subset of big data solutions. The following diagram shows a possible logical architecture for IoT. The diagram emphasizes the event-streaming components of the architecture CDDO
  • 42. CDDO
  • 43. CDDO
  • 44. CDDO