SlideShare a Scribd company logo
1 of 24
Download to read offline
Your logo
here
Autonomous Intelligent
Agents
The next frontier in Network Automation
Javier Antich - javier@anetta.ai
VIDEO
Network infrastructures
are more complex than
ever
Qualified resources are
more scarce than ever
Network infrastructures
are more mission critical
than ever
Knowledge softwarization
Knowledge dependent on people
Scarce, limited.
user user
API call
+
Knowledge compiled in software
Broadly available at the distance of an API call
Elastic, scalable, “unlimited”
The LLMs are huge
“knowledge compilators”
The network softwarization journey
Standarization of
APIs
Network
Softwarization
Pervasive
Network Data
Decision
points
Decision
optimization
Cloud
LLM
Knowledge
softwarization
Dynamic
networks
Autonomous
agents
Autonomous
networks
LLM-Powered Autonomous Agents
From
LLM
Imperative / prescriptive
Task execution:
• Generate text
• Summarize text
• Translate text
• Q&A
• ...
To
Memory Function
Planning
Action
Intent based / descriptive
- Complex problem solver
- Autonomous execution
- Example: Anetta.ai
LLM-powered
Agent
Complex network information search
Problem diagnostics
Network infrastructures
are more complex than
ever
Qualified resources are
more scarce than ever
Network infrastructures
are more mission critical
than ever
LLM-
Powered
Autonomous
Agents
Your logo
here
AI in Networking:
where does it fit?
Igor Giangrossi
Sr. Dir, Consulting Engineering
Typical use cases of AI/ML in Networking
Reporting Thresholding Baselining Clustering Predicting
Collect current and
historical data for
effective visualization
and analysis
Detect situations
where customized
indicators violate
defined thresholds
Learn the expected
range of values for
key resources
Identify things that
appear to be
behaving differently
than others
Anticipate behavior
that might happen in
the future
Passive Pro-active
Active
Centralized data collection and analysis
AI/ML
Actions
Data
Could we use AI/ML inside routers?
Challenges:
• What is the use case?
• Processing resources (CPU, Memory, Disk)?
• App development environment / SDK?
• Data collection API?
• Analysis only, or closed loop automation?
• How to use the output?
Opportunities:
• All system state readily available
• Real-time processing of events?
• Smaller, custom-trained models?
Demo: ChatGPT app in Nokia SR Linux
Natural language as a CLI helper
Hardware eXtensible Data Path (XDP)
Infrastructure
Standard Linux Kernel
Pub/Sub via
protobufs/gRPC
Lightweight Impart
Database (IDB)
NetOps
Development Kit
(NDK)
Applications
BGP OSPF QoS …
ACL
ChatGPT App
BFD ISIS MPLS
Management
YANG Models
gNMI gNOI gRIBI OC gRPC CLI
Question + context
Answer
LLM
Try it yourself!
Your logo
here
The AIOps Maturity
Model
for networking
Dave Siegel
Agenda
● Definitions: Monitoring,
Observability and AI Ops
● Maturity model overview
● Progression through the model
● Use Case: Tracfone
Monitoring – Observability - AIOps
Monitoring
Observability
AI Ops
Aggregate
MELT
Gather
MELT
Root Cause
Analysis
Predictive
Analytics
Use Cases
Benefits
Prescriptive Analytics
Self-healing
Anomaly
detection
Support
Audits
Noise
Reductio
n
Natural
Language
Interaction
s
Maturity Model
Passive
Ops
Too much data –
rely on customer-
triggered incident
Reactive and
highly manual
processes
Silod Ops teams
– poor
collaboration
Active
Ops
Silo’d
observability
tools
Part Reactive,
part proactive
Silo’d Ops teams
– some
collaboration
AIOps
AI Augmented
Operations
Highly Proactive
Strong Ops Team
Collaboration
NoOps
Autonomous AI
Supervised full
automation
Ops team re-
skilled as
developers
Passive to Active Ops
Graduation Criteria:
● Exec Sponsorship – budgets and business goal alignment
● Manual operations transitioned to tools-led ops landscape
● Architects, ops teas and developers focused on the discipline of
observability
Characteristics of Active Ops
● Proactive Alerting on serious issues, detecting hazcons, predicting unknown
‘unknowns’
● Filtering noise in telemetry data
● Correlation of events across data types and sources – reduced alert fatigue
● Collected and analyzed data measures SLA and SLO compliance
Active Ops to AI Ops
Active Ops Graduation Criteria
● Adoption of enterprise AI discipline
● Refactored Ops processes to gear them towards an AI-based automation environment
● AIOps solutions are the central operations function in the enterprise
● AIOps solutions are linked seamlessly with existing Monitoring and Observability solutions
Characterization of AI Ops
● Decision making is augmented by AI-based tools through descriptive and predictive analytics, as well as
remediation recommendations
● Expert management of large data systems/modern data lakes/lakehouse
● Enhanced Root Cause Analysis, Anomaly & Outlier detection, and correlation of these machine interpreted
incidents
● Prediction and forecasting inherent in the ML models
● Highly collaborative ops teams
● AI tools are trained/customized to the specific domain(s) they support
Active to AI Ops Use Case: Tracfone
Challenges
● Over a dozen monitoring tools
● Excellent Eng and Ops staff in their specific domain
● Cross-domain challenges resulted significant outage times
The Implementation of Selector AIOps
● Ingested data from 18 different tools that monitored everything from the network all the
way up to the application layer
● AI driven alert & event filtering, and correlation
● Graphical dashboards presenting a unified view and analytical insights
Results
● Huge reduction in MTTR, especially in major incidents
● Improved overall uptime with proactive identification of potential incident causing issues
Questions/Discussion
Thank You!

More Related Content

Similar to Mini-Track: AI and ML in Network Operations Applications

TB8568_8568_Presentation
TB8568_8568_PresentationTB8568_8568_Presentation
TB8568_8568_PresentationRonnie Falgout
 
An Integrated Approach to Manage IT Network Traffic - An Overview
An Integrated Approach to Manage IT Network Traffic - An OverviewAn Integrated Approach to Manage IT Network Traffic - An Overview
An Integrated Approach to Manage IT Network Traffic - An OverviewManageEngine
 
The differing ways to monitor and instrument
The differing ways to monitor and instrumentThe differing ways to monitor and instrument
The differing ways to monitor and instrumentJonah Kowall
 
MindSphere: The cloud-based, open IoT operating system. Damiano Manocchia
MindSphere: The cloud-based, open IoT operating system. Damiano ManocchiaMindSphere: The cloud-based, open IoT operating system. Damiano Manocchia
MindSphere: The cloud-based, open IoT operating system. Damiano ManocchiaData Driven Innovation
 
20160000 Cloud Discovery Event - Cloud Access Security Brokers
20160000 Cloud Discovery Event - Cloud Access Security Brokers20160000 Cloud Discovery Event - Cloud Access Security Brokers
20160000 Cloud Discovery Event - Cloud Access Security BrokersRobin Vermeirsch
 
Cloud Experience: Data-driven Applications Made Simple and Fast
Cloud Experience: Data-driven Applications Made Simple and FastCloud Experience: Data-driven Applications Made Simple and Fast
Cloud Experience: Data-driven Applications Made Simple and FastDatabricks
 
System Support for Internet of Things
System Support for Internet of ThingsSystem Support for Internet of Things
System Support for Internet of ThingsHarshitParkar6677
 
Network Automation Journey, A systems engineer NetOps perspective
Network Automation Journey, A systems engineer NetOps perspectiveNetwork Automation Journey, A systems engineer NetOps perspective
Network Automation Journey, A systems engineer NetOps perspectiveWalid Shaari
 
Combining Logs, Metrics, and Traces for Unified Observability
Combining Logs, Metrics, and Traces for Unified ObservabilityCombining Logs, Metrics, and Traces for Unified Observability
Combining Logs, Metrics, and Traces for Unified ObservabilityElasticsearch
 
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunen
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunenMeetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunen
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunenDigipolis Antwerpen
 
Building a Real-Time Security Application Using Log Data and Machine Learning...
Building a Real-Time Security Application Using Log Data and Machine Learning...Building a Real-Time Security Application Using Log Data and Machine Learning...
Building a Real-Time Security Application Using Log Data and Machine Learning...Sri Ambati
 
MLOps journey at Swisscom: AI Use Cases, Architecture and Future Vision
MLOps journey at Swisscom: AI Use Cases, Architecture and Future VisionMLOps journey at Swisscom: AI Use Cases, Architecture and Future Vision
MLOps journey at Swisscom: AI Use Cases, Architecture and Future VisionBATbern
 
Serverless machine learning architectures at Helixa
Serverless machine learning architectures at HelixaServerless machine learning architectures at Helixa
Serverless machine learning architectures at HelixaData Science Milan
 
AI Scalability for the Next Decade
AI Scalability for the Next DecadeAI Scalability for the Next Decade
AI Scalability for the Next DecadePaula Koziol
 
AI for Software Engineering
AI for Software EngineeringAI for Software Engineering
AI for Software EngineeringMiroslaw Staron
 
SplunkLive! Utrecht 2016 - NXP
SplunkLive! Utrecht 2016 - NXPSplunkLive! Utrecht 2016 - NXP
SplunkLive! Utrecht 2016 - NXPSplunk
 
Excellent slides on the new z13s announced on 16th Feb 2016
Excellent slides on the new z13s announced on 16th Feb 2016Excellent slides on the new z13s announced on 16th Feb 2016
Excellent slides on the new z13s announced on 16th Feb 2016Luigi Tommaseo
 

Similar to Mini-Track: AI and ML in Network Operations Applications (20)

Mastering System Resiliency with AIOps
Mastering System Resiliency with AIOpsMastering System Resiliency with AIOps
Mastering System Resiliency with AIOps
 
Resume
ResumeResume
Resume
 
TB8568_8568_Presentation
TB8568_8568_PresentationTB8568_8568_Presentation
TB8568_8568_Presentation
 
An Integrated Approach to Manage IT Network Traffic - An Overview
An Integrated Approach to Manage IT Network Traffic - An OverviewAn Integrated Approach to Manage IT Network Traffic - An Overview
An Integrated Approach to Manage IT Network Traffic - An Overview
 
The differing ways to monitor and instrument
The differing ways to monitor and instrumentThe differing ways to monitor and instrument
The differing ways to monitor and instrument
 
MindSphere: The cloud-based, open IoT operating system. Damiano Manocchia
MindSphere: The cloud-based, open IoT operating system. Damiano ManocchiaMindSphere: The cloud-based, open IoT operating system. Damiano Manocchia
MindSphere: The cloud-based, open IoT operating system. Damiano Manocchia
 
20160000 Cloud Discovery Event - Cloud Access Security Brokers
20160000 Cloud Discovery Event - Cloud Access Security Brokers20160000 Cloud Discovery Event - Cloud Access Security Brokers
20160000 Cloud Discovery Event - Cloud Access Security Brokers
 
Cloud Experience: Data-driven Applications Made Simple and Fast
Cloud Experience: Data-driven Applications Made Simple and FastCloud Experience: Data-driven Applications Made Simple and Fast
Cloud Experience: Data-driven Applications Made Simple and Fast
 
System Support for Internet of Things
System Support for Internet of ThingsSystem Support for Internet of Things
System Support for Internet of Things
 
Network Automation Journey, A systems engineer NetOps perspective
Network Automation Journey, A systems engineer NetOps perspectiveNetwork Automation Journey, A systems engineer NetOps perspective
Network Automation Journey, A systems engineer NetOps perspective
 
Combining Logs, Metrics, and Traces for Unified Observability
Combining Logs, Metrics, and Traces for Unified ObservabilityCombining Logs, Metrics, and Traces for Unified Observability
Combining Logs, Metrics, and Traces for Unified Observability
 
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunen
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunenMeetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunen
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunen
 
Building a Real-Time Security Application Using Log Data and Machine Learning...
Building a Real-Time Security Application Using Log Data and Machine Learning...Building a Real-Time Security Application Using Log Data and Machine Learning...
Building a Real-Time Security Application Using Log Data and Machine Learning...
 
MLOps journey at Swisscom: AI Use Cases, Architecture and Future Vision
MLOps journey at Swisscom: AI Use Cases, Architecture and Future VisionMLOps journey at Swisscom: AI Use Cases, Architecture and Future Vision
MLOps journey at Swisscom: AI Use Cases, Architecture and Future Vision
 
Serverless machine learning architectures at Helixa
Serverless machine learning architectures at HelixaServerless machine learning architectures at Helixa
Serverless machine learning architectures at Helixa
 
AI Scalability for the Next Decade
AI Scalability for the Next DecadeAI Scalability for the Next Decade
AI Scalability for the Next Decade
 
AI at Scale in Enterprises
AI at Scale in Enterprises AI at Scale in Enterprises
AI at Scale in Enterprises
 
AI for Software Engineering
AI for Software EngineeringAI for Software Engineering
AI for Software Engineering
 
SplunkLive! Utrecht 2016 - NXP
SplunkLive! Utrecht 2016 - NXPSplunkLive! Utrecht 2016 - NXP
SplunkLive! Utrecht 2016 - NXP
 
Excellent slides on the new z13s announced on 16th Feb 2016
Excellent slides on the new z13s announced on 16th Feb 2016Excellent slides on the new z13s announced on 16th Feb 2016
Excellent slides on the new z13s announced on 16th Feb 2016
 

More from Network Automation Forum

Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveAutomating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveNetwork Automation Forum
 
Network Source of Truth and Infrastructure as Code revisited
Network Source of Truth and Infrastructure as Code revisitedNetwork Source of Truth and Infrastructure as Code revisited
Network Source of Truth and Infrastructure as Code revisitedNetwork Automation Forum
 
AutoCon 0 Day Two Keynote: Kireeti Kompella
AutoCon 0 Day Two Keynote: Kireeti KompellaAutoCon 0 Day Two Keynote: Kireeti Kompella
AutoCon 0 Day Two Keynote: Kireeti KompellaNetwork Automation Forum
 
Simplified Troubleshooting through API Scripting
Simplified Troubleshooting through API Scripting Simplified Troubleshooting through API Scripting
Simplified Troubleshooting through API Scripting Network Automation Forum
 
Applying Platform Engineering Principles to On-Premises Network Infrastructure
Applying Platform Engineering Principles to On-Premises Network InfrastructureApplying Platform Engineering Principles to On-Premises Network Infrastructure
Applying Platform Engineering Principles to On-Premises Network InfrastructureNetwork Automation Forum
 
Evolving the Network Automation Journey from Python to Platforms
Evolving the Network Automation Journey from Python to PlatformsEvolving the Network Automation Journey from Python to Platforms
Evolving the Network Automation Journey from Python to PlatformsNetwork Automation Forum
 
A Real-World Approach to Intent-based Networking and Service Orchestration
A Real-World Approach to Intent-based Networking and Service OrchestrationA Real-World Approach to Intent-based Networking and Service Orchestration
A Real-World Approach to Intent-based Networking and Service OrchestrationNetwork Automation Forum
 
Mini-Track: The State of Network Automation
Mini-Track: The State of Network Automation Mini-Track: The State of Network Automation
Mini-Track: The State of Network Automation Network Automation Forum
 
Mini-Track: Challenges to Network Automation Adoption
Mini-Track: Challenges to Network Automation AdoptionMini-Track: Challenges to Network Automation Adoption
Mini-Track: Challenges to Network Automation AdoptionNetwork Automation Forum
 

More from Network Automation Forum (14)

Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveAutomating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive
 
Mini-Track: Observability
Mini-Track: ObservabilityMini-Track: Observability
Mini-Track: Observability
 
Network Source of Truth and Infrastructure as Code revisited
Network Source of Truth and Infrastructure as Code revisitedNetwork Source of Truth and Infrastructure as Code revisited
Network Source of Truth and Infrastructure as Code revisited
 
Zero to Automated in Under a Year
Zero to Automated in Under a YearZero to Automated in Under a Year
Zero to Automated in Under a Year
 
Mini-Track: Lessons from Public Cloud
Mini-Track: Lessons from Public CloudMini-Track: Lessons from Public Cloud
Mini-Track: Lessons from Public Cloud
 
Design Driven Network Assurance
Design Driven Network AssuranceDesign Driven Network Assurance
Design Driven Network Assurance
 
AutoCon 0 Day Two Keynote: Kireeti Kompella
AutoCon 0 Day Two Keynote: Kireeti KompellaAutoCon 0 Day Two Keynote: Kireeti Kompella
AutoCon 0 Day Two Keynote: Kireeti Kompella
 
Simplified Troubleshooting through API Scripting
Simplified Troubleshooting through API Scripting Simplified Troubleshooting through API Scripting
Simplified Troubleshooting through API Scripting
 
Applying Platform Engineering Principles to On-Premises Network Infrastructure
Applying Platform Engineering Principles to On-Premises Network InfrastructureApplying Platform Engineering Principles to On-Premises Network Infrastructure
Applying Platform Engineering Principles to On-Premises Network Infrastructure
 
Evolving the Network Automation Journey from Python to Platforms
Evolving the Network Automation Journey from Python to PlatformsEvolving the Network Automation Journey from Python to Platforms
Evolving the Network Automation Journey from Python to Platforms
 
A Real-World Approach to Intent-based Networking and Service Orchestration
A Real-World Approach to Intent-based Networking and Service OrchestrationA Real-World Approach to Intent-based Networking and Service Orchestration
A Real-World Approach to Intent-based Networking and Service Orchestration
 
Mini-Track: The State of Network Automation
Mini-Track: The State of Network Automation Mini-Track: The State of Network Automation
Mini-Track: The State of Network Automation
 
Mini-Track: Challenges to Network Automation Adoption
Mini-Track: Challenges to Network Automation AdoptionMini-Track: Challenges to Network Automation Adoption
Mini-Track: Challenges to Network Automation Adoption
 
AutoCon 0 Day One Keynote: John Willis
AutoCon 0 Day One Keynote: John WillisAutoCon 0 Day One Keynote: John Willis
AutoCon 0 Day One Keynote: John Willis
 

Recently uploaded

The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 

Recently uploaded (20)

The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 

Mini-Track: AI and ML in Network Operations Applications

  • 1. Your logo here Autonomous Intelligent Agents The next frontier in Network Automation Javier Antich - javier@anetta.ai VIDEO
  • 2. Network infrastructures are more complex than ever Qualified resources are more scarce than ever Network infrastructures are more mission critical than ever
  • 3. Knowledge softwarization Knowledge dependent on people Scarce, limited. user user API call + Knowledge compiled in software Broadly available at the distance of an API call Elastic, scalable, “unlimited” The LLMs are huge “knowledge compilators”
  • 4. The network softwarization journey Standarization of APIs Network Softwarization Pervasive Network Data Decision points Decision optimization Cloud LLM Knowledge softwarization Dynamic networks Autonomous agents Autonomous networks
  • 5. LLM-Powered Autonomous Agents From LLM Imperative / prescriptive Task execution: • Generate text • Summarize text • Translate text • Q&A • ... To Memory Function Planning Action Intent based / descriptive - Complex problem solver - Autonomous execution - Example: Anetta.ai LLM-powered Agent
  • 8. Network infrastructures are more complex than ever Qualified resources are more scarce than ever Network infrastructures are more mission critical than ever LLM- Powered Autonomous Agents
  • 9. Your logo here AI in Networking: where does it fit? Igor Giangrossi Sr. Dir, Consulting Engineering
  • 10.
  • 11. Typical use cases of AI/ML in Networking Reporting Thresholding Baselining Clustering Predicting Collect current and historical data for effective visualization and analysis Detect situations where customized indicators violate defined thresholds Learn the expected range of values for key resources Identify things that appear to be behaving differently than others Anticipate behavior that might happen in the future Passive Pro-active Active
  • 12. Centralized data collection and analysis AI/ML Actions Data
  • 13. Could we use AI/ML inside routers? Challenges: • What is the use case? • Processing resources (CPU, Memory, Disk)? • App development environment / SDK? • Data collection API? • Analysis only, or closed loop automation? • How to use the output? Opportunities: • All system state readily available • Real-time processing of events? • Smaller, custom-trained models?
  • 14. Demo: ChatGPT app in Nokia SR Linux Natural language as a CLI helper Hardware eXtensible Data Path (XDP) Infrastructure Standard Linux Kernel Pub/Sub via protobufs/gRPC Lightweight Impart Database (IDB) NetOps Development Kit (NDK) Applications BGP OSPF QoS … ACL ChatGPT App BFD ISIS MPLS Management YANG Models gNMI gNOI gRIBI OC gRPC CLI Question + context Answer LLM
  • 16. Your logo here The AIOps Maturity Model for networking Dave Siegel
  • 17. Agenda ● Definitions: Monitoring, Observability and AI Ops ● Maturity model overview ● Progression through the model ● Use Case: Tracfone
  • 18. Monitoring – Observability - AIOps Monitoring Observability AI Ops Aggregate MELT Gather MELT Root Cause Analysis Predictive Analytics Use Cases Benefits Prescriptive Analytics Self-healing Anomaly detection Support Audits Noise Reductio n Natural Language Interaction s
  • 19. Maturity Model Passive Ops Too much data – rely on customer- triggered incident Reactive and highly manual processes Silod Ops teams – poor collaboration Active Ops Silo’d observability tools Part Reactive, part proactive Silo’d Ops teams – some collaboration AIOps AI Augmented Operations Highly Proactive Strong Ops Team Collaboration NoOps Autonomous AI Supervised full automation Ops team re- skilled as developers
  • 20. Passive to Active Ops Graduation Criteria: ● Exec Sponsorship – budgets and business goal alignment ● Manual operations transitioned to tools-led ops landscape ● Architects, ops teas and developers focused on the discipline of observability Characteristics of Active Ops ● Proactive Alerting on serious issues, detecting hazcons, predicting unknown ‘unknowns’ ● Filtering noise in telemetry data ● Correlation of events across data types and sources – reduced alert fatigue ● Collected and analyzed data measures SLA and SLO compliance
  • 21. Active Ops to AI Ops Active Ops Graduation Criteria ● Adoption of enterprise AI discipline ● Refactored Ops processes to gear them towards an AI-based automation environment ● AIOps solutions are the central operations function in the enterprise ● AIOps solutions are linked seamlessly with existing Monitoring and Observability solutions Characterization of AI Ops ● Decision making is augmented by AI-based tools through descriptive and predictive analytics, as well as remediation recommendations ● Expert management of large data systems/modern data lakes/lakehouse ● Enhanced Root Cause Analysis, Anomaly & Outlier detection, and correlation of these machine interpreted incidents ● Prediction and forecasting inherent in the ML models ● Highly collaborative ops teams ● AI tools are trained/customized to the specific domain(s) they support
  • 22. Active to AI Ops Use Case: Tracfone Challenges ● Over a dozen monitoring tools ● Excellent Eng and Ops staff in their specific domain ● Cross-domain challenges resulted significant outage times The Implementation of Selector AIOps ● Ingested data from 18 different tools that monitored everything from the network all the way up to the application layer ● AI driven alert & event filtering, and correlation ● Graphical dashboards presenting a unified view and analytical insights Results ● Huge reduction in MTTR, especially in major incidents ● Improved overall uptime with proactive identification of potential incident causing issues