AI - should we embrace a fresh approach or continue with the traditional one? AI products and solutions have gained immense significance in enabling businesses to stay competitive. However, deploying and operating AI products within an organization's perimeter bring new challenges in terms of data security and reliability. To mitigate risks such as data leakage, finops, ethical alignment, and processes to ensure reliability it is crucial to adopt new approaches. In this context, let's explore the emerging challenges and SRE practices specifically tailored for AI.

2. AGENDA:
● Inspiration
● Some Numbers
● AI Current State
● AIRe Challenges
● AI Observability

3. 3
@DenysVasyliev
denys-vasyliev
deadopsclub
den-vasyliev
@VasylievDenys

4. It’s time to talk about Reliability Engineering for AI - AIRe
INSPIRATION

5. The statistics show that AI is not just a fleeting trend, but a significant
technological advancement that will reshape industries globally.
NUMBERS

6. NUMBERS
https://drive.google.com/file/d/1gQhYT7j6b2wJmrFZHNeQgTiWPyTsjOfX/view

7. NUMBERS
https://drive.google.com/file/d/1gQhYT7j6b2wJmrFZHNeQgTiWPyTsjOfX/view

8. ChatGPT reached 100 million users just two months after
launching, making it the fastest-growing consumer internet app
ever. With rate about 590 million visits from 100 million unique
visitors per month. Similarweb
Auto-GPT
CURRENT STATE

9. CHALLENGES
Mojo
Agents
LLM
Transformers
LangChain
FinOps
SecOps
MlOps
API-Integrations
Reliability
Observability
AI Runtime
Performance
Build / Buy / Open Source
Deployment and Scaling
Latency and Performance
Cost and Resource Management
Legal and Data Protection
Security and Data Poisoning
Application:
- Workload
- Deployment strategy
- Size and Resources
Infrastructure:
- Hardware
- Networking
- Storage
Observability:
- Metrics
- Storage
- Recovery
Security:
- Data Protection
- Data Poisoning
Performance:
- Monitoring
- Tuning
- Optimisation

10. https://colab.research.google.com/gist/den-vasyliev/ef87f1514c5da4ba63e03fcfa24a3d6f/langchain_agent_tracing_tutorial.ipynb
DEMO