This document discusses the importance of network visibility for efficient OpenStack operations. It outlines how Cisco collects data from OpenStack including network flows, logs, and metrics. This data is analyzed and visualized in AVOS to provide insights such as how workloads are performing, hotspots in the cloud, and virtual and physical status. Anomalies can be detected by classifying system states and analyzing patterns over multiple metrics. Future plans include incorporating more data sources and network distance metrics for more integrated analytics and data-driven diagnostics.

1. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential
Cisco
Confidential© 2013 Cisco and/or its affiliates. All rights reserved.
Network Visibility
For Efficient OpenStack Operations

2. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
ConfidentialCisco ConfidentialCisco Confidential© 2013 Cisco and/or its affiliates. All rights reserved.
Cloud/Big-data Winnovation Team
Alex Holden Damian Van VuurenAiling Zhang
Marc Solanas Matt Weeks Pengfei Zhang
Kai Zhang
Xinyuan Huang
Debo Dutta
Yathiraj Udupi

3. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential
Today...

4. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
ConfidentialCisco ConfidentialCisco Confidential© 2013 Cisco and/or its affiliates. All rights reserved.

5. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential
Outline
• Data Gathering
• Network Visibility
• Network Analysis
• Conclusion

6. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential
Virtual status
Performance
Why is my job slow?
Operators
Physical status
Hotspots
What are they doing in my cloud?
Users

7. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential

8. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential
Network flows
New ceilometer agent
Collects and aggregates data from Neutron
VM-VM flow traffic insight

9. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential
Application logs
OpenStack Logs
Server Syslogs
VM Syslogs
Application (Hadoop, etc) Logs
...

10. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential
AVOS:
Analytics and
Visualization on
OpenStack Demo

11. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential
Cisco
Confidential© 2013 Cisco and/or its affiliates. All rights reserved.
Data Insights

12. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential
Data insights - What is going on in a Hadoop cluster?
Networkflows(bit/s)
Outgoing network flows from VMs
Time (s) Time (s)
Incoming network flows to VMs
Networkflows(bit/s)

13. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential
Data insights - What is going on in a Hadoop cluster?
Time (s)
Networkflows(bit/s)
Outgoing network flows
master <-> slave

14. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential
Data insights - What is going on in a Hadoop cluster?
Time (s)
Networkflows(bit/s)
Outgoing network flows
slave <-> slave

15. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential
Data insights - How to troubleshoot?
Normal Server down

16. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential
Data insights - How to troubleshoot?
INFO org.apache.hadoop.hdfs.DFSClient: Exception in
createBlockOutputStream …
java.io.IOException: Bad connect ack with firstBadLink
as 192.168.0.7:…
INFO org.apache.hadoop.hdfs.DFSClient: Abandoning
blk_…
INFO org.apache.hadoop.hdfs.DFSClient: Excluding
datanode 192.168.0.7:…
WARNING nova.compute.manager … [instance:
6a475088-...] Instance shutdown by itself. Calling the
stop API." …

17. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential
● Collect Multiple Metrics
● Analyze Patterns
● Classify System States
Data insights - How to detect anomalies?

18. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential
Future Plans
Network Distance
Data-driven Diagnostics
More data sources & integrated analysis

19. © 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential
Thank you.
Please take our survey:
http://goo.gl/CMAZje
Coming Talk: Storage Visibility and Optimization for OpenStack:
Wednesday, May 14 • 3:30pm - 4:10pm