The document summarizes a presentation about measuring and monitoring network performance in school districts across Georgia. It discusses how the Georgia Measurement and Monitoring (GAMMON) project collects quantitative data on network usage and application performance. This data helps identify bandwidth limitations that impact education technology use in classrooms. GAMMON also analyzes how districts' network capacities align with their technology plans and provides recommendations on improving performance.
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
GAMMON at GAETC
1. What Everyone Needs to Know About Network Performance
Warren Matthews, PhD
Research Scientist II
Office of Information Technology
warren.matthews@oit.gatech.edu
Lisa Flynn, EdS
Chemistry and Technology Integration
Osborne High School, Cobb County Schools
lisa.flynn@cobbk12.org
1
2. Abstract
• We will present quantitative data of network
performance from school districts around
Georgia, and describe the limitations it sets
for the performance of education applications
in the classroom. The measurements will also
be put in perspective by examining the
districts own technology plan. The session is
suitable for both IT support staff and teachers
interested in the use of technology to enhance
their classes.
2
4. What Everyone Needs to Know About Network Performance.
PART 1: WHAT AND WHY?
4
5. What is GAMMON?
• The Georgia Measurement and Monitoring
(GAMMON) project gathers quantitative
data about network and application
performance.
– Troubleshooting, Planning
(analytics, business
intelligence), Security, Inventory.
– Provide the quantitative evidence to back-up
qualitative experiences.
• Since 2006, revitalized in 2011.
If you don’t measure, you don’t
know. (Kevin Walsh, UCSD)
Measure, measure, measure.
(Rico Mariani, Microsoft)
5
6. Active Measurements
Active measurements inject additional
traffic onto the network to determine endto-end performance across the Internet.
GAMMON
Server
GAMMON
Server
Internet
GAMMON
Server
GAMMON servers are placed at
the edge of the school district
network, making tests and
measuring performance across the
Internet between each other.
6
8. Why?
• Network demand in the classroom has
quadrupled over the last five years.
• In a 2010 Federal Communications
Commissions survey of E-rate connected
schools, nearly 80% of respondents
reported that they had inadequate
bandwidth to meet educational needs.
8
11. Direct-To-Discovery
GT Professor Lisa
Yaszek leading a
book discussion
between GT class
and middle school
kids in Barrow
County.
GT Professor Jim
Sowell leading an
astronomy lesson
with classroom in
Australia.
11
12. Application Performance
Not interactive
Highly interactive
HD video conferencing
Gaming Telephone call
Web surfing
Email
• High bandwidth
• Low latency
• Low jitter
• Low bandwidth
• Latency and
jitter are almost
unimportant
When you’ve
got to get to the
Airport.
When you’re
out for a Sunday
Drive.
12
13. Motivation (1/2).
• Is it feasible to expect schools to do more
and more online?
– Governor’s Digital Education Task Force.
• “I learned with paper and pencil. Today’s
students learn with light” (Anonymous).
– But many school districts in Georgia
experience slow downloads, choppy audio and
video. Access points are maxed out. Online
resources too have downtime.
13
14. Motivation (2/2).
• Teachers are expected to teach bell-tobell, but they can’t if they’re waiting for the
technology. Many report that this is the
rule, not the exception.
– Our assumption is this disrupts online
learning.
• Not surprisingly, districts want to know
what is going on in their network.
– but report that they are blind, or partially
blind.
14
15. Why develop more tools?
• Varying levels of hardware and software to
monitor traffic.
• Do not reinvent the wheel, but
– Common platform to compare results.
– Cost of GAMMON vs numerous commercial
tools.
– Extra pair of eyes.
– Share the philosophy of research.
15
16. What Everyone Needs to Know About Network Performance.
PART 2: HISTORY AND
BACKGROUND
16
17. Can we be Friends?
• Similarities with the research community
– Bandwidth is required but not sufficient.
– Development of Research networks (15-20
years ago)
• Research and education are birds of a
feather.
17
19. Capacity
• Is it enough?
– Now?
– Next month?
– Next Year?
– How do you know?
• What do the school
districts plan to do
with online
learning?
19
20. Current Deployment.
Currently there are 18 GAMMON
servers deployed around Georgia.
Each server measures the one-way
delay and route to all the others.
Data is being gathered but analysis and
interpretation is required.
The current servers are mostly reused
machines from older projects.
GAMMON itself grew out of CPR, an oncampus measurement project.
20
21. Problem.
Round Trip Time
This graph show the round trip time (in milliseconds) between the clean room
at Georgia Tech and a school district central office . We look “under the hood”
and see what causes the slow downloads, choppy audio and video. Think about
the time it takes to drive through Atlanta at different times of the day.
Day of the month
In the evenings and weekends, delay is
5 milliseconds, just like driving on I-85.
Severely congested connections
mean long delays, just like driving on
I-85.
21
22. Round Trip Time
Solution.
2.4 milliseconds
2.2 milliseconds
Day of the month
This graph show the delay (in milliseconds) between the clean room at
Georgia Tech and a school district central office .
Compare to the problem graph –
good connectivity is like your own
private Peach Pass.
22
23. Example of an Upgrade.
Barrow County School System upgraded from 20 Mbps to 150 Mbps.
Immediately see usage 23x previous capacity.
More capacity means less congestion. Less Congestion enables interactive applications.
Interactive Applications enhance learning, especially when combined with the right
teacher and the right opportunities.
23
24. Putnam County Schools
"GAMMON greatly helped me sell the need for bandwidth
to my school board.”
-Keith Ellenberg, Chief Operating Officer,
Putnam County Charter School System
300
250
200
Capacity (Mbps)
150
100
50
0
2007
2008
2009
2010
2011
2012
24
25. What Everyone Needs to Know About Network Performance.
PART 3: MEASUREMENTS
25
27. Achievable Bandwidth Per
Student
• The only good
network is one that
is not a bottleneck.
• Measurements will
be put into context.
Preliminary
Another view is under development.
27
35. Pythia
• Pythia uses GAMMON measurements to
detect and diagnose network problems.
35
36. More Tools
• Work in Progress
• Verify Content Filters
• More External measurement
– PAM tools
• More Internal measurements
• More netflow analytics
– SYN Flood
• Routing (especially multi-homed).
36
38. What Everyone Needs to Know About Network Performance.
PART 4: WHAT DOES IT
ALL MEAN?
38
39. Summary
• GAMMON quantified network performance
– Provides decision makers with data based
information to improve network performance
– improves network utilization in the classroom
decreasing loss of valuable educational time
• Limitations are identified using the data
which are impeding the performance of
educational applications and media in the
classroom.
• Work in Progress
– Catch up at GAMEIS or GAETC next year.
40. Conclusions and Recommendations
• Even with a small sample, variation in
performance and philosophy is huge.
• Many districts suffer congestion.
– No surprises but graphs to prove it.
– We assume this impacts learning.
• How much is enough?
– External bottlenecks -> internal bottlenecks.
40
41. This year (2013-2014)
• More measurements, More analysis
– Readiness Index
– District’s Technology Plans
• Summer 2014
– Performance workshop and GAMMON training.
– Secure K-12 workshop
• We hope to have funding to increase
deployment next year
– What if you can’t wait?
41
42. How to get involved
• Let us know you’re interested.
• Join the monthly conference call.
• Install your own server
– We can provide specs
– Install software, Provide access for us to analyze.
• Create account on website.
– Allow us to share information amongst the
community.
42
43. Contact Us.
• For more information, please contact
Warren Matthews
– warren.matthews@oit.gatech.edu
– 678-992-9185
43
44. Thanks
• Bill Price and GTA
• Bob Swiggum, Rep. Mike
Dudgeon, Joseph Barrow.
• Annette, Gino, Leon, Suren
44
45. Thanks
• And especially all the sites that host
servers, and the people that got them there.
– John St.Clair, Morad El-Jourbagy, Jeremy
Caswell, Terry Treadgill, Phil Kline, Keith
Ellenberg, Sam Ganas, Carol Helton, Jodi
Perdue, William Sperin, Chris Usrey, John
Call, Jefferey Harrel, Twanda Banks, Charlie
Coleman, Aubrey Jones, David Smith, Taylor
Duke, Tim Maynard.
45