A 100 gigabit highway for science: researchers take a 'test drive' on ani testbed


Published on

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

A 100 gigabit highway for science: researchers take a 'test drive' on ani testbed

  1. 1. TweetTweet 18 6 18 Share This: Apr. 30, 2012 — Climate researchers are producing some of the fastest growing datasets in science. Five years ago, the amount of information generated for the Nobel Prize-winning United Nations International Panel on Climate Change (IPCC) Fourth Assessment Report was 35 terabytes -- equivalent to the amount of text in 35 million books, occupying a bookshelf 248 miles (399 km) long. By 2014, when the next IPCC report is published, experts predict that 2 petabytes of data will have been generated for it -- that's a 580 percent increase in data production. Because thousands of researchers around the world contribute to the generation and analysis of this data, a reliable, high-speed network is needed to transport the torrent of information. Fortunately, the Department of Energy's (DOE) ESnet (Energy Sciences Network) has laid the foundation for such a network -- not just for climate research, but for all data-intensive science. "There is a data revolution occurring in science," says Greg Bell, acting director of ESnet, which is managed by Lawrence Berkeley National Laboratory. "Over the last decade, the amount of scientific data transferred over our network has increased at a rate of about 72 percent per year, and we see that trend potentially accelerating." In an effort to spur U.S. scientific competitiveness, as well as accelerate development and widespread deployment of 100-gigabit technology, the Advanced Networking Initiative (ANI) was created with $62 million in funding from the American Recovery and Reinvestment Act (ARRA) and implemented by ESnet. ANI was established to build a 100 Gbps national prototype network and a wide-area network testbed. To cost-effectively deploy ANI, ESnet partnered with Internet2 -- a consortium that provides high-performance network connections to universities across America -- which also received a stimulus grant from the Department of Commerce's Broadband Technologies Opportunities Program. Researchers Take a "Test Drive" on ANI So far more than 25 groups have taken advantage of ESnet's wide-area testbed, which is open to researchers from government agencies and private industry to test new, potentially disruptive technologies without interfering with production science network traffic. The testbed currently connects three unclassified DOE supercomputing facilities: the National Energy Research Scientific Computing Center (NERSC) in Oakland, Calif., the Argonne Leadership Computing Facility (ALCF) in Argonne, Ill., and the Oak Ridge Leadership Computing Facility (OLCF) in Oak Ridge, Tenn. "No other networking organization has a 100-gigabit network testbed that is available to researchers in this way," says Brian Tierney, who heads ESnet's Advanced Networking Technologies Group. "Our 100G testbed has been about 80 percent booked since it became available in January, which just goes to show that there are a lot of researchers hungry for a resource like this." Climate 100 To ensure that researchers will use future 100-gigabit effectively, another ARRA-funded project called Climate 100 brought Matter & Energy Telecommunications Consumer Electronics Earth & Climate Environmental Policy Climate Computers & Math Computers and Internet Information Technology Science & Society Privacy Issues Environmental Policies Articles Consensus of scientists regarding global warming Local area network Streaming media Scientific opinion on climate change Temperature record of the past 1000 years Blue Gene A warming climate will likely change the statistics of tropical cyclones and hurricanes. This image represents one frame from a simulation called "Hurricane Season" that was created to study how well NCAR's Community Atmospheric Model can reproduced observed tropical cyclone statistics. (Credit: Image by Prabhat and M. Wehner (LBNL)) Related Topics Related Stories New Approach to Support Future Climate Projections (Nov. 28, 2012) — Scientists have developed a new approach for evaluating past climate sensitivity data to help improve comparison with estimates of long-term climate projections developed by the Intergovernmental ... > read more Sea Levels Rising Faster Than IPCC Projections (Nov. 28, 2012) — Sea levels are rising 60 per cent faster than the Intergovernmental Panel on Climate Change's central projections, new research suggests. While A 100-Gigabit Highway for Science: Researchers Take a 'Test Drive' On ANI Testbed Facebook Twitter Google+ TweetTweet 27K 8.2k | 92.5K Breaking News Interested in ad-free access? If you'd like to read ScienceDaily without ads, let us know! Just In: Particle Accelerator in Earth's Radiation Belts more breaking science news Social Networks Follow ScienceDaily on Facebook, Twitter, and Google: Recommend ScienceDaily on Facebook, Twitter, and Google +1: Other social bookmarking and sharing tools: ... from NewsDaily.com New NASA telescope scours sun in 'grand opening' 'Future That Never Was' looked fantastic Experts: Gas in Gulf blowout is less damaging 'Blackfish' doc looks at SeaWorld's captive whales US advances plan to kill barred owls in Northwest Right at Home: Crisp geometrics shape decor Paleontologists discover dinosaur tail in northern Mexico Smaller, paler Earth unveiled in new NASA photo more science news In Other News ... Why was doomed Spanish train going so fast? Priest jailed in theft of Bolivian icon's jewels Brazil protests take toll on Rousseff's popularity, economy key U.S. does not plan fast decision on whether coup occurred in Egypt Obama, Vietnam leader agree on trade but clash on human rights Colombia admits rights violations in battle with leftists Prince Harry will be 'fun' Uncle Science News ... from universities, journals, and other research organizations Save Email Print Share Like 9 enlarge Tech Jobs on Dice.com www.Dice.com The Tech Jobs You Want Are Here. Browse Tech Jobs & Apply Online. $72.25 - Priceline Last minute deals. Book Now! Days Inn Pinole Berkeley Share Share Share Like 65k ShareShareShareShareShareShareShare News Articles Videos Images Books Health & Medicine Mind & Brain Plants & Animals Earth & Climate Space & Time Matter & Energy Computers & Math Fossils & Ruins A 100-gigabit highway for science: Researchers take a 'test drive... http://www.sciencedaily.com/releases/2012/04/120430152134.htm 1 of 3 7/25/13 4:25 PM
  2. 2. together middleware and network engineers to develop tools and techniques for moving unprecedentedly massive amounts of climate data. "Increasing network bandwidth is an important step toward tackling ever-growing scientific datasets, but it is not sufficient by itself; next-generation high-bandwidth networks need to be evaluated carefully from the applications perspective as well," says Mehmet Balman of Berkeley Lab's Scientific Data Management group, a member of the Climate 100 collaboration. According to Balman, climate simulation data consists of a mix of relatively small and large files with irregular file size distribution in each dataset. This requires advanced middleware tools to move data efficiently on long-distance high-bandwidth networks. "The ANI testbed essentially allowed us to 'test drive' on a 100-gigabit network to determine what kind of middleware tools we needed to build to transport climate data," says Balman. "Once the development was done, we used the testbed to optimize and tune." At the 2011 Supercomputing Conference in Seattle, Wash., the Climate 100 team used their tool and the ANI testbed to transport 35 terabytes of climate data from NERSC's data storage to compute nodes at ALCF and OLCF. "It took us approximately 30 minutes to move 35 terabytes of climate data over a wide-area 100 Gbps network. This is a great accomplishment," says Balman. "On a 10 Gbps network, it would have taken five hours to move this much data across the country." Space Exploration In 2024, the most powerful radio telescope ever constructed will go online. Comprising 3,000 satellite dishes spread over 250 acres, this instrument will generate more data in a single day than the entire Internet carries today. Optical fibers will connect each of these 15-meter-wide (50 ft.) satellite dishes to a central high performance computing system, which will combine all of the signals to create a detailed "big picture." "Given the immense sensor payload, optical fiber interconnects are critical both at the central site and from remote stations to a single correlation facility," says William Ivancic, a senior research engineer at NASA's Glenn Research Center. "Future radio astronomy networks need to incorporate next generation network technologies like 100 Gbps long-range Ethernet links, or better, into their designs." In anticipation of these future networks, Ivancic and his colleagues are utilizing a popular high-speed transfer protocol, called Saratoga, to effectively carry data over 100-gigabit long-range Ethernet links. But because it was cost-prohibitive to upgrade their local network with 100-gigabit hardware, the team could not determine how their software would perform in a real-world scenario -- that is, until they got access to the ANI testbed. "Quite frankly, we would not be doing these speed tests without the ANI testbed," says David Stewart, an engineer at Verizon Federal Systems and Ivancic's colleague. "We are currently in the development and debugging phase, and have several implementations of our code. With the ANI testbed, we were able to optimize and scale our basic PERL implementation to far higher speeds than our NASA testbed." End-to-End Delivery Meanwhile, Dantong Yu, who leads the Computer Science Group at Brookhaven National Laboratory, used the ANI testbed to design an ultra-high-speed, end-to-end file transfer protocol tool to move science data at 100 gigabits per second across a national network. "A network like ANI may be able to move data at 100 Gbps, but at each end of that connection there is a host server that either uploads or downloads data from the network," says Yu. "While the host servers may be capable of feeding data into the network and downloading it at 100 Gbps, the current software running on these systems is a bottleneck." According to Yu, the bottlenecks are primarily caused by the number of times the current software forces the computer to make copies of the data before uploading it to the network. "Initially I was testing this protocol at a very local lab level. In this scenario transfers happen in a split-second, which is far from reality," says Yu. "ANI allowed me to see how long it really takes to move data across the country, from East-to West Coast, with temperature rises appear to be consistent with the ... > read more Scientific Expertise Lacking Among 'Doubters' of Climate Change, Says New Analysis (June 27, 2010) — An analysis of the scientific prominence and expertise of climate researchers shows that the few who are unconvinced of human-caused climate change rank far below researchers who are convinced. Most ... > read more Climate Debate: What's Warming Us Up? Human Activity or Mother Nature? (Dec. 21, 2009) — A major analysis of the climate debate concludes that the majority of scientists agree that global warming is primarily man-made, although a vocal minority of skeptics is holding onto the idea that ... > read more Climate Change Likely To Be More Devastating Than Experts Predicted, Warns Top IPCC Scientist (Feb. 15, 2009) — Without decisive action, global warming is likely to accelerate at a much faster pace and cause more environmental damage than predicted, says Stanford scientist Chris Field, a leading member of the ... > read more Strange Science News Putin hosts world's Orthodox leaders at unique gathering more top news Science Video News Quake Network In the Global Seismographic Network, 138 networked stations can pick up quake movement and send instant information to computers around the world.. ... > full story Climatologists Forecast Completely New Climates Meteorologists See Future of Increasingly Extreme Weather Events Engineers Create Exhibits on Achievements, Promise more science videos Behavior of Turbulent Flow of Superfluids Is Opposite That of Ordinary Fluids Centaurs: NASA's WISE Finds Mysterious Centaurs May Be Comets Neuroscientists Plant False Memories in Mice: Location Where Brain Stores Memory Traces, Both False and Authentic, Pinpointed Silky Brain Implants May Help Stop Spread of The new Nexus 7 www.google.com/nexus The world's highest-resolution 7" tablet from Google. Learn more. Medical Billing Software www.Kareo.com Demo our Medical Billing Software No Contracts; No Set Up Fees! Emphysema vs COPD? symptomfind.com/Emphysema What's the Difference Between COPD and Emphysema? Get the Facts Here. A 100-gigabit highway for science: Researchers take a 'test drive... http://www.sciencedaily.com/releases/2012/04/120430152134.htm 2 of 3 7/25/13 4:25 PM
  3. 3. TweetTweet 18 6 | 18 APA MLA my software, which in turn helped me optimize the code." The Next Steps Within the next few months, the official ANI project will be coming to an end, but the community will continue to benefit for decades to come from its investments. The 100-gigabit prototype network will be converted into ESnet's fifth-generation production infrastructure, one that will be scale to 44 times its current. ESnet will also seek new sources of funding for the 100-gigabit testbed to ensure that it will be available to network researchers on a sustained basis. "Since its inception, ESnet has delivered the advanced capabilities required by DOE science. Many of these capabilities are cost-prohibitive, or simply unavailable, on the commercial market," says Bell. "Because our network is optimized for the needs of DOE science, we're always looking for efficient ways to manage our large science flows. ESnet's new 100-Gigabit network will allow us to do that more flexibly and morecost- effectively than ever." Share this story on Facebook, Twitter, and Google: Other social bookmarking and sharing tools: Story Source: The above story is based on materials provided by DOE/Lawrence Berkeley National Laboratory. Note: Materials may be edited for content and length. For further information, please contact the source cited above. Need to cite this story in your essay, paper, or report? Use one of the following formats: DOE/Lawrence Berkeley National Laboratory (2012, April 30). A 100-gigabit highway for science: Researchers take a 'test drive' on ANI testbed. ScienceDaily. Retrieved July 25, 2013, from http://www.sciencedaily.com/releases /2012/04/120430152134.htm Note: If no author is given, the source is cited instead. Search ScienceDaily Find with keyword(s): Search TweetTweet 18 6 | 92.5K Number of stories in archives: 140,301 Enter a keyword or phrase to search ScienceDaily's archives for related news topics, the latest news stories, reference articles, science videos, images, and books. Recommend ScienceDaily on Facebook, Twitter, and Google: Other social bookmarking and sharing services: Free Subscriptions Feedback Save Email Print Share Epilepsy Simulated Hibernation Aids Toad Work more strange science news ... from ScienceDaily Get the latest science news with our free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader: Email Newsletters RSS Newsfeeds ... we want to hear from you! Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions? Leave Feedback About ScienceDaily® | Editorial Staff | Awards & Reviews | Contribute News | Advertise With Us | Contact Us | Privacy Policy | Terms of Use Copyright 2013 by ScienceDaily, LLC or by third-party sources, where indicated. All rights controlled by their respective owners. Content on this website is for informational purposes only. It is not intended to provide medical or other professional advice. Views expressed on this website do not necessarily reflect those of ScienceDaily, its staff, or its partners. Like 9 Like 9 A 100-gigabit highway for science: Researchers take a 'test drive... http://www.sciencedaily.com/releases/2012/04/120430152134.htm 3 of 3 7/25/13 4:25 PM