Your SlideShare is downloading. ×

Hadoop in Public Sector

1,990
views

Published on

Published in: Technology, Education

0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,990
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Industry specific cover imageHadoop in the Public SectorTom PlunkettJune 13, 2012
  • 2. Tom Plunkett• Big Data Technical Lead for Oracle Public Sector• Led a Team that won a MapReduce Research Project from the Office of the Secretary of Defense in 2009• Designed and taught a graduate level course on MapReduce for Virginia Tech’s Computer Science Department in 2010• Author of a book on Oracle’s Big Data Products (publication date in 2013) Copyright © 2012 Oracle. All rights reserved. 2
  • 3. Hadoop in the Public Sector• Obama Administration Big Data Initiative• U.S. Intelligence Agencies• U.S. Department of Defense• U.S. Civilian Departments and Agencies• Other governmental entities Copyright © 2012 Oracle. All rights reserved. 3
  • 4. Obama Administration’s Big Data Initiative• Office of Science and Technology Policy announced on March 29th, 2012 an additional $200 million per year in funding for Big Data Research• Department of Defense currently spending over $250 million a year on Big Data Research Copyright © 2012 Oracle. All rights reserved. 4
  • 5. Several Projects Received $25 Million aYear from the Obama Big Data Initiative• DARPA XDATA• NSF and NIH Core Techniques for Advancing Big Data Science and Engineering• NIH Thousand Genomes Project• Department of Energy Scalable Data Management, Analysis and Visualization Institute• US Geological Survey Big Data for Earth Science Copyright © 2012 Oracle. All rights reserved. 5
  • 6. DARPA XDATA• $25 million per year for four years for data processing and visualization research• Developed Software Code will be licensed under Apache or similar license• Proposals under the Broad Agency Announcement were due May 30• http://www.darpa.mil/NewsEvents/Releases/ 2012/03/29.aspx Copyright © 2012 Oracle. All rights reserved. 6
  • 7. NSF and NIH: Core Techniquesfor Advancing Big Data• $25 million available for funding research• Up to $1 million per year for five years for data processing or visualization research; proposals are due June 13 at 5pm• Up to $250k per year for three years for data processing or visualization research; proposals are due July 11 at 5pm• http://www.nsf.gov/news/news_summ.jsp?c ntn_id=123607 Copyright © 2012 Oracle. All rights reserved. 7
  • 8. NIH 1000 Genomes Project• 200 TB public dataset hosted on Amazon S3 for free• Dataset access is free, Researchers pay for AWS computational resources• http://www.nih.gov/n ews/health/mar2012/ nhgri-29.htm Copyright © 2012 Oracle. All rights reserved. 8
  • 9. Department of Energy Scalable DataManagement, Analysis and VisualizationInstitute• Received $25 million in funding for this year• The SciDAC (Scientific Discovery through Advanced Computing) Institute of Scalable Data Management, Analysis and Visualization is funded by the DOE Office of Science through the Office of Advanced Scientific Computing Research.• Research in Data Management, Data Analysis, Visualization, and Scientific Software Tools• http://sdav-scidac.org/ Copyright © 2012 Oracle. All rights reserved. 9
  • 10. US Geological Survey• The Powell Center of the US Geological Survey funds Big Data research for Earth System Science• The Powell Center provides annual research awards in the area of Earth System Science• Proposals for FY13 were due on April 30• http://powellcenter.usgs.gov/ Copyright © 2012 Oracle. All rights reserved. 10
  • 11. U.S. Intelligence Agencies• NSA publicly announced it was using Hadoop at a NDU conference on July 15, 2009• NSA donated Accumulo code in 2011 Copyright © 2012 Oracle. All rights reserved. 11
  • 12. U.S. Army Distributed Common Ground System (DCGS-A)• Can predict likely IED sites based on logistic routes and past attacks.• http://ctovision. com/2011/04/th e-cloud-and- physical- security/ Copyright © 2012 Oracle. All rights reserved. 12
  • 13. U.S. Naval Air V-22 Osprey• US Naval Air Condition Based Maintenance (CBM+) for the V-22 Osprey• http://www.acq.osd.mil/log/mpp/cbm+/Briefings/CBM+_and _CAMEO_Overview06Jul2011.pdf• Photo source: wikipedia Copyright © 2012 Oracle. All rights reserved. 13
  • 14. U.S. Civilian Departments and Agencies• Department of Homeland Security (DHS)• Department of Energy(DOE)• Department of Veteran Affairs• Health and Human Services (HHS)• Food and Drug Administration (FDA)• National Archives and Records Admin• NASA• National Institute of Health (NIH)• National Science Foundation (NSF)• http://www.whitehouse.gov/sites/default/files/microsi tes/ostp/big_data_fact_sheet_final.pdf Copyright © 2012 Oracle. All rights reserved. 14
  • 15. Other Governmental entities• State and Local governments are looking at Hadoop to solve problems involving Health, Public Safety, and Traffic• Foreign Governmental agencies are using Hadoop in similar ways to their U.S. counterparts (intelligence agencies, etc.)• Tennessee Valley Authority uses HDFS to store power utility information• Many additional examples Copyright © 2012 Oracle. All rights reserved. 15
  • 16. Questions?• Obama Administration’s Big Data Initiative• U.S. Intelligence Agencies• U.S. Department of Defense• U.S. Civilian Departments and Agencies• Other governmental entities Copyright © 2012 Oracle. All rights reserved. 16
  • 17. Oracle’s Big Data Platform Big Data Database / Business Data Warehouse Intelligence InfiniBand InfiniBand Real-Time Decisions Acquire Organize & Discover Analyze Decide Copyright © 2012 Oracle. All rights reserved.