Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

What's Next with Government Big Data

1,007 views

Published on

Big Data continues to be a hot topic in government. Now it's time to take the discussion to the next level. Most agencies understand Big Data and are collecting large amounts of data, but the challenge of how to manage it still remains.

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

What's Next with Government Big Data

  1. 1. Government Big Data:What’s NextMarch 21, 2013Brought to you by:
  2. 2. Today’s SpeakersSteve ResslerFounder and PresidentGovLoopMarina MartinEntrepreneur-in-Residence & Head of the Education Data InitiativeU.S. Department of EducationGary NewgaardDirector of Federal SolutionsEMC IsilonShawn KingsberryCIORecovery Accountability and Transparency Board
  3. 3. Housekeepingo Twitter Hash Tag: #gltraino If you would like to submit a question, just look for the "Ask aquestion" console. The presenters will field your questions at theend.o If you have any technical difficulties during the training click on theHelp button located below the slide window.o We will be e-mailing you a link to the archived version of thistraining, so you can view it again or share it with a colleague, anda GovLoop training certificate.
  4. 4. February 22, 2013On Premises or Hosted ServicePublic Transparency WebsiteFraud Analytics as a ServiceBig Data as a ServiceRATB Cloud ServicesHigh Level Technical Briefing
  5. 5. RATBCLOUDSERVICERATBCLOUDSERVICELOGICALARCHITECTURELOGICALARCHITECTURE
  6. 6. RATB Logical System DiagramLogical RATB System Design Capabilities• Public and Private Cloud providing separateand distinct websites running off of acommon software, system, and datawarehouse infrastructure• Elasticity to support millions of concurrentusers• Content and Design team to support layoutand design requirements• Secured access to sensitive data providingvirtual desktop as a service.• Data automation providing scheduledretrieval of required data sets.• Risk framework providing streamlinedmatching against risk databases.• Link analysis systems and highly skilledanalysts.• Partners with key industry companiesproviding rapid development levelintegration services.
  7. 7. RATB High Level Technologies19Social MediaWeb InfrastructureVisualization, Analysis,and ReportingData LayerInfrastructureDisclaimer of Endorsement:Reference herein to any specific commercial products, process, or service by trade name, trademark, manufacturer, or otherwise, does not necessarily constitute or imply its endorsement, recommendation, or favoring by the United StatesGovernment. The views and opinions of authors expressed herein do not necessarily state or reflect those of the United States Government, and shall not be used for advertising or product endorsement purposes.Note: There are extensive products in this “infrastructure layer” These are the key components.A more comprehensive list can be made available by request.
  8. 8. Recovery Accountability and Transparency BoardEnterprise Architecture of the Future20
  9. 9. Data Governance21
  10. 10. Advanced Analytics CloudWhat is FederalAccountability.gov• The portal allows Federal agencies andInspectors General the ability to reviewand evaluate the risk assessment ofentities, companies, and universitiesreceiving Federal Funds.22HIGHLIGHTS• Deployed Security: FIPS 140-2• Infrastructure: Secured Private CloudU.S. Department of Defense U.S. Environmental Protection Agency, OIGU.S. Department of Education, OIG U.S. Department of Justice, OIG / CivilDivisionU.S. Department of Homeland Security,OIGU.S. ArmyNational Science Foundation, OIG U.S. Social Security Administration, OIGU.S. Department of Agriculture U.S. Census BureauCorporation for National andCommunity Service OIGU.S. Department of Commerce, OIGU.S. Department of the Interior U.S. Department of LaborU.S. Department of Health and HumanServicesU.S. Department Housing and UrbanDevelopment, OIGExecutive Office for the US States andAttorneyRATB Cloud Service Customers
  11. 11. Advanced Analytics CloudDesktop and Analytics As A Service23Structured and Unstructured Data ETLuRevealESRIARC GISServerOracleENDECAFastAlertAnalysts, InvestigatorsPalantirAccountabilityScorecarduRevealESRIArcGISServerENDECASTOREFastAlertSQLServer2008PalantirPersistenceEngineScoreCardSQLServer2008HANA In-MemoryComputingSingle Sign-On Identity and Access ManagementSecurity Layer (Netwitness, Archer, Juniper SSL VPN…)VMWareViewVDIStakeholders Request ForAssistance
  12. 12. Cloud Hub CategorizationPEOPLE PROCESS TECHNOLOGYMODULARLAYERSSINGLEPANEOFGLASSNote: The specific details behind the RATB Cloud Hub Categorization can be provided by request.
  13. 13. RATB Cloud Service WebsitesRecovery.gov
  14. 14. RATB Cloud Service WebsitesEducationjobsfund.gov
  15. 15. RATB Cloud Service WebsitesFederaltransparency.gov
  16. 16. RATB Cloud Service WebsitesFederalaccountability.gov
  17. 17. March 19, 2013On Premises or Hosted ServiceShawn Kingsberry, Chief Information Officershawn.kingsberry@ratb.gov
  18. 18. 30© Copyright 2012 EMC Corporation. All rights reserved.EMC ISILONSCALE-OUT NASBig Data Storagefor the Federal SectorGary NewgaardDirector - EMC IsilonFederal
  19. 19. 31© Copyright 2012 EMC Corporation. All rights reserved.Isilon TechnologySummaryBig Data Overview
  20. 20. 32© Copyright 2012 EMC Corporation. All rights reserved.What Is Big Data?Data that challenges the capabilities of a system to capture,manage, and process it within an acceptable elapsed time~ Wikipedia ~Data that challenges the capabilities of a system to capture,manage, and process it within an acceptable elapsed time~ Wikipedia ~
  21. 21. 33© Copyright 2012 EMC Corporation. All rights reserved.ExabytesThe Big Data ChallengeBy 2013, 80% of all storage capacity sold will be for file-based dataSource: “Scale Out Storage in the Content Driven Enterprise: Unleashing the Value of Information Assets,” IDC White Paper (2010 Enterprise Disk Storage Consumption Model), June 2011File based: 61.8% CAGR Block based: 23.7% CAGRMedia &EntertainmentMedia &EntertainmentDesign &SimulationDesign &SimulationFinancialServicesFinancialServicesBioinformaticsBioinformatics Oil & GasOil & GasFile Shares &ArchivesFile Shares &Archives
  22. 22. 34© Copyright 2012 EMC Corporation. All rights reserved.Data growth47%CIOs Turning to Scale-Out to Deal withMassive File-Data Growth84%Already usingor planning touse scale-out withinthe next 24 monthsThe#1 and#2concerns of CIOs…Source: Scale-out NAS Market SurveySystem performanceand scalability37%…are driving adoptionof scale-outSource: “User Survey Analysis: Key Trends Shaping the Future ofData Center Infrastructure Through 2011,” Gartner, October 2010
  23. 23. 35© Copyright 2012 EMC Corporation. All rights reserved.Big Data Apps Need Big Data StorageData intensive, HPC workflowsMedical Imaging Gene Sequencing Seismic ExplorationMedia & Entertainment Product DevelopmentSatellite Images
  24. 24. 36© Copyright 2012 EMC Corporation. All rights reserved.Big Data Project in the Federal Sector**Sorce: GovWin IQ Report 2012
  25. 25. 37© Copyright 2012 EMC Corporation. All rights reserved.Examples of Federal Sector Big Data• Healthcare• Life Sciences• Surveillance• Physical Security• Defense/Intelligence• Cyber
  26. 26. 38© Copyright 2012 EMC Corporation. All rights reserved.Sample of Government Accounts UsingIsilon’s Unified Scale-out Storage…and Why?Unlocks New CapabilitiesIncreases IT operating leverageComplementaryReduces storage costsSpeeds workflows
  27. 27. 39© Copyright 2012 EMC Corporation. All rights reserved.EMC Isilon Growing MomentumHealthcare and Life SciencesUCLA
  28. 28. 40© Copyright 2012 EMC Corporation. All rights reserved.The EMC Isilon DifferenceEMC Isilon Value Proposition for Healthcare– Eliminate silos of storage– Predictable scalability without added complexity– Consolidate active short-term and long-term dataCertification with Major Alliance Players– EMC Isilon certified with most major PACS vendors– EMC Isilon certified with most VNAs– New certifications are simpleEMC Isilon works with next wave diagnostic tools– Digital Pathology, NGS, Proteomics– Video Surveillance, Sleep Studies, Electron MicroscopesEMC Isilon Competitive Difference– “Never Migrate Again” architecture– Move away from API-built storage– Uses standard CIFS and NFS storage protocol connections– Experience the value of scale-out NAS
  29. 29. 41© Copyright 2012 EMC Corporation. All rights reserved.“Never Refresh Again” ArchitectureMeet Your Big DataRequirements with EMC Isilon• One File System, One Volume StorageManagement Simplicity• Zero Downtime Expansion• Greater than 80% utilization rates• Adapt your existing storage resources• Accommodate IT infrastructure changes• Investment Protection: Pay As You Grow• Eliminate Silos and Hot Spots
  30. 30. 42© Copyright 2012 EMC Corporation. All rights reserved.The Cost Advantage of IsilonEase of use and management simplicityIDC: Isilon improves IT productivity by 48%, reduces OPEX*Storage allocationStorage provisioningManaging capacityManaging backupSpace reclamationAdding new applicationsUploading of re-loading data0.0 0.5 1.0 1.5 2.0FTEHoursperTBinUseIsilon Traditional* Source: “Quantifying the Business Benefits of Scale-Out NAS Solutions,” IDC White Paper, November 2011
  31. 31. 43© Copyright 2012 EMC Corporation. All rights reserved.Reduces Big Data storage costs by 40%The Cost Advantage of IsilonSource: “Quantifying the Business Benefits of Scale-Out NAS Solutions,” IDC White Paper, November 2011
  32. 32. 44© Copyright 2012 EMC Corporation. All rights reserved.Isilon Scale-Out NAS ArchitectureOneFS OperatingEnvironmentOneFS OperatingEnvironmentIntra-clusterCommunication LayerIntra-clusterCommunication LayerServersClient/Application LayerClient/Application Layer Ethernet LayerEthernet LayerServersServersCIFSCIFSNFSNFSFTPFTPHTTPHTTPHDFSforHadoopHDFSforHadoop
  33. 33. 45© Copyright 2012 EMC Corporation. All rights reserved.More scalable than traditional storage systemsLargest and Most Scalable File SystemOneFS scales from 18 TB to more than 20 PB in a singlefile system, single volumeUnder 60 seconds toscale with no downtimeWorld’s fastestperformance andcapacity scalingOver 100 GB/s ofthroughput
  34. 34. 46© Copyright 2012 EMC Corporation. All rights reserved.Markets and SolutionsEMCIsilon Federal MarketsHome Directories & Archive
  35. 35. Questions?

×