How Big Data is Transforming the Data Center

  • 183 views
Uploaded on

From storing and managing to access and analysis—big data requires an integrated approach. And if anything goes wrong, it's your name in that boardroom. …

From storing and managing to access and analysis—big data requires an integrated approach. And if anything goes wrong, it's your name in that boardroom.

Listen to subject matter expert Tom Huntington as he discusses these key issues:
• IBM's recommendations for big data management
• How new technologies (PowerHA, VTL, SAN & Live Partition Mobility) can help
• Integration into live environments
• Monitoring storage growth and building database reports
• How to keep automation alive and useful

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
183
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
0
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • Everyone in the room must get a business card and one problem that someone else is faced with in managing there Data Center/IT Environment? We will share a few of them and then put in a hat the business cards to draw a winner of gift card.
  • Mostly for hardware maintenance
  • Ok a show of hands, is anyone connecting a san to power servers running ibm i?WHAT is SAN? What are the BENEFITS?WHO should you turn to? What to AVOID?
  • Is it up?Does it have enough disk space?Are the Daemons up?Monitor SNMP eventsRobot/TRAPPER converts to OS/400 Message
  • Remember this is a movement of a live partition to another serial number
  • Think of Big DataYou still need to keep on top of purgingIFS area is becoming a cluttered closetDefine enough armsTransaction based systems need to spread the i/oTake advantage of the offline redundancies
  • The increase in IFS StorageAre your old disk utilities helping or hurting you?Is anyone actively purging data?
  • Don’t forget about AUTOMATION and MONITORING to help manage Traditional technologies like tape will play LESS OF A ROLE in our data centerNETWORK with your peers and suppliers Learn from their experiences
  • Help/Systems develops, markets, and supports the world’s leading software solutions for Power Systems running IBM i, automating and job scheduling software for Windows, UNIX, and Linux. The Help/Systems family of companies includes Robot system management automation; Skybot Software for Windows, UNIX, and Linux; PowerTech security and compliance solutions; SEQUEL Software business intelligence and developer tools.
  • Security  is front and center on virtually every corporation’s radar; or should be.  Growing regulatory compliance  requirements have come as the result of increased risk from numerous factors.  The IBM i platform  has been neglected for many years due to misconceptions and a general lack of awareness of how  to properly secure  it.  PowerTech solutions have been  designed specifically for IBM i, and are  the result of almost two  decades of experience as a market and thought leader. As the provider of a  comprehensive suite of security modules, PowerTech can assist with the  challenge of detecting, auditing, and controlling server access.  Designed to extended and enhance IBM’s  own security controls, PowerTech security solutions can be installed  individually or as a complete set.   Capabilities added by installing PowerTech solutions include a powerful  perimeter firewall, database change monitoring, and a highly scalable audit  environment. Tom H. Depending on the audience I talk to each product.
  • Is your team still using OS/400 Query? How much? Did you know SEQUEL can help you with performance in this area? Did you know it can improve the productivity of the end user too.Ourbusiness intelligence solutions consists of: SEQUEL ViewPoint and the SEQUEL Web Interface. SEQUEL is a powerful data retrieval tool. It allows you to put the power to see the data into the hands of the user who needs it, when they need it.With SEQUEL View Point you can build dashboards with data from multiple sources, allowing executives to see data from a high organizational level. And still allow them to drill down into more detailed data. Or the data can jump in at a departmental level for managers to analyze.• Users can access their REAL-TIME data easily. Views of the data can be ad hoc or regularly accessed across an organization. This makes sharing of the data fast, easy and accurate.• Graphs can be created to enhance the visual aspects of the data for analysis.• Client Reports can show data with totals, lines, logos to make the data more presentable. Sequel Web Interface allows users to see the data, in a variety of formats, from a browser.• End-users can use a our Sequel Web Interface tool to see the previously designed views, reports, tables and dashboards using their browser. • The easy to use designer, as well as the power users building their own views over the data, will free the IT staff to address more pressing corporate technology issues.

Transcript

  • 1. © 2013 Help/Systems, LLC. All trademarks and registered trademarks are the property of their respective owners9WHY IS THERE SO MUCH DATA?o Regulationso Electronic Documentso Medical Recordso Social Activityo Transactional Datao Marketing
  • 2. © 2013 Help/Systems, LLC. All trademarks and registered trademarks are the property of their respective owners10A TIME OF TRANSITION TO SMARTER…Actionable insights are derived from massive volumes of dataNew and growth services are demanded even with constrained IT budgetsIT client experience is required that speed time to value and increases return on investmentSocialDatabasesApplications MobileBig DataPhenomenonInstrumented Devices & SensorsServer mgnt & admincosts to make up 69% of$247B est. worldwide IT80% of newapplications nowdeployed on cloudDigital contentrocketing up to8 zettabytes by 2015(90% unstructured)Internet connecteddevices grow to 1trillion devices by 2015Source: Colin Parris Common Kickoff Meeting April 2013
  • 3. © 2013 Help/Systems, LLC. All trademarks and registered trademarks are the property of their respective owners11WHAT IS A ZETTABYTE?Here is the storage revenue of the mentors of theindustry for their most recent financial quarters:*Quarter ended April 2013, March 2013 for the others
  • 4. © 2013 Help/Systems, LLC. All trademarks and registered trademarks are the property of their respective owners12WHAT IS BIG DATA?o In 2012, Gartner1: “Big data are high volume, high velocity,and/or high variety information assets that require new formsof processing to enable enhanced decision making, insightdiscovery and process optimization.”o Wikipedia: A collection of data sets2 so large and complexthat it becomes difficult to process using on-hand databasemanagement tools or traditional data processing applications1 http://en.wikipedia.org/wiki/Gartner 2 http://en.wikipedia.org/wiki/Data_set
  • 5. © 2013 Help/Systems, LLC. All trademarks and registered trademarks are the property of their respective owners14POWER SYSTEMS GROWTH150,000 CUSTOMERS*DS8300 512,000 GB
  • 6. © 2013 Help/Systems, LLC. All trademarks and registered trademarks are the property of their respective owners16o Responding to IBM i market, time between releases is longero Regular IBM i Technology Refreshes provide new functionsand I/O supporto Simpler to install on a current release and less disruptiveIBM i ROADMAP** All statements regarding IBMs future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
  • 7. © 2013 Help/Systems, LLC. All trademarks and registered trademarks are the property of their respective owners21DATABASE FILE LIMITATIONSo Number of bytes in a record 32,766 byteso Number of fields in a record format 8,000 fieldso Number of key fields in a file 120 fieldso Size of key for physical and logical files 32,768 characterso Number of records contained in a file member 4,294 967,294 recordso Number of bytes in a file member 1,869,162,846,624 byteso Number of bytes in an access path 1,099,511,627,776 byteso Number of keyed logical files built over a physical file member 3,686 fileso Number of physical file members in a logical file member 32 memberso Number of members that can be joined 256 memberso Size of a character or DBCS field 32,766 byteso Maximum number of distinct database files that can be in use at one time ~500,000o Maximum number of members in a physical or logical file 32,767o Maximum number of constraints per physical file 5,000 constraintso Maximum number of triggers per physical file 300 triggerso Maximum number of recursive insert and update trigger calls 200
  • 8. © 2013 Help/Systems, LLC. All trademarks and registered trademarks are the property of their respective owners45IBM’S PARTITION TECHNOLOGY HISTORY
  • 9. © 2013 Help/Systems, LLC. All trademarks and registered trademarks are the property of their respective owners46IBM i I/O SERVER OPTIONSo Built into IBM io Host Disk, Optical, Tapeo Consolidate Ethernet Traffico Same technology as hosting AIX,Linux, and iSCSIoVIOS Servero Host Disk, Optical, Tapeo Bridge Ethernet Traffico Attach external storageo Advance Virtualization Functions
  • 10. © 2013 Help/Systems, LLC. All trademarks and registered trademarks are the property of their respective owners50WHAT IS LIVE PARTITION MOBILITY?* Live Partition Mobility requires the purchase ofthe optional PowerVM Enterprise EditionMove a running partition fromone Power7 server to anotherwith no application downtimeo Reduce planned downtime bymoving workloads to anotherserver during systemmaintenanceo Rebalance processing poweracross servers when and whereyou need it
  • 11. © 2013 Help/Systems, LLC. All trademarks and registered trademarks are the property of their respective owners57Notes- This table does not list more detailed considerations, for example required levels of firmware or PTFs required or configuration performance considerations- POWER7 servers require IBM i 6.1 or later- This table can change over time as addition hardware/software capabilities/options are added# DS3200 only supports SAS connection, not supported on Rack/Tower servers which use only Fibre Channel connections, supported on Blades with SAS## DS3500 has either SAS or Fibre Channel connection. Rack/Tower only uses Fibre Channel. Blades in BCH support either SAS or Fibre Channel. Blades in BCS only uses SAS.### Not supported on IBM i 7.1. But see SCORE System RPQ 846-15284 for exception support* Supported with Smart Fibre Channel adapters – NOT supported with IOP-based Fibre Channel adapters** NPIV requires Machine Code Level of 6.1.1 or later and requires NPIV capable HBAs (FC adapters) and switches@ BCH supports DS3400, DS3500, DS3950 & BCS supports DS3200, DS3500% NPIV requires IBM i 7.1 TR2 (Technology Refresh 2) and latest firmware released May 2011 or later%% NPIV requires IBM i 7.1 TR6 (Technology Refresh 6)For more details, use the System Storage Interoperability Center:www.ibm.com/systems/support/storage/config/ssic/Note there are currently some differences between the above table andthe SSIC. The SSIC should be updated to reflect the above informationSUPPORT FOR IBM STORAGE SYSTEM WITH IBM iFROM GOTTFRIEND SCHIMUNEK AT IBM
  • 12. © 2013 Help/Systems, LLC. All trademarks and registered trademarks are the property of their respective owners73VTL SUPPORTo Tested Robot/SAVE witho DataDomain EMCo SPHiNX Crossroadso DSIo Sepaton
  • 13. © 2013 Help/Systems, LLC. All trademarks and registered trademarks are the property of their respective owners78WHAT’S ON OUR ROAD MAP?o Already shipped licensing support for LPM and PowerHAo Support for running products in iASP with little effort from youo Robot/CONSOLEo Robot/SCHEDULE & SCHEDULE Enterpriseo Robot/REPORTSo Some customers are running products already in iASP
  • 14. © 2013 Help/Systems, LLC. All trademarks and registered trademarks are the property of their respective owners79THE FUTUREo PowerHA, VIOS, VTL, iASP, and SAN help to manage Big Datao SQE helps with Data Access on IBM io IBM’s merge of AIX, Linux and i on Power Hardware puts all oftheir R&D money into the futureo VIOS and LPM help to support running Clouds on these serverso The Power Server and IBM i have road map items into2026—Look at Steve Will’s blog
  • 15. © 2013 Help/Systems, LLC. All trademarks and registered trademarks are the property of their respective owners81PORTFOLIO OF FLEXIBLE SOFTWARE SOLUTIONS
  • 16. © 2013 Help/Systems, LLC. All trademarks and registered trademarks are the property of their respective owners82Robot/CONSOLEMessage, Resource, & Log ManagementRobot/ALERTPager, Text, or Email NotificationRobot/NETWORKIBM i Event & PerformanceConsolidationRobot/SPACEDisk Space ManagementRobot/LPARPartition ResourceMovement & ManagementRobot/AUTOTUNEAutomatic Performance TuningRobot/SCHEDULEJob Scheduler & AutomaticComputer OperatorRobot/SCHEDULEEnterpriseEnterprise Job SchedulerRobot/REPLAYInteractive Job ManagementRobot/SAVEAutomatic Backup, Recovery,& Media ManagementRobot/REPORTSReport Distribution, Archiving,& Viewing
  • 17. Create ViewsDynamically DrillDown into DataCreateCharts & GraphsCreateCustom ReportsPivot Datain a TableCreateDashboardsWrite ScriptsBuildApplicationsSEQUEL ViewPointExplorerBrowser Access(SEQUEL Web Interface)