Uploaded byHelpSystems
How Big Data is Transforming the Data Center
There is a massive amount of data being generated from various sources such as regulations, electronic documents, medical records, social media, transactions, and marketing. This data is growing so quickly that traditional database tools cannot handle it, giving rise to the phenomenon of big data. New technologies and services are needed to derive actionable insights from all this data while maintaining efficient IT budgets.
More Related Content
Similar to How Big Data is Transforming the Data Center
More from HelpSystems
How Big Data is Transforming the Data Center
- 9. © 2013 Help/Systems,LLC. All trademarks and registered trademarks are the property of their respective owners9 WHY IS THERE SO MUCH DATA? o Regulations o Electronic Documents o Medical Records o Social Activity o Transactional Data o Marketing
- 10. © 2013 Help/Systems,LLC. All trademarks and registered trademarks are the property of their respective owners10 A TIME OF TRANSITION TO SMARTER… Actionable insights are derived from massive volumes of data New and growth services are demanded even with constrained IT budgets IT client experience is required that speed time to value and increases return on investment SocialDatabases Applications Mobile Big Data Phenomenon Instrumented Devices & Sensors Server mgnt & admin costs to make up 69% of $247B est. worldwide IT 80% of new applications now deployed on cloud Digital content rocketing up to 8 zettabytes by 2015 (90% unstructured) Internet connected devices grow to 1 trillion devices by 2015 Source: Colin Parris Common Kickoff Meeting April 2013
- 11. © 2013 Help/Systems,LLC. All trademarks and registered trademarks are the property of their respective owners11 WHAT IS A ZETTABYTE? Here is the storage revenue of the mentors of the industry for their most recent financial quarters: *Quarter ended April 2013, March 2013 for the others
- 12. © 2013 Help/Systems,LLC. All trademarks and registered trademarks are the property of their respective owners12 WHAT IS BIG DATA? o In 2012, Gartner1: “Big data are high volume, high velocity, and/or high variety information assets that require new forms of processing to enable enhanced decision making, insight discovery and process optimization.” o Wikipedia: A collection of data sets2 so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications 1 http://en.wikipedia.org/wiki/Gartner 2 http://en.wikipedia.org/wiki/Data_set
- 14. © 2013 Help/Systems,LLC. All trademarks and registered trademarks are the property of their respective owners14 POWER SYSTEMS GROWTH 150,000 CUSTOMERS *DS8300 512,000 GB
- 16. © 2013 Help/Systems,LLC. All trademarks and registered trademarks are the property of their respective owners16 o Responding to IBM i market, time between releases is longer o Regular IBM i Technology Refreshes provide new functions and I/O support o Simpler to install on a current release and less disruptive IBM i ROADMAP ** All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
- 21. © 2013 Help/Systems,LLC. All trademarks and registered trademarks are the property of their respective owners21 DATABASE FILE LIMITATIONS o Number of bytes in a record 32,766 bytes o Number of fields in a record format 8,000 fields o Number of key fields in a file 120 fields o Size of key for physical and logical files 32,768 characters o Number of records contained in a file member 4,294 967,294 records o Number of bytes in a file member 1,869,162,846,624 bytes o Number of bytes in an access path 1,099,511,627,776 bytes o Number of keyed logical files built over a physical file member 3,686 files o Number of physical file members in a logical file member 32 members o Number of members that can be joined 256 members o Size of a character or DBCS field 32,766 bytes o Maximum number of distinct database files that can be in use at one time ~500,000 o Maximum number of members in a physical or logical file 32,767 o Maximum number of constraints per physical file 5,000 constraints o Maximum number of triggers per physical file 300 triggers o Maximum number of recursive insert and update trigger calls 200
- 45. © 2013 Help/Systems,LLC. All trademarks and registered trademarks are the property of their respective owners45 IBM’S PARTITION TECHNOLOGY HISTORY
- 46. © 2013 Help/Systems,LLC. All trademarks and registered trademarks are the property of their respective owners46 IBM i I/O SERVER OPTIONS o Built into IBM i o Host Disk, Optical, Tape o Consolidate Ethernet Traffic o Same technology as hosting AIX, Linux, and iSCSI oVIOS Server o Host Disk, Optical, Tape o Bridge Ethernet Traffic o Attach external storage o Advance Virtualization Functions
- 50. © 2013 Help/Systems,LLC. All trademarks and registered trademarks are the property of their respective owners50 WHAT IS LIVE PARTITION MOBILITY? * Live Partition Mobility requires the purchase of the optional PowerVM Enterprise Edition Move a running partition from one Power7 server to another with no application downtime o Reduce planned downtime by moving workloads to another server during system maintenance o Rebalance processing power across servers when and where you need it
- 57. © 2013 Help/Systems,LLC. All trademarks and registered trademarks are the property of their respective owners57 Notes - This table does not list more detailed considerations, for example required levels of firmware or PTFs required or configuration performance considerations - POWER7 servers require IBM i 6.1 or later - This table can change over time as addition hardware/software capabilities/options are added # DS3200 only supports SAS connection, not supported on Rack/Tower servers which use only Fibre Channel connections, supported on Blades with SAS ## DS3500 has either SAS or Fibre Channel connection. Rack/Tower only uses Fibre Channel. Blades in BCH support either SAS or Fibre Channel. Blades in BCS only uses SAS. ### Not supported on IBM i 7.1. But see SCORE System RPQ 846-15284 for exception support * Supported with Smart Fibre Channel adapters – NOT supported with IOP-based Fibre Channel adapters ** NPIV requires Machine Code Level of 6.1.1 or later and requires NPIV capable HBAs (FC adapters) and switches @ BCH supports DS3400, DS3500, DS3950 & BCS supports DS3200, DS3500 % NPIV requires IBM i 7.1 TR2 (Technology Refresh 2) and latest firmware released May 2011 or later %% NPIV requires IBM i 7.1 TR6 (Technology Refresh 6) For more details, use the System Storage Interoperability Center: www.ibm.com/systems/support/storage/config/ssic/ Note there are currently some differences between the above table and the SSIC. The SSIC should be updated to reflect the above information SUPPORT FOR IBM STORAGE SYSTEM WITH IBM i FROM GOTTFRIEND SCHIMUNEK AT IBM
- 73. © 2013 Help/Systems,LLC. All trademarks and registered trademarks are the property of their respective owners73 VTL SUPPORT o Tested Robot/SAVE with o DataDomain EMC o SPHiNX Crossroads o DSI o Sepaton
- 78. © 2013 Help/Systems,LLC. All trademarks and registered trademarks are the property of their respective owners78 WHAT’S ON OUR ROAD MAP? o Already shipped licensing support for LPM and PowerHA o Support for running products in iASP with little effort from you o Robot/CONSOLE o Robot/SCHEDULE & SCHEDULE Enterprise o Robot/REPORTS o Some customers are running products already in iASP
- 79. © 2013 Help/Systems,LLC. All trademarks and registered trademarks are the property of their respective owners79 THE FUTURE o PowerHA, VIOS, VTL, iASP, and SAN help to manage Big Data o SQE helps with Data Access on IBM i o IBM’s merge of AIX, Linux and i on Power Hardware puts all of their R&D money into the future o VIOS and LPM help to support running Clouds on these servers o The Power Server and IBM i have road map items into 2026—Look at Steve Will’s blog
- 81. © 2013 Help/Systems,LLC. All trademarks and registered trademarks are the property of their respective owners81 PORTFOLIO OF FLEXIBLE SOFTWARE SOLUTIONS
- 82. © 2013 Help/Systems,LLC. All trademarks and registered trademarks are the property of their respective owners82 Robot/CONSOLE Message, Resource, & Log Management Robot/ALERT Pager, Text, or Email Notification Robot/NETWORK IBM i Event & Performance Consolidation Robot/SPACE Disk Space Management Robot/LPAR Partition Resource Movement & Management Robot/AUTOTUNE Automatic Performance Tuning Robot/SCHEDULE Job Scheduler & Automatic Computer Operator Robot/SCHEDULE Enterprise Enterprise Job Scheduler Robot/REPLAY Interactive Job Management Robot/SAVE Automatic Backup, Recovery, & Media Management Robot/REPORTS Report Distribution, Archiving, & Viewing
- 84. Create Views Dynamically Drill Downinto Data Create Charts & Graphs Create Custom Reports Pivot Data in a Table Create Dashboards Write Scripts Build Applications SEQUEL ViewPoint Explorer Browser Access (SEQUEL Web Interface)
Editor's Notes
- #8 Everyone in the room must get a business card and one problem that someone else is faced with in managing there Data Center/IT Environment? We will share a few of them and then put in a hat the business cards to draw a winner of gift card.
- #52 Mostly for hardware maintenance
- #54 Ok a show of hands, is anyone connecting a san to power servers running ibm i?WHAT is SAN? What are the BENEFITS?WHO should you turn to? What to AVOID?
- #68 Is it up?Does it have enough disk space?Are the Daemons up?Monitor SNMP eventsRobot/TRAPPER converts to OS/400 Message
- #69 Remember this is a movement of a live partition to another serial number
- #71 Think of Big DataYou still need to keep on top of purgingIFS area is becoming a cluttered closetDefine enough armsTransaction based systems need to spread the i/oTake advantage of the offline redundancies
- #75 The increase in IFS StorageAre your old disk utilities helping or hurting you?Is anyone actively purging data?
- #81 Don’t forget about AUTOMATION and MONITORING to help manage Traditional technologies like tape will play LESS OF A ROLE in our data centerNETWORK with your peers and suppliers Learn from their experiences
- #82 Help/Systems develops, markets, and supports the world’s leading software solutions for Power Systems running IBM i, automating and job scheduling software for Windows, UNIX, and Linux. The Help/Systems family of companies includes Robot system management automation; Skybot Software for Windows, UNIX, and Linux; PowerTech security and compliance solutions; SEQUEL Software business intelligence and developer tools.
- #84 Security is front and center on virtually every corporation’s radar; or should be. Growing regulatory compliance requirements have come as the result of increased risk from numerous factors. The IBM i platform has been neglected for many years due to misconceptions and a general lack of awareness of how to properly secure it. PowerTech solutions have been designed specifically for IBM i, and are the result of almost two decades of experience as a market and thought leader. As the provider of a comprehensive suite of security modules, PowerTech can assist with the challenge of detecting, auditing, and controlling server access. Designed to extended and enhance IBM’s own security controls, PowerTech security solutions can be installed individually or as a complete set. Capabilities added by installing PowerTech solutions include a powerful perimeter firewall, database change monitoring, and a highly scalable audit environment. Tom H. Depending on the audience I talk to each product.
- #85 Is your team still using OS/400 Query? How much? Did you know SEQUEL can help you with performance in this area? Did you know it can improve the productivity of the end user too.Ourbusiness intelligence solutions consists of: SEQUEL ViewPoint and the SEQUEL Web Interface. SEQUEL is a powerful data retrieval tool. It allows you to put the power to see the data into the hands of the user who needs it, when they need it.With SEQUEL View Point you can build dashboards with data from multiple sources, allowing executives to see data from a high organizational level. And still allow them to drill down into more detailed data. Or the data can jump in at a departmental level for managers to analyze.• Users can access their REAL-TIME data easily. Views of the data can be ad hoc or regularly accessed across an organization. This makes sharing of the data fast, easy and accurate.• Graphs can be created to enhance the visual aspects of the data for analysis.• Client Reports can show data with totals, lines, logos to make the data more presentable. Sequel Web Interface allows users to see the data, in a variety of formats, from a browser.• End-users can use a our Sequel Web Interface tool to see the previously designed views, reports, tables and dashboards using their browser. • The easy to use designer, as well as the power users building their own views over the data, will free the IT staff to address more pressing corporate technology issues.