IBM Systems and Technology                                                                                                ...
IBM Systems and Technology                                                                                                ...
IBM Systems and Technology                                                                                                ...
IBM Systems and Technology                                                                                                ...
IBM Systems and Technology                                                                                                ...
Please Recycle                 POS03099-USEN-00
Upcoming SlideShare
Loading in …5

IBM PowerLinux Big Data Analytics Solutions


Published on

Data is exploding from sources like sensors used to gather climate information, posts to social media sites, digital pictures and videos posted online, transaction records of online purchases, and from cell phone GPS signals to name a few sources. Everyday, we create 2.5 quintillion bytes of data—so much that 90 percent of the data in the world today has been created in the last two years alone. This data is big data.

Published in: Technology
1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

IBM PowerLinux Big Data Analytics Solutions

  1. 1. IBM Systems and Technology Power SystemsSolution Brief IBM PowerLinux Big Data Analytics Solutions Watson-inspired analytics solutions for businesses of all sizes Data is exploding from sources like sensors used to gather climate Highlights information, posts to social media sites, digital pictures and videos posted online, transaction records of online purchases, and from ●● ● ● Deliver actionable insights using cell phone GPS signals to name a few sources. Everyday, we create InfoSphere® BigInsights and InfoSphere Streams on PowerLinux™ servers to 2.5 quintillion bytes of data—so much that 90 percent of the data in analyze structured and unstructured data the world today has been created in the last two years alone. This data is at massive scale big data. ●● ● ● Make impactful business decisions using IBM InfoSphere BigInsights and Today’s businesses want to leverage the data explosion to create competi- InfoSphere Streams on PowerLinux tive advantages. In fact, 89 percent of CEOs say they want better insight servers through business intelligence and analytics. An infrastructure that is ●● ● ● Deliver higher quality analytics services designed for data means extending beyond traditional sources of data to with a reliable and secure POWER7® generate insight by leveraging new forms of information. foundation ●● ● ● Put technical advancements learned from Both structured and unstructured data will continue to grow at astronom- IBM Watson™ to work for your business ical rates. Today’s organizations are challenged with managing the volume of data they have. It’s difficult to keep pace with the growing amounts of incoming data that could provide vital information to their business to make timely decisions and achieve business goals. Smarter companies are thinking differently about how to deal with big data that is growing exponentially within their organizations. To meet this challenge, many are deploying Linux-based IT infrastructures designed to capably handle both structured and unstructured data, making it easier to capture, manage and analyze information to drive better-informed busi- ness decisions.
  2. 2. IBM Systems and Technology Power SystemsSolution Brief posed in natural language in less than three seconds by execut- ing thousands of complex analytical tasks simultaneously. The result—a brilliant landmark win on TV’s Jeopardy game show—was impressive, but merely hinted at the real-world value of Linux running on workload-optimized systems. And, these same principles that enabled Watson to master natural language queries can be put to work for today’s businesses. We understand how to design a system that is optimized across the full technology stack to maximize performance and effi- ciency. IBM had a choice of systems to use when designing Watson. We chose PowerLinux servers because they are fit for this purpose. IBM PowerLinux Big Data Analytics SolutionsIBM PowerLinux Big Data Analytics solutions help businesses leverage IBM InfoSphere BigInsights for Hadoop basedgain new insights with scalable, powerful solutions using data-at-rest analytics and IBM InfoSphere Streams for realApache Hadoop-based IBM InfoSphere BigInsights software time data-in-motion enable organizations to analyze data-at-rest, and InfoSphereStreams software to analyze data-in-motion. The deep integra-tion and optimization of analytics workload performance on Health insurer WellPoint is implementing a PowerLinux Big DataPowerLinux enables businesses to run thousands of tasks in solution to help medical professionals make better decisions right atparallel to deliver analytics services faster. the point of care for patients with serious illnesses. These workload- optimized systems are helping reduce the time to diagnose and treatPowerLinux Big Data solutions are illnesses.industry standard, tuned to the taskToday organizations are only tapping in to a small fraction ofthe data that is available to them. The challenge is figuring out IBM InfoSphere BigInsights is IBM’s powerful and versatilehow to analyze ALL the data, and find insights with new and solution for managing and analyzing Internet-scale volumes ofunconventional data types. structured and unstructured data-at-rest. Built on the open source Apache Hadoop software framework, InfoSphereIBM has stepped up to the challenge with new developments BigInsights enhances this technology to withstand the demandsfrom IBM Research extending available open source technolo- of your enterprise, adding administrative, workflow, provision-gies. Based on PowerLinux and leveraging Apache Hadoop ing, and security features, along with sophisticated analyticaltechnology, Watson embodies optimized system design by capabilities including text analytics and IBM BigSheets for datacombining open source Hadoop software running on a cluster exploration. The result is that you get a more developer- andof POWER7 systems with IBM’s DeepQA analytics software user-friendly solution for complex, large-scale analytics.and the domain knowledge and expertise of IBM’s Researchteam. Watson was tuned to the task of answering questions 2
  3. 3. IBM Systems and Technology Power SystemsSolution BriefIBM InfoSphere Streams enables continuous analysis of massive Run thousands of tasks in parallel withvolumes of streaming data with sub-millisecond response times.The offering provides a highly scalable and agile infrastructure ●● ● Eight high frequency cores per socketthat can support a wide variety of both structured and unstruc- ●● ● Four intelligent threads per coretured data types. These capabilities help you improve your ●● ● Larger on-chip cache (eDRAM)organization’s insights and decision-making, providing anopportunity to respond to events as they happen. Achieve massive scale-out flexibility withPowerLinux Big Data Solutions for both IBM InfoSphere ●● ● Choice of PowerLinux 7R2 dense rack or POWER7-basedBigInsights and InfoSphere Streams enable businesses to Flex System p24L compute nodesdeliver analytics services faster by taking advantage of the ●● ● Internal or external storage optionsworkload-optimizing features of the POWER7 architecture ●● ● High speed, low latency interconnectthat specifically apply to big data: ●● ● Comparable pricing to x86 rack/compute node Exploit extreme memory bandwidth ●● ● 2x the bandwidth of other commercially available systems at 500 GB per chip Workload accelerators designed for key big data functions are planned2 to further accelerate data compression and text analytics. IBM PowerLinux servers and Apache Hadoop Apache Hadoop is an open source framework that allows for the distributed processing of large data sets across clusters of computers. It is architected to scale out from single servers to thousands of machines, each offering local computation and storage. Apache Hadoop is emerging as the preferred way of handling Internet-scale structured and unstructured informa- tion at rest. With the explosion of data generated by social media sources, 80 to 85 percent of the world’s data is now unstructured (text, audio, video, click streams, log files etc.) 3
  4. 4. IBM Systems and Technology Power SystemsSolution Brief The IBM Big Data Solution for InfoSphere BigInsights enterprise-ready analytics platform brings the power of Hadoop“Big data and scalability go hand-in-hand. to the enterprise. Complementary IBM innovations deliverBig data solutions must be capable of massive scale-out data processing and analysis with built-inhandling Terabytes to Petabytes of data resiliency and fault tolerance. Organizations can run large-for real-time, deep analytical and complex scale, distributed analytics jobs on clusters of cost-effective PowerLinux server hardware. Designed to store data at rest,workloads. IBM PowerLinux Big Data this solution leverages Hadoop’s MapReduce framework toSolutions provide the best performance and tackle very large data sets by breaking up the data across manytotal cost of ownership to meet the growing nodes and coordinating data processing across a massively par-needs of our big data customers.” allel environment. The Hadoop environment with MapReduce and additional open source technologies such as Hive and Pig are integrated and delivered with this robust solution.—Anjul Bhambhri, Vice President Big Data, IBM Information Management Software The IBM PowerLinux Big Data Solution for InfoSphere BigInsights is optimized to withstand the demands of your enterprise, adding administrative, workflow, provisioning, andIBM Watson is based on the distributed Hadoop architecture, security features, along with best-in-class analytical capabilitiesrunning on Linux on 90 commercially available POWER7 from IBM Research. The result is a more developer- and user-servers with 15 terabytes of RAM and 2,870 processor cores. friendly solution for complex, large scale analytics, allowingTwo-socket PowerLinux 7R2 servers are designed to scale out, enterprises of all sizes to manage the massive volume, varietycomplementing the distributed architecture of the Hadoop and velocity of data that consumers and businesses create everyframework and file system. Based on POWER7 processors, day, cost-effectively turning data into insight.IBM PowerLinux servers with Apache Hadoop help businessesapply Watson-like solutions to real-life analytics projects of IBM PowerLinux Big Data Solution forany scale. The PowerLinux 7R2 server is the basis for the InfoSphere StreamsIBM PowerLinux Big Data Solution for InfoSphere BigInsights The IBM PowerLinux Big Data Solution for InfoSpheresolution for mining structured and unstructured data. Streams enables continuous analysis of massive volumes of streaming data with sub-millisecond response times. StreamIBM PowerLinux Big Data Solution for computing changes when, where, and how much of your busi-InfoSphere BigInsights ness data you can analyze. Designed to manage stream f lowsIBM has embraced the open source movement because we and apply various analytics—mining, mathematical, video,believe Apache Hadoop offers a way for organizations to man- etc.—against that streaming data, companies can store less,age and analyze massive volumes of data. IBM InfoSphere analyze more, and make better decisions, faster. By extractingBigInsights enhances Hadoop with performance, reliability, insight from data as it is streaming into your organization, yousecurity and administrative features, including a sophisticated can react to events as they are happening to change businesstext analytics module and IBM BigSheets for data exploration. outcomes. For example, financial institutions can inspect real-time credit card usage to detect and prevent fraudulent transactions. 4
  5. 5. IBM Systems and Technology Power SystemsSolution BriefThe IBM PowerLinux Big Data Solution for InfoSphereStreams performs complex real-time analytics on data-in-motion. Enterprises extend their data warehouse data miningsolution to score data in real-time as it flows into the organiza-tion—and scale to any size PowerLinux cluster. This streaminganalytics solution benefits from the high memory bandwidth ofthe POWER7 platform. The deep integration of this analyticsworkload on PowerLinux enables businesses to run thousandsof tasks in parallel to deliver real-time analytics services.Exploiting the data explosion to analyze streaming data withmultiple data types and respond to millions of events per secondas they happen enables smarter companies to drive innovationand set themselves apart in the crowded marketplace.Whether your business requires real-time analytics on stream-ing data, or uncovering insights from historical data, or both,IBM PowerLinux Big Data solutions help answer thosebusiness questions that have previously been beyond reach. the reasons that readers of the Linux Journal selected IBM as the winner in the “Best Linux Server Vendor” category in itsWhy IBM? 2011 Readers’ Choice Awards.3Forward-thinking organizations are transforming their ITinfrastructures to enable themselves to more effectively apply IBM has invested more than US$1 billion in the Linux andanalytics to achieve better business outcomes. The same deep open source community. IBM is consistently among the topanalytics capabilities that have been demonstrated by Watson commercial contributors of Linux code, with more than 600can be applied to countless businesses and industries. Turning IBM4 developers involved in over 100 open source projects andto IBM software, based on industry-standard Linux and open thousands of dedicated development and support personnelsource applications, running on workload-optimized systems supporting all of IBM’s products and customers on Linux. Wecan improve overall business performance. not only support this community, we’re part of it.IBM PowerLinux Big Data Solutions are deeply optimized IBM has completed tens of thousands of Linux customersystems, from the hardware, to the Linux operating system engagements, and facilitated thousands of migrations to Linux.and software applications, through IBM Software offerings. We offer the widest range of hardware, middleware, and ser-IBM is in a unique position to leverage two decades of vices products for Linux in the industry. We support Linux onLinux and open source experience, as well as IBM Research all modern IBM Systems. And we back PowerLinux with a fulltechnologies developed for Watson, and hardware expertise line of implementation, support and migration services.from the microprocessor up. We believe that these are among 5
  6. 6. Please Recycle POS03099-USEN-00