Data processing.for.smarterbusinessinfrastructure.v2

628 views

Published on

The more things change, the more they stay the same. It used to be the world was all about Data Processing. But then client/server and distributed processing came into the fold. Now with Cloud and Business Analytics at the forefront, it's really back to Data processing again. And better yet, the mainframe remains a premier platform for dealing with the new forms of data processing.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
628
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
8
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • We all see these workloads everyday, across industries. In Banking there are components across retail and wholesale banking that rely on several architectures to execute, but the core of most banking relies on System z and z/OS. Insurance typically maintains Claims processing on z but reaches out to the internet for interaction with consumers, utilizing Linux, Unix and Intel. Public Sector is relying more and more on the web based capability to reach out to consumers and improve the rate of return for taxes, accurate payment of social benefits and even Census based reporting.
  • This chart represents the business components of a large North American Bank. Each one of the ovals represents a machine. A bunch of them in the top right are running websphere, for example. Using vMotion to move a virtual machine from one server to another is a small part of the puzzle. All the other issues of multiple interconnects with the security issues they present, still remain. As does the “silo” management approach. VMWare propagates the “fit for politics” approach. Transition: let’s see what happens if we virtualize most of this on a zEnterprise….
  • In this chart, everything, except the end user devices, has been moved into a zEnterprise. Some of it might be on zOS, some on Linux on z, some on AIX on blades, some on x86 Linux on blades, whatever makes sense. But it’s all managed centrally, with the benefits outlines at the bottom of the chart. Note that there are no more physical LANs connecting all these distributed systems. They have been replaced with virtual LANs on a private data network, for greater security and fewer points of failure. Key is that the business applications, and the programming model, are unchanged. We just moved them onto a superior infrastructure.
  • Data processing.for.smarterbusinessinfrastructure.v2

    1. 1. Data Processing for a Smarter Business Infrastructure Jim Porell
    2. 2. Business Patterns <ul><li>Patterns are recognizable in a wide variety of ways </li></ul><ul><li>Programming components </li></ul><ul><ul><li>Assignment, Select/Case, Loop, Conditional (if then else) </li></ul></ul><ul><li>Business workflows </li></ul><ul><ul><li>Read/write (transaction) </li></ul></ul><ul><ul><li>Log/Trigger/Alert/message </li></ul></ul><ul><ul><li>Read only (browse) </li></ul></ul><ul><ul><li>Search, Query, Analytics </li></ul></ul><ul><ul><li>Workflow </li></ul></ul>
    3. 3. Examples of Industry patterns Hybrid transactions are evident across many industries Common Elements: On-line transaction processing, web browsing, business analytics, work flow processing Banking Insurance Retail Healthcare Telco Public Sector Core Banking Internet Rate Quotes On-line Catalog Patient Care Systems Business Support Systems (BSS) Electronic Tax Reporting Wholesale Banking – Payments Policy Sales & Management (e.g. Life, Annuity, Auto) Supply Chain Management On-line Claims Submission & Payments Operation Support System (OSS) Web-based Social Security Customer Care & Insight Claims Processing Customer Analysis
    4. 4. Operational environment differs <ul><li>Early IT industry was based on “Data Processing” </li></ul><ul><ul><li>Monolithic applications that had a set of logic applied to business data </li></ul></ul><ul><li>Client/Server and Distributed introduced Application processing </li></ul><ul><ul><li>Based on limited scale and commodity processing, data was copied/moved to the application serving environment </li></ul></ul>
    5. 5. Operation modes <ul><li>A distinction appears to exist between real time processing and batch mode </li></ul><ul><li>Typically batch is considered for reconciliation, clean up, backup/archive or distribution of data – some might call this utility computing </li></ul><ul><li>Real time is considered by many to be the direct business logic against data. </li></ul>
    6. 6. Operational Domains <ul><li>Many times, a business will segregate workloads into “manageable domains” </li></ul><ul><ul><li>Online Transaction Processing </li></ul></ul><ul><ul><li>Data Warehouse </li></ul></ul><ul><ul><li>Business Analytics </li></ul></ul><ul><ul><li>Operational risk </li></ul></ul><ul><li>Many times, for ease of management, these domains have a single type of server associated with the workload </li></ul><ul><li>One might consider these silo’s or compartments </li></ul>
    7. 7. Labeling traditional distribution <ul><li>While many domains will consider their work result to be real time operations, the reality is just part of a larger BATCH workflow that moves data to different operational domains </li></ul><ul><li>As a result, the following labels might apply: </li></ul><ul><ul><li>Compartmentalized, siloed </li></ul></ul><ul><ul><li>Batch </li></ul></ul><ul><ul><li>Hindsight </li></ul></ul><ul><ul><li>Fiefdoms </li></ul></ul><ul><ul><li>Passive connections (move responsibility to the next team) </li></ul></ul><ul><li>With data replicated, governance, risk and compliance becomes more complex…the possibility of loss or fraud grows </li></ul>
    8. 8. New Models <ul><li>Over the years, servers, networks and storage devices have grown dramatically. Virtualization has improved to enable multiple workloads to be co-resident within a server infrastructure. </li></ul><ul><li>As such, we can go “back to the future” by re-introducing data processing </li></ul><ul><ul><li>This would be moving the applications to the data instead of moving the data to the applications </li></ul></ul>
    9. 9. Data processing changes operations <ul><li>In essence, it is a shared data model </li></ul><ul><ul><li>Collaboration and sharing </li></ul></ul><ul><ul><li>Insight </li></ul></ul><ul><ul><li>Active connections </li></ul></ul><ul><ul><li>Shared operations and organizational structures </li></ul></ul><ul><ul><li>Simplified governance, risk and compliance management due to collaboration </li></ul></ul><ul><ul><li>Rather than transfer data, which can be time consuming and bandwidth consuming, data can be flash copied, in moments, or directly shared. </li></ul></ul>
    10. 10. Imagine the possibilities….. An operational advantage you can turn into a business advantage <ul><li>Business Problem </li></ul><ul><ul><li>Data warehouse can detect trends, but not necessarily prevent fraud or upgrade transactions in real time because data is copied in bulk or batch mode </li></ul></ul><ul><li>Insight instead of Hindsight </li></ul><ul><ul><li>Opens up opportunities for real time analytics </li></ul></ul><ul><ul><ul><li>Preventing fraud </li></ul></ul></ul><ul><ul><ul><li>Making business analytic decisions faster </li></ul></ul></ul><ul><ul><li>Improved performance and lowers cost </li></ul></ul><ul><ul><li>Uses blade-based specialty processors, storage for warehouse workloads </li></ul></ul><ul><ul><li>Boosts overall query performance up to 80x </li></ul></ul><ul><ul><li>Customers could see a 40% reduction in storage utilization </li></ul></ul><ul><ul><li>Supports in-memory column store for parallel star schema queries </li></ul></ul><ul><ul><li>Uses column-based compression to minimize storage needs </li></ul></ul><ul><ul><li>Unchanged interfaces to DB2 for z/OS and thus no changes to the BI/DW applications </li></ul></ul><ul><ul><li>Provides capability to perform both transactional (OLTP) and warehousing (OLAP) type of queries in the same database management system </li></ul></ul>Blades zEnterprise ISAO or Decision Support Transform Z196 Claims POS Credit/Debit DB Cognos On Linux
    11. 11. Local and Remote operations <ul><li>Data coming from sensors and SCADA devices (streamed) could be analytically processed at the source of the data, by moving servers to the devices </li></ul><ul><li>Data could be mirrored to remote sites by storage infrastructure (active mgt) vs batch transferred by the business using a file transfer program or tape distribution. </li></ul><ul><li>The model is flexible to support multiple operations types. However, in either case, a central control mechanism across the local and remote operations will simplify operations. </li></ul>
    12. 12. Examples of this DP model <ul><li>Retail distribution centers with local servers controlling conveyor belts in the center, while the servers are remotely managed from HQ </li></ul><ul><li>Oil rigs that perform local analytics for realtime reservoir management while HQ can provide additional analytics against globally mirrored data </li></ul><ul><li>zEnterprise with zBX and z196 collaboration </li></ul><ul><li>IBM SAO for analytic attachment to existing servers </li></ul>
    13. 13. Application Architecture: The Complexity of Distributed <ul><li>Business Objectives </li></ul><ul><li>A bank has four basic transactions </li></ul><ul><ul><li>Credit, Debit, Transfer, Inquiry </li></ul></ul><ul><li>And they have a variety of choices for front end interface </li></ul><ul><ul><li>ATM, Branch Terminal, Kiosk, Web browser, PDA, Cellphone </li></ul></ul><ul><li>Customer uses a Bladecenter to drive multi channel transformation </li></ul><ul><li>The back end processing remains the same regardless of the presentation device </li></ul><ul><li>Fully Distributed Model (if deployed) </li></ul><ul><li>Each application becomes a cluster of server images and must be individually authenticated and managed </li></ul><ul><li>Each line is a separate network connection, requiring high bandwidth and protection </li></ul><ul><li>Data is replicated across enterprise to meet scalability </li></ul><ul><li>Customer deploys/builds automation processes to facilitate system recovery with additional software – this is not trivial and requires additional software and unique development </li></ul><ul><li>High environmental needs and full time employees to manage infrastructure </li></ul>Application Servers WebSphere ® Service Platform Database Connectors SQLJ Service Message Servlet Loan Applic. Bank Teller General Ledger Credit Card Processing Risk Analysis Service Service Connectors/Appliances Current Accounts Batch Programs Bill Payment Database SQLJ Currency Exchange Temp data to Electronic Data Warehouse Batch Process RMI/IIOP EJB WAS Bill Payment EJBs Authentication Server Mgt Mgt Mgt Mgt Mgt Mgt Mgt Mgt Mgt Mgt Mgt Mgt Mgt Management Considerations for an enterprise Authentication Alert processing Firewalls Virtual Private Networks Network Bandwidth Encryption of data Audit Records/Reports Provisioning Users/Work Disaster Recovery plans Storage Management Data Transformations Application Deployment How does the Virtualization Manager improve these?
    14. 14. Application Architecture: A Large Enterprise <ul><li>zEnterprise Combinations – reducing control points </li></ul><ul><li>Assumes the Bladecenter for the multi channel transformation </li></ul><ul><li>Can leverage Websphere on either Linux for System z or z/OS </li></ul><ul><li>The Bladecenter functionality can be migrated to zBX in the future </li></ul><ul><li>TCA and TCO advantages over distributed </li></ul><ul><li>It’s the very same programming model in a different container that provides a superior operations model </li></ul>End User – Hosted Client Application Server Service Platform Desktop Framework Devices Websphere Service Platform Database Connectors SQLJ Service Message Servlet Loan Applic. Bank Teller General Ledger Credit Card Processing Risk Analysis Service Service Connectors Current Accounts Banking Portal Device Apps. XML over HTTP(S) Middleware Services Batch Programs Bill Payment Database SQLJ Desktop Framework Services Personalization Service Systems & Databases MQ Currency Exchange Temp data to Electronic Data Warehouse Batch Process RMI/IIOP EJB WAS Bill Payment EJBs Authentication Server System zEnterprise Potential advantages of consolidating your application and data serving <ul><li>Security Fewer points of intrusion </li></ul><ul><li>Resilience Fewer Points of Failure </li></ul><ul><li>Performance Avoid Network Latency </li></ul><ul><li>Operations Fewer parts to manage </li></ul><ul><li>Environmentals Less Hardware </li></ul><ul><li>Capacity Management On Demand additions/deletions </li></ul>With IFL With zAAP & zIIP <ul><li>Utilization Efficient use of resources </li></ul><ul><li>Scalability Batch and Transaction Processing </li></ul><ul><li>Auditability Consistent identity </li></ul><ul><li>Simplification Problem Determination/diagnosis </li></ul><ul><li>Transaction Integrity Automatic recovery/rollback </li></ul><ul><li>Security Fewer points of intrusion </li></ul><ul><li>Connectivity Improved throughput </li></ul><ul><li>Simplification Problem Determination/Monitoring </li></ul><ul><li>Development Consistent, cross platform tools </li></ul>With zBX
    15. 15. Examples of End to End Security Wireless Business Infrastructure HQ Outsourcer <ul><li>Mainframe Userid and Password Encryption via Host on Demand </li></ul><ul><li>Virtual Private Network encryption (which exploits the zIIP) </li></ul><ul><li>Audit and anomaly detection via TCIM </li></ul><ul><li>Fraud Forensics, Analysis and Prevention via Intellinx (which exploits the zAAP) </li></ul><ul><li>LAN encryption via WPA which exploits z/OS PKI </li></ul><ul><li>z/OS PKI deployment with Global Services </li></ul><ul><li>PKI management via Venafi </li></ul>zIIP ? ? ? ? ? ? ? ? ? zAAP z/OS PKI Services Bank Regional Data center Branch Manager Point of Sale Point of Sale Hacker Or Insider Compliance Insight Manager Global Services: Security & Privacy Consulting
    16. 16. Smarter Business Infrastructure <ul><li>This form of sharing, collaboration and real time data processing provides the foundations of smarter “infrastructure” </li></ul><ul><li>Leveraging the best of server operations with a shared operations model, a business can be transformed to drive greater ROI. </li></ul><ul><li>Data, Delivery and Design of System provide the basis for Smarter Computing </li></ul><ul><ul><li>Design refers to IBM’s design of systems </li></ul></ul>
    17. 17. Smarter Computing <ul><li>Focus here is around IBM systems that work to assist customers toward a Smarter Planet. </li></ul><ul><li>The difference (IMHO) is that Smarter Computing is targeted toward IBM Systems and Smarter Planet is the resulting “solution” that a customer puts together. </li></ul><ul><li>Let’s introduce another D – Development. </li></ul><ul><li>The distinction is that customers put the pieces together that makes sense for their business. </li></ul>
    18. 18. Example of a customer moving to zEnterprise HMC – Unified Resource Manager PR/SM PR/SM zEnterprise Blade Extension PowerVM ™ x86 Power Smarter Bus. Infra Smarter Solution <ul><li>Smarter Business Infrastructure focuses on servers </li></ul><ul><ul><li>The System of Systems approach </li></ul></ul><ul><li>Smarter Solutions are managed end to end </li></ul><ul><ul><li>From end user interface (presentation) through applications and database servers </li></ul></ul><ul><ul><ul><li>There are an order of magnitude more end user systems than there are servers </li></ul></ul></ul><ul><li>IBM has very little technology focused on the end user components </li></ul><ul><ul><li>Tivoli – Big Fix </li></ul></ul><ul><ul><li>Rational tooling </li></ul></ul><ul><ul><li>AIM Websphere </li></ul></ul><ul><ul><li>Hosted Desktops have not been widely deployed </li></ul></ul>SE SE Virtual Machine z/OS Virtual Machine z/OS Virtual Machine z/OS Virtual Machine z/OS AIX AIX AIX xHyp Linux Linux Linux AMM Virtual Machine z/OS
    19. 19. A note about Building Applications for System z - Marketing <ul><li>Predominantly, System z brand markets the operational aspects of the platform </li></ul><ul><ul><li>TCO/TCA and competitive qualities of service </li></ul></ul><ul><ul><li>The mainframe is the Interstate Highway of computing </li></ul></ul><ul><ul><li>The zEnterprise story is focused on “re-hosting” within zBX and better management of the operations and organizational synergy (from operations) </li></ul></ul><ul><li>System z Brand does not focus on creating new content for the mainframe – targeting CTO/Architects </li></ul><ul><ul><li>As a result: The mainframe has a dirt road for an on-ramp </li></ul></ul><ul><ul><li>Customers DESIGN their future workflows with the servers that they are familiar </li></ul></ul><ul><ul><ul><li>Architects are familiar with desktops which drives content toward Windows, Linux and Solaris </li></ul></ul></ul><ul><ul><li>Rational comes closest, but they are focused toward what they sell: </li></ul></ul><ul><ul><ul><li>RDz, EGL, Cobol, C/C++, PL/I </li></ul></ul></ul><ul><ul><li>not the full capabilities of DEVELOPING for and running on System z </li></ul></ul><ul><ul><ul><li>PHP, Perl, Ruby on Rails, Python, Mono </li></ul></ul></ul><ul><ul><ul><ul><li>Uniquely focused toward Linux for System z </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Much of this is possible with z/OS as well - open source and Rocket Software products </li></ul></ul></ul></ul><ul><li>This doesn’t have to be hard, but with this gap, we are missing a tremendous audience to bring more content, which results in more mips to System z </li></ul><ul><ul><li>In short order, zBX may become the “platform of choice” for hosting new applications </li></ul></ul><ul><ul><li>To fit in with the 3 D’s – let’s add a 4 th - Development </li></ul></ul>
    20. 20. Development <ul><li>We know that customers build solutions using x86 desktop technology </li></ul><ul><ul><li>This tends to favor Windows, Linux and Solaris based solutions </li></ul></ul><ul><ul><li>Rational Developer is a great example. The tool runs under Windows. </li></ul></ul><ul><li>Platforms like z/OS and AIX may be considered “second tier” because they don’t have “desktop” versions to put a system on “every desktop” </li></ul><ul><li>It’s important to recognize that these systems also add value to application execution/operations, as much as they do for Data operations. </li></ul><ul><li>It’s important that CTO’s and Architects feel comfortable developing for these platforms </li></ul><ul><li>Using the 3 D’s of Smart Computing, IBM can say that our systems are the “Interstate highway of computing”. </li></ul><ul><li>But developers will say we have a dirt road for an on-ramp. </li></ul><ul><li>Let’s pave that on ramp </li></ul>
    21. 21. Business Patterns – for developers <ul><li>We learned in the first slide that there are common programming structures </li></ul><ul><li>Development tools leverage these structures to build applications. </li></ul><ul><li>But the same business logic can be constructed in a wide variety of programming languages </li></ul><ul><ul><li>Visual Basic, .Net, Java, C/C++, Cobol, PL/I, EGL </li></ul></ul>
    22. 22. Tool choice or business choice? <ul><li>Many times, the development tool dictates the deployment options </li></ul><ul><ul><li>Visual basic, .Net  Microsoft Windows </li></ul></ul><ul><ul><li>Javaone  Java – yes any platform, but only one language </li></ul></ul><ul><li>But from the data processing discussion, we recognize that there are a wide variety of choices </li></ul><ul><ul><li>Desirable to leverage existing investments rather than “greenfield” new solutions. </li></ul></ul>
    23. 23. Rational provides heterogeneous tooling <ul><li>Common front end tooling, based on eclipse.org, that provides a familiar and consistent tool </li></ul><ul><li>Supports many programming languages and execution platforms and subsystems </li></ul><ul><li>Enables generation of new applications as well as modernizing the maintenance of existing applications </li></ul>
    24. 24. Federation of Data and applications <ul><li>Just as we talked about moving applications to data (federation of data), there can be a federation of applications around that data. </li></ul><ul><li>However, the applications don’t necessarily have to be re-written to facilitate that. Most of the popular programming models are supported on each of the IBM systems. </li></ul><ul><ul><li>Leverage the Rational tools to help determine where the best “fit for purpose” of existing and new applications should be deployed. </li></ul></ul><ul><li>Businesses can then leverage the operational synergy of having applications and data, but can extend the organizational synergy into the development environment as well as into the operational environment. </li></ul>
    25. 25. Reducing complexity <ul><li>Reduce the number of copies of data and the number of data moves necessary to populate that data </li></ul><ul><li>Reduces the number of servers necessary to host that data and to host the applications that process that data </li></ul><ul><ul><li>Virtualization is a key element toward server reduction </li></ul></ul><ul><li>Manage workload optimized systems in a consistent end to end fashion </li></ul><ul><ul><li>zURM is an example of System of Systems mgt </li></ul></ul>
    26. 26. Competition pushes homogeneity <ul><li>Microsoft </li></ul><ul><ul><li>Adopt the .Net programming model and move data to applications. </li></ul></ul><ul><ul><li>The demonstrate that more is better, which increases the complexity of systems management </li></ul></ul><ul><li>Oracle is Java and Fusion focused, as well as their own database focused </li></ul><ul><ul><li>Their goal is to migrate businesses from their existing platforms and move toward the oracle system. </li></ul></ul><ul><ul><li>They ignore investments and value of existing systems </li></ul></ul><ul><li>HP and Dell are a hybrid of the above, but focused on commodity hardware and massive scale out systems </li></ul>
    27. 27. IBM delivers workload optimized and fit for purpose system and software <ul><li>Data consolidation and federation </li></ul><ul><li>Application hosting close to the data through the fastest means appropriate </li></ul><ul><ul><li>Network, channel or in memory </li></ul></ul><ul><li>Development tools that allow modern programming constructs to be deployed where they make the most sense for processing their data </li></ul><ul><ul><li>Commodity or value oriented operating systems and subsystems </li></ul></ul><ul><ul><li>Modernizing existing application programming </li></ul></ul><ul><ul><li>Deploying new programming </li></ul></ul><ul><ul><li>Making development affordable, accessible and consistent </li></ul></ul>
    28. 28. Smarter Computing <ul><li>The interstate highway of computing </li></ul><ul><ul><li>Data </li></ul></ul><ul><ul><li>Design </li></ul></ul><ul><ul><li>Deployment </li></ul></ul><ul><li>Paving the on ramp </li></ul><ul><ul><li>Development </li></ul></ul>

    ×