INT413 ECDA 12.6 Optimization  Jerry Kauffman Software Development Manager [email_address] 7/19/2004
The Enterprise. Unwired.  Unwire People Unwire Information Manage Information Information Management Core Capture Publish ...
The Enterprise. Unwired. Unwire People Unwire Information Manage Information Sybase Workspace Industry and Cross Platform ...
DirectConnect 12.6 (Where it fits) Make all your enterprise data look like one database Any mainframe data Oracle MS SQL S...
<ul><li>First major release in 3 years. </li></ul><ul><li>Major redesign of several products. </li></ul>DirectConnect 12.6
<ul><li>Enterprise Connect Data Access IPS </li></ul><ul><ul><li>DirectConnect for Microsoft SQL Server </li></ul></ul><ul...
<ul><li>Performance, Scalability </li></ul><ul><li>Peaceful Coexistence </li></ul><ul><li>New Features </li></ul><ul><li>D...
<ul><li>Performance, Scalability </li></ul><ul><li>Peaceful Coexistence </li></ul><ul><li>New Features </li></ul><ul><li>D...
<ul><li>New Product Architecture </li></ul><ul><ul><li>DirectConnect for Microsoft SQL Server </li></ul></ul><ul><ul><li>D...
New Product Architecture - Background <ul><li>Predecessor  Product Architecture </li></ul><ul><ul><li>Multiple processes <...
12.5 Product Architecture O P E N S E R V E R S E R V E R M G R Main Process Open Server  Based Event Handler, Service Man...
12.5 Product Architecture O P E N S E R V E R S E R V E R M G R C O N N H A N D L R D B T O O L S D T Y P E C O N V T D S ...
12.5 Product Architecture O P E N S E R V E R S E R V E R M G R C O N N H A N D L R D B T O O L S D A T A C O N V T D S L ...
New Product Architecture <ul><li>Predecessor  Product Architecture </li></ul><ul><ul><li>Multiple processes </li></ul></ul...
12.6 Product Architecture O P E N S E R V E R S E R V E R M G R Main process Open Server  Based Event Handler, Service Man...
12.6 Product Architecture O P E N S E R V E R S E R V E R M G R Main process Open Server  Based Event Handler, Service Man...
12.6 Product Architecture O P E N S E R V E R Main process   S E R V E R M G R C O N N H A N D L R D A T A C O N V S Y B O...
12.5 Software Layers Removed D B T O O L S D A T A C O N V T D S L I B R A R Y Dc2any process (one per connection) pipe T ...
12.5 vs. 12.6 Executable Size Disk Space (KB)
12.5 vs. 12.6 Memory – 1 Connection Memory Utilized (MB)
12.5 vs. 12.6 Memory – 10 Connections Memory Utilized (MB)
12.5 vs. 12.6 Memory – 10 Connections
<ul><li>New Product Architecture </li></ul><ul><ul><li>DirectConnect for Microsoft SQL Server </li></ul></ul><ul><ul><li>D...
<ul><li>SMP Open Server Conversion </li></ul><ul><ul><li>DirectConnect for Microsoft SQL Server </li></ul></ul><ul><ul><li...
<ul><ul><li>All DirectConnects are based on Sybase's Open Server SDK.  The SDK can be used to build TDS based, database ev...
<ul><ul><li>DirectConnect 12.5 operated in  non-preemptive mode  using  Open Server threads .  DirectConnect controlled co...
<ul><ul><li>DirectConnect 12.6 uses Open Server  preemptive  scheduling which utilizes  native  operating system  threads....
12.5 vs. 12.6 Performance Comparison <ul><li>~25% performance increase </li></ul>
<ul><li>Performance, Scalability </li></ul><ul><li>Peaceful Coexistence </li></ul><ul><li>New Features </li></ul><ul><li>D...
<ul><li>Definition: Internal initiative to improve ability of Sybase products to peacefully coexist when installed togethe...
<ul><li>Isolation of common libraries </li></ul><ul><li>InstallShield </li></ul><ul><li>Minimize dependency on system envi...
<ul><li>Performance, Scalability </li></ul><ul><li>Peaceful Coexistence </li></ul><ul><li>New Features </li></ul><ul><li>D...
<ul><li>Windows Service Execution (All) </li></ul><ul><li>Date and Time datatype support  (Oracle) </li></ul><ul><li>LINUX...
<ul><li>DirectConnect for DB2 UDB </li></ul><ul><ul><li>Has been available for access to AS400 since 12.5.3 </li></ul></ul...
<ul><li>Benefits of using DirectConnect for DB2 UDB </li></ul><ul><ul><li>Express Transfer to/from AS400 targets </li></ul...
<ul><li>Performance, Scalability </li></ul><ul><li>Peaceful Coexistence </li></ul><ul><li>New Features </li></ul><ul><li>D...
<ul><li>Enhanced Usability </li></ul><ul><li>Support for DirectConnect for Oracle </li></ul><ul><li>Multiple Platform supp...
Enhanced Usability – More Informative
Enhanced Usability – Verbose Mode
Enhanced Usability – Bottom Panel
Enhanced Usability – Limited Field Help
<ul><ul><li>508 Compliant </li></ul></ul><ul><ul><li>Sybase Central v4.3 Support </li></ul></ul><ul><ul><li>Up to date JCo...
<ul><ul><li>All the administrative features DirectConnect for Oracle provides are now supported by DCManager. </li></ul></...
<ul><ul><li>Windows NT, 2000, 2003 </li></ul></ul><ul><ul><li>Linux </li></ul></ul><ul><ul><li>Solaris </li></ul></ul><ul>...
<ul><ul><li>DCManager has been designed to work on the latest version of Sybase Central (Version 4.3) along with the other...
<ul><li>Beta Q4 2004 </li></ul><ul><li>Beta Period - November 23, 2004 through January 18, 2005   </li></ul><ul><li>For mo...
<ul><li>Port the remaining DirectConnects to Linux platform </li></ul><ul><li>Add support for the Unicode datatype  </li><...
INT413 ECDA 12.6 Optimization  Questions? Jerry Kauffman Software Development Manager [email_address] 7/19/2004
Upcoming SlideShare
Loading in …5
×

Enterprise Connect Data Access (ECDA) 12.6 Optimization

966 views
879 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
966
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
7
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Hello Everyone, I’m Jerry Kauffman and I manage software development for our middleware products called Direct Connect. Direct Connect, in combination with other Sybase products like ASE, offers transparent access to heterogeneous data. This data can be stored across the enterprise and include competitors database products like Informix, DB2, Oracle and Microsoft SQL Server. On behalf of Sybase, I would like to welcome you to Techwave. The name of this session is INT 413 ECDA 12.6 Optimization. At this session you will learn about the benefits of the work we have put into this new version of Direct Connect.
  • As you will see throughout Techwave this week, our job is to guide your data throughout the Enterprise - Unwired. To build an Unwired Enterprise, you need to do three things: 1. Manage enterprise information – make that information useful, relevant and valuable 2. Unwire the information across the enterprise – ensuring fast, reliable access in real-time 3. And finally unwire the people – enabling them to work wherever they need to, securing data across networks, systems and devices.
  • The Unwired Enterprise is an information management strategy. In this session, we’ll be discussing Direct Connect 12.6 and the recent changes we have implemented. Direct Connect 12.6 is part of of Sybase’s Unwired Enterprise solution. It is included under the heading “Manage Information” It is part of both Real time data services, in that it helps to provide transparent access to real time heterogeneous data And Connectivity Options, in that it allows you to treat all data, regardless of storage platform, consistently as if it is part of a single unified data store.
  • If you are not familiar with DirectConnect, here is how it fits into Sybase’s Unwired Enterprise Solution to data management in your enterprise. Specifically, it is middleware that helps provide Transparent Access to heterogeneous data. The data can be stored in any number of data stores including Oracle, MS SQL Server, DB2 UDB, and Informix. Together with Sybase ASE it makes all your data look like it is in one database.
  • Now that you understand how DirectConnect fits lets look at our upcoming 12.6 release! This is the first Major Release of both Enterprise Connect Data Access And Mainframe Connect That we have had in 3 years. What we have undertaken in this latest version is to re architect and redesign several key products in the DC line.
  • DirectConnects are packaged into two integrated product sets. First we have Enterprise Connect Data Access which consists of the base which is ASE/CIS and then one of the 5 DirectConnects, I.E. MSSS, DB2 UDB, Informix, ODBC, and Oracle. The Microsoft SQL Server, DB2 UDB, Informix, and ODBC products all share a common product architecture that uses ODBC for target database access. The architecture for these products was completely revised and streamlined for this upcoming release of version 12.6. With this new release of DirectConnect for Oracle, it now shares the same common installer with the other DirectConnects and is based on the same release cycle. In addition DirectConnect for Oracle will be released on the Linux Platform for the first time. DirectConnect for OS/390 is packaged with other mainframe products in the Mainframe Connect Integrated Product Set. DirectConnect for OS/390 has also received performance and scalability improvements for the 12.6 release. DirectConnect for AS/400 which is part of the ECDA IPS for 12.5 is not part of the 12.6 IPS. DirectConnect for AS/400 will continue to be supported in the 12.5 version until customers have had time to migrate to DirectConnect for DB2 UDB version 12.6 which supports the AS400 over TCP/IP – Ill have more to say about his later in the presentation.
  • The themes for our 12.6 release are first and foremost: Performance and scalability. Several of the products in this release were re-architected and all of the products utilize a new scheduler. Peaceful coexistence with other Sybase products is another area where we focused engineering resources. This release will have New features and include new platforms. And the DirectConnect Manager has undergone a major rewrite.
  • Turning now to the performance and Scalability theme of the 12.6 DC release……..
  • We focused on what we could do to the DirectConnect architecture that would simplify and improve it’s performance and scalability. The ODBC based DirectConnects, that is DirectConnect for MSSS, DB2 UDB, Informix, and ODBC are, with this release, based on a much simpler and more efficient architecture. In addition, All of the DirectConnects are built upon the newer more optimized and efficient Open Server scheduling software.
  • Comparing the new Architecture to the existing architecture. Due to limitations in early ODBC drivers, in order to maintain transactional integrity, each connection had to be in its own process space. That resulted in a multi-process style DirectConnect architecture with the DirectConnect server (or parent process) occupying one process space and then creating one new child process for each new DirectConnect connection (each in its own space). Naturally, this type of architecture requires intense interprocess communication and the need to copy relational data from the child process to the parent process.
  • This is a graphic abstraction of the 12.5 (and Previous) DirectConnect Server (or parent) process. (An open server application server process). It has a server manager layer to handle server administrative functions such as reading configuration files and creating services. Upon startup the server manager checks the &amp;quot;service library directory&amp;quot; and dynamically loads any service libraries it finds in the service library directory.
  • Here you can see that for the ODBC based products, the dcany service library is what gets loaded. The dcany service library has a connection and event handling layer, a generic database class library, and a datatype converter. The TDS client layer is used to communicate with the child processes. The service library spawns a child process for each connection.
  • The child process communicates with the parent process using the TDS protocol over a pipe. It has a TDS server layer for handling the database events. The data converter converts between TDS data and ODBC data. An ODBC class library encapsulates the ODBC API. The ODBC driver manager dynamically loads the appropriate ODBC driver for a connection to the target database. By now you can begin to see the inefficiencies. For example a query&apos;s result set data being returned from the target is converted from ODBC to TDS. Next the data is copied from the child process to the parent process where it is converted (and copied) again from TDS to a generic dbtools format. Finally the generically formatted data is converted back to TDS and sent to the client. (3 conversions, 3 copies) These inefficiencies led to unnecessary complexity which made maintenance much more difficult. The 12.6 architecture address this head on and as a result is much simpler...
  • The 12.6 architecture is based on a single process It creates a new thread for each connection The data is shared as opposed to copied between the main thread and the connection threads Data conversions are thus simplified and/or reduced
  • The new architecture doesn’t impact the main process, which is identical for all DirectConnects. As before, for the ODBC based products DirectConnect loads the dcany service library.
  • The new 12.6 architecture is simpler. It no longer has a DBTOOLS layer or a TDS layer for spawning or communicating with a child process. For each connection...
  • For each new connection, A new thread is created. Each connection thread maps the TDS database events and data directly to the ODBC equivalents. The architecture is much simpler, It performs fewer data conversions (maximum of 1), and less data movement and duplication (1 copy). And as an added bonus there are also fewer software layers which improves the DC maintainability
  • These are the 12.5 software layers that were eliminated. Removing the dbtools and generic data conversion layers eliminates 54,000 lines of code. The TDS client, network, and server layer&apos;s eliminated another 59,000 lines of code.
  • The footprint of 12.6 is substantially smaller too. On Windows, total disk space for the executable and service library is 673K smaller.
  • The difference in memory utilization is even more dramatic. (debug numbers) For 1 connection here you can see a 6MB reduction
  • Running this up to 10 connections it becomes even more dramatic. (these are debug numbers) For 10 connections 12.5 grew from 31 to 152 MB an increase of 121 MB While 12.6 only grew 25MB to 27MB an increase of only 2 MB
  • Roughly only 18% of the memory used in 12.5 is consumed in 12.6
  • Another big difference between 12.5 and 12.6 is We are now using the SMP version of Open Server.
  • And now with the 12.6 release we do this for all DirectConnects.
  • As I said, DC’s are based on the Open Server SDK which can be used to build TDS based, database event handlers. The SMPOS option of Open Server was made available in the 12.5 release of OCS It provides the reentrant libraries for preemptive event handling with native threads that DC now uses.
  • DC 12.5 used open sever threads which resulted in performance issues Listed here: Fewer Context Switches Poor CPU utilization These factors led to Lower Throughput
  • Where as DC 12.6 now uses native OS threads which improves the performance Now DC is able to switch context frequently It makes efficient use of the CPUs including SMP This results in Higher throughput The ability to scale to handle more users And gives it the ability to utilize Synchronized access to shared resources which ensures reentrancy and thread safety
  • To date, without any performance tuning, engineering is reporting approximately a 25% increase in performance.
  • Next I will be talking about the work we did to support Peaceful Coexistence.
  • This was an internal initiative to eliminate interference between Sybase Applications. Due to business reasons customers may not keep all Sybase software up to date. This would cause issues if there were shared dependencies. To achieve this we have made both product and installation changes Each component group verifies their component with all other Sybase components when a new version is being tested.
  • For Direct Connect we focused on: Isolation of common libraries New InstallShield installer which gives us better control of the process We Minimized DC’s dependency on the system environment (less registry, eliminated environment variables (There still is a registry dependency on windows for DDT drivers) We added new start and add server scripts that set the environment for you This ensures consistency and independence from other Sybase products..
  • Next I will be discussing the new features.
  • New features for ECDA and MFC 12.6 All DCs are now capable of being run as a Windows Service The Oracle DC includes the new data type support for Date and Time. We will be adding this support to the other DCs in subsequent bug fix releases We added support for the Linux platform however, for the initial release only DCO and DCM will be available on Linux. Again, we will make Linux a supported platform for the other DCs in subsequent bug fix releases We added the Express transfer feature for additional targets besides MSSS and also added it to the features available on the Unix platforms.
  • About the AS400. We will continue to support the AS400 option (and SNA) in the 12.5 DCs. However we will not be back porting new functionality to this code branch. Sybase has made a strategic decision not to carry forward the AS400 option which continues to be available in 12.5 into the 12.6 release. While we still see a need to support the AS400 option (and SNA) we see that market shrinking. Instead, we see DC for DB2 UDB as the wave of the future to support AS400. Be aware that the DB2 UDB option supports TCP/IP access only. There is a migration plan available with the 12.6 release. It will cover configuration files, connectivity, Stored Procedures, and Character set translation. CS&amp;S has already been looking at it to insure that the migration plan is workable.
  • There are significant benefits for using the DirectConnect option for DB2 UDB to access your AS400. Express transfer, More powerful SQL SPs, TCP/IP access, name and password encryption, And the ability to keep up with AS400 updates and features. Most significantly leveraging SMP OS for better performance and scalability
  • The last theme of this release is the new DC Manager.
  • How many of you have used DC manager before? For those of you not familiar with DC Manager, it is a tool that allows a user to perform a number of administrative tasks on running DirectConnect Servers. This can be done from the server machine itself or from a client workstation. It is built as a plug-in for the Sybase Central Framework which also hosts a number of other Sybase admin tools The design goals for the new DC Manager were Enhanced Usability, Support for DirrectConnect for Oracle, Multi-platform support, Enhanced compatibility with other Sybase Central Plug-ins
  • To address usability we added more pertinent information on each of the dialogs. This particular dialog is a Copy Service Dialog You might want to copy an existing service and rename it to turn tracing on. Here you can see that by selecting the Server from the list of known servers, additional information is provided in the server Information box A critical item of information, for example, is the Connection Status. If this shows that the server is not connected then a service copy will fail.
  • There are two options you may use while running DC Manager – Standard and Verbose Users familiar with DirectConnect and/or DCManager will be comfortable with the standard screens. On occasion a user may do something that they are not particularly familiar with. In that case, selecting the “verbose” box will change the dialog size and provide additional information. Hopefully, this additional information will guide the user through the dialog. In most cases, verbose mode is just not necessary but on those rare occasions when a little extra help might explain something….it’s available.
  • Another enhanced usability feature is the bottom panel The bottom panel is context sensitive and in some cases will show up automatically or in others when verbose mode is selected.. In this example, the bottom panel follows whatever is highlighted in the list pane (MaxResultSize). Scrolling through the individual properties one at a time one can review the property description and the current value in the bottom panel. You can also edit the property in place without needing to bring up a separate dialog. An independent edit dialog is also available for those users that prefer that.
  • In addition to other types of usability improvements the standard “help” screens are also available. Help is provided at the plug-in level, dialog level, and even some limited help is provided for each individual control on the dialog. This Field help is available by hitting shift F1 on any field, button, or other control. In addition the entire help system has been rewritten and updated. It is now based on Java Help.
  • DC Manager is now 508 Compliant to enable those with disabilities to better utilize the product. The plug in will be built upon the Sybase Central 4.3 framework which supports a number of additional usability enhancements. Sybase Central framework is the common framework other Sybase management plug-ins It is used by Rep Server and ASE, for example Thus enabling greater cross-product consistency and compatibility. A more recent version of Jconnect is also used to provide better compatibility with Sybase servers and to provide improved speed.
  • DirectConnect for Oracle admin features are now fully supported by DC Manager
  • DCM is no longer restricted to Windows. If you would like to install it on the Unix server where your DirectConnect is you are now able to do this.
  • DC Manager will have enhanced compatibility with other Sybase products like ASE Manager and the Rep-Server Manager because DC Manager is built on the same Sybase Central Framework as they are.
  • Beta signup is now open Our Beta will be from Nov 23-Jan 18, 2005 Visit our beta Website to register We will GA in Late Q1
  • Post 12.6 We will be porting the other DCs to LINUX We will also be adding UNICODE data type support, and be adding date and time data type support
  • QUESTIONS?
  • Enterprise Connect Data Access (ECDA) 12.6 Optimization

    1. 1. INT413 ECDA 12.6 Optimization Jerry Kauffman Software Development Manager [email_address] 7/19/2004
    2. 2. The Enterprise. Unwired. Unwire People Unwire Information Manage Information Information Management Core Capture Publish Enrich Deliver
    3. 3. The Enterprise. Unwired. Unwire People Unwire Information Manage Information Sybase Workspace Industry and Cross Platform Solutions <ul><li>Adaptive Server Enterprise </li></ul><ul><li>Sybase IQ </li></ul><ul><li>Dynamic Archive </li></ul><ul><li>Dynamic ODS </li></ul><ul><li>Real Time Data Services </li></ul><ul><li>Replication Server </li></ul><ul><li>OpenSwitch </li></ul><ul><li>Mirror Activator </li></ul><ul><li>PowerDesigner </li></ul><ul><li>Connectivity Options </li></ul><ul><li>Enterprise Application Server </li></ul><ul><li>PowerBuilder Family </li></ul><ul><li>Unwired Accelerator </li></ul><ul><li>Unwired Orchestrator </li></ul><ul><li>Unwired Toolkit </li></ul><ul><li>SQL Anywhere Studio </li></ul><ul><li>Mobile Email & Applications </li></ul><ul><li>Enterprise Portal </li></ul><ul><li>XcelleNet Frontline Solutions </li></ul><ul><li>PocketBuilder </li></ul><ul><li>AvantGo </li></ul>
    4. 4. DirectConnect 12.6 (Where it fits) Make all your enterprise data look like one database Any mainframe data Oracle MS SQL Server Sybase DB2 UDB for OS/390, NT/UNIX AS/400 Informix ODBC-enabled databases Documents/Files Custom Specialty Data Stores ASE/CIS Mainframe Connect DirectConnect Specialty Data Store Toolkit Any Client Or Browser Proxy Tables
    5. 5. <ul><li>First major release in 3 years. </li></ul><ul><li>Major redesign of several products. </li></ul>DirectConnect 12.6
    6. 6. <ul><li>Enterprise Connect Data Access IPS </li></ul><ul><ul><li>DirectConnect for Microsoft SQL Server </li></ul></ul><ul><ul><li>DirectConnect for DB2 UDB </li></ul></ul><ul><ul><li>DirectConnect for Informix </li></ul></ul><ul><ul><li>DirectConnect for ODBC </li></ul></ul><ul><ul><li>DirectConnect for Oracle </li></ul></ul><ul><li>MainframeConnect IPS </li></ul><ul><ul><li>DirectConnect for OS/390 </li></ul></ul><ul><li>DirectConnect for AS400 </li></ul><ul><ul><li>Migration to DB2 UDB </li></ul></ul>All DirectConnect 12.6 Products Updated
    7. 7. <ul><li>Performance, Scalability </li></ul><ul><li>Peaceful Coexistence </li></ul><ul><li>New Features </li></ul><ul><li>DCManager Update </li></ul>12.6 Themes
    8. 8. <ul><li>Performance, Scalability </li></ul><ul><li>Peaceful Coexistence </li></ul><ul><li>New Features </li></ul><ul><li>DCManager Update </li></ul>12.6 Themes
    9. 9. <ul><li>New Product Architecture </li></ul><ul><ul><li>DirectConnect for Microsoft SQL Server </li></ul></ul><ul><ul><li>DirectConnect for DB2 UDB </li></ul></ul><ul><ul><li>DirectConnect for Informix </li></ul></ul><ul><ul><li>DirectConnect for ODBC </li></ul></ul><ul><li>SMP Open Server Conversion </li></ul><ul><ul><li>All DirectConnects </li></ul></ul>Performance, Scalability
    10. 10. New Product Architecture - Background <ul><li>Predecessor Product Architecture </li></ul><ul><ul><li>Multiple processes </li></ul></ul><ul><ul><li>New process for each connection </li></ul></ul><ul><ul><li>Interprocess communications </li></ul></ul><ul><ul><li>Excess data conversions </li></ul></ul><ul><li>12.6 Product Architecture </li></ul><ul><ul><li>Single Process </li></ul></ul><ul><ul><li>New thread for each connect </li></ul></ul><ul><ul><li>Data sharing between main thread and connection threads </li></ul></ul><ul><ul><li>Simplified data conversions </li></ul></ul>
    11. 11. 12.5 Product Architecture O P E N S E R V E R S E R V E R M G R Main Process Open Server Based Event Handler, Service Manager ASE/CIS Rep. Server
    12. 12. 12.5 Product Architecture O P E N S E R V E R S E R V E R M G R C O N N H A N D L R D B T O O L S D T Y P E C O N V T D S L I B R A R Y Main Process with Service Library Loaded Open Server Based Event Handler, Service Manager Service Library (dcany.so) ASE/CIS Rep. Server
    13. 13. 12.5 Product Architecture O P E N S E R V E R S E R V E R M G R C O N N H A N D L R D B T O O L S D A T A C O N V T D S L I B R A R Y T D S S E R V E R D A T A C O N V S Y B O D B C O D B C M G R ODBC DRIVERS MSSS INFX DB2 UDB TDS Event Hdler, Data conversions, DB operations (dc2any) Service Library, DB Operations, Data Conversions (dcany.so) ODBC Drivers (MVMSSS19.so) (MVINFX19.so) (MVDB219.so) Main process Dc2any process (one per connection) Open Server Based Event Handler, Service Manager (direct) pipe ASE/CIS Rep. Srvr Target DB
    14. 14. New Product Architecture <ul><li>Predecessor Product Architecture </li></ul><ul><ul><li>Multiple processes </li></ul></ul><ul><ul><li>New process for each connection </li></ul></ul><ul><ul><li>Interprocess communications </li></ul></ul><ul><ul><li>Excess data conversions </li></ul></ul><ul><li>12.6 Product Architecture </li></ul><ul><ul><li>Single Process </li></ul></ul><ul><ul><li>New thread for each connection </li></ul></ul><ul><ul><li>Data sharing between main thread and connection threads </li></ul></ul><ul><ul><li>Simplified data conversions </li></ul></ul>
    15. 15. 12.6 Product Architecture O P E N S E R V E R S E R V E R M G R Main process Open Server Based Event Handler, Service Manager (direct) ASE/CIS Rep. Server
    16. 16. 12.6 Product Architecture O P E N S E R V E R S E R V E R M G R Main process Open Server Based Event Handler, Service Manager (direct) C O N N H A N D L R D A T A C O N V S Y B O D B C O D B C M G R Service Library, DB Operations, Data Conversions (dcany.so) ASE/CIS Rep. Server
    17. 17. 12.6 Product Architecture O P E N S E R V E R Main process S E R V E R M G R C O N N H A N D L R D A T A C O N V S Y B O D B C O D B C M G R ODBC DRIVERS MSSS INFX DB2 UDB Service Library, DB Operations, Data Conversions (dcany.so) ODBC Drivers (MVMSSS19.so) (MVINFX19.so) (MVDB219.so) (one thread per connection) Open Server Based Event Handler, Service Manager (direct) ASE/CIS Rep. Server Target Database
    18. 18. 12.5 Software Layers Removed D B T O O L S D A T A C O N V T D S L I B R A R Y Dc2any process (one per connection) pipe T D S S E R V E R Main process
    19. 19. 12.5 vs. 12.6 Executable Size Disk Space (KB)
    20. 20. 12.5 vs. 12.6 Memory – 1 Connection Memory Utilized (MB)
    21. 21. 12.5 vs. 12.6 Memory – 10 Connections Memory Utilized (MB)
    22. 22. 12.5 vs. 12.6 Memory – 10 Connections
    23. 23. <ul><li>New Product Architecture </li></ul><ul><ul><li>DirectConnect for Microsoft SQL Server </li></ul></ul><ul><ul><li>DirectConnect for DB2 UDB </li></ul></ul><ul><ul><li>DirectConnect for Informix </li></ul></ul><ul><ul><li>DirectConnect for ODBC </li></ul></ul><ul><li>SMP Open Server Conversion </li></ul><ul><ul><li>All DirectConnects </li></ul></ul>Performance, Scalability
    24. 24. <ul><li>SMP Open Server Conversion </li></ul><ul><ul><li>DirectConnect for Microsoft SQL Server </li></ul></ul><ul><ul><li>DirectConnect for DB2 UDB </li></ul></ul><ul><ul><li>DirectConnect for Informix </li></ul></ul><ul><ul><li>DirectConnect for ODBC </li></ul></ul><ul><ul><li>DirectConnect for Oracle ( available since 12.5) </li></ul></ul><ul><ul><li>DirectConnect for OS/390 </li></ul></ul><ul><ul><li>db2 access service </li></ul></ul><ul><ul><li>trstcp access service </li></ul></ul><ul><ul><li>trslu62 access service </li></ul></ul>SMP Open Server Conversion
    25. 25. <ul><ul><li>All DirectConnects are based on Sybase's Open Server SDK. The SDK can be used to build TDS based, database event handling servers. </li></ul></ul><ul><ul><li>Open Server can be configured to manage event threads in many ways. </li></ul></ul><ul><ul><li>Open Server release 12.5 introduced the SMPOS option, which provides reentrant libraries for preemptive event handling with native threads. </li></ul></ul>SMP Open Server Conversion of DirectConnect
    26. 26. <ul><ul><li>DirectConnect 12.5 operated in non-preemptive mode using Open Server threads . DirectConnect controlled context switches, usually after all work for the thread was completed. Results in: </li></ul></ul><ul><ul><ul><li>Fewer context switches </li></ul></ul></ul><ul><ul><ul><li>Poor CPU utilization </li></ul></ul></ul><ul><ul><ul><li>Lower throughput </li></ul></ul></ul>SMP Open Server Conversion (cont)
    27. 27. <ul><ul><li>DirectConnect 12.6 uses Open Server preemptive scheduling which utilizes native operating system threads. The operating system controls context switching. Results in: </li></ul></ul><ul><ul><ul><li>Frequent context switches for improved time slicing </li></ul></ul></ul><ul><ul><ul><li>Efficient CPU utilization (including SMP) </li></ul></ul></ul><ul><ul><ul><li>Higher throughput </li></ul></ul></ul><ul><ul><ul><li>Scales to handle more users </li></ul></ul></ul><ul><ul><ul><li>Synchronized access to shared resources, ensure reentrancy and thread safety </li></ul></ul></ul>SMP Open Server Conversion
    28. 28. 12.5 vs. 12.6 Performance Comparison <ul><li>~25% performance increase </li></ul>
    29. 29. <ul><li>Performance, Scalability </li></ul><ul><li>Peaceful Coexistence </li></ul><ul><li>New Features </li></ul><ul><li>DCManager Update </li></ul>12.6 Themes
    30. 30. <ul><li>Definition: Internal initiative to improve ability of Sybase products to peacefully coexist when installed together. Minimize/eliminate interference between Sybase applications running on the same machine and within the same directory structure. </li></ul><ul><li>Achieved by product and installation changes </li></ul><ul><li>Verified by departmental peaceful coexistence testing and independent Sybase quality assurance teams </li></ul>Peaceful Coexistence
    31. 31. <ul><li>Isolation of common libraries </li></ul><ul><li>InstallShield </li></ul><ul><li>Minimize dependency on system environment </li></ul><ul><li>New start and add server scripts </li></ul>Peaceful Coexistence Changes (cont)
    32. 32. <ul><li>Performance, Scalability </li></ul><ul><li>Peaceful Coexistence </li></ul><ul><li>New Features </li></ul><ul><li>DCManager Update </li></ul>DirectConnect 12.6 Themes
    33. 33. <ul><li>Windows Service Execution (All) </li></ul><ul><li>Date and Time datatype support (Oracle) </li></ul><ul><li>LINUX </li></ul><ul><ul><li>DC/Oracle </li></ul></ul><ul><ul><li>DCManager </li></ul></ul><ul><li>Express Transfer </li></ul><ul><ul><li>Microsoft SQL Server, DB2 UDB, Informix, and ODBC </li></ul></ul><ul><ul><li>UNIX and Windows Platforms </li></ul></ul>New Features
    34. 34. <ul><li>DirectConnect for DB2 UDB </li></ul><ul><ul><li>Has been available for access to AS400 since 12.5.3 </li></ul></ul><ul><ul><li>ECDA IPS 12.6 (and beyond) will no longer include the AS400 option </li></ul></ul><ul><li>TCP/IP Access Only </li></ul><ul><ul><li>SNA is not supported </li></ul></ul><ul><li>Migrate AS400.cfg files to dcany.cfg file </li></ul><ul><ul><li>Reconfigure connectivity and character set translation </li></ul></ul><ul><li>Migrate Sybase AS400 SQL stored procedures to native AS400 SQL stored procedures </li></ul><ul><ul><li>Native stored procedures utilize extensive IBM SQL programming language </li></ul></ul>DirectConnect for AS400 Migration
    35. 35. <ul><li>Benefits of using DirectConnect for DB2 UDB </li></ul><ul><ul><li>Express Transfer to/from AS400 targets </li></ul></ul><ul><ul><li>More powerful SQL stored procedures </li></ul></ul><ul><ul><li>TCP/IP access </li></ul></ul><ul><ul><li>Login name and password encryption </li></ul></ul><ul><ul><li>Keeping pace of DB2 UDB AS400 updates and new features </li></ul></ul><ul><ul><li>Uses new architecture and the SMPOS </li></ul></ul>DirectConnect for AS400 Migration (cont)
    36. 36. <ul><li>Performance, Scalability </li></ul><ul><li>Peaceful Coexistence </li></ul><ul><li>New Features </li></ul><ul><li>DCManager Update </li></ul>DirectConnect 12.6 Themes
    37. 37. <ul><li>Enhanced Usability </li></ul><ul><li>Support for DirectConnect for Oracle </li></ul><ul><li>Multiple Platform support </li></ul><ul><li>Enhanced Compatibility with other Sybase Central Plug-ins </li></ul>DCManager Update
    38. 38. Enhanced Usability – More Informative
    39. 39. Enhanced Usability – Verbose Mode
    40. 40. Enhanced Usability – Bottom Panel
    41. 41. Enhanced Usability – Limited Field Help
    42. 42. <ul><ul><li>508 Compliant </li></ul></ul><ul><ul><li>Sybase Central v4.3 Support </li></ul></ul><ul><ul><li>Up to date JConnect Support </li></ul></ul>Enhanced Usability – Other
    43. 43. <ul><ul><li>All the administrative features DirectConnect for Oracle provides are now supported by DCManager. </li></ul></ul>DCM - Direct Connect for Oracle Support
    44. 44. <ul><ul><li>Windows NT, 2000, 2003 </li></ul></ul><ul><ul><li>Linux </li></ul></ul><ul><ul><li>Solaris </li></ul></ul><ul><ul><li>HP-UX </li></ul></ul><ul><ul><li>AIX </li></ul></ul>DCM - Multiple Platform support
    45. 45. <ul><ul><li>DCManager has been designed to work on the latest version of Sybase Central (Version 4.3) along with the other major Sybase products (ASE and Rep-Server) to enhance compatibility across multiple product plug-ins. </li></ul></ul>DCM - Enhanced Compatibility
    46. 46. <ul><li>Beta Q4 2004 </li></ul><ul><li>Beta Period - November 23, 2004 through January 18, 2005 </li></ul><ul><li>For more Info Visit http://www.sybase.com/ecda_mfc126beta </li></ul><ul><li>GA Q1 2005 </li></ul>DC 12.6 Availability
    47. 47. <ul><li>Port the remaining DirectConnects to Linux platform </li></ul><ul><li>Add support for the Unicode datatype </li></ul><ul><li>Add support for the new data types “Date” and “Time” </li></ul>DC 12.6 What’s Next
    48. 48. INT413 ECDA 12.6 Optimization Questions? Jerry Kauffman Software Development Manager [email_address] 7/19/2004

    ×