Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
1
Explore What’s New
In UniData 8.1
Jonathan Smith, Principal Technical Support Engineer
2
Abstract
 8.1 was the first major release of UniData in several years. This
presentation describes the new features and...
3
Agenda
 File changes
 Encryption changes
 Installation
improvements
 64-bit builds
 Shared Memory
allocation
©2015 ...
4
File Changes
• New Hash Type 3
• 64-bit Files
• New Dynamic File Split Type
5
New Hash Type 3
Becomes the default for newly created files
• Controlled via the DEFAULT_HASH_TYPE udtconfig tuneable
...
6
New Hash Type 3
Before deciding on the new hash type…
• 13 candidates were examined
• 6 different test patterns over mi...
7
64-bit Files – 32-bit Restrictions
A UniData static hashed file or a sub-file of a dynamic
hashed file is limited to 2G...
8
64-bit Files
The 64-bit data model resolves these issues by allowing
data files sufficiently large that they will not r...
9
64-bit Files
Static files can grow past the previous 2GB boundary
• When you get the growth warning limit in the udt.er...
10
Dynamic Whole File Splitting – Why Change?
 UniData dynamic files grew and shrank based on the
loading of individual g...
11
Dynamic Whole File Splitting - What Changed?
New dynamic file type: WHOLEFILE
• Changes its modulo based on the total ...
12
Encryption Changes
13
Automatic Data Encryption (ADE) Changes
UniData indexes and keys can now be encrypted
Privileged ADE operations no lo...
14
Installation Improvements
15
Installation Improvements - UNIX
A new script called udtsetup should now be used for
an install or upgrade
Upgrade va...
16
Installation Improvements - UNIX
Web authorization and connection to U2BC records
URI (Uniform Resource Identifier) s...
17
Installation Improvements - Windows
Maintain current configuration for upgrade installation
Custom bat file can be ru...
18
64-bit Builds
19
64-bit Builds
ALL builds will be 64-bit only
• No 32-bit builds
 64-bit builds will not install on a 32-bit OS
• Must...
20
Shared Memory Allocation
21
Shared Memory Allocation
Prior to 8.1.0, UniData UniBasic variable space was
allocated with Shared Memory from a syste...
22
Account-based
Licensing
23
Account-based Licensing
An account or a group of accounts are defined as a
logical account
• The license count of the ...
24
U2 Replication
25
U2 Replication
Performance Monitor
• Allows the collection and display of detailed statistics for U2
Replication via t...
26
Security
27
Security
The OpenSSL libraries are updated to version 1.0.1j
• UniData can now import both SHA-1 and SHA-2 certificate...
28
Security
Encrypted passwords
• SSL configuration files no longer contain clear text
passwords.
SSL certificate revoca...
29
Security
SSL_PROTOCOLS
• Specifies the protocols allowed using SSL connections
• The allowed protocols are: SSLv3, TLS...
30
Security
UniBasic SCR API now allows a specific SSL version control
UniBasic Security API now has SHA2 and PKCS#12 su...
31
UniBasic
32
UniBasic in UniData 8.1
 Local functions and subroutines are now supported
• These new subroutines are a block of code...
33
UniBasic in UniData 8.1
 The processing of an EQUATE statement now only incurs the same
execution time penalty as a co...
34
IPv6
35
IPv6
UniData 8.1.0 supports both IPv6 and IPv4
• Server side system calls are both IPv4 and IPv6 compatible
UniBasic ...
36
Other Changes
37
Other Changes - SAVEDLISTS
Prior to 8.1.0, when creating a SAVEDLIST, UniData used
an internal hard-coded break point ...
38
Other Changes - Windows
 The UniRPC service is now configured to be ‘multithreaded’ by default
 UDT.OPTIONS 120 added...
39
Other Changes – cleanupd
On UNIX, the cleanupd process has been redesigned in
order to improve the dead process detect...
40
Other Changes
The SAMPLE keyword has been added to SQL
AFTER EVENT TRIGGERS
udtconfig configurable changes
• HTTP_DE...
41
Previously Supported Components
Objectcall
• No longer functional in 8.1
On the UNIX version, the udtinstall and upda...
42
Next Steps
Other presentations:
• 8.1 in Depth: Meet the New UDT 64-bit Files
• Troubleshooting UDT
• Lab: UniData 8.1...
43
Disclaimer
THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL PURPOSES ONLY.
WHILE EFFORTS WE...
44
Trademarks and Acknowledgements
The trademarks and service marks identified in the following list are the exclusive pro...
45
Upcoming SlideShare
Loading in …5
×

Explore What’s New In UniData 8.1

112 views

Published on

8.1 was the first major release of UniData in several years. This presentation describes the new features and functionality we’ve added. New features include 64-bit files, 64-bit builds, account-based licensing, installation improvements, improvement to ADE, IPV6 support … and the list goes on.

Published in: Software
  • Be the first to comment

  • Be the first to like this

Explore What’s New In UniData 8.1

  1. 1. 1 Explore What’s New In UniData 8.1 Jonathan Smith, Principal Technical Support Engineer
  2. 2. 2 Abstract  8.1 was the first major release of UniData in several years. This presentation describes the new features and functionality we’ve added. New features include 64-bit files, 64-bit builds, account- based licensing, installation improvements, improvement to ADE, IPV6 support … and the list goes on. ©2015 Rocket Software, Inc. All Rights Reserved.
  3. 3. 3 Agenda  File changes  Encryption changes  Installation improvements  64-bit builds  Shared Memory allocation ©2015 Rocket Software, Inc. All Rights Reserved.  Account-based licensing  U2 Replication  Security  UniBasic  IPv6  Other changes
  4. 4. 4 File Changes • New Hash Type 3 • 64-bit Files • New Dynamic File Split Type
  5. 5. 5 New Hash Type 3 Becomes the default for newly created files • Controlled via the DEFAULT_HASH_TYPE udtconfig tuneable  Improved hashing of groups • The general distribution is significantly improved compared to other hash types • In a number of specific customer examples where the existing hash types gave a poor distribution, hash type 3 succeeded ©2015 Rocket Software, Inc. All Rights Reserved.
  6. 6. 6 New Hash Type 3 Before deciding on the new hash type… • 13 candidates were examined • 6 different test patterns over millions of keys were examined including exact customer cases where dynamic files would overflow extremely quickly • We decided on the AP function which is a general hash function listed in the NIST (National Institute of Standards and Technology) Dictionary of Algorithms and Data Structures • Testing on customer cases that did not perform well with Type 0 or Type 1, we were able to demonstrate performance improvements, some of them quite substantial ©2015 Rocket Software, Inc. All Rights Reserved.
  7. 7. 7 64-bit Files – 32-bit Restrictions A UniData static hashed file or a sub-file of a dynamic hashed file is limited to 2G in size • Theoretically, a UniData dynamic file can grow to 500G until it reaches 256 dat, over or idx files. The overall cost of the dynamic file operations is high than static hashed files, and internal management of the sub-files requires complicated code and hence reduced file performance. • In the information-hungry world we operate in today, this was becoming a serious restriction for more and more user applications. • The block-size of the data file is limited to 16K and as data records are now getting larger and larger, this also is a performance limitation of the 32-bit model. ©2015 Rocket Software, Inc. All Rights Reserved.
  8. 8. 8 64-bit Files The 64-bit data model resolves these issues by allowing data files sufficiently large that they will not reach a limitation in the foreseeable future as the maximum size is now 8 Exabytes • The conversion from 32-bit to 64-bit will need to be done with the RESIZE or memresize command  memresize has also been modified to use buffer sizes greater than 4GB. It should now be considered unlimited • The address mode for RESIZE and memresize will remain the same as currently defined in the file if no keyword is specified  If a file is converted from one address model to another and has one or more indexes, the indexes will also be converted to the new address mode ©2015 Rocket Software, Inc. All Rights Reserved.
  9. 9. 9 64-bit Files Static files can grow past the previous 2GB boundary • When you get the growth warning limit in the udt.errlog, you can resize these files to 64-bit to avoid file corruption, potential loss of data, and downtime • When upgrading to 8.1.0, part of the upgrade plan could be to resize all files over a given size to 64-bit to avoid waiting for the warning. You can also take advantage of the increased buffer size with memresize and, on UNIX, the “concurrent” option to resize a file while it is in use. 64-bit files can have a block size of up to 2GB • Allows you to store some previously problematic large records without issue ©2015 Rocket Software, Inc. All Rights Reserved.
  10. 10. 10 Dynamic Whole File Splitting – Why Change?  UniData dynamic files grew and shrank based on the loading of individual groups • For this type of file to perform well, records need to hash evenly and work at their best when there is only a small standard deviation in terms of:  The average record size for the KEYDATA style  The average key size for the KEYONLY style • When these styles are not hashed evenly, a UniData dynamic file can grow unnecessarily large. This contributes to wasted disk space as well as reducing the file scan performance (SELECT, SSELECT). • In order to reduce unnecessary splitting, the UDT_SPLIT_POLICY configurable was added prior to 8.1.0 and is still applicable to KEYDATA and KEYONLY dynamic files ©2015 Rocket Software, Inc. All Rights Reserved.
  11. 11. 11 Dynamic Whole File Splitting - What Changed? New dynamic file type: WHOLEFILE • Changes its modulo based on the total file load rather than on an individual group’s load • The new whole-file based style works for both 32-bit and 64-bit dynamic files • The existing dynamic file types KEYONLY and KEYDATA will continue to be supported • udtconfig tuneables have been added for the default split and merge values • The default dynamic file type will be the new whole file based style and is controlled with a udtconfig tuneable ©2015 Rocket Software, Inc. All Rights Reserved.
  12. 12. 12 Encryption Changes
  13. 13. 13 Automatic Data Encryption (ADE) Changes UniData indexes and keys can now be encrypted Privileged ADE operations no longer require the master key as a password • Starting at 8.1.0, these operations are now protected by a separate password which can be changed independently of the master key ©2015 Rocket Software, Inc. All Rights Reserved.
  14. 14. 14 Installation Improvements
  15. 15. 15 Installation Improvements - UNIX A new script called udtsetup should now be used for an install or upgrade Upgrade validation Custom configurations Parameter file added for a ‘silent install’ ©2015 Rocket Software, Inc. All Rights Reserved.
  16. 16. 16 Installation Improvements - UNIX Web authorization and connection to U2BC records URI (Uniform Resource Identifier) support Backup and restore of udt environment Check and correct file permissions Improved logging with unique exit codes and messages ©2015 Rocket Software, Inc. All Rights Reserved.
  17. 17. 17 Installation Improvements - Windows Maintain current configuration for upgrade installation Custom bat file can be run before or after the install Parameter file added for a ‘silent install’ Backup and restore of udt environment Improved logging ©2015 Rocket Software, Inc. All Rights Reserved.
  18. 18. 18 64-bit Builds
  19. 19. 19 64-bit Builds ALL builds will be 64-bit only • No 32-bit builds  64-bit builds will not install on a 32-bit OS • Must have a compatible 64-bit compiler • Any linked C routines, Windows dll’s, etc. must be 64-bit compatible if it is required to perform a makeudt • The compiler and OS version that UniData is built on is stored in the port.note file ©2015 Rocket Software, Inc. All Rights Reserved.
  20. 20. 20 Shared Memory Allocation
  21. 21. 21 Shared Memory Allocation Prior to 8.1.0, UniData UniBasic variable space was allocated with Shared Memory from a system-wide shared pool in order to reduce total system-wide memory consumption In 8.1.0, we moved to a heap memory allocation model for UniBasic variable processing. A future webinar to discuss these changes is planned ©2015 Rocket Software, Inc. All Rights Reserved.
  22. 22. 22 Account-based Licensing
  23. 23. 23 Account-based Licensing An account or a group of accounts are defined as a logical account • The license count of the main UniData licence can be subdivided into the logical accounts • Aids in hosting multiple customer installations on the same physical machine with only one instance of UniData • Logical account can be configured to help ensure that administrators always have a license seat to use if required • Not currently supported with device licensing enabled ©2015 Rocket Software, Inc. All Rights Reserved.
  24. 24. 24 U2 Replication
  25. 25. 25 U2 Replication Performance Monitor • Allows the collection and display of detailed statistics for U2 Replication via the Extensible Administration Tool (XAdmin) or command line interface of reptool Data Compression • Allows data to be compressed during the network transfer phase • Reduces the data volume being transferred and the overall transfer time • Reduces any problems that customers may experience due to slow network speeds ©2015 Rocket Software, Inc. All Rights Reserved.
  26. 26. 26 Security
  27. 27. 27 Security The OpenSSL libraries are updated to version 1.0.1j • UniData can now import both SHA-1 and SHA-2 certificates directly • Minimum industry version to correct vulnerabilities, such as Heartbleed and POODLE • Tech Note available on how to update library to newer versions as 1.0.1m U2 root certificate store • This file contains a metadata section that stores data such as version, creation and modification times, and so forth, and is designed around the Microsoft certificate store to allow similar interrogation ©2015 Rocket Software, Inc. All Rights Reserved.
  28. 28. 28 Security Encrypted passwords • SSL configuration files no longer contain clear text passwords. SSL certificate revocation list (CRL) processing • Including the handling of standard based CRL files, multiple CRLs (from different CAs), DER type CRL, delta CRLs, and improved error reporting during CRL verification. ©2015 Rocket Software, Inc. All Rights Reserved.
  29. 29. 29 Security SSL_PROTOCOLS • Specifies the protocols allowed using SSL connections • The allowed protocols are: SSLv3, TLSv1, TLSv1.1, TLSv1.2 SSL_OPTIONS • Specifies additional options that will be set for SSL connections • The valid options are: TLS_FALLBACK_SCSV, and NO_TLS_FALLBACK_SCSV More information in the release notes and Security Features manual ©2015 Rocket Software, Inc. All Rights Reserved.
  30. 30. 30 Security UniBasic SCR API now allows a specific SSL version control UniBasic Security API now has SHA2 and PKCS#12 support As part of the updating the OpenSSL libraries, various obsolete handshake sequences are now rejected around SSLv3 and SSLv2 Both the standard (non-secure) and SSL (secure) UniData telnet services on Windows can now be selectively disabled with XAdmin ©2015 Rocket Software, Inc. All Rights Reserved.
  31. 31. 31 UniBasic
  32. 32. 32 UniBasic in UniData 8.1  Local functions and subroutines are now supported • These new subroutines are a block of code that you call like existing subroutines and functions but they exist in the same source code file • COMMON and EQUATE statements along with variables used in a local subroutine only apply for that local subroutine  MQSeries AMI and MQI Interface • Existing UniBasic code using the U2AMI will now display the following message: “Note: IBM is no longer supporting AMI. This feature is removed from UniData as of UniData 8.1.0. Please use the new MQI feature as an alternative.”  U2 Dynamic Objects (UDO) provide an object structure based on JSON within UniBasic • Starting at 8.1.0, UniData allows the conversion between XML and JSON data within the objects ©2015 Rocket Software, Inc. All Rights Reserved.
  33. 33. 33 UniBasic in UniData 8.1  The processing of an EQUATE statement now only incurs the same execution time penalty as a comment line • To take advantage of this enhancement, programs will be need to recompiled and recataloged  Introduction of a new @USER.TYPE of 3, which will be set if client access to the system is from UniObjects, Intercall, or our other client tools  SYSTEM(9012) has also be enhanced to return 1 if the client access is from InterCall, UniObjects ,or other client tools; otherwise it returns 0  SYSTEM(99) has been added to return the system time in the number of seconds since midnight 1 January 1970 in Coordinated Universal Time (UTC) ©2015 Rocket Software, Inc. All Rights Reserved.
  34. 34. 34 IPv6
  35. 35. 35 IPv6 UniData 8.1.0 supports both IPv6 and IPv4 • Server side system calls are both IPv4 and IPv6 compatible UniBasic functions added to allow the programmatic setting of any client side connection preference New UCI configuration line IPVERSION =“IPV6” | “IPV4” and the uci client connection will use this preference to connect to the server (unirpcd) New functions added for the Intercall client ©2015 Rocket Software, Inc. All Rights Reserved.
  36. 36. 36 Other Changes
  37. 37. 37 Other Changes - SAVEDLISTS Prior to 8.1.0, when creating a SAVEDLIST, UniData used an internal hard-coded break point to control the size of files created in the SAVEDLIST directory. • This could result in many separate SAVEDLIST files being generated by appending a sequential three-digit number (for example, 000,001,002, etc.) to the list name. Now the SAVEDLIST will be a single file with 000 appended to the list name. • This behavior is controlled from the udtconfig tuneable SINGLE_SAVEDLIST. The default is 1. If a user wants to return to the old method, then the tuneable can be set to 0. ©2015 Rocket Software, Inc. All Rights Reserved.
  38. 38. 38 Other Changes - Windows  The UniRPC service is now configured to be ‘multithreaded’ by default  UDT.OPTIONS 120 added to resolve printing issues on some instances of Windows 2012  The performance of the Recoverable File System (RFS) has now been dramatically improved for Windows  Separate UniData event logs now appear in the Windows Event viewer  UniData now recognizes administrator privileges for users who inherit their administrative privileges through a domain group hierarchy ©2015 Rocket Software, Inc. All Rights Reserved.
  39. 39. 39 Other Changes – cleanupd On UNIX, the cleanupd process has been redesigned in order to improve the dead process detection phase and make the resource cleanup easier • Prior to these changes, race conditions could be encountered which resulted in problems determining if a process had exited • ‘NUSERS’ extra semaphores are required • The ipcstat command has been modified and will report these structures as a ‘live detection semaphore’ • When a process logs in, they acquire one of the semaphores; when it exits (normally or abnormally) the semaphore will be released • The cleanupd process now checks the status of the owner of the semaphore in order to determine the status of process ©2015 Rocket Software, Inc. All Rights Reserved.
  40. 40. 40 Other Changes The SAMPLE keyword has been added to SQL AFTER EVENT TRIGGERS udtconfig configurable changes • HTTP_DEFAULT_VERSION controls the default HTTP version used in UniBasic • Several of the default values of the configurable parameters have been increased to reduce the amount of tuning during installation Improved error reporting back to UniObjects.NET and UOJ connections ©2015 Rocket Software, Inc. All Rights Reserved.
  41. 41. 41 Previously Supported Components Objectcall • No longer functional in 8.1 On the UNIX version, the udtinstall and updatesys scripts are in 8.1.0. However the new udtsetup script is now the recommended script for installations and upgrades ©2015 Rocket Software, Inc. All Rights Reserved.
  42. 42. 42 Next Steps Other presentations: • 8.1 in Depth: Meet the New UDT 64-bit Files • Troubleshooting UDT • Lab: UniData 8.1 Administration • Lab: U2 Replication • U2 Replication for HADR • U2 Replication and EDA • HADR Best Practices • SaaS Best Practices and Account Based Licensing ©2015 Rocket Software, Inc. All Rights Reserved.
  43. 43. 43 Disclaimer THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL PURPOSES ONLY. WHILE EFFORTS WERE MADE TO VERIFY THE COMPLETENESS AND ACCURACY OF THE INFORMATION CONTAINED IN THIS PRESENTATION, IT IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. IN ADDITION, THIS INFORMATION IS BASED ON ROCKET SOFTWARE’S CURRENT PRODUCT PLANS AND STRATEGY, WHICH ARE SUBJECT TO CHANGE BY ROCKET SOFTWAREWITHOUT NOTICE. ROCKET SOFTWARE SHALL NOT BE RESPONSIBLE FOR ANY DAMAGES ARISING OUT OF THE USE OF, OR OTHERWISE RELATED TO, THIS PRESENTATION OR ANY OTHER DOCUMENTATION. NOTHING CONTAINED IN THIS PRESENTATION IS INTENDED TO, OR SHALL HAVE THE EFFECT OF: • CREATING ANY WARRANTY OR REPRESENTATION FROM ROCKET SOFTWARE(OR ITS AFFILIATES OR ITS OR THEIR SUPPLIERS AND/OR LICENSORS); OR • ALTERING THE TERMS AND CONDITIONS OF THE APPLICABLE LICENSE AGREEMENT GOVERNING THE USE OF ROCKET SOFTWARE. ©2015 Rocket Software, Inc. All Rights Reserved.
  44. 44. 44 Trademarks and Acknowledgements The trademarks and service marks identified in the following list are the exclusive properties of Rocket Software, Inc. and its subsidiaries (collectively, “Rocket Software”). These marks are registered with the U.S. Patent and Trademark Office, and may be registered or pending registration in other countries. Not all trademarks owned by Rocket Software are listed. The absence of a mark from this page neither constitutes a waiver of any intellectual property rights that Rocket Software has established in its marks nor means that Rocket Software is not owner of any such marks. Aldon, CorVu, Dynamic Connect, D3, FlashConnect, Pick, mvBase, MvEnterprise, NetCure, Rocket, SystemBuilder, U2, U2 Web Development Environment, UniData, UniVerse, and wIntegrate Other company, product, and service names mentioned herein may be trademarks or service marks of others. ©2015 Rocket Software, Inc. All Rights Reserved.
  45. 45. 45

×