Many customers of NonStop SQL/MP are using the SQL/MX engine to access the data that is stored in SQL/MP tables. They enjoy the features of ANSI DML and use the JDBC drivers in Java programs and ODBC drivers for off-platform applications written in other languages.
This document summarizes the advantages of using the NonStop SQL/MX native tables. It is intended for architects, designers, developers of applications written for or being ported to NonStop Servers as well as database administrators (DBAs) that manage SQL/MP or SQL/MX databases.
Understanding NonStop SQLMX SDA and its impact on performanceFrans Jongma
This paper describes how the Session Data Area (SDA) is used and how its configuration affects performance. The
area is reserved on a session basis and query fragments of a session can only be reused by the same session. It differs in this from the database data cache in DP2, which is shared by all
clients. Because the area is a shared resource and the amount of data is limited, it is advised to track its usage and where possible, adjust the size of the area to the amount of sessions.
The eBITUG 2017 presentation that provides and overview of DBaaS capabilities delivered by NonStop SQL/MX. It also shows how DBS simplifies provision of databases and facilitates automation. It supports virtualized as well as regular NonStop X86-based systems.
Many customers of NonStop SQL/MP are using the SQL/MX engine to access the data that is stored in SQL/MP tables. They enjoy the features of ANSI DML and use the JDBC drivers in Java programs and ODBC drivers for off-platform applications written in other languages.
This document summarizes the advantages of using the NonStop SQL/MX native tables. It is intended for architects, designers, developers of applications written for or being ported to NonStop Servers as well as database administrators (DBAs) that manage SQL/MP or SQL/MX databases.
NonStop SQL/MX DBS demo with iTP WebserverFrans Jongma
This is a step-by-step overview of NonStop SQL/MX Database Services can be used to quickly provision a database and some additional functions. The demo was created using a few very simple HTML pages that invoke the DBS interface.
Introduction to embedded sql for NonStop SQLFrans Jongma
This document provides an introduction to using embedded SQL for NonStop SQL/MX. It discusses the compilation process which involves preprocessing SQL statements, compiling the host language code, and compiling the SQL to generate an execution plan stored in a module file. It provides examples of simple compilation and controlling the module names and locations. The goal is to help new SQL/MX users get started quickly with embedded SQL.
Understanding NonStop SQLMX SDA and its impact on performanceFrans Jongma
This paper describes how the Session Data Area (SDA) is used and how its configuration affects performance. The
area is reserved on a session basis and query fragments of a session can only be reused by the same session. It differs in this from the database data cache in DP2, which is shared by all
clients. Because the area is a shared resource and the amount of data is limited, it is advised to track its usage and where possible, adjust the size of the area to the amount of sessions.
The eBITUG 2017 presentation that provides and overview of DBaaS capabilities delivered by NonStop SQL/MX. It also shows how DBS simplifies provision of databases and facilitates automation. It supports virtualized as well as regular NonStop X86-based systems.
Many customers of NonStop SQL/MP are using the SQL/MX engine to access the data that is stored in SQL/MP tables. They enjoy the features of ANSI DML and use the JDBC drivers in Java programs and ODBC drivers for off-platform applications written in other languages.
This document summarizes the advantages of using the NonStop SQL/MX native tables. It is intended for architects, designers, developers of applications written for or being ported to NonStop Servers as well as database administrators (DBAs) that manage SQL/MP or SQL/MX databases.
NonStop SQL/MX DBS demo with iTP WebserverFrans Jongma
This is a step-by-step overview of NonStop SQL/MX Database Services can be used to quickly provision a database and some additional functions. The demo was created using a few very simple HTML pages that invoke the DBS interface.
Introduction to embedded sql for NonStop SQLFrans Jongma
This document provides an introduction to using embedded SQL for NonStop SQL/MX. It discusses the compilation process which involves preprocessing SQL statements, compiling the host language code, and compiling the SQL to generate an execution plan stored in a module file. It provides examples of simple compilation and controlling the module names and locations. The goal is to help new SQL/MX users get started quickly with embedded SQL.
Concepts of NonStop SQL/MX: Part 3 - Introduction to MetadataFrans Jongma
Series of articles written for DBA’s and developers who know Oracle and want to learn about NonStop SQL/MX. Useful for people who know NonStop, and would like to know about similarities and differences between the two products.
Concepts of NonStop SQL/MX: Part 2 - Introduction to catalogs and other objectsFrans Jongma
Series of articles written for DBA’s and developers who know Oracle and want to learn about NonStop SQL/MX. Useful for people who know NonStop, and would like to know about similarities and differences between the two products.
This document discusses the Module File Cache (MFC) feature of NonStop SQL/MX, which provides a persistent cache for SQL statements beyond what is possible with the internal SQL/MX query cache. MFC caches compiled SQL statements on disk for reuse across connections and application instances. It works with the JDBC and ODBC drivers to improve performance by avoiding recompilation of statements that have already been compiled and cached in MFC modules on disk. The document covers how MFC is organized, best practices for its use, and some current limitations.
A user guide that introduces a new User Interface to HPE NonStop SQL/MX DBS.
SQL/MX DBS is a solution that provides a multi-tenant database environment where the databases are isolated from each other while still sharing common resources such as compute power, storage, and network capacity. However, while the databases share the storage, each database uses dedicated, unshared, devices which prevents them from encountering database bottlenecks such as database cache and lock-space. Cache and lock space are part of the NonStop SQL Data Access Managers which are dedicated to only one database and not shared with others.
The document provides a set of interview questions for an Oracle DBA role. It includes questions about database backups, restoring from backup, database initialization parameters, database object storage structures like data blocks and extents, table structures, database performance monitoring and tuning, database security, database utilities, and basic UNIX commands. The questions cover a wide range of topics that a junior or mid-level Oracle DBA should be familiar with.
This document provides a collection of 17 frequently asked questions (FAQs) about Oracle database concepts. It includes concise definitions and explanations of key terms such as Oracle, Oracle database, Oracle instance, parameter file, system global area, program global area, user account, schema, user role, and more. It also provides sample scripts and is intended as a learning and interview preparation guide for Oracle DBAs.
This document lists 576 Oracle DBA interview questions covering topics such as checking privileges and permissions, resizing datafiles, finding analyzed tables, active users, what a user is doing, table and index counts, tablespace and user space usage, OS and database versions, datafile reads and writes, segments close to limits, archived log and backup information, online redo log groups, datafiles, schema sizes, quotas, tablespace usage, table sizes, row distribution, database recovery, alerts, thresholds, notifications, archive log format, connection troubleshooting, and other administrative tasks and problems.
The document discusses SQL (Structured Query Language) which is used to interact with relational database management systems like MySQL. It provides a brief history of SQL, explaining that SQL originated from SEQUEL in 1974 and became a standard language used by Oracle and Ingres databases in the late 1970s. The document also provides an overview of the basic components of SQL including DDL for defining databases, DML for manipulating data, and DCL for controlling permissions. It uses examples to demonstrate some common SQL statements and their syntax.
Oracle DBA Tutorial for Beginners -Oracle training institute in bangaloreTIB Academy
Get Oracle DBA Training through free Oracle DBA Tutorial, In this Oracle DBA Tutorial specially made for Beginners. You can download Oracle DBA Tutrial
Oracle Database is a collection of data treated as a unit. The purpose of a database is to store and retrieve related information. Oracle Database was started in 1977 as Software Development Laboratories by Larry Ellison and others. Over time, Oracle released several major versions that added new functionality, such as Oracle 12c which was designed for cloud computing. A database server is the key to solving problems of information management by allowing storage, retrieval, and manipulation of data.
Compare the capabilities of the Microsoft Access, Microsoft SQL Serv.pdfarihantplastictanksh
Compare the capabilities of the Microsoft Access, Microsoft SQL Server, Oracle’s MySQL, and
Oracle relational database management systems (RDBMSs). Your paper should discuss the
processing speeds, data storage capabilities, maximum users supported, platforms supported,
user interfaces, development tools, vendor support, and cost. Discuss and cite at least two
references in addition to our textbook. Your paper should be 3-5 pages in length (excluding title
and References pages)
Solution
Microsoft Access
Overview:
Microsoft Access is a part of Microsoft Office,
it is commercially available database in the market
Inexpensive/standard on most computers
users can create complex databases
database professionalas can use construct a database
customers of MS-Access:
It is mainly used in small corporate companies or IT Sectors with 1-80 endusers.
Features of MS-Access:
1.It is having GUI Interface for creating databases
2. A databae contains tables, forms, reports, queries, macros.
3. It facilitates autocontent wizards to build tables or forms or reports.
4. It acts as an interface to other DBMS using ODBC
5. It is used for small business companies
6. Provides security like password protection
7. Provides a Data dictionary
8. We can repair the database
9. We can create different views
10. External data can be imported into Access
11. We can create web pages based using the database
12. It has as built in Macro functions
13. It uses Structurered Query Language
14. We can create forms, reports etc by using Visual Basic Application programming
15. Provides Add in controls like calendars
16. It can merged into word and analysed with Excel etc.
Issues:
Security:
User level security is very difficult
Tuning:
It does not have the ability to split over multiple Hard Drives, multiple CPUs or to place tables
into memory.
Locking:
Basic handling of concurrent users Backup and recovery at basic level.
ANSI SQL standard often doesn\'t work,MS-Access has it\'s own modified version of ANSI
SQL.
MySQL
Overview
MySQL is a database engine. It has a command line interface that allows the creation of
database. It Requires Front-end applications to access it for end users. EX:- C#, PHP, Microsoft
ASP.Net.
Typical users
Small companies or workgroups, through to very large Internet databases with large numbers of
users
Ex:wikipedia,Moodle.
Features
1. Speed:One of the fastest databases available
2. Ease of use: when compared to larger databases such as Oracle Uses standard SQL
3. Capability: A multi-threaded server allowing many clients to connect at the same time Fully
networked for the Internet with built in security
4.Portability: Runs on a many operating systems and different hardware
5. Small size: when compared to other large databases e.g. Oracle
6. Availabliity and Cost: Open Source ,Free in most situations to use
7. Open distribution and source code: You can check how it works – if you have the knowledge.
8. interface to other DBMS’s using Open Database Connectivit.
This document provides answers to 50 questions that may be asked in an Oracle database administrator interview. The questions cover topics such as Oracle database administration, SQL, PL/SQL, UNIX, and networking. For example, questions ask how to determine the database time zone, explain uses of GLOBAL_NAMES and WRAP, describe functions, procedures and packages, explain redo logs, and list UNIX commands for managing files and permissions.
MySQL is an open-source relational database management system that works on many platforms. It provides multi-user access to support many storage engines and is backed by Oracle. SQL is the core of a relational database which is used for accessing and managing the database. The different subsets of SQL are DDL, DML, DCL, and TCL. MySQL has many features including ease of management, robust transactional support, high performance, low total cost of ownership, and scalability.
The Power of Relationships in Your Big DataPaulo Fagundes
The document provides an overview of Oracle NoSQL Database Release 3.0, including new features such as table data modeling, secondary indexing, data centers for disaster recovery, and security enhancements. Best practices are discussed for choosing a data model, using indexes, and configuring data centers and zones.
Managing large chain of Hotels and ERP database comprises of core areas such as HRMS & PIP.HRMS (Human Resource Management System), which further includes areas such as Soft Joining, Promotion, Transfer, Confirmation, Leave Attendance and Exit, etc. PIP (Payroll Information Portal), wherein employees can view their individual Salary details, submit investment declaration, Reimbursement claim & CTC structuring, etc. Management of Large Chain of Hotels and ERP Database in AWS Cloud involves continuous monitoring with regards to the areas such as Performance of resource usages and optimization techniques relating to the use of PL/SQL. High Availability (HA) of data is accomplished through the Backup and Recovery mechanism and security of the data by Encryption & Decryption mechanism.
Getting to know oracle database objects iot, mviews, clusters and more…Aaron Shilo
This document provides an overview of various Oracle database objects and storage structures including:
- Index-organized tables store data within the index based on key values for faster access times and reduced storage.
- Materialized views store the results of a query for faster access instead of re-executing joins and aggregations.
- Virtual indexes allow testing whether a potential new index would be used by the optimizer before implementing.
The presenter discusses how different segment types like index-organized tables, materialized views, and clusters can reduce I/O and improve query performance by organizing data to reduce physical reads and consistent gets. Experienced Oracle DBAs use these features to minimize disk I/O, the greatest factor in
This document provides an overview of In-Memory OLTP and other SQL Server 2016 features such as Stretch Database, Always Encrypted, Dynamic Data Masking, and Query Store. It discusses how In-Memory OLTP can significantly improve database application performance through its memory-optimized tables and natively compiled stored procedures. It also summarizes capabilities for several high availability and security features introduced in SQL Server 2016.
The document provides an overview of database system concepts and architecture. It discusses the key concepts of database schema and instance, the three schema architecture consisting of the internal, conceptual and external schemas, and the goals of data independence. It also describes database languages like DDL and DML used at different levels, common DBMS interfaces, components and utilities. Finally, it covers centralized and client-server architectures and classifications of DBMS based on data model, number of users/sites, software, cost and purpose.
Concepts of NonStop SQL/MX: Part 3 - Introduction to MetadataFrans Jongma
Series of articles written for DBA’s and developers who know Oracle and want to learn about NonStop SQL/MX. Useful for people who know NonStop, and would like to know about similarities and differences between the two products.
Concepts of NonStop SQL/MX: Part 2 - Introduction to catalogs and other objectsFrans Jongma
Series of articles written for DBA’s and developers who know Oracle and want to learn about NonStop SQL/MX. Useful for people who know NonStop, and would like to know about similarities and differences between the two products.
This document discusses the Module File Cache (MFC) feature of NonStop SQL/MX, which provides a persistent cache for SQL statements beyond what is possible with the internal SQL/MX query cache. MFC caches compiled SQL statements on disk for reuse across connections and application instances. It works with the JDBC and ODBC drivers to improve performance by avoiding recompilation of statements that have already been compiled and cached in MFC modules on disk. The document covers how MFC is organized, best practices for its use, and some current limitations.
A user guide that introduces a new User Interface to HPE NonStop SQL/MX DBS.
SQL/MX DBS is a solution that provides a multi-tenant database environment where the databases are isolated from each other while still sharing common resources such as compute power, storage, and network capacity. However, while the databases share the storage, each database uses dedicated, unshared, devices which prevents them from encountering database bottlenecks such as database cache and lock-space. Cache and lock space are part of the NonStop SQL Data Access Managers which are dedicated to only one database and not shared with others.
The document provides a set of interview questions for an Oracle DBA role. It includes questions about database backups, restoring from backup, database initialization parameters, database object storage structures like data blocks and extents, table structures, database performance monitoring and tuning, database security, database utilities, and basic UNIX commands. The questions cover a wide range of topics that a junior or mid-level Oracle DBA should be familiar with.
This document provides a collection of 17 frequently asked questions (FAQs) about Oracle database concepts. It includes concise definitions and explanations of key terms such as Oracle, Oracle database, Oracle instance, parameter file, system global area, program global area, user account, schema, user role, and more. It also provides sample scripts and is intended as a learning and interview preparation guide for Oracle DBAs.
This document lists 576 Oracle DBA interview questions covering topics such as checking privileges and permissions, resizing datafiles, finding analyzed tables, active users, what a user is doing, table and index counts, tablespace and user space usage, OS and database versions, datafile reads and writes, segments close to limits, archived log and backup information, online redo log groups, datafiles, schema sizes, quotas, tablespace usage, table sizes, row distribution, database recovery, alerts, thresholds, notifications, archive log format, connection troubleshooting, and other administrative tasks and problems.
The document discusses SQL (Structured Query Language) which is used to interact with relational database management systems like MySQL. It provides a brief history of SQL, explaining that SQL originated from SEQUEL in 1974 and became a standard language used by Oracle and Ingres databases in the late 1970s. The document also provides an overview of the basic components of SQL including DDL for defining databases, DML for manipulating data, and DCL for controlling permissions. It uses examples to demonstrate some common SQL statements and their syntax.
Oracle DBA Tutorial for Beginners -Oracle training institute in bangaloreTIB Academy
Get Oracle DBA Training through free Oracle DBA Tutorial, In this Oracle DBA Tutorial specially made for Beginners. You can download Oracle DBA Tutrial
Oracle Database is a collection of data treated as a unit. The purpose of a database is to store and retrieve related information. Oracle Database was started in 1977 as Software Development Laboratories by Larry Ellison and others. Over time, Oracle released several major versions that added new functionality, such as Oracle 12c which was designed for cloud computing. A database server is the key to solving problems of information management by allowing storage, retrieval, and manipulation of data.
Compare the capabilities of the Microsoft Access, Microsoft SQL Serv.pdfarihantplastictanksh
Compare the capabilities of the Microsoft Access, Microsoft SQL Server, Oracle’s MySQL, and
Oracle relational database management systems (RDBMSs). Your paper should discuss the
processing speeds, data storage capabilities, maximum users supported, platforms supported,
user interfaces, development tools, vendor support, and cost. Discuss and cite at least two
references in addition to our textbook. Your paper should be 3-5 pages in length (excluding title
and References pages)
Solution
Microsoft Access
Overview:
Microsoft Access is a part of Microsoft Office,
it is commercially available database in the market
Inexpensive/standard on most computers
users can create complex databases
database professionalas can use construct a database
customers of MS-Access:
It is mainly used in small corporate companies or IT Sectors with 1-80 endusers.
Features of MS-Access:
1.It is having GUI Interface for creating databases
2. A databae contains tables, forms, reports, queries, macros.
3. It facilitates autocontent wizards to build tables or forms or reports.
4. It acts as an interface to other DBMS using ODBC
5. It is used for small business companies
6. Provides security like password protection
7. Provides a Data dictionary
8. We can repair the database
9. We can create different views
10. External data can be imported into Access
11. We can create web pages based using the database
12. It has as built in Macro functions
13. It uses Structurered Query Language
14. We can create forms, reports etc by using Visual Basic Application programming
15. Provides Add in controls like calendars
16. It can merged into word and analysed with Excel etc.
Issues:
Security:
User level security is very difficult
Tuning:
It does not have the ability to split over multiple Hard Drives, multiple CPUs or to place tables
into memory.
Locking:
Basic handling of concurrent users Backup and recovery at basic level.
ANSI SQL standard often doesn\'t work,MS-Access has it\'s own modified version of ANSI
SQL.
MySQL
Overview
MySQL is a database engine. It has a command line interface that allows the creation of
database. It Requires Front-end applications to access it for end users. EX:- C#, PHP, Microsoft
ASP.Net.
Typical users
Small companies or workgroups, through to very large Internet databases with large numbers of
users
Ex:wikipedia,Moodle.
Features
1. Speed:One of the fastest databases available
2. Ease of use: when compared to larger databases such as Oracle Uses standard SQL
3. Capability: A multi-threaded server allowing many clients to connect at the same time Fully
networked for the Internet with built in security
4.Portability: Runs on a many operating systems and different hardware
5. Small size: when compared to other large databases e.g. Oracle
6. Availabliity and Cost: Open Source ,Free in most situations to use
7. Open distribution and source code: You can check how it works – if you have the knowledge.
8. interface to other DBMS’s using Open Database Connectivit.
This document provides answers to 50 questions that may be asked in an Oracle database administrator interview. The questions cover topics such as Oracle database administration, SQL, PL/SQL, UNIX, and networking. For example, questions ask how to determine the database time zone, explain uses of GLOBAL_NAMES and WRAP, describe functions, procedures and packages, explain redo logs, and list UNIX commands for managing files and permissions.
MySQL is an open-source relational database management system that works on many platforms. It provides multi-user access to support many storage engines and is backed by Oracle. SQL is the core of a relational database which is used for accessing and managing the database. The different subsets of SQL are DDL, DML, DCL, and TCL. MySQL has many features including ease of management, robust transactional support, high performance, low total cost of ownership, and scalability.
The Power of Relationships in Your Big DataPaulo Fagundes
The document provides an overview of Oracle NoSQL Database Release 3.0, including new features such as table data modeling, secondary indexing, data centers for disaster recovery, and security enhancements. Best practices are discussed for choosing a data model, using indexes, and configuring data centers and zones.
Managing large chain of Hotels and ERP database comprises of core areas such as HRMS & PIP.HRMS (Human Resource Management System), which further includes areas such as Soft Joining, Promotion, Transfer, Confirmation, Leave Attendance and Exit, etc. PIP (Payroll Information Portal), wherein employees can view their individual Salary details, submit investment declaration, Reimbursement claim & CTC structuring, etc. Management of Large Chain of Hotels and ERP Database in AWS Cloud involves continuous monitoring with regards to the areas such as Performance of resource usages and optimization techniques relating to the use of PL/SQL. High Availability (HA) of data is accomplished through the Backup and Recovery mechanism and security of the data by Encryption & Decryption mechanism.
Getting to know oracle database objects iot, mviews, clusters and more…Aaron Shilo
This document provides an overview of various Oracle database objects and storage structures including:
- Index-organized tables store data within the index based on key values for faster access times and reduced storage.
- Materialized views store the results of a query for faster access instead of re-executing joins and aggregations.
- Virtual indexes allow testing whether a potential new index would be used by the optimizer before implementing.
The presenter discusses how different segment types like index-organized tables, materialized views, and clusters can reduce I/O and improve query performance by organizing data to reduce physical reads and consistent gets. Experienced Oracle DBAs use these features to minimize disk I/O, the greatest factor in
This document provides an overview of In-Memory OLTP and other SQL Server 2016 features such as Stretch Database, Always Encrypted, Dynamic Data Masking, and Query Store. It discusses how In-Memory OLTP can significantly improve database application performance through its memory-optimized tables and natively compiled stored procedures. It also summarizes capabilities for several high availability and security features introduced in SQL Server 2016.
The document provides an overview of database system concepts and architecture. It discusses the key concepts of database schema and instance, the three schema architecture consisting of the internal, conceptual and external schemas, and the goals of data independence. It also describes database languages like DDL and DML used at different levels, common DBMS interfaces, components and utilities. Finally, it covers centralized and client-server architectures and classifications of DBMS based on data model, number of users/sites, software, cost and purpose.
Database administration refers to the whole set of activities performed by a database administrator to ensure that a database is always available as needed. Other closely related tasks and roles are database security, database monitoring and troubleshooting, and planning for future growth
This document discusses database systems and SQL. It begins by defining key database concepts like data models, schemas, and instances. It then provides an introduction to SQL, explaining what SQL is used for and some of its main functions. The document goes on to describe database system architecture, languages, and interfaces. It discusses the three-schema architecture and concepts of data independence. It also covers database management system components, utilities, and classifications.
The document discusses the benefits of making the system catalogs in a relational database management system (RDBMS) as relations (tables). This approach stores schema metadata and internal bookkeeping information in relational tables and views, as advocated by the RDBMS. It allows all metadata to be made available through catalog views, which present metadata independently of the underlying implementation and are unaffected by catalog table changes. Catalog views provide the most efficient and standardized way to access core server metadata and help with query optimization.
A database management system (DBMS) is system software that allows for the creation, management, and use of databases, making it easier to create, retrieve, update and manage large amounts of data in an organized manner. The document discusses the definition, importance, implementation, requirements, and challenges of a DBMS, as well as entity relationship diagrams, modeling, and security concepts related to databases. In conclusion, a DBMS is an effective system for systematic data management that is widely used around the world.
This document provides an introduction to SQL Server for beginners. It discusses prerequisites for learning SQL such as knowledge of discrete mathematics. It explains that SQL Server runs as a service and can be accessed via tools like SQL Server Management Studio. The document also covers basic concepts in SQL Server including how data is stored and organized in tables, columns, rows and databases. It defines primary keys and discusses different data types. Finally, it discusses the client-server model and how SQL Server can be accessed from client applications via libraries, web services, and other connectivity options.
SQLite is a public-domain software package that provides a lightweight relational database management system (RDBMS). It can be used to store user-defined records in tables. SQLite is flexible in where it can run and how it can be used, such as for in-memory databases, data stores, client/server stand-ins, and as a generic SQL engine. The SQLite codebase supports multiple platforms and consists of the SQLite core, sqlite3 command-line tool, Tcl extension, and configuration/building options. SQL is the main language for interacting with relational databases like SQLite and consists of commands for data definition, manipulation, and more.
This document provides an overview of the Red Hat Cluster Suite, which delivers high availability solutions. It discusses the Cluster Manager technology, which provides application failover capability to make applications highly available. Cluster Manager uses shared storage, service monitoring, and communication between servers to detect failures and restart applications on healthy nodes. It ensures data integrity through techniques like I/O barriers, quorum partitions, and active/passive or active/active application configurations across nodes.
Similar to Native tables in NonStop SQL database (20)
Introduction of Cybersecurity with OSS at Code Europe 2024Hiroshi SHIBATA
I develop the Ruby programming language, RubyGems, and Bundler, which are package managers for Ruby. Today, I will introduce how to enhance the security of your application using open-source software (OSS) examples from Ruby and RubyGems.
The first topic is CVE (Common Vulnerabilities and Exposures). I have published CVEs many times. But what exactly is a CVE? I'll provide a basic understanding of CVEs and explain how to detect and handle vulnerabilities in OSS.
Next, let's discuss package managers. Package managers play a critical role in the OSS ecosystem. I'll explain how to manage library dependencies in your application.
I'll share insights into how the Ruby and RubyGems core team works to keep our ecosystem safe. By the end of this talk, you'll have a better understanding of how to safeguard your code.
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfChart Kalyan
A Mix Chart displays historical data of numbers in a graphical or tabular form. The Kalyan Rajdhani Mix Chart specifically shows the results of a sequence of numbers over different periods.
5th LF Energy Power Grid Model Meet-up SlidesDanBrown980551
5th Power Grid Model Meet-up
It is with great pleasure that we extend to you an invitation to the 5th Power Grid Model Meet-up, scheduled for 6th June 2024. This event will adopt a hybrid format, allowing participants to join us either through an online Mircosoft Teams session or in person at TU/e located at Den Dolech 2, Eindhoven, Netherlands. The meet-up will be hosted by Eindhoven University of Technology (TU/e), a research university specializing in engineering science & technology.
Power Grid Model
The global energy transition is placing new and unprecedented demands on Distribution System Operators (DSOs). Alongside upgrades to grid capacity, processes such as digitization, capacity optimization, and congestion management are becoming vital for delivering reliable services.
Power Grid Model is an open source project from Linux Foundation Energy and provides a calculation engine that is increasingly essential for DSOs. It offers a standards-based foundation enabling real-time power systems analysis, simulations of electrical power grids, and sophisticated what-if analysis. In addition, it enables in-depth studies and analysis of the electrical power grid’s behavior and performance. This comprehensive model incorporates essential factors such as power generation capacity, electrical losses, voltage levels, power flows, and system stability.
Power Grid Model is currently being applied in a wide variety of use cases, including grid planning, expansion, reliability, and congestion studies. It can also help in analyzing the impact of renewable energy integration, assessing the effects of disturbances or faults, and developing strategies for grid control and optimization.
What to expect
For the upcoming meetup we are organizing, we have an exciting lineup of activities planned:
-Insightful presentations covering two practical applications of the Power Grid Model.
-An update on the latest advancements in Power Grid -Model technology during the first and second quarters of 2024.
-An interactive brainstorming session to discuss and propose new feature requests.
-An opportunity to connect with fellow Power Grid Model enthusiasts and users.
Programming Foundation Models with DSPy - Meetup SlidesZilliz
Prompting language models is hard, while programming language models is easy. In this talk, I will discuss the state-of-the-art framework DSPy for programming foundation models with its powerful optimizers and runtime constraint system.
OpenID AuthZEN Interop Read Out - AuthorizationDavid Brossard
During Identiverse 2024 and EIC 2024, members of the OpenID AuthZEN WG got together and demoed their authorization endpoints conforming to the AuthZEN API
Generating privacy-protected synthetic data using Secludy and MilvusZilliz
During this demo, the founders of Secludy will demonstrate how their system utilizes Milvus to store and manipulate embeddings for generating privacy-protected synthetic data. Their approach not only maintains the confidentiality of the original data but also enhances the utility and scalability of LLMs under privacy constraints. Attendees, including machine learning engineers, data scientists, and data managers, will witness first-hand how Secludy's integration with Milvus empowers organizations to harness the power of LLMs securely and efficiently.
Fueling AI with Great Data with Airbyte WebinarZilliz
This talk will focus on how to collect data from a variety of sources, leveraging this data for RAG and other GenAI use cases, and finally charting your course to productionalization.
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc
How does your privacy program stack up against your peers? What challenges are privacy teams tackling and prioritizing in 2024?
In the fifth annual Global Privacy Benchmarks Survey, we asked over 1,800 global privacy professionals and business executives to share their perspectives on the current state of privacy inside and outside of their organizations. This year’s report focused on emerging areas of importance for privacy and compliance professionals, including considerations and implications of Artificial Intelligence (AI) technologies, building brand trust, and different approaches for achieving higher privacy competence scores.
See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe.
This webinar will review:
- The top 10 privacy insights from the fifth annual Global Privacy Benchmarks Survey
- The top challenges for privacy leaders, practitioners, and organizations in 2024
- Key themes to consider in developing and maintaining your privacy program
Driving Business Innovation: Latest Generative AI Advancements & Success StorySafe Software
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
Taking AI to the Next Level in Manufacturing.pdfssuserfac0301
Read Taking AI to the Next Level in Manufacturing to gain insights on AI adoption in the manufacturing industry, such as:
1. How quickly AI is being implemented in manufacturing.
2. Which barriers stand in the way of AI adoption.
3. How data quality and governance form the backbone of AI.
4. Organizational processes and structures that may inhibit effective AI adoption.
6. Ideas and approaches to help build your organization's AI strategy.
Best 20 SEO Techniques To Improve Website Visibility In SERPPixlogix Infotech
Boost your website's visibility with proven SEO techniques! Our latest blog dives into essential strategies to enhance your online presence, increase traffic, and rank higher on search engines. From keyword optimization to quality content creation, learn how to make your site stand out in the crowded digital landscape. Discover actionable tips and expert insights to elevate your SEO game.
Have you ever been confused by the myriad of choices offered by AWS for hosting a website or an API?
Lambda, Elastic Beanstalk, Lightsail, Amplify, S3 (and more!) can each host websites + APIs. But which one should we choose?
Which one is cheapest? Which one is fastest? Which one will scale to meet our needs?
Join me in this session as we dive into each AWS hosting service to determine which one is best for your scenario and explain why!
Digital Marketing Trends in 2024 | Guide for Staying AheadWask
https://www.wask.co/ebooks/digital-marketing-trends-in-2024
Feeling lost in the digital marketing whirlwind of 2024? Technology is changing, consumer habits are evolving, and staying ahead of the curve feels like a never-ending pursuit. This e-book is your compass. Dive into actionable insights to handle the complexities of modern marketing. From hyper-personalization to the power of user-generated content, learn how to build long-term relationships with your audience and unlock the secrets to success in the ever-shifting digital landscape.
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfMalak Abu Hammad
Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers:
* What is Vector Search?
* Importance and benefits of vector search
* Practical use cases across various industries
* Step-by-step implementation guide
* Live demos with code snippets
* Enhancing LLM capabilities with vector search
* Best practices and optimization strategies
Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications.
#MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Native tables in NonStop SQL database
1. Native Tables in NonStop SQL/MX
Frans Jongma,
Hewlett Packard Enterprise
Advanced Technology Center
NonStop Enterprise Division
Version 1.1
Date: April 2018.
This is Version 1.0 rebranded to HPE format. Note that the document refers to the features of
SQL/MX version 3.2.1 and does not discuss features of newer releases.
Abstract
HPE NonStop SQL/MX is the relational database management system (RDBMS) that is based
on ANSI SQL:1999 with extensions from ANSI SQL:2003. The product can be seen as
combination of a SQL engine and a SQL file system. The engine can be used to access the
tables of previous RDBMS called NonStop SQL/MP as well as the SQL/MX native tables in the
native SQL/MX file system.
Many customers of NonStop SQL/MP are using the SQL/MX engine to access the data that is
stored in SQL/MP tables. They enjoy the features of ANSI DML and use the JDBC drivers in
Java programs and ODBC drivers for off-platform applications written in other languages.
This document summarizes the advantages of using the NonStop SQL/MX native tables. It is
intended for architects, designers, developers of applications written for or being ported to
NonStop Servers as well as database administrators (DBAs) that manage SQL/MP or SQL/MX
databases.
Introduction
HPE NonStop SQL/MX is the relational database management system (RDBMS) that is based
on ANSI SQL:1999 with extensions from ANSI SQL:2003. The product can be seen as a SQL
engine and a SQL file system. The engine can be used to access the tables of previous RDBMS
called NonStop SQL/MP as well as the SQL/MX native tables.
Many customers of NonStop SQL/MP are using the SQL/MX engine to access the data that is
stored in SQL/MP tables. They enjoy the features of ANSI DML and use the JDBC drivers in
Java programs and ODBC drivers for off-platform applications written in other languages.
Long-time NonStop customers may recall some of the SQL/MX features, such as the support for
Referential Integrity (RI), and GRANT/REVOKE for access control to the data. However, in the
2. NonStop Advanced Technology Center
Native Tables in NonStop SQL/MX -2-
last few years, many new features have been added to the SQL/MX file system and customers
that have been using the engine only may not be aware of the complete feature set that the
newer file system might bring them. In this document, the features are grouped into the
following categories:
Security and data integrity: For example, GRANT/REVOKE, Referential Integrity,
triggers.
File characteristics: Hash partitioning, support for large (up to 32KB) rows and large
keys.
Extended data type support: For example, big numbers.
Other features: Meta data, tools and utilities.
It is assumed that the reader is familiar already with the HPE Nonstop SQL/MX Comparison
Guide for SQL/MP Users manual. Additional references to additional documentation are
provided in the sections where they apply. The NonStop SQL/MX manuals can be found in the
NonStop Technical Library at: www.hpe.com/info/nonstop-docs. From this page, select the
appropriate server model, J-Series or L-Series. This document refers to the manual titles as
they appear in the Technical Library without the release number, which is 3.5 at the time of this
writing.
Security and Data Integrity features
The security and data integrity features of the NonStop SQL/MX file system enhance the quality
of the data by enforcing the ANSI model of access control to the data in addition to the integrity
checks prior to deleting or adding a row to the database. These checks include removal of
dependent rows if a parent row is deleted in a cascaded delete operation. Database triggers
may be used to create more complex validation rules.
ANSI user access control
Access to SQL/MX objects is granted to PUBLIC, the set of user IDs known to the system, or to
specific users of the system by their Guardian user ID. SQL/MX allows the creation of a Security
Administrator group. This group contains the users that are allowed to GRANT and REVOKE
object-privileges to other users without having access to the objects themselves. This feature is
also referred to as “Separation of Duties” and was introduced in Release 3.1. In older releases,
the Super-ID, or an operator-ID was used to create and own the objects, but this owner was
also allowed to access the data.
Users are added to the Security Administrators by granting them security administrator
(SECURITY_ADMIN) rights.
The list of security administrators can be obtained by the following command in mxci.
3. NonStop Advanced Technology Center
Native Tables in NonStop SQL/MX -3-
>>get all security_admins;
--- SQL operation complete.
>>
If no Security Administrator group exists, the Super-ID has the privilege to maintain metadata,
such as granting other users to create catalogs, grant users to create schemas in a catalog that
is not owned by these users and to revoke permissions. If a Security Administrator group exists,
only the members of this group have this privilege, and the Super-ID only has the privilege if it
has been explicitly added to this group.
Referential Integrity constraints
Referential Integrity (RI) constraints define relations between tables and may restrict addition or
delete operations on one table based on the existence of data in another table. The typical
example is a constraint on an employee table that only allows adding an employee if the
department number exists in the department table. And, optionally, the restriction to delete a
department row if there is still an employee row referencing it. Without the DBMS enforcing
these rules, program code must be written to do the same. Using RI constraints can therefore
simplify the application development, especially where the effect of an update or delete requires
cascading to other tables. But more importantly, without these RI constraints, one should not
allow end-user tools to access the database in update mode.
Triggers
A trigger is a mechanism to perform certain actions automatically in response to specified
database events such as INSERT, UPDATE and DELETE. These actions can be performed
before or after the event. There are many uses for triggers, not only in relation to security and
data integrity.
Triggers may call Stored Procedures to perform more complex code than the trigger definition
allows, which can be useful when porting code from other DBMSes.
References
SQL/MX reference manual: Chapter 1, Security.
File characteristics
SQL/MX native tables are key-sequenced, TMF-audited tables that are defined in SQL/MX
catalogs and schemas. SQL Access to these tables can only happen using their three-part ANSI
name (catalog.schema.table_name). The physical locations of these tables are in Guardian
subvolumes that have 8 character names starting with ZSD. SQL/MX tables are represented by
two files: one holding the data, the other containing system information. This latter file is also
referred to as the resource fork. A DBA can assign a 6 character Guardian name to the table;
4. NonStop Advanced Technology Center
Native Tables in NonStop SQL/MX -4-
however, in most cases these names are system-generated. The last two position of the file
name denotes whether it is the data fork (value 00), or the resource fork (value 01).
With the new file system, new features were introduced.
Increased block, row and key sizes
SQL rows are stored by the Disk Access Manager (DAM) in blocks of either 4K or 32K bytes.
The DBA can define the block size when the table is created. The system default is defined by
the DEFAULT_BLOCKSIZE Control Query Default (CQD) and is 4096 bytes.
SQL/MX tables can have 4K block and 32K block sizes if the row size is less than 4036 bytes.
The maximum row size available to users is 32708 bytes. Row definitions that exceed 4K bytes,
can only be stored in blocks of 32K (32768) bytes. It may be beneficial to store small rows in
32K blocks, because the blocks are also used to store the index structures of the keys. Larger
blocks can hold more index entries resulting in a lower number of index levels.
The maximum primary key size of a SQL/MX native table is 2048 bytes when no triggers are
defined. With triggers defined, the maximum size is 2032 bytes. Tables with 4K blocks support a
maximum clustering key size of 2010 bytes.
Indexes are subject to the same restrictions as the base tables. The sum of the columns that
form the key of the index may not exceed 2048 bytes when the index is stored in 32K blocks.
Note that the length of the key of an index is the sum of the lengths of the columns that form the
key plus the sum of the length of the clustering key of the base table if the index is non-unique.
Multiple partitions per volume
All SQL objects of a schema reside in the same Guardian subvolume, but multiple partitions of a
table or index may be present on the same disk/subvolume. This is different from SQL/MP
partitioned tables where every disk can only have one partition of a table or index because all
partitions have the same Guardian file name. This feature allows a development system to have
the same number of partitions as a production system but on a smaller amount of physical
disks.
Decoupling of clustering and partitioning keys
SQL/MX allows more freedom in ordering and partitioning the data compared to SQL/MP tables.
In SQL/MP, the order of the columns in the primary key determines the order of the rows placed
on disk as well as the way the data can be partitioned. In a table or index definition, SQL/MX
recognizes three key types: the storage or clustering key, the partitioning key and the primary
key.
5. NonStop Advanced Technology Center
Native Tables in NonStop SQL/MX -5-
Storage or Clustering key
The storage or clustering key determines the order of the rows in each partition of the table. All
SQL/MX tables are key-sequenced and the index blocks within the base table contain the index
records in the order of the storage key. The set of columns that make up the clustering key must
guarantee uniqueness. If necessary, SQL/MX will add an additional column to the clustering key
to create uniqueness, the SYSKEY column.
The example shows the creation of a table without a primary key, but with a storage key
specified. The order of the rows within the table is based on region. Even without a primary key,
partitioning is possible: the table is partitioned on the REGION column.
>>CREATE TABLE ORDER_EXAMPLE
+>(ORDERNUM NUMERIC (6) UNSIGNED NO DEFAULT NOT NULL,
+>PARTNUM NUMERIC (4) UNSIGNED NO DEFAULT NOT NULL,
+>REGION CHARACTER(10) NO DEFAULT NOT NULL,
+>UNIT_PRICE NUMERIC (8,2) NO DEFAULT NOT NULL,
+>QTY_ORDERED NUMERIC (5) UNSIGNED NO DEFAULT NOT NULL )
+>STORE BY (REGION)
+>LOCATION $DATA01 NAME PARTITION_01
+>RANGE PARTITION BY (REGION)
+>( ADD FIRST KEY 'REG_01' LOCATION $DATA01 NAME PARTITION_02,
+> ADD FIRST KEY 'REG_50' LOCATION $DATA02 NAME PARTITION_03
+>);
--- SQL operation complete.
>>
When no storage key is defined and no primary key constraint is present, the storage key will be
the SYSKEY column. Partitioning of such a table is not possible, just like in SQL/MP.
The example shows the use of a partition name. SQL/MX tables have partition names that can
be used for a better identification of the partition. For example, a sequence number can be
assigned such as is done in this CREATE TABLE statement. The default partition name is the
full file system name (node_volume_subvolume_filename). When tables are restored to another
location using Backup-Restore2, the partition name will still refer to the original location of the
object.
Partitioning key
The partitioning key is defined by the RANGE or HASH PARTITION BY clause when a table or
index is created. The partitioning key consists of one or more columns of the storage or
clustering key. The order of the partitioning columns may differ from that of the storage key. In
this example, the ORDER_EXAMPLE table has the rows stored in order of order number, part
number and region. The table is partitioned by region. This means that only within a partition,
the rows are ordered by ordernum, partnum and region.
>>CREATE TABLE ORDER_EXAMPLE
6. NonStop Advanced Technology Center
Native Tables in NonStop SQL/MX -6-
+>(ORDERNUM NUMERIC (6) UNSIGNED NO DEFAULT NOT NULL,
+>PARTNUM NUMERIC (4) UNSIGNED NO DEFAULT NOT NULL,
+>REGION CHARACTER(10) NO DEFAULT NOT NULL,
+>UNIT_PRICE NUMERIC (8,2) NO DEFAULT NOT NULL,
+>QTY_ORDERED NUMERIC (5) UNSIGNED NO DEFAULT NOT NULL )
+>STORE BY (ORDERNUM, PARTNUM, REGION)
+>LOCATION $DATA01 NAME PARTITION_01
+>RANGE PARTITION BY (REGION)
+>( ADD FIRST KEY 'REG_01' LOCATION $DATA01 NAME PARTITION_02,
+> ADD FIRST KEY 'REG_50' LOCATION $DATA02 NAME PARTITION_03
+>);
--- SQL operation complete.
>>
Primary key
The primary key is really a constraint that enforces uniqueness of the row in the table. SQL/MX
uses the primary key (when it is not droppable) as the base table index. In fact, it then becomes
the storage key.
The example shows the three columns defined as the primary key. The STORE BY clause is
optional and used for documentation purposes. If the STORE BY clause is specified, it must be
the same as or a prefix of the primary key.
>>CREATE TABLE ORDER_EXAMPLE
+>(ORDERNUM NUMERIC (6) UNSIGNED NO DEFAULT NOT NULL,
+>PARTNUM NUMERIC (4) UNSIGNED NO DEFAULT NOT NULL,
+>REGION CHARACTER(10) NO DEFAULT NOT NULL,
+>UNIT_PRICE NUMERIC (8,2) NO DEFAULT NOT NULL,
+>QTY_ORDERED NUMERIC (5) UNSIGNED NO DEFAULT NOT NULL
+>, PRIMARY KEY (ORDERNUM, PARTNUM, REGION) )
+>STORE BY PRIMARY KEY
+>LOCATION $DATA01 NAME PARTITION_01
+>RANGE PARTITION BY (REGION)
+>( ADD FIRST KEY 'REG_01' LOCATION $DATA01 NAME PARTITION_02,
+> ADD FIRST KEY 'REG_50' LOCATION $DATA02 NAME PARTITION_03
+>);
--- SQL operation complete.
>>
Droppable Primary Key constraints
SQL/MX tables support the droppable primary key constraint. A unique index on the primary key
columns will be created by the system. Note however, that this automatically created index is
not automatically partitioned. The base table requires a clustering key definition which defines
the structure of the base table index.
>>CREATE TABLE ORDER_HASH_EXAMPLE_DROPPABLE
+>(ORDERNUM NUMERIC (6) UNSIGNED NO DEFAULT NOT NULL,
+>PARTNUM NUMERIC (4) UNSIGNED NO DEFAULT NOT NULL,
+>REGION CHARACTER(10) NO DEFAULT NOT NULL,
+>UNIT_PRICE NUMERIC (8,2) NO DEFAULT NOT NULL,
7. NonStop Advanced Technology Center
Native Tables in NonStop SQL/MX -7-
+>QTY_ORDERED NUMERIC (5) UNSIGNED NO DEFAULT NOT NULL
+>, PRIMARY KEY (ORDERNUM, PARTNUM, REGION) DROPPABLE )
+>STORE BY (REGION)
+>LOCATION $DATA01 NAME PARTITION_01
+>HASH PARTITION BY (REGION)
+>( ADD LOCATION $DATA01 NAME PARTITION_02 ,
+> ADD LOCATION $DATA02 NAME PARTITION_03
+>);
--- SQL operation complete.
>>
Hash partitioned tables
NonStop SQL/MX supports range partitioning and hash partitioning for tables and indexes. With
range partitioning, one uses a FIRST KEY clause to define key ranges for each partition. Each
record is assigned to the partition whose range includes the value of its partitioning key.
With hash partitioning, NonStop SQL uses a hash function on the values of the partitioning key
(which can be just a part of the clustering key) and each record is assigned to a partition based
on the result.
>>CREATE TABLE ORDER_HASH_EXAMPLE
+>(ORDERNUM NUMERIC (6) UNSIGNED NO DEFAULT NOT NULL,
+>PARTNUM NUMERIC (4) UNSIGNED NO DEFAULT NOT NULL,
+>REGION CHARACTER(10) NO DEFAULT NOT NULL,
+>UNIT_PRICE NUMERIC (8,2) NO DEFAULT NOT NULL,
+>QTY_ORDERED NUMERIC (5) UNSIGNED NO DEFAULT NOT NULL
+>, PRIMARY KEY (ORDERNUM, PARTNUM, REGION) )
+>STORE BY PRIMARY KEY
+>LOCATION $DATA01 NAME PARTITION_01
+>HASH PARTITION BY (REGION)
+>( ADD LOCATION $DATA01 NAME PARTITION_02,
+> ADD LOCATION $DATA02 NAME PARTITION_03
+>);
--- SQL operation complete.
Sequence Generators
Sequence generators (SG) are used to create unique numerical values
NonStop SQL/MX supports two types of sequence generators, Internal Sequence Generators,
which are used by columns defined as IDENTITY, and Sequences or External SGs.
Internal Sequence Generator
An Internal Sequence Generator is implicitly created when an IDENTITY column is defined in a
CREATE TABLE statement. The SG is a separate table with only one row associated only with
that IDENTITY column. The example shows how the ORDERNUM column is defined as an
IDENTITY column. The GENERATED ALWAYS AS IDENTITY clause tells the system to assign
8. NonStop Advanced Technology Center
Native Tables in NonStop SQL/MX -8-
a unique value for each inserted row. A GENERATED BY DEFAULT AS IDENTITY clause
allows the application to supply a value when inserting a row, but it can also let the system
determine the value.
>>CREATE TABLE ORDER_SG_EXAMPLE
+>(ORDERNUM LARGEINT GENERATED ALWAYS AS IDENTITY
+> (START WITH 1 INCREMENT BY 1 MINVALUE 1 NO CYCLE),
+>PARTNUM NUMERIC (4) UNSIGNED NO DEFAULT NOT NULL,
+>REGION CHARACTER(10) NO DEFAULT NOT NULL,
+>UNIT_PRICE NUMERIC (8,2) NO DEFAULT NOT NULL,
+>QTY_ORDERED NUMERIC (5) UNSIGNED NO DEFAULT NOT NULL
+>, PRIMARY KEY (ORDERNUM, PARTNUM, REGION ) )
+>STORE BY PRIMARY KEY
+>LOCATION $DATA01 NAME PARTITION_01
+>HASH PARTITION BY (REGION)
+>( ADD LOCATION $DATA01 NAME PARTITION_02 ,
+> ADD LOCATION $DATA02 NAME PARTITION_03
+>);
--- SQL operation complete.
>>prepare x1 from insert into order_sg_example (partnum, region, unit_price,
qty_ordered) values ( ?,?,?,?);
--- SQL command prepared.
>>prepare x2 from insert into order_sg_example values (DEFAULT, ?,?,?,?);
--- SQL command prepared.
The two prepare statements demonstrate how an application can supply parameterized values.
When no column names are provided as in statement x2, the keyword DEFAULT can be used
as a value for the IDENTITY column.
Sequences
An external sequence generator is explicitly created using the CREATE SEQUENCE statement.
The external sequence generator is a schema level database object that the application uses to
generate values for a numeric column. The values generated by the external sequence
generator are unique for that sequence generator and can be used to create unique values
across a set of tables in a schema.
The next example shows simple usage of a sequence. It is created as a SQL object; in the
example all the defaults are used. To get the next value of the sequence, one uses a SQL
SELECT statement to select the pseudo column NEXTVAL. The DUAL view 1
is used to return
only one value, and since this is the first call to select NEXTVAL SQL/MX returns 1. This value
remains the current value until another call to select nextval is issued.
>>create sequence myseq;
1 The DUAL view is a view that has the same purpose as the DUAL pseudo table in other DBMSes. It
returns one row. The DUAL view and metadata views for SQL/MX are described in the paper called
Concepts of NonStop SQL/MX, Introduction to SQL/MX Metadata (part three in the series).
9. NonStop Advanced Technology Center
Native Tables in NonStop SQL/MX -9-
--- SQL operation complete.
>>select myseq.nextval from dual;
NEXTVAL
--------------------
1
--- 1 row(s) selected.
>>select myseq.currval from dual;
CURRVAL
--------------------
1
--- 1 row(s) selected.
>>select myseq.nextval from dual;
NEXTVAL
--------------------
2
--- 1 row(s) selected.
>>
References
SQL/MX reference manual: Chapter 2, CREATE TABLE Statement.
SQL/MX reference manual: Chapter 2, IDENTITY Columns and internal Sequence Generators.
SQL/MX reference manual: Chapter 6, Language Elements: KEYS.
DML variants that are allowed only on native tables
In the earlier releases, all SQL/MX DML could be executed on SQL/MP tables by the SQL/MX
engine. With releases newer than 3.0, some new DML statements have been introduced that
will only work on native tables. New, native-only DML features are: updatable primary keys, self
referencing updates and multi-commit delete. More native-only DML features may be added in
future releases.
Updating the primary key value
With the release of SQL/MX 3.2, updates on the primary keys are allowed. Note however, that
this update is implemented as a delete of the row(s) followed by and an insert. The reason is
simple: as a result of the update of the primary key the row may have to move from one partition
(on one volume) to another.
10. NonStop Advanced Technology Center
Native Tables in NonStop SQL/MX -10-
Self referencing updates
Self referencing updates are updating a table that is read within the same statement using a
subquery.
Imagine a gaming application where you want existing rows to be copied to new rows:
>>insert into tx1 select identifier + 1000, user_name, 'New Game' from tx1;
--- 500 row(s) inserted.
This example shows how to clean up rows that are below an average.
>>delete from tx1 where u < (select avg(u) from tx1);
--- 100 row(s) deleted.
SQL/MX assures that rows are only processed once, to avoid getting into a loop as is the risk
with the INSERT statement where new rows with incremented identifiers are inserted at the end
of the table.
Multi-commit delete
DELETE operations on very large tables can be very long running, locking many rows and may
lead to lock escalations or even worse, a TMF timeout that causes the delete to be backed out.
The Multi-commit option for the DELETE statement breaks up the delete into multiple smaller
deletes. These deletes will be performed by separate Executor Server Processes (ESP), one for
each partition. Currently, the multi-commit option does not allow host variables in the WHERE
clause. It is therefore more useful in a dynamic SQL environment.
>>delete with multi commit every 200 rows from tx1 where u < 500;
--- 4 row(s) deleted.
References
SQL/MX reference manual: Chapter 2, DELETE Statement.
Data types
NonStop SQL/MX native tables support floating point data in IEEE format, which differs from the
Tandem-float format that is used in SQL/MP tables. Character Large Objects (CLOBS) and
Binary Large Objects (BLOBS) are supported by the JDBC drivers. The new data types are
supported by the native tables.
11. NonStop Advanced Technology Center
Native Tables in NonStop SQL/MX -11-
Floating point data types
When SQL/MP tables are migrated to SQL/MX native tables, the floating point data columns
need to be examined for compatibility. SQL/MP uses a different format to implement floating
point data than IEEE which SQL/MX uses. For example, there is no equivalent for a Tandem
REAL in the IEEE data type which preserves the precision and exponent. The IEEE REAL uses
less storage but supports a smaller exponent size. Alternatively, for more exponent and
precision, the column can be defined as FLOAT or DOUBLE PRECISION.
Extended numeric precision
Columns defined as NUMERIC (precision, scale) can have a scale of maximum 128 digits,
which is an increase from 18 in older releases.
Unicode data type
SQL/MX native tables support ISO88591 for single-byte characters and UCS2 (Unicode).
Unicode is a universal encoded character set that lets you store data from any language using a
single character set. NonStop SQL/MX uses the UTF-16BE (16 bits, big endian) encoding for
UCS2. The full range of UTF-16 characters is allowed, but surrogate pairs are not recognized as
characters. (Surrogate pairs are used to expand the code space of UTF-16 beyond the UCS-2
character encoding.)
Large Objects (CLOBs and BLOBs)
Native tables provide support for large binary and character objects, referred to as BLOBs and
CLOBS. Because the largest supported row size is approximately 32KB, an object that is larger
than this maximum cannot be stored in a single row. The JDBC drivers support these objects by
inserting the objects into a dedicated table in as many 32K chunks as necessary to store the
object. The driver takes care of assigning a key value for the object and to store the data into
the table.
References
SQL/MX reference manual: Chapter 6, Language Elements: Data Types.
JDBC Type 2 Driver Programmer’s Reference: Chapter 4, Working with BLOB and CLOB Data
NonStop JDBC Type 4 Driver Programmer’s reference: Chapter 5, Working with BLOB and
CLOB Data
Other functionality
This section describes the miscellaneous features of SQL/MX native tables. For example, the
SQL/MX metadata is stored in SQL/MX native tables; the FASTCOPY utility can efficiently copy
native tables and indexes and the GUARDIAN FUP program can show information about native
12. NonStop Advanced Technology Center
Native Tables in NonStop SQL/MX -12-
tables using their native (ANSI) names. Backup and restore of native tables must be done by
Backup/Restore2 instead of Backup/Restore.
Metadata tables
Users of SQL/MP with the SQL/MX engine use the SQL/MX metadata only to a small extent.
This metadata is often only used to map SQL/MP tables to SQL/MX aliases to allow the use of
full ANSI names to access the data stored in the MP tables. When native tables are used, all the
information about them is stored in highly normalized SQL tables. The layout of the tables is
described in Chapter 10 of the SQL/MX reference manual. The NonStop Advanced Technology
Center provides a utility, mxschema , that creates a set of convenience views on the metadata
that allow a DBA to view information about a objects in a schema using simple SQL queries
instead of writing complex joins. The utility is available from HPE free of charge, but note that it
is provided “as-is”, without warranty of any kind.
Distributed databases
Native tables are accessed via the catalog they are registered in. When tables are distributed
across multiple NonStop servers, the catalog must be registered on each of the nodes using the
REGISTER CATALOG command to make the catalog visible to these nodes. If the catalog is
not visible, a program cannot get access to the data. This is a different approach from SQL/MP
tables where remote data could be accessed by their file names such as
NODE.$DATA.SQL.TBL. SQL/MX tables will always be called by their catalog.schema.table
name regardless of the system they are located.
A user must be granted access via GRANT/REVOKE, but in order to access remote data,
GUARDIAN REMOTEPASSWORDS must be set up, just as is required to access SQL/MP
remote data.
Stored Procedures
Stored procedures can access native tables as well as SQL/MP tables using the same API and
the same (JDBC T2) driver. However, the SPJ must be defined in the SQL/MX catalog.
Views
SQL/MX views can only refer to SQL/MX native tables. The SQL/MX view text is not limited to
the 3,000 characters of SQL/MP.
Utilities
Many new utilities exist for SQL/MX and this paper will only touch upon a few of them that are
important to know about.
13. NonStop Advanced Technology Center
Native Tables in NonStop SQL/MX -13-
Fastcopy
Fastcopy is a command that is similar to SQL/MP LOAD or COPY. It can copy data from one
large table to another faster than a normal insert/select. The most important things to know
about fastcopy are:
Fastcopy performs the functionality of INSERT INTO <target_table> (*) SELECT *
FROM <source_table>. This means that the source and target tables must be similar,
have the same number of columns, compatible data types and so on.
The target table will be made non-audited for the duration of the command, to allow fast
inserts.
Due to the initialization, fastcopy of small tables will take longer than a normal insert-
select.
The command can be executed by user programs using dynamic SQL.
Indexes, when defined on the target and online, are copied in a second step the same
way the table was copied, in the order of the alternate key. This is more efficient than to
create the index separately.
The source table will be accessible for read-only operation while fastcopy executes.
The syntax allows for separate commands to copy a table and index. Fastcopy will
detect if any updates on the source have been applied and will not release the targets
unless it completed successfully.
System generated key values, such as SYSKEYS and IDENTITY columns are copied to
the target.
The target table and indexes will be compacted as if a reload had been performed.
FUP
Fup has been enhanced over the years to provide some support for SQL/MX native tables.
However, SQL/MP users may not be fully aware of the power of the ANSI name support in FUP.
The next paragraphs highlight some features of the INFO and LISTLOCKS commands.
Enhanced INFO command
FUP INFO requested on a table by its ASNI name shows information on all the partitions of the
object instead of just a single Guardian file. The next example shows the information of the
ORDER_EXAMPLE table. It has three partitions, one on $DATA02 and two on $DATA01. One
info command shows the information of all partitions.
-info 'table frans.perf.order_example'
CODE EOF LAST MODIF OWNER RWEP TYPE REC BL
$DATA01.ZSDFJ001
DK4BGG00 550A+ 12288 7:25 211,96 *SQL XPK Ta 28 4
VT1BGG00 550A+ 0 4Sep2013 6:44 211,96 *SQL PK Ta 28 4
$DATA02.ZSDFJ001
L54BGG00 550A+ 12288 7:32 211,96 *SQL XPK Ta 28 4
14. NonStop Advanced Technology Center
Native Tables in NonStop SQL/MX -14-
Enhanced LISTLOCKS command
This example shows the locks placed on the ORDER_DETAIL table when a transaction has
deleted one row, but has not committed yet. The table has three partitions and every partition
has an “Intent-lock” placed on it. The actual row lock is in the partition on $DATA02.
-listlocks 'table frans.perf.order_example'
$DATA01.ZSDFJ001.DK4BGG00
ANSI NAME FRANS.PERF.ORDER_EXAMPLE
LOCK REQUESTER KEY
TYPE STATE ID LEN KEY/RECORD ADDRESS
F GI NSKIT10(2).1.168356
$DATA01.ZSDFJ001.VT1BGG00
ANSI NAME FRANS.PERF.ORDER_EXAMPLE
LOCK REQUESTER KEY
TYPE STATE ID LEN KEY/RECORD ADDRESS
F GI NSKIT10(2).1.168356
$DATA02.ZSDFJ001.L54BGG00
ANSI NAME FRANS.PERF.ORDER_EXAMPLE
LOCK REQUESTER KEY
TYPE STATE ID LEN KEY/RECORD ADDRESS
R G NSKIT10(2).1.168356 16 ?0 ?0 ?0 ?4 ?0 ?1 "REG_50
"
R G NSKIT10(2).1.168356 16 ?255 ?255 ?255 ?255 ?255
?255 ?255 ?255 ?255 ?255 ?255 ?255 ?255 ?255 ?255 ?255
F GI NSKIT10(2).1.168356
-
The LISTLOCKS command can also be used on the schema level by specifying the SCHEMA
keyword instead TABLE.
Warning: The amount of locks displayed may be high on production systems.
Backup and Restore using BR2
SQL/MX objects must be backed up and restored using new utilities. Backup/Restore2 is used
to backup and restore SQL/MX native tables and OSS files to tape.
Customers may already use PAK and UNPAK utilities to backup and restore Guardian objects
to disk. PAK2 and UNPAK2 are available but not yet distributed the same way as
PAK.PAK2/UNPAK2 are best executed from the OSS environment and they use the OSS file
system, however, a Guardian non-native (code 100) version exists.
References
SQL/MX reference manual: Chapter 2, FASTCOPY
SQL/MX reference manual: Chapter 10, Metadata Tables
SQL/MX Guide to Stored Procedures in Java
15. NonStop Advanced Technology Center
Native Tables in NonStop SQL/MX -15-
Backup and Restore 2 Manual
Concepts of NonStop SQL/MX, Introduction to SQL/MX Metadata: HPE Document ID: 4AA3-
6539ENW
Concepts of NonStop SQL/MX, Introduction to SQL/MX Stored Procedures: HPE document ID:
4AA4-9428ENW
Conclusion
Many SQL/MX customers are happy with the functionality that the SQL/MX engine provides
them accessing their SQL/MP data. However, today’s new applications often require more
functionality that only native tables provide. This paper has tried to provide an overview of all the
features that native tables support, and the list may be a lot longer than most SQL/MP
customers expect. I was surprised to write this many pages worth of differences!
Today’s applications maintain more data, which results in storing larger rows; they use
“meaningless” keys, generated by the system as –for example- sequences and they assume the
DBMS to maintain Referential Integrity. All of this is supported by SQL/MX native tables.
SQL/MX security is enhanced by the introduction of the Security Administrator role: the SA can
manage the security of database objects without having access to the data itself. Note that
SQL/MX native tables require different backup and restore procedures than SQL/MP data.
Backups of native tables require the Backup/Restore2 product and can be backed up to disk
using the pak2/unpak2 utilities.