SAP HANA SPS09 - SAP HANA Core & SQL

1
©2014 SAP AG or an SAP affiliate company. All rights reserved.
SAP HANA SPS 09 - What’s New? SAP HANA Core & SQL
SAP HANA Product Management November, 2014
(Delta from SPS 08 to SPS 09)

©2014 SAP SE or an SAP affiliate company. All rights reserved.
2
Public
Disclaimer
This presentation outlines our general product direction and should not be relied on in making a purchase decision. This presentation is not subject to your license agreement or any other agreement with SAP.
SAP has no obligation to pursue any course of business outlined in this presentation or to develop or release any functionality mentioned in this presentation. This presentation and SAP’s strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice.
This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in this document, except if such damages were caused by SAP intentionally or grossly negligent.

3
Public
Agenda
Extended HANA core features
Extended HANA SQL syntax

5
Public
Partitioning – What’s New in SPS 09?
Typical use cases for partitioning
Load-balancing
Performance: parallelization, partition pruning, merge
Overcome 2 billion rows limit
Types of partitioning
Single-Level partitioning: hash, range, round-robin
Multi-Level partitioning: hash-range, hash-round-robin, hash-hash, round-robin-range, range-range (new)
Added Data-Types for partitioning
Range partitioning: BIGINT, DECIMAL (new)
Table re-partitioning
Python script to improve performance for table re-partitioning (new)
Script is not available for customers, but shall be used by SAP consultants
Script is documented and attached to SAP note: #2012533
Script can be applied to SAP HANA version >= rev69 Patch Level 4

6
Public
Range-Range partitioning
When to use range and range-range partitioning
Applications may choose to use range partitioning to actively manage the partitioning of a table
Example:
Time-based partitioning, where a date column is leveraged as partitioning specification
An application may add a partition for an upcoming year so that new data is inserted into that new partition.
CREATE COLUMN TABLE mytable (a DATE, b int, PRIMARY KEY (a, b))
PARTITION BY
RANGE (year(a))
(PARTITION '2000' <= values < ‘2011', PARTITION '2011' <= values < ‘2014‘, PARTITION value = ‘2014'),
RANGE (b)
(PARTITION 0 <= values < 10001, PARTITION OTHERS)
0-10000
Server 1
Server 2
Server 3
Year 2000-2010
Year 2011-2013
Year 2014
>10000
0-10000
>10000
0-10000
>10000

7
Public
Table re-distribution – What’s New in SPS 09?
What is table re-distribution
Assign tables / partitions to nodes in a distributed SAP HANA system
SAP HANA provides a redistribution tool in the HANA admin console that evaluates landscape information and configuration parameters to generate and execute an optimized distribution plan
An optimized data distribution affects significantly the performance in a multi-node HANA cluster
How to configure table distribution
Maintain Table-Classification + Table Placement configuration in HANA system tables
The Table Placement configuration allows you to define distribution/partitioning rules for tables, table groups and schemas
Assign tables to a particular node
< SPS09: master node, any (slave) node
>=SPS09: hostname with associated volumeID (new)
Hostname/Hostgroup with associated volumeID
Allows to assign tables/table_groups/schemas to particular hosts (volumes)
Tables will remain on the volume, even during re-distribution (“pinning”), i.e. no table movement
Support auto-failover, as the tables are assigned to volumes

8
Public
Example: steps to assign a schema to volume
Step 1: Identify the volumeID for HANA indexserver datafile on a host
Step 2: Associate host alias with volumeID in global.ini
SYSTEM ALTER configuration ('global.ini','SYSTEM') SET ('table_placement','hostA')='3' WITH RECONFIGURE;
Step 3: Assign schema to host alias in table placement
UPSERT "_SYS_RT"."TABLE_PLACEMENT"(SCHEMA_NAME,LOCATION) VALUES('My_Schema','hostA') WHERE SCHEMA_NAME = 'My_Schema';

9
Public
Memory efficiency – What’s New in SPS 09?
Primary Key Inverted Hash
HANA allows to define a composite primary key for column tables as INVERTED HASH
Hash keys have reduced main memory requirements HANA, as the composite key is encoded in a condensed manner (hash value)
Note:
–The query performance can be affected by using hash keys depending on the statement, such as for between-queries or like-queries on the composite key
–DML operations on tables with hash keys can still lead to performance penalties (~10%)
CREATE COLUMN TABLE mytable ("id" NVARCHAR (5), "l_name" NVARCHAR (20), "f_name" NVARCHAR(20), PRIMARY KEY INVERTED HASH("id", "l_name"));
Auto-Unload of Tables
Forces the HANA database to unload tables from main memory automatically after a defined unused retention period
Note:
–HANA unloads tables based on LRU, whenever the available memory becomes small
–Additionally, applications can control the loading and unloading of tables explicitly
With SPS09, the auto-unload function supports the administrator to take off unused tables periodically from main memoy
Note:
–The monitoring task of unused tables adds additional workload on the HANA database
–The SQL syntax will be described with the next HANA DSP revision (Feb 2015)
CREATE|ALTER TABLE … [UNUSED RETENTION PERIOD <retention_period>] – retention period in <sec>

HANA SQL
The slides cover new HANA SQL core functions. They will be documented for SPS09 in the customer note #2094186.
It is planned to update the HANA SQL reference guide in Feb 2015.
SQL extensions for new HANA options, like dynamic tiering, streaming, data integration and quality, spatial, multi-tenancy, time series are not covered here. Their SQL syntax will be described in dedicated Developer Guides (see customer note #2091815) or in the HANA Admin Guide.
Important Remarks:

11
Public
Regular Expressions – What’s New in SPS 09?
Regular expressions (RegEx) are used to find and replace complex text patterns (expressions) in strings. HANA SPS09 supports regular expression operators in SQL statements. The search pattern grammar is based on Perl Compatible Regular Expression (PCRE).
Example:
LIKE_REGEXPR
SELECT * FROM mytab WHERE text LIKE_REGEXPR 'them|this';
LOCATE_REGEXPR
update mytab set num = LOCATE_REGEXPR (START 'A' IN 'AaBb');
TEXT
NUM
This or that
1

12
Public
Regular Expressions – cont.
OCCURENCES_REGEXPR
update mytab set num = OCCURRENCES_REGEXPR ('B' FLAG 'i' IN 'AaBb' FROM 1);
REPLACE_REGEXPR
insert into mytab values (REPLACE_REGEXPR ('A' FLAG 'i' IN 'AaBb aBAcd cAAA' WITH 'b'), 0);
SUBSTRING_REGEXPR
insert into mytab values SUBSTR_REGEXPR ('OR' FLAG 'i' IN (select text from mytab where text LIKE_REGEXPR 'them|this')), 0);

13
Public
Window Functions – What’s New in SPS 09?
The window functions allow you to divide the result sets of a query, or a logical partition of a query, into groups of rows called window partitions. A window partition is specified by one or more expressions in the OVER clause. Window functions are applied to each row within window partition boundaries.
Window frame ROWS specification
Physically limits the rows within a partition by specifying a number of rows preceding or following with respect to the current row
Inverse distribution functions
PERCENTILE_CONT:
–Returns an interpolated value based on a continuous distribution of the column value
PERCENTILE_DISC:
–Given a percentile, returns the value that corresponds to that percentile. Assumes a discrete distribution data model

14
Public
Number Functions – What’s New in SPS 09?
Number functions take numeric values, or strings with numeric characters, as inputs and return numeric values
BITCOUNT
Counts the number of set bits in the given integer or varbinary value
–SELECT BITCOUNT (255) "bitcount" FROM DUMMY; -> 8
BITXOR
Performs an XOR operation on the bits of the given non-negative integer or VARBINARY values
–SELECT BITXOR (255, 123) "bitxor" FROM DUMMY; -> 132
BITOR
Performs an OR operation on the bits of the given non-negative integer or VARBINARY values
–SELECT BITOR (255, 123) "bitor" FROM DUMMY; -> 255
BITNOT
Performs a bitwise NOT operation on the bits of the given integer value
–SELECT BITNOT (255) "bitnot" FROM DUMMY; -> -256

15
Public
Aggregate function – What’s New in SPS 09?
Aggregate functions calculate a single value from the values of multiple rows in a column
STRING_AGG()
Returns the concatenated string
–SELECT STRING_AGG(text,';') FROM mytab;
Note:
Supported with rev82 and now officially announced with SPS09
Documented in the SQL reference guide with SPS08
Not supported for WITHIN GROUP

16
Public
Table Sampling – What’s New in SPS 09?
The goal of the TABLESAMPLE operator is to allow queries to be executed over ad-hoc random samples of tables. Samples are computed uniformly over data items that are qualified by some columnar base table.
Example
Compute an approximate average of the salary field for managers over 1% of the emp table
–SELECT count(*), avg(salary) FROM emp TABLESAMPLE SYSTEM (1) WHERE type = 'manager'
Note:
For SPS09, sampling is limited to columnar base tables and repeatability is not supported
TABLESAMPLE operator will be documented in the updated SQL reference guide Feb 2015

17
Public
How to find SAP HANA documentation on this topic?
•In addition to this learning material, you can find SAP HANA platform documentation on SAP Help Portal knowledge center at http://help.sap.com/hana_platform.
•The knowledge centers are structured according to the product lifecycle: installation, security, administration, development:
SAP HANA Options
SAP HANA Advanced Data Processing
SAP HANA Dynamic Tiering
SAP HANA Enterprise Information Management
SAP HANA Predictive
SAP HANA Real-Time Replication
SAP HANA Smart Data Streaming
SAP HANA Spatial
•Documentation sets for SAP HANA options can be found at http://help.sap.com/hana_options:
SAP HANA Platform SPS
What’s New – Release Notes
Installation
Administration
Development
References
•

Thank you
Contact information
Ruediger Karl
SAP HANA Product Management
AskSAPHANA@sap.com

19
Public
© 2014 SAP SE or an SAP affiliate company. All rights reserved.
No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP SE or an SAP affiliate company.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. Please see http://global12.sap.com/corporate-en/legal/copyright/index.epx for additional trademark information and notices.
Some software products marketed by SAP SE and its distributors contain proprietary software components of other software vendors.
National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or warranty of any kind, and SAP SE or its affiliated companies shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP SE or SAP affiliate company products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation, and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platform directions and functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. All forward- looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions.

SAP HANA SPS09 - SAP HANA Core & SQL

In this document

More Related Content

What's hot

Similar to SAP HANA SPS09 - SAP HANA Core & SQL

More from SAP Technology

Recently uploaded

SAP HANA SPS09 - SAP HANA Core & SQL