Informix User Group France - 30/11/2010 - Nouveautés IDS 11.10 & 11.50

Fonctionnalités majeures IDS 11.10 & 11.50

Laurent Valenza
laurent.valenza@fr.ibm.com

Mardi 30 novembre 2010
User Group Informix France

Create Index Automatically Creates Enhan
Glo ced
bal Distributions & Statistics dbin
non f o()
-log configu Multiple Trigger per
ging ratio sysdbopen &
Private tem n of table
Cache Memory p tab Automatic Checkpoints sysdbclose
Process for Virtual les
s or s Auto AIO VP Tuning s
im e statistic
OnBar W hole System Parallel Restore atic real-temp tables
Autom d f or t
Auto LRU Tuning Databas create
e Restar Enhanced Explain
t Policy
Non-Block Checkpoints
raci ng Database Scheduler
SQL Admin API SQL Hi s tory T
ontape Directory Backup
Online Reconfiguration Last Committed Isolation
of the Physical log Dynamically Rename rypted on
Enha
ANSI Join Directives nced Objects in ER Enc nicati
sysm mu DR
ast er Com or H
Detailed Thread Wait Information User Group Informix FranceF

Cheetah

Disponibilité RESILIENCE

Performance OLTP DATA SERVER

Scalabilité CAPACITE DE TRAITEMENT HAUTEMENT SCALABLE

Sécurité SECURITE DES DONNEES ET DES ACCES A LA BASE

Administration FAIBLE ADMINISTRATION

Développement GESTION DES RESSOURCES DE LA BASE DE DONNEES


Remote Standalone Secondary Server
Mise en place de la fonctionnalité HDR facilitée, uniquement en cas de besoin

k
Serveur totalement r
indépendant o
OLTP
Mise en place de la HDR
w
facilitée N t
e
Copie des bases sur les N
System B
deux systèmes System A
k
Aucun impact sur la r
production N HDR
o
w
Synchronisation
t
asynchrone des log buffers

w
e

o
e

k
r
t
Chiffrement des données N

N
entre les noeuds HDR
ER : Amélioration du
parallèlisme


Remote Standalone Secondary


Shared Disk Secondary


Sauvegarde et Restauration

Sauvegarde et restauration sur des partitions du système, répertoires

– Modification des paramètres TAPEDEV, LTAPEDEV

– Ontape & Onbar

Continuous Logical Restore (utile pour la création d’un système de backup)

– Alternative à la fonctionnalité HDR

Amélioration des sauvegardes et restaurations parallèles (valable aussi aujourd’hui
pour les “whole backup”)

RTO_SERVER_RESTART, action sur le temps de redémarrage du moteur en cas de
crash


Cheetah

Disponibilité RESILIENCE

Performance OLTP DATA SERVER

Scalabilité CAPACITE DE TRAITEMENT HAUTEMENT SCALABLE

Sécurité SECURITE DES DONNEES ET DES ACCES A LA BASE

Administration FAIBLE ADMINISTRATION

Développement
GESTION DES RESSOURCES DE LA BASE DE DONNEES


OLTP Data Server

AMELIORATION DE LA REPLICATION D’ENTREPRISE
– Exécution Parallélisé de l’application des modifications sur les
enregistrements
– Amélioration remarquable des performances globales

IMPROVED STATISTICS MAINTENANCE
– Mise à jour automatique des statistiques lors de créations d’index

NON BLOCKING CHECKPOINT
– Nouvel algorithme de synchronisation, suppression du mécanisme de
fuzzy-checkpoint


Build for Speed – less hardware required

• Tremendous performance on low cost hardware
• Customers scale for high volume throughput
• Financial services: 100,000 messages/sec on 4-CPU Linux system
• Pharmacy system: 1B transactions per day on a 8-CPU machine
• Large retailer: Over 225 transactions/sec on a 32-CPU system
with space for growth
• IDS 11.5: Up to 50% faster than previous versions

“In our benchmarking process, Informix came out above all other
leading solutions for its performance, scalability and reliability.”
- Jon Tasker - Project Manager, Trafficmaster, UK

Scalabilité

Architecture multithread
– Faible consommation de ressources
– Architecture 32 & 64 Bits
– Thread Migration pour le load balancing
– Ajout “on the fly” de processeur virtuel

Gestion des utilisateurs
– Allocation dynamique des ressources en fonction de la charge

Ressources physiques
– Gestion des I/O
– Parallélisme
– Ajout automatique d’espace disque


Sécurité

Encryption Expert

Label Based Common Criteria
Access Control Certification

Chiffrement au niveau réseau


Sécurité

Chiffrement :
– Communication entre le client et le serveur, end to end
– Requêtes distribuées
– Enterprise Replication, sélection des serveurs à chiffrer, communication totalement
sécurisée
– HDR, chiffrement totale ou partielle des journaux, chiffrement entre le primaire et le
secondaire
Contrôle :
– Chargement des datablades
– Création des bases de données et autres…
– Séparation des rôles
> DBSA : Database system Administrator
> DBSSO : Database system security officer
> AAO : Audit Analysis Officer
> BAR : Backup and Restore Group
Audit :
– On-Audit, ShowAudit géré par AAO et DBSSO


Sécurité

Label Access Control (LBAC):
– Permet de définir qui peut accéder aux données mais
aussi aux colonnes
– Gestion très précise des données
– Système flexible dans l’utilisation mais aussi grâce à la
richesse de ses options
– Puissant et robuste dans l’application des règles de
sécurité


Sécurité

Common Criteria Certification
– Certification gouvernementale rigide :
• Identification, Authentification, Controle d’accès, Audit,
Communications et la protection des données
• EAL 4 - Niveau maximum qu’un logiciel peut obtenir pour
être utilisé dans les pays signataires en terme de sécurité
– Bénéfices :
• Niveau de sécurité du produit
• Compatibilité avec : SOX, HIPAA, Gramm-Leach-Bliley


IDS Survey results : Average DBA Days/Year
25% report no DBA time at all
An Average of 7 minutes per user week

14%

8% Les s than 1 Day
1 to 2 Days
2 to 3 Days
11%
3 Days or More
67%


Administration

Nouvelle Database (sysadmin) :
–Fonction d’administration
–Gestion des alertes
–Collecte de données
Améloriation de sysmaster et onstat :
–Checkpoint
–Environnement User/Server
–Online & onbar log files
–Information Réseau (IO counts and times)
–SQL Statement Historique
Scheduler interne
–Execution de SQL
–Procédure stockée
–UDR


Fonction SQL Administration

Nouvelles UDRs pour l’administration du serveur
Informix
Thématique d’administration :
– Gestion de l’espace
– Gestion de la configuration
– Maintenance des routines
– Oncheck
Avantages :
– Administration SQL
– Remote Administration
– Suivi de l’exécution des commandes dans des
tables Informix
– Reporting personalisable
– Integration dans le système d’audit de l’entreprise


Fonction SQL Administration

L’API SQL Admin stocke Column Type Description
les informations dans cmd_number serial
une table de la base
sysadmin cmd_exec_time datetime Time the command
year to was started
second
cmd_user varchar User executing the
command
cmd_hostname varchar Host the command
was executed from

cmd_executed varchar The command
executed
cmd_ret_status Integer Return code
cmd_ret_msg lvarchar Return message


Sysmaster : Nouvelles tables
TABLE NAME DESCRIPTION
syscheckpoint The information about the checkpoint and associated statistics
systcblst Modified the existing table to add wait stats.
sysenvses View Informix’s session environment variables
sysenv View the servers environment variables
sysonlinelog View the online.log for the server
sysscblst Improvement to view the memory used by session
sysnetworkio View the network I/O generated by database session
sysdual Oracle compatibility feature
syssqlcacheprof Displays the profile information about each SQL cache
syssqltrace The sql statements which have been recently executed on the system
syssqltrace_itr The list of iterators for the SQL statement.
syssqltrace_info General information about the SQL tracing
sysnetglobal Global Network Information
sysnetclienttype Network information based on client type
sysbaract_log The OnBar Activity Log file
sysrstcb Improvement to view I/O and lock wait information


SQL Drill Down

Name Description
Information de détail sur User ID User id
les requêtes SQL Session ID Database Session ID

Database Name Current Database Name
Visualisation de toutes les Statement Type Type of SQL statement being executed
couches Statement Execution Duration of the SQL statement
time

Lecture simple, claire du Time of Execution Date & Time this statement completed

Statement Text SQL statement text or the procedure
contenu de sysmaster et stack trace with statement type

onstat RSAM statistics •Buffer Reads & Writes
•Page reads & Writes
•Memory Sorts, disk Sorts,
•Lock requests, waits
Configuration dynamique •Logical Log Records
•Index buffer reads

Granularité au niveau
SQL statistics •Estimated # of rows
utilisateur •Estimated Cost
•# of rows returned
•Statement Type
•Database Isolation Level


SQL Drill Down – vue onstat
Database: sysadmin
Statement text:
SELECT MAX(run_task_seq) FROM ph_run A, ph_task B WHERE A.run_task_id
= ?
AND A.run_task_id = B.tk_id AND A.run_time + B.tk_delete < CURRENT
Iterator/Explain
================
ID Left Right Est Cost Est Rows Num Rows Type
3 0 0 1 1 1 Index Scan
4 0 0 19 545 1 Index Scan
2 3 4 20 5 1 Nested Join
1 2 0 1 1 1 Group
Statement information:
Sess_id User_id Stmt Type Finish Time Run Time
21 0 SELECT 10:51:11 0.0023
Statement Statistics:
Page Buffer Read Buffer Page Buffer Write
Read Read % Cache IDX Read Write Write % Cache
0 77 100.00 0 0 0 0.00
Lock Lock LK Wait Log Num Disk Memory
Requests Waits Time (S) Space Sorts Sorts Sorts
0 0 0.0000 0.000 B 0 0 0
Total Total Avg Max Avg I/O Wait Avg Rows
Executions Time (S) Time (S) Time (S) IO Wait Time (S) Per Sec
220 78.8463 0.3584 1.9557 0.000000 0.000000 439.9908
Estimated Estimated Actual SQL ISAM Isolation SQL
Cost Rows Rows Error Error Level Memory
20 1 1 0 0 DR 41552


Open Admin Tool
Outil Web d’administration

Un seul outil pour superviser
plusieurs instances déportées

Information géographiques sur la
localisation des serveurs

Surveillance pointue des
instances
Lecture claire des erreurs

Vision centralisée des serveurs

Géo-Visualisation des serveurs

Développement

Trigger :
– Multiple INSERT, UPDATE, DELETE,SELECT dans une table avec aussi support du INSTEAD OF
– Support des triggers sur les vues
XML publishing :
– SQL sur XML stockée en base
– XPATH
– Génerer du XML
– Manipuler du XML
Index Hierarchic :
– Support des données hiérarchiques
– Monde MVS, MainFrame
Basic Text Datablade :
– Recherche de mots, phrases
– Documents non structurés
– Colonne : CHAR, VARCHAR, LVARCHAR, TEXT, CLOB
– Operations boolean type OR, AND et NOT


Nouvelles fonctionnalités
de « Cheetah » IDS 11.50


Connection Manager

IDS 11.5 introduces the Online
Connection Manager and
Server Monitor (oncmsm):
• a daemon program which
accepts a client connection Austin

as
eg
request and then re-routes OLFrisco

sV
TP

La
e?
that connection to one of the

nc
best fit nodes in the IDS

ta
ins
cluster.

g
lo
ta
• Monitors instance activity ca
h Dallas
levels.
hic
W

CA
TA

M ART
LLas Vegas
O
G

Paris Tokyo
Sao Paulo


SLA
SLA = Service Level Agreement

• A “contract” between client applications and IDS instances.

• Can be based on probability of performance and data “currency”:
• If user requires the most current data as opposed to slight lag
time while replication occurs, user must connect to primary or
HDR secondary instance.
• If user can tolerate some degree of latency, then user should be
connected to another secondary instance based on “currency”
requirement (SDS vs HDR secondary vs RSS).

• Can also be based on geographic or functional requirements:
• Connect to instances within X miles/km.
or
• Connect to instances designated to support specific types of
application workloads.
but you must define this by “known” instance names.

SLA
For example:
SLA oltp=primary
SLA report=rss_1+rss_2+rss_3
SLA accounting=SDS+HDR
SLA catalog=rss_4+rss_5+rss_6
SLA test=RSS

The following are “reserved words” for SLA definitions:
primary – the cluster primary.
SDS – any SDS instance.
HDR – the HDR secondary.
RSS – any RSS instance.

An SLA definition can include “reserved words” as well as specific
instance names.
NOTE: each SLA has a separate SQLHOSTS entry on CM
server.

SLA
Connection attempts using SLAs:

SLA oltp=primary
SLA payroll=HDR+primary
SLA report=SDS+HDR


Failover Arbitrator

The Failover Arbitrator provides automatic failover logic for high-
availability clusters.

Monitors all nodes checking for the primary
failover.
Is Primary
Primary Really Down?
Down?
Performs failover (i.e. promote secondary to
primary) when it is confirmed that the primary HDR
is down. Traffic

Primary HDR secondary
RSS
Released as part of the Connection Traffic

Manager.

W ill support failover to an RSS node. RSS


Failover Arbitrator

Example:
FOC serv1+(serv2+SDS)+HDR+RSS,10

Failover order if primary doesn’t come “back” after 10 seconds, for
example network connectivity hiccup:
• serv1 instance.
• best choice of serv2 or one of the (surviving?) SDS instances.
• HDR secondary.
• Any RSS node.

The FOC can be passed to the connection manager (oncmsm) on the
command line as “-f serv1+(serv2+SDS)+HDR+RSS,10”.


Updatable Secondaries

Client applications can update data on secondary servers!

Updatable secondaries give the appearance that
updates are occurring directly on the secondary
server when in fact the transaction is transferred to
the primary server and then the change is replicated
to the secondary server.


Updatable Secondaries

Attempted writes (insert, update, and delete) are redirected
from the secondary to the primary instance.
Only supports DML statements, can not create tables,
indexes etc.
Uses optimistic concurrency to avoid updating a stale copy
of the row.
Works on all MACH-11 secondary instances.


Nouvelles fonctionnalités
de « Cheetah » IDS 11.50xC4


Compression

Ability to store data rows in compressed format on disk

Saves up to 90% of row storage space
Space returned can then be used by any table in the dbspace

Ability to estimate possible compression ratio

Fits more data onto a page
Fits more data into buffer pool
Reduces logical log usage


Compression
Performance Impact
IO-bound workloads
– Compression may improve performance by reducing IOs
(both data page and logical log)
– More data fits on a page, so more in buffer pool
– Log records are smaller, so less logging

For CPU-bound workloads
– Additional CPU used to compress and expand rows
– Should not be a large impact


Compression

All are supported on compressed tables
HDR
– Tables will be compressed on secondary iff they are
compressed on primary
ER
– Compression status of tables is independent between
source and target, specified by user


Compression
Things That Cannot Be Compressed
Out-of-row data (e.g. blobs)
Indexes
Catalog tables
Temp tables
Partition tables
Dictionary tables
Tables in the following databases:
sysuser,sysmaster,sysutils,syscdr,syscdcv1


Compression

Individual fragments for table big2
Free Pages
Used Pages
Estimate of used after compression

Informix Warehouse
Run your BI/Analytics on Informix

• Informix customers want
•Leverage functionality from
the same characteristics for XPS:
their core BI/Analytics as
they have in IDS •External tables
Business •Lite scans
Intelligence
and •Hybrid fragmentation
Analytics •They want warehousing
tools integrated with IDS •Administer with OAT
•Integration with other DW/BI
products:
•Many customers already •Cognos 8
use IDS for their BI/Analytics
•SQL Warehouse
•Informix Warehouse for
IDS


Merci

Laurent Valenza
laurent.valenza@fr.ibm.com

Mardi 30 novembre 2010

Informix User Group France - 30/11/2010 - Nouveautés IDS 11.10 & 11.50

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (14)

Similar to Informix User Group France - 30/11/2010 - Nouveautés IDS 11.10 & 11.50

Similar to Informix User Group France - 30/11/2010 - Nouveautés IDS 11.10 & 11.50 (20)

More from Nicolas Desachy

More from Nicolas Desachy (7)