NoSQL support in Informix (JSON storage, Mongo DB API)

Informix 12.1
Conference Highlights
© 2013 IBM Corporation
1
Conference Highlights
More than 700 technical sessions
More than 110 hands-on labs
Industry-focused business and IT leadership sessions
Approximately 300 client and Business Partner speakers
IBM’s largest EXPO – 350+ exhibits
Visit: http://www-01.ibm.com/software/data/2013-conference/

Informix 12.1
IOD Informix Customer Advisory Council
and Business Partner Meeting
• November 2, 2013
• Breakfast 8:30 am
• Banyan A & C
2
• Banyan A & C
• Mandalay Bay South Convention Center
For more information, please contact Anita
McKeithen (mckeithe@us.ibm.com)

Informix 12.1
SAVE THE DATE
Informix IOD Deep Dive Workshop
• November 3, 2013
• Come to learn more about Informix NoSQL which
features:
•Ease of use
3
•Ease of use
•API Support
•Usability of Sharded Queries
•Simple Migration from other NoSQL dbs such
as (MongoDB)
•High Availability/Sharded Data Replication
• For more information, please contact Anita
McKeithen (mckeithe@us.ibm.com)

Informix NoSQL
IBM Informix Version 12.10
4

Informix 12.1
Overview
What is NoSQL, JSON and BSON?
New Informix NoSQL/JSON Capabilities
Solution Highlights
The Power of a Hybrid Solution
Value: Open Source vs Enterprise Class
5

Informix 12.1
Not Only SQL or NOt allowing SQL
A non-relational database management systems
– Does not require a fixed schema
– Avoids join operations
– Scales horizontally
– No ACID (eventually consistent)
Good with distributing data and fast application development
What is a NoSQL Database?
Provides a mechanism for storage and retrieval of
data while providing horizontal scaling.

Informix 12.1
Why NoSQL?
Non-traditional data management
requirements driven by Web 2.0
companies
– Document stores, key-value stores, graph and
columnar dbms
The Three Vs:
– Velocity – high frequency of data arrivals
– Velocity – high frequency of data arrivals
– Volume – BigData
– Variability – unstructured data, flexibility in
schema design
New data interchange formats – like JSON
(JavaScript Object Notation) and BSON
(Binary JSON)
Scale-out requirements across
heterogeneous environment – Cloud
computing
7

Informix 12.1
JSON Syntax Rules
– JSON syntax is a subset of the JavaScript object notation syntax:
– Data is in name/value pairs
– Data is separated by commas
– Curly braces hold objects
– Square brackets hold arrays
JSON Name/Value Pairs
– JSON data is written as key/value pairs.
– A key/value pair consists of a field name (in double quotes), followed by a colon, followed
JSON Details
– A key/value pair consists of a field name (in double quotes), followed by a colon, followed
by a value:
JSON Values can be
– A number (integer or floating point)
– A string (in double quotes)
– A Boolean (true or false)
– An array (in square brackets)
– An object (in curly brackets)
– Null
8 © 2013 IBM Corporation
"name":"John Miller"

Informix 12.1
JSON: JavaScript Object Notation
What is JSON?
– JSON is lightweight text-data interchange format
– JSON is language independent
– JSON is "self-describing" and easy to understand
JSON is syntax for storing and exchanging text information much like XML.
However, JSON is smaller than XML, and faster and easier to parse.
{
"name":"John Miller",
"age":21,
"count":27,
"employees": [
{ "f_name":"John" , "l_name":"Doe" },
{ "f_name":"Anna","m_name" : "Marie","l_name":"Smith" },
{ "f_name":"Peter" , "l_name":"Jones" }
]
}
BSON is a binary form of JSON.

Informix 12.1
Basic Translation Terms/Concepts
Mongo/NoSQL Terms Informix Terms
Database Database
Collection Table
Document Row
Field Column
10
{"name":"John","age":21}
{"name":"Tim","age":28}
{"name":"Scott","age":30}
Name Age
John 21
Tim 28
Scott 30
Collection
Document
Key Value
Table
Row

Informix 12.1
IBM Use Case Characteristics for JSON
Schema flexibility and development agility
– Application not constrained by fixed pre-defined schema
– Ability to handle a mix of structured and unstructured data
Consistent low latency, even under high loads
– Ability to handle thousands of users
– Typically millisecond response time
Continuous availability
– 24x7x365 availability
– Online maintenance operations
– Ability to upgrade hardware or software without down time
Dynamic Elasticity
– Rapid horizontal scalability
– Ability to add or delete nodes dynamically in the Cloud/Grid
– Application transparent elasticity
Low cost infrastructure
– Commonly available hardware (Windows & Linux,…)
Reduced need for database administration and maintenance

Informix 12.1
Why Most Commercial Relational Databases cannot
meet these Requirements
Schema Flexibility & Development Agility
– Relational schemas are inherently rigid
– Database design needs to be done before application is developed
– Different rows cannot have a different structures
– Data modeling based on domain objects, which may not be well understood upfront
Consistent Low Latency, even under high load
– ACID requirements inherently introduce write latency
– There is no latency-consistency tradeoff knobs available
– Requirement can be met, but at a much higher cost (hardware, software or complexity)
High Availability
– Requirement can be met, but at a significant cost
– Typically rolling version upgrades are complex in clustered RDBMS
Dynamic Elasticity
– Not a natural fit for RDBMS, due to requirement for strong consistency
– Scale-out requires partition tolerance, that increases latency
Low Cost
– Distributed RDBMS typically require specialized hardware to achieve performance
– Popular relational databases typically require several DBAs for maintenance and tuning

Informix 12.1
Some Typical NoSQL Use Cases - Mostly Interactive Web/Mobile
Online/Mobile Gaming
– Leaderboard (high score table) management
– Dynamic placement of visual elements
– Game object management
– Persisting game/user state information
– Persisting user generated data (e.g.
drawings)
Display Advertising on Web Sites
– Ad Serving: match content with profile and
E-commerce/Social Commerce
– Storing frequently changing product
catalogs
Social Networking/Online
Communities
Communications
– Device provisioning
present
– Real-time bidding: match cookie profile with
ad inventory, obtain bids, and present ad
Dynamic Content Management and
Publishing (News & Media)
– Store content from distributed authors, with
fast retrieval and placement
– Manage changing layouts and user
generated content
13
Logging/message passing
– Drop Copy service in Financial
Services (streaming copies of trade
execution messages into (for
example) a risk or back office
system)

Informix 12.1
High Level Solution
Include JSON and BSON
Provide a mongo compatible programming
Super scale out
– Simplify the ability to scale out to multiple nodes, multiple versions, multiple copies
– Provided diskless and disk based scale out at the individual node with automatic failover
– Provided Sharded Insert, Update, Delete and Query operations
Provide native JSON & BSON support in the Informix Database Server
– Provided Sharded Insert, Update, Delete and Query operations
Simplify the “up and running” experience
Added value
– Blended/Hybrid workloads
– Join between NoSQL and Relational tables
– Joins utilize indexes on both Relational and NoSQL
– Industrial strength query optimizer
– Enterprise Security and encryption
14

Informix 12.1
New NoSQL/JSON Features in Informix
Two new built in “first-class” data types called JSON and BSON
Support for MongoDB client side APIs
Sharded operations enable horizontal scaling
Provide native JSON & BSON support in the Informix Database Server
Sharded operations enable horizontal scaling
Adaptive default system initialization
15

Informix 12.1
Two New Data Types JSON and BSON
JSON and BSON data types
Index support for NoSQL data types
Native operators and comparator functions allow for
direct manipulation of the BSON data type
Database Server automatically converts to and from
• JSON BSON
• Character data JSON
16

Informix 12.1
MongoDB Application Compatibly
Ability to use any of the MongodB client drivers and frameworks against the Informix
Database Server
– Little to no change required when running MongoDB programs
– Informix listens on the same default port as mongo, no need to change.
Leverage the different programming languages available
– Language examples C, C#, Erlang, JAVA, node.js, Perl, Python, Ruby
17
Mongo Action Description
db.customer.insert( { name: “John", age: 21 } ) Insert into database “db” the customer
collection the associated document.
db.customer.find( {age: { $gt:21 } } ) Retrieve from database “db” the customer
collection all documents with the age
greater than 21.

Informix 12.1
Client Applications
New Wire Protocol Listener supports existing MongoDB drivers
Connect to MongoDB or Informix with same application!
MongoDB
native Client
Applications
MongoDB
Wire
MongoDB
driver
MongoDB
web browser
Mobile
JDBC
Driver
IBM
NoSQL
Wire
Protocol
Listener
Wire
Protocol
Informix
NoSQL
Cluster
driver
MongoDB shell

Informix 12.1
Scaling Out – Sharding Data
Shard Key
state= “WA”
Shard Key
state= “CA” • Each node in the environment
hold a portion of the data
• Shard by either hash or
expression
• When inserting data it is
automatically moved to the
correct node
Shard Key
state= “OR”
correct node
• Queries automatically
aggregate data from the
required node(s)

Informix 12.1
Simplify the “up and running” Experience
Install and setup a typical database instance with only 3 questions:
– Where to place the Product?
– Where to place the Data?
– How many users do you anticipate?
Newly installed instance adapts to the resources on the computer
20
Description
Auto tuning of CPU VPS
Auto Table Placement
Auto Buffer pool tuning
Auto Physical Log extension
Auto Logical Log Add

Informix 12.1
Simply Administration - OAT manages JSON objects
21

Simple Power –
Informix Hybrid Database Capabilities
22

Informix 12.1
Informix NoSQL NewSQL – The Hybrid Solution
Best of Both Worlds
Relational and non-relational data in one system
NoSQL/MongoDB Apps can access Informix Relational Tables
Distributed Queries
Multi-statement Transactions
Enterprise Proven Reliability
Enterprise Proven Reliability
Enterprise Ready Security
Enterprise Level Performance
Informix provides the capability to leverage
the abilities of both relational DBMS and document store systems.
MongoDB does not. It is a document store system lacking key abilities
like transaction durability.
23

Informix 12.1
Round Peg Square Hole
The DBA and/or programmer no longer have to decide upfront if it
is better to use a system entirely of JSON documents or a system
only of SQL tables, but rather have a single database in which the
programmer decides a if JSON document is optimal or a SQL table
is optimal for the data and usage.
24

Informix 12.1
Informix Specific Advantages with Mongo Drivers
Traditional SQL tables and JSON collections co-existing in the same
database
Using the MongoDB client drivers Query, insert, update, delete
–JSON collections
–Traditional SQL tables
–Timeseries data
Join SQL tables to JSON collections utilizing indexes
Execute business logic in stored procedures
Provide a view of JSON collections as a SQL table
–Allows existing SQL tools to access JSON data
Enterprises level functionality
25

Informix 12.1
Scalability
Better performance on multi-core, multi-session scenarios
–Architecture has finer grain locking – not entire database
–Better concurrency because less resources locked
Document Compression
–60% to 90% observed
Bigger documents – 2GB maximum size
–MongoDB caps at 16MB
Informix has decades of optimization on single node solution

Informix 12.1
Some Typical NoSQL Use Cases - Mostly Interactive Web/Mobile
Online/Mobile Gaming
– Leaderboard (high score table) management
– Dynamic placement of visual elements
– Game object management
– Persisting game/user state information
– Persisting user generated data (e.g.
drawings)
Display Advertising on Web Sites
E-commerce/Social Commerce
– Storing frequently changing product
catalogs
Social Networking/Online
Communities
Communications
present
– Real-time bidding: match cookie profile with
ad inventory, obtain bids, and present ad
Dynamic Content Management and
Publishing (News & Media)
– Store content from distributed authors, with
fast retrieval and placement
– Manage changing layouts and user
generated content
27
Logging/message passing
– Drop Copy service in Financial
Services (streaming copies of trade
execution messages into (for
example) a risk or back office
system)

Informix and MongoDB Have Free Editions
Editions Informix MongoDB
Free Developer
Innovator-C
Basic
Innovator-C
For Purchase Express, Workgroup,
Advanced Workgroup,
Enterprise, Advanced
Enterprise
Standard,
Enterprise
28

MongoDB Subscriptions
Basic Standard Enterprise
Edition MongoDB MongoDB MongoDB
Enterprise
Support 9am-9pm local, M-F 24x7x365 24x7x365
29
License AGPL Commercial Commercial
Emergency Patches Not Included Included Included
Price $2,500 / Server / Year $5,000 / Server /
Year
$7,500 / Server /
Year
Subscription information obtained from 10Gen site, June 26, 2013.
Additional monthly charges for backup services.

Price Point Comparison Estimate, 3-year cost
Dual Core Intel
Nehalem
Innovator-C Express
(4 core, 8 GB,
2 nodes)
Workgroup
(16 core, 16 GB,
unlimited nodes)
Product Cost $0 $8,540 $19,740
Support Subscription
Year 1
24 x 7 x 365
Production System Down
Development Call
$1,680 Included Included
Development Call
Emergency Patches
Free Upgrades
Support Renewal Year 2 $1,680 $1,708 $3,948
Support Renewal Year 3 $1,680 $1,708 $3,948
Total $5,040 $11,956 $27,636
30
MongoDB Enterprise, 3-year cost: $22,500
Subscription information obtained from 10Gen site, June 26, 2013.
Retail U.S. prices subject to change, valid as of June 26, 2013.

Informix 12.1
Questions

NoSQL support in Informix (JSON storage, Mongo DB API)

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (9)

Similar to NoSQL support in Informix (JSON storage, Mongo DB API)

Similar to NoSQL support in Informix (JSON storage, Mongo DB API) (20)

More from Keshav Murthy

More from Keshav Murthy (20)

Recently uploaded

Recently uploaded (20)

NoSQL support in Informix (JSON storage, Mongo DB API)