Big Data LDN 2018: 2018 DATA TRENDS: RESULTS FROM FIFTH ANNUAL DATA AND ANALYTICS SURVEY

2018 Data Trends
Results from Annual Data Survey
Nishanth Kadiyala, Product Evangelist
@nish_kadi, @ProgressSW

2© 2018 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
Agenda
§ Overview
§ Trends:
• Databases
• Standards
• Cloud
• Analytics
• Security
§ Next Steps

Overview

96 of Fortune 100
Enterprises leverage our connectivity solutions
ISVs distribute DataDirect drivers
350+
10,000+
Enterprises rely on Progress for their connectivity
Leading BI vendors embed DataDirect drivers.
8 of the 9
© 2018 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.
Users seamlessly access data daily enabled by
DataDirect
1M+
4
Mission:
To give Enterprises and ISVs
frictionless access to the information
they need by harmonizing access to the
world’s disparate data.

ODBC
1.0 in 1992
4.0 in 2016
Co-founders of
ODBC
JDBC
1.0 in 1997
4.2 in 2014
Key member of JDBC
Expert Group
ADO.NET
1.0 in 2002
4.6 in 2015
Key component of
.NET Framework
OData
ISO/IEC standard in
February 2017
First to join OData
technical committee
Our Rich Heritage with Open Standards and APIs

The World’s Data Flows through Our Connectors
ISV
FINANCIAL
SERVICES
TELECOM HEALTHCARE MANUFACTURING RETAIL GOVERNMENT

1400+ Participants
65+ Countries
5th Annual Survey

Trends

Data Source Popularity Data Access Standards
Analytics Trend Data Security Standards
Cloud Adoption

Cloud Adoption

Mission-critical Enterprise Apps Still Run on RDBMS
55%
40%
37%
24%
20%
20%
19%
14%
9%
9%
7%
7%
7%
6%
5%
5%
5%
4%
4%
3%
2%
2%
2%
2%
1%
1%
0%
2%
2%
2%
2%
2%
3%
1%
4%
1%
8%
1%
2%
3%
2%
5%
1%
5%
4%
1%
4%
4%
0%
1%
1%
0%
1%
1%
1%
1%
0%
1%
6%
SQL Server
MySQL
Oracle
Progress OpenEdge
PostgreSQL
Microsoft Access
Microsoft SQL Azure
IBM DB2
SQLite
SAP HANA
MariaDB
Amazon Redshift
Teradata
Google Cloud SQL
Amazon Aurora
Informix
Google BigQuery
Azure Cosmos
Sybase ASE
Netezza
FireBird
Sybase IQ
Pivotal Greenplum
Vertica
MemSQL
Snowflake
VoltDB
Other:
None
Not sure
Currently use
Plan to use in the next two years
Enterprises are increasingly migrating
their databases to the cloud

19%
17%
10%
7%
6%
6%
5%
5%
5%
5%
5%
4%
4%
4%
4%
3%
2%
2%
2%
1%
1%
2%
32%
12%
5%
6%
4%
2%
3%
2%
1%
2%
2%
1%
3%
1%
2%
3%
2%
3%
1%
1%
1%
1%
0%
1%
15%
Amazon S3
Hadoop Hive
Spark SQL
Hortonworks
Amazon EMR
Apache Solr
Cloudera CDH
Oracle BDA
Apache Sqoop
IBM BigInsights
SAP Cloud Platform Big Data Services
Cloudera Impala
MapR
Azure HDInsights
Apache Storm
Google Cloud DataProc
Apache Drill
Apache Phoenix
Presto
Pivotal HD
GemFireXD
Other:
None
Not sure
Currently use Plan to use in the next two years
Big Data Marked the Industry’s Shift from ETL to ELT
Big Data Technologies
Hadoop Hive continues to grow
in popularity as companies
started unlocking data lakes.

27%
11%
7%
7%
6%
6%
5%
4%
3%
2%
2%
1%
1%
1%
0%
0%
0%
2%
32%
10%
7%
4%
2%
3%
5%
2%
3%
2%
4%
2%
1%
1%
1%
1%
0%
0%
0%
1%
14%
MongoDB
Cassandra
Redis
Oracle NoSQL
Google Cloud Datastore
HBase
DynamoDB
Couchbase
Google Cloud Bigtable
DocumentDB
SimpleDB
MarkLogic
DataStax Enterprise
Aerospike
Riak
Scylla
ArangoDB
Other
None
Not sure
Currently use
Plan to use in next two years
Web Services, IoT have sparked the adoption of
NoSQL technologies
NoSQL Data Sources
MongoDB has recently
released an ODBC driver

Cloud Adoption

Modern Infrastructure Introduces Modern
Integration Challenges
47%
44%
35%
36%
32%
31%
2%
Data spread across an increasing number of data sources
Integrating cloud data with on-premises data
Data Volume - Big Data, IoT, Social Media, Enterprise Data
Data Veracity - Data Inconsistency, Data Uncertainty, Ambiguous Data,
Incomplete Data etc.
Data Velocity - batch, near real-time, real-time, streaming etc.
Data Variety - Structured, Unstructured, Semi-Structured
Other (please specify):

Standards-based Integration is the Solution to these
Challenges
58%
54%
48%
40%
31%
28%
10%
10%
8%
4%
2%
2%
1%
4%
2%
1%
5%
1%
2%
1%
1%
2%
1%
3%
1%
2%
3%
1%
ODBC
REST
JDBC
SOAP
ADO.NET
Native Database Access
XQuery
XPath
OData
JSDO
SparQL
GraphQL
Not sure
None
Currently use
• Web developers have chosen
REST as the de-facto standard
• REST, however, is just an
architectural style

OData – Standard REST API for Querying the Web
§ An open protocol for creating and
consuming queryable and interoperable
RESTful APIs in a simple and standard way.
§ No client dependencies for end-users
§ Approved by the ISO / OASIS groups
Adopted by:
HTTP(S)

Use Case: Salesforce Requires OData to Consume
External Sources in Real-Time
• Real-time access to all customer data is
essential for success of sales reps
• Salesforce Connect enables enterprises to
access external data in real-time via OData
• Hybrid Data Pipeline offers instant OData
connectors for any data source
OData
Salesforce Connect
Service Required
Big Data RDBMS NoSQL
On-premises
Connector

Demand for ODBC/JDBC Access to REST APIs is
also on the Rise
REST SOAP Other

Cloud Adoption

AWS, Azure and Google Cloud are The Only
Growing Public Clouds
44%
39%
22%
18%
14%
10%
8%
6%
5%
4%
3%
2%
1%
0%
6%
13%
3%
Amazon Web Services
Microsoft Azure
VMware
Google Cloud
Salesforce
Oracle
IBM
SAP HANA
Rackspace
RedHat OpenStack
RedHat OpenShift
Digital Ocean
CenturyLink
Linode
None
Not sure
Native solutions such as AWS Glue
provide lighter alternatives

58%
28%
13%
9%
2%
10%
16%
VPN
SSH Tunneling
Reverse Proxy
Commercial Data Gateways (Progress DataDirect Hybrid Data Pipeline,
Power BI Gateway, etc.)
We don't traverse the firewall
Not sure
Hybrid Connectivity is Now Mission-Critical
Does your hybrid connectivity
strategy easily scale to
hundreds of customers?

Vendor-Agnostic Data Gateway Built for Cloud ISVs
• Enables Cloud ISVs to access on-premises data
without any network changes
• Easy to install, maintain and scale across
thousands of customers
• Engineered for the cloud – high availability, load
balancing and more
No Firewall
Configuration
Big Data RDBMS NoSQL
On-premises
Connector
ODBC, JDBC,
OData

Analytics Market Data Security Standards
Cloud Adoption

Multiple BI Tools to Solve Multiple Use Cases
42%
26%
22%
18%
16%
16%
15%
9%
9%
7%
5%
5%
4%
4%
3%
3%
2%
2%
2%
2%
2%
2%
1%
1%
1%
1%
1%
0%
5%
8%
5%
0%
3%
5%
4%
2%
2%
2%
2%
1%
1%
1%
2%
3%
1%
2%
1%
0%
1%
1%
1%
0%
0%
0%
0%
1%
1%
0%
0%
1%
11%
Excel
Microsoft BI Platform (SSIS, SSAS, SSRS)
Tableau
Power BI
SAP
QlikView
IBM Cognos
Oracle Business Intelligence (OBIEE)
SAS
MicroStrategy
Oracle Hyperion
Pentaho
Google Data Studio
Birt
Amazon Quicksight
Tibco JasperSoft
Information Builders
Tibco Spotfire
GoodData
Domo
WebFocus
Clear Analytics
Logi Analytics
Looker
YellowFin
Board
Sisense
Targit
None
Not Sure
Currently use
Tableau, Power BI and Qlik
are dominating the Data
Visualization market

Many ISVs Have Started Embedding BI into Their
Apps
Embedded BI is the integration of
self-service BI capabilities such as
dashboards, real-time insights and
weekly reports into commonly
used business applications

Open Analytics Allows ISVs to Support All The
Analytics Needs of Customers
Your App data / API / Database
.
.
Open Analytics via standard
ODBC, JDBC or OData

Cloud Adoption

Enterprise Data Security is Highly Complex

Enterprise Data Security is Highly Complex
44%
39%
30%
26%
22%
16%
1%
6%
15%
Authentication / Authorization (AD, LDAP, SSO, Pass-through, NTLM, Kerberos, etc.)
Data Encryption / Decryption (SSL/TLS, AES, SHA, Data Masking, Native
Encryptions, etc.)
Cloud Security (OAuth, OpenID, 2FA, MFA, CASB, IAM, etc.)
Data Auditing (Logging, Monitoring, Lineage, Alerts, Error Handling, etc.)
Relational Database Security (Oracle Wallet, Oracle Internet Directory, etc.)
Big Data Security (Knox, Ranger, Sentry, etc.)
Other
None
Not sure

GDPR and other Laws are Disrupting Analytics
15%
15%
14%
14%
13%
12%
5%
5%
4%
4%
3%
3%
2%
2%
2%
2%
1%
1%
1%
1%
1%
1%
1%
0%
2%
9%
35%
ISO 27001
GDPR
SOX (Sarbanes - Oxley)
HIPAA/HITECH
PCI DSS
Data Privacy Laws - PII
FIPS
NIST
SAS 70
PHI
FISMA
JSOX
CPA
FERPA
AEO
PA-DSS
ITAR
NERC
PIPEDA
POPI
OCAP
GxP
FSB
NEN 27000
Other
None
Not sure
DataDirect offers a simple solution
to mask data and retain analytics
while complying with GDPR

DataDirect’s Masking Capabilities
DBs Containing
Sensitive Data
Analytics
Teams

What’s Next

Resources
§ 2018 Report on Data Connectivity
§ Webinar on OData over Databases
§ Brochure on Hybrid Data Pipeline
§ Everything about Open Analytics
§ Basics of SQL Access over Enterprise APIs
§ Webinar on enterprise data security
Contact Us
Success Stories
Tutorials
Documentation

Talk to the Data Experts at Booth 347
@nish_kadi nkadiyal@progress.comwww.datadirect.com

Big Data LDN 2018: 2018 DATA TRENDS: RESULTS FROM FIFTH ANNUAL DATA AND ANALYTICS SURVEY

Big Data LDN 2018: 2018 DATA TRENDS: RESULTS FROM FIFTH ANNUAL DATA AND ANALYTICS SURVEY

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Big Data LDN 2018: 2018 DATA TRENDS: RESULTS FROM FIFTH ANNUAL DATA AND ANALYTICS SURVEY

Similar to Big Data LDN 2018: 2018 DATA TRENDS: RESULTS FROM FIFTH ANNUAL DATA AND ANALYTICS SURVEY (20)

More from Matt Stubbs

More from Matt Stubbs (20)

Recently uploaded

Recently uploaded (20)

Big Data LDN 2018: 2018 DATA TRENDS: RESULTS FROM FIFTH ANNUAL DATA AND ANALYTICS SURVEY