© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Alternatives for Systems Integration
i...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Kai Wähner
Consulting
Developing
Coach...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
What is the key message?
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Key messages
NoSQL cannot be avoided, ...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Agenda
1) Introduction to NoSQL
2) Sys...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Agenda
1) Introduction to NoSQL
2) Sys...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
The evolving database landscape
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
NoSQL
Big Data
Cloud
Complementary con...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Agenda
1) Introduction to NoSQL
2) Sys...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
A new era: NoSQL
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
➜„Spaghetti communication“
What is the...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
What is the problem?
• Applications
• ...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Solution: Systems integration
All Road...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Wishes for integrators
• Standardized ...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Systems integration in the NoSQL era
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Complexity
of Integration
Enterprise
S...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Agenda
1) Introduction to NoSQL
2) Sys...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Complexity
of Integration
Enterprise
S...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Alternatives for Systems Integration
A...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
APIs
➜ Vendor APIs
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Example: Amazon AWS S3 Key Value Store...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Example: Amazon AWS S3 Key Value Store...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
APIs
➜ Generic Storage APIs
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
jClouds (Generic API)
Generic API for ...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
jClouds (Generic API)
Blobstore API
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
jClouds (Generic API)
Several differen...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
jClouds (Generic API) – AWS S3 Blobsto...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
APIs
➜ Generic NoSQL specific APIs
Kun...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
EclipseLink (JPA) NoSQL Support
http:/...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Hibernate OGM (Object/Grid Mapper)
htt...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Kundera
https://github.com/impetus-ope...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
APIs
➜ REST / SOAP APIs
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
SaaS – Salesforce (REST API)
• SOAP
• ...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
SaaS – Salesforce (REST API)
• SOAP
• ...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Agenda
1) Introduction to NoSQL
2) Sys...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Complexity
of Integration
Enterprise
S...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Integration
Integration Frameworks
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Enterprise Integration Patterns
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Enterprise Integration Patterns
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Standalone
Application
Server
Web Cont...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
AmazonS3 s3 = new AmazonS3Client(new P...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
// Producer
from(“ftp:toS3")
.setHeade...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
NoSQL with an Integration Framework
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Document-oriented database
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Document-oriented database
• 10gen
• s...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Code example: MongoDB Java Driver
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Code example: camel-mongodb component
...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Live demo
Integration of NoSQL with an...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Some more...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Key-Value database
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Code example: camel-aws component
// P...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Code example: camel-jclouds component
...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
In-memory database
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Code example: camel-hazelcast componen...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Graph-oriented database
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Code example: camel-neo4j component
//...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Column-oriented database
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Code example: camel-hbase component
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Agenda
1) Introduction to NoSQL
2) Sys...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Connectivity
Routing
Transformation
IN...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Many important players ...
Gartner Qua...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Oracle Service Bus
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Three IBM ESBs
 Rebranded: WebSphere ...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Mule ESB
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Talend ESB
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Three ESBs (JBoss ESB, Switchyard, Fus...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
NoSQL with an Enterprise Service Bus
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Example: Talend ESB
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
TalendAdministrationCenter
TalendESBSt...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Example: Talend ESB
Eclipse STP/WTP
so...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Route Builder
 Endpoints
 EIPs
 Pro...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Live demo
Integration of NoSQL with an...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Agenda
1) Introduction to NoSQL
2) Sys...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Connectivity
Routing
Transformation
Co...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Oracle Platform
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
IBM WebSphere Stack
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
WSO2 Carbon Platform
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Data
Quality
Data
Integration
MDM ESB
...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Integration of NoSQL with an integrati...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Open Source
Proprietary
ESB Vendor == ...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
ESB BPM Data Quality
ESB Vendor == Int...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
• A lot of glue code
• Testing
• Bugfi...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Agenda
1) Introduction to NoSQL
2) Sys...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Custom NoSQL Connectors
Easy to realiz...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Live demo (Example Salesforce Connecto...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Alternative for custom NoSQL Connector...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Code example: REST API for Salesforce ...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Did you get the key message?
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Key messages
NoSQL cannot be avoided, ...
© Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner
Did you get the key message?
Thank you for your attention. Questions?
kwaehner@talend.com
www.kai-waehner.de
LinkedIn / Xing
@KaiWaehner
Upcoming SlideShare
Loading in...5
×

Alternatives for Systems Integration in the NoSQL Era - NoSQL Roadshow 2013

3,122

Published on

Published in: Technology, Business
0 Comments
13 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
3,122
On Slideshare
0
From Embeds
0
Number of Embeds
7
Actions
Shares
0
Downloads
4
Comments
0
Likes
13
Embeds 0
No embeds

No notes for slide

Alternatives for Systems Integration in the NoSQL Era - NoSQL Roadshow 2013

  1. 1. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Alternatives for Systems Integration in the NoSQL Era Kai Wähner kwaehner@talend.com @KaiWaehner www.kai-waehner.de 9/16/2013
  2. 2. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Kai Wähner Consulting Developing Coaching Speaking Writing Main Tasks Requirements Engineering Enterprise Architecture Management Business Process Management Architecture and Development of Applications Service-oriented Architecture Integration of Legacy Applications Cloud Computing Big Data Contact Email: kwaehner@talend.com Blog: www.kai-waehner.de/blog Twitter: @KaiWaehner Social Networks: Xing, LinkedIn
  3. 3. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner What is the key message?
  4. 4. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Key messages NoSQL cannot be avoided, and must be integrated! NoSQL integration is already possible! Different APIs, Frameworks and Products helps a lot!
  5. 5. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Agenda 1) Introduction to NoSQL 2) Systems Integration 3) API 4) Integration Framework 5) Enterprise Service Bus 6) Integration Suite 7) Custom Connectors Live Demos
  6. 6. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Agenda 1) Introduction to NoSQL 2) Systems Integration 3) API 4) Integration Framework 5) Enterprise Service Bus 6) Integration Suite 7) Custom Connectors
  7. 7. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner The evolving database landscape
  8. 8. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner NoSQL Big Data Cloud Complementary concepts
  9. 9. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Agenda 1) Introduction to NoSQL 2) Systems Integration 3) API 4) Integration Framework 5) Enterprise Service Bus 6) Integration Suite
  10. 10. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner A new era: NoSQL
  11. 11. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner ➜„Spaghetti communication“ What is the problem?
  12. 12. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner What is the problem? • Applications • Interfaces • Technologies • Products Growth
  13. 13. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Solution: Systems integration All Roads lead to Rome ...
  14. 14. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Wishes for integrators • Standardized Modeling • Efficient Realization • Automatic Testing
  15. 15. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Systems integration in the NoSQL era
  16. 16. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Complexity of Integration Enterprise Service Bus Integration Suite Low High Integration Framework IncludesIncludes Alternatives for Systems Integration API
  17. 17. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Agenda 1) Introduction to NoSQL 2) Systems Integration 3) API 4) Integration Framework 5) Enterprise Service Bus 6) Integration Suite 7) Custom Connectors
  18. 18. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Complexity of Integration Enterprise Service Bus Integration Suite Low High Integration Framework IncludesIncludes Alternatives for Systems Integration API
  19. 19. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Alternatives for Systems Integration API • Proprietary API • Vendor API • Generic API • Web Service Interface • REST Web Service • SOAP Web Service
  20. 20. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner APIs ➜ Vendor APIs
  21. 21. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Example: Amazon AWS S3 Key Value Store (Java API) AmazonS3 s3 = new AmazonS3Client(new PropertiesCredentials( S3Sample.class.getResourceAsStream("AwsCredentials.properties"))); String bucketName = "my-first-s3-bucket-" + UUID.randomUUID(); String key = "MyObjectKey"; try { s3.createBucket(bucketName); s3.putObject(new PutObjectRequest(bucketName, key, createSampleFile())); S3Object object = s3.getObject(new GetObjectRequest(bucketName, key)); ObjectListing objectListing = s3.listObjects(new ListObjectsRequest() .withBucketName(bucketName) .withPrefix("My")); s3.deleteObject(bucketName, key); s3.deleteBucket(bucketName); } catch (AmazonServiceException ase) { // error handling... } catch (AmazonClientException ace) { // error handling... }
  22. 22. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Example: Amazon AWS S3 Key Value Store (Ruby API)
  23. 23. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner APIs ➜ Generic Storage APIs
  24. 24. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner jClouds (Generic API) Generic API for IaaS
  25. 25. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner jClouds (Generic API) Blobstore API
  26. 26. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner jClouds (Generic API) Several different NoSQL providers supported
  27. 27. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner jClouds (Generic API) – AWS S3 Blobstore (Java) Use another blobstore? Just change this line!
  28. 28. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner APIs ➜ Generic NoSQL specific APIs Kundera
  29. 29. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner EclipseLink (JPA) NoSQL Support http://wiki.eclipse.org/EclipseLink/Examples/JPA/NoSQL As of EclipseLink 2.4, EclipseLink has added JPA support for NoSQL databases, initially with support for MongoDB and Oracle NoSQL. EclipseLink's NoSQL support allows the JPA API and JPA annotations/xml to be used with NoSQL data. EclipseLink also supports several NoSQL specific annotations/xml including @NoSQL that defines a class to map NoSQL data.
  30. 30. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Hibernate OGM (Object/Grid Mapper) http://www.hibernate.org/subprojects/ogm.html
  31. 31. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Kundera https://github.com/impetus-opensource/Kundera
  32. 32. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner APIs ➜ REST / SOAP APIs
  33. 33. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner SaaS – Salesforce (REST API) • SOAP • REST
  34. 34. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner SaaS – Salesforce (REST API) • SOAP • REST
  35. 35. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Agenda 1) Introduction to NoSQL 2) Systems Integration 3) API 4) Integration Framework 5) Enterprise Service Bus 6) Integration Suite 7) Custom Connectors
  36. 36. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Complexity of Integration Enterprise Service Bus Integration Suite Low High Integration Framework INTEGRATION Connectivity Routing Transformation Alternatives for Systems Integration
  37. 37. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Integration Integration Frameworks
  38. 38. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Enterprise Integration Patterns
  39. 39. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Enterprise Integration Patterns
  40. 40. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Standalone Application Server Web Container Cloud Spring Container Deployment
  41. 41. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner AmazonS3 s3 = new AmazonS3Client(new PropertiesCredentials( S3Sample.class.getResourceAsStream("AwsCredentials.properties"))); String bucketName = "my-first-s3-bucket-" + UUID.randomUUID(); String key = "MyObjectKey"; try { s3.createBucket(bucketName); s3.putObject(new PutObjectRequest(bucketName, key, createSampleFile())); S3Object object = s3.getObject(new GetObjectRequest(bucketName, key)); ObjectListing objectListing = s3.listObjects(new ListObjectsRequest() .withBucketName(bucketName) .withPrefix("My")); s3.deleteObject(bucketName, key); s3.deleteBucket(bucketName); } catch (AmazonServiceException ase) { // error handling... } catch (AmazonClientException ace) { // error handling... } No longer „glue code“
  42. 42. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner // Producer from(“ftp:toS3") .setHeader(S3Constants.KEY, simple(“order.txt")) .to("aws-s3://myBucket?accessKey=" + a+ "&secretKey= " + s) // Consumer from(„salesforce://orders__c?user=dummy1“) .filter(„attributeType==‚dvd‘“) .to(“ibm-database:orderData") Domain Specific Language (Camel)
  43. 43. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner NoSQL with an Integration Framework
  44. 44. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Document-oriented database
  45. 45. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Document-oriented database • 10gen • stores structured data as JSON-like documents with dynamic schemas • REST API and several SDKs (Java, .NET, Ruby, PHP, Python, etc.) • Ad hoc queries, indexing, replication, load balancing • Powerful, but also easy to use and flexible • Example: Disney persists state information of online games in a common object repository.
  46. 46. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Code example: MongoDB Java Driver
  47. 47. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Code example: camel-mongodb component // Producer from(“jms:FlightDocumentQueue") .to("mongodb:myDb?database=flights &collection=tickets &operation=insert"); // Consumer from("mongodb:myDb?database=flights &collection=cancellations &tailTrackIncreasingField=departureTime") .to(“jms:CancelledFlightsQueue");
  48. 48. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Live demo Integration of NoSQL with an integration framework in action...
  49. 49. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Some more...
  50. 50. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Key-Value database
  51. 51. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Code example: camel-aws component // Producer from(„jms:toS3Queue") .setHeader(S3Constants.KEY, simple(“order.txt")) .to("aws-s3://myBucket?accessKey=" + a + "&secretKey= " + s) // Consumer from("aws-s3://myBucket?accessKey=“ + a + "&secretKey=" + s) .to("log:S3logging")
  52. 52. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Code example: camel-jclouds component from("direct:toJcloudsAwsS3") .setHeader(JcloudsConstants.BLOB_NAME, "jclouds-demo-tutorial.txt") .setHeader(JcloudsConstants.CONTAINER_NAME, "kw-s3-data") .to("jclouds:blobstore:aws-s3") from("direct:toJcloudsMicrosoftAzure") .setHeader(JcloudsConstants.BLOB_NAME, "jclouds-demo-tutorial.txt") .setHeader(JcloudsConstants.CONTAINER_NAME, "kw-s3-data") .to("jclouds:blobstore:azureblob")
  53. 53. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner In-memory database
  54. 54. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Code example: camel-hazelcast component // Producer from("direct:add") .setHeader(HazelcastConstants.OPERATION, „add“) .to("hazelcast:queue:foo"); // Consumer from("hazelcast:queue:foo") .log(“content of object foo: ${body}");
  55. 55. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Graph-oriented database
  56. 56. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Code example: camel-neo4j component // Producer from("jms:createNewNeo4jNode") .to("neo4j:http://Neo4jServer:7474/data"); // Consumer from(„neo4j://todo)... Not implemented in current Camel release (2.12)  Maybe 2.13?  Use Camel‘s REST Connectors (shown in some minutes...)
  57. 57. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Column-oriented database
  58. 58. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Code example: camel-hbase component
  59. 59. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Agenda 1) Introduction to NoSQL 2) Systems Integration 3) API 4) Integration Framework 5) Enterprise Service Bus 6) Integration Suite 7) Custom Connectors
  60. 60. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Connectivity Routing Transformation INTEGRATION Tooling Monitoring Support Complexity of Integration Enterprise Service Bus Integration Suite Low High Integration Framework + What is an Enterprise Service Bus (ESB)?
  61. 61. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Many important players ... Gartner Quadrant 2013 for Application Integration
  62. 62. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Oracle Service Bus
  63. 63. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Three IBM ESBs  Rebranded: WebSphere Integration Bus
  64. 64. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Mule ESB
  65. 65. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Talend ESB
  66. 66. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Three ESBs (JBoss ESB, Switchyard, Fuse ESB) Two BPMs (jBPM, Polymita) No unified platform (yet) Red Hat / JBoss
  67. 67. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner NoSQL with an Enterprise Service Bus
  68. 68. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Example: Talend ESB
  69. 69. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner TalendAdministrationCenter TalendESBStudio TalendESB Service Development Mediation & Integration Testing Build & Deploy Performance & Availability Web Services Stack Mediation & Integration Message Broker Service Container Loadbalancing & High Availability Security Business Rules Management Development Runtime Operation Documentation & Examples Professional Services Certified Partners Training & Certification24x7 Support Indemnification Maintenance Project Repository Configuration Deployment Repository Example: Talend ESB
  70. 70. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Example: Talend ESB Eclipse STP/WTP soapUI Route Designer Mediation Service Designer Integration Apache Maven Build & Deploy Apache CXF REST & Web Services Apache Camel Mediation Apache ActiveMQ Message Broker Apache Karaf / Cellar OSGi / Clustering Eclipse Equinox OSGi Service Locator & Service Act. Monitoring Distributed Registry / Tracking Secure Token Server Security Service Activity Monitoring and Service Locator UI Management, Configuration & Monitoring Repository Metadata & Projects Development Runtime Operation Documentation & Examples vFabric Hyperic HQ Apache Archiva Artifact repository TalendESBStudio TalendESBRuntime TalendAdministrationCenter Professional Services Certified Partners Training & Certification24x7 Support Indemnification Maintenance
  71. 71. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Route Builder  Endpoints  EIPs  Processors  Custom Connectors Configuration  Connectors  Endpoints Code Generation  100% Java  Camel Code  Packaged as OSGi Bundles Execution in the IDE  Debugging  Live statistics  Short dev cycles Example: Talend ESB Studio
  72. 72. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Live demo Integration of NoSQL with an Enterprise Service Bus in action...
  73. 73. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Agenda 1) Introduction to NoSQL 2) Systems Integration 3) API 4) Integration Framework 4) Enteprise Service Bus 6) Integration Suite 7) Custom Connectors
  74. 74. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Connectivity Routing Transformation Complexity of Integration Enterprise Service Bus Integration Suite Low High Integration Framework INTEGRATION Tooling Monitoring Support + BUSINESS PROCESS MGT. BIG DATA / MDM REGISTRY / REPOSITORY RULES ENGINE „YOU NAME IT“ + What is an Integration Suite?
  75. 75. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Oracle Platform
  76. 76. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner IBM WebSphere Stack
  77. 77. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner WSO2 Carbon Platform
  78. 78. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Data Quality Data Integration MDM ESB Big Data Big Data  Open source license  Free of charge  Optional support  Based on open source projects such as Eclipse or Apache Camel, CXF, Hadoop  Commercial license  Subscription model  Support included Data Quality Data Integration MDM ESB BPM Talend Unified Platform
  79. 79. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Integration of NoSQL with an integration suite in Action... Live Demo
  80. 80. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Open Source Proprietary ESB Vendor == Integration Suite Vendor
  81. 81. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner ESB BPM Data Quality ESB Vendor == Integration Suite Vendor
  82. 82. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner • A lot of glue code • Testing • Bugfixing • No support Some other people already had the problems you would have! Custom Combination of ESB, BPM, etc.
  83. 83. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Agenda 1) Introduction to NoSQL 2) Systems Integration 3) API 4) Integration Framework 5) Enteprise Service Bus 6) Integration Suite 7) Custom Connectors
  84. 84. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Custom NoSQL Connectors Easy to realize for all integration alternatives * • Integration Framework • Enterprise Service Bus • Integration Suite * At least for open source solutions
  85. 85. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Live demo (Example Salesforce Connector) Custom NoSQL Connectors in action...
  86. 86. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Alternative for custom NoSQL Connectors • SOAP • REST
  87. 87. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Code example: REST API for Salesforce object store // Salesforce Query (SOQL) via REST API from("direct:salesforceViaHttpLIST") .setHeader("X-PrettyPrint", 1) .setHeader("Authorization", accessToken) .setHeader(Exchange.CONTENT_TYPE, "application/json") .to("https://na14.salesforce.com/services/data/v20.0/query?q=SELECT+name+from +Article__c") // Salesforce CREATE via REST API from("direct:salesforceViaHttpCREATE") .setHeader("X-PrettyPrint", 1) .setHeader("Authorization", accessToken) .setHeader(Exchange.CONTENT_TYPE, "application/json“) .to("https://na14.salesforce.com/services/data/v20.0/sobjects/Article__c")
  88. 88. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Did you get the key message?
  89. 89. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Key messages NoSQL cannot be avoided, and must be integrated! NoSQL integration is already possible! Different APIs, Frameworks and Products helps a lot!
  90. 90. © Talend 2013 “Alternatives for Systems Integration in the NoSQL Era” by Kai Wähner Did you get the key message?
  91. 91. Thank you for your attention. Questions? kwaehner@talend.com www.kai-waehner.de LinkedIn / Xing @KaiWaehner

×