JavaScript as Data Processing Language & HTML5 Integration
Upcoming SlideShare
Loading in...5
×
 

JavaScript as Data Processing Language & HTML5 Integration

on

  • 1,901 views

These last years, data management has become a trending and very dynamic subject. Subjects and tech trends like NoSQL, localcache, offline synchronization or message brokers are now at the core of ...

These last years, data management has become a trending and very dynamic subject. Subjects and tech trends like NoSQL, localcache, offline synchronization or message brokers are now at the core of projects infrastructures. This is linked to the new trend around functional programing, for data manipulation.
The talk goal is to show connections between NoSQL, data processing, message broking and JavaScript. How to quickly prototype with these tools! Are these tools only for mass storage or raw performance? Does it allow you to code faster?

http://qconlondon.com/london-2013/presentation/JavaScript%20as%20Data%20Processing%20Language%20&%20HTML5%20Integration

Statistics

Views

Total Views
1,901
Views on SlideShare
1,661
Embed Views
240

Actions

Likes
3
Downloads
7
Comments
1

7 Embeds 240

http://www.waxzce.org 147
http://eventifier.co 40
http://www.linkedin.com 38
https://twitter.com 10
http://localhost 3
http://plus.url.google.com 1
http://eventifier.com 1
More...

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

JavaScript as Data Processing Language & HTML5 Integration JavaScript as Data Processing Language & HTML5 Integration Presentation Transcript

  • + Javascript as a data processing language & htlm5 integration Qcon London 2013 – Quentin ADAM
  • + Who I am ? n  Quentin ADAM n  @waxzce on twitter n  CEO of Clever Cloud, the most powerful PaaS in Europe ;-) clever cloud
  • + Why we have to talk about data processing ?
  • + Big change in software industry Yesteday Now n  One instance n  One instance (distributed) n  One organization n  Multiple organization + a lot of users n  One data repository n  One data repository Multi-tenant
  • + •  Atomicity •  Consistency ACID •  Isolation •  DurabilityInstance for oneOrganization Powerful •  Transaction •  UserTake advantage of ACID database data management management •  One above one
  • + But it designs a bottleneck
  • + Example : e-shop on classic mode
  • + Example : e-shop on classic mode User A buy a hdd TransactionDatabase Transaction : user A is•  Stock management processed•  Order management•  Invoice generation•  Customer Account reward•  … Stock & Order are just perfectly synchronize
  • + Example : e-shop on classic mode User A buy a hdd TransactionDatabase Transaction : user A is•  Stock management processed•  Order management•  Invoice generation•  Customer Account reward•  … then User B buy a Stock & hdd Transaction Order are user B is just perfectly processed synchronize
  • + Example : e-shop on multi-tenant mode n  i.e. : Multiple shop of various sellers on the same instance
  • + Example : e-shop on multi-tenant mode User A buy ahdd on seller A TransactionDatabase Transaction : user A is•  Stock management processed•  Order management•  Invoice generation•  Customer Account reward•  … then User B buy a Stock &book on seller B Transaction Order are user B is just perfectly processed synchronize
  • Who care the+ synchronization of vendor A&B?
  • Destroy the bottle neck and switch to+ another storage system This is why the noSQL movement start.
  • + noSQL = not only SQL
  • + Now talking about how to get data from storage
  • + SQL don’t solve all the data processing expression.
  • + Some javascripts facts n  Run for server needs at the beginning n  Netscape Server in 1996, and then in IIS n  Clearly a major language n  Run on n  Browser n  Mobile n  Servers n  Easy to integrate n  Most peoples know it n  Most used language on github n  Event driven
  • + So, can we use javascript as a data processing language ?
  • + Data processing is focus on n  Find n  Filter n  Manage collection n  CRUD order
  • + Map / reduce => the big bang of new data processing n  Atomize the problem Get a k/v data n  Easy to parallelize n  From the functional Map : transform data to what you programing model need (apply function) Reduce : filter data & aggregate Get the result
  • Do you wanna some functional+ programing ? Javascript is so flexible than we can apply several patern on top of the language
  • + And map/reduce ?
  • + NoSQL we can considerate for example n  Object Store n  Key/Value with documents capacities n  Pure Document n  Column based
  • + NoSQL we can considerate for example n  Object Store n  Key/Value with documents capacities n  Pure Document n  Column based
  • +And one more !With localStorage features
  • + JSON domination n  Store n  Processing n  Access
  • + Example with riak n  Key/Value n  http REST & protobuff data API n  Store JSON data on a URL n  Very good distribution n  Good performances
  • + Example with riak map/reduce
  • + Put some real time n  Lots lots of noSQL DB handle a _change_ pipe : n  All datas and updates stream n  Bind it on a websocket : put some real time on your application
  • + Data as a Service Various backen DB API RESTFull API clients •  Full web client : html5 + local storage •  Mobile : phonegapp or native •  Other servers app
  • + Data as a Service n  Data as others service n  With the same language the application n  Build sync algorithm to start offline / online software n  Some protocol : atom, gdata, oData n  Some popular API : S3, twitter, EC2… n  Security and access layer : oauth…
  • + DataBase as a Service n  Xeround n  Amazon dynamo n  Lots of heroku addon n  Kinvey PaaS
  • + Transparent data consumption n  Webkit JavaScriptCore n  REST / JSON n  Data Classes n  auto-updatable n  accessors Atomatic data access framework n  events n  Methods n  Cool html5 IDE n  Best use case : work oriented app
  • + Wakanda example http://play.wakanda.org/
  • + How to start ?
  • + Find a toy project
  • + Use hosted services n  Less ops footprint n  No more instalation n  Quick learn curve n  Focus on your needs & values
  • + Innovate & write kick ass apps
  • + Thx for Listening & Q/A time Thx to the http://twitter.com/waxzce http://qconlondon.com Quentin ADAM on google ;-) quentin.adam@clever-cloud.com n  http://www.clever-cloud.com clever n  http://engineering.clever-cloud.com/ cloud