Advanced JSON   Persistence Mapping, RPCs,  Cross-Domain and More. Kris Zyp [email_address] www.xucia.com www.json.com
Overview <ul><li>Specifications - JSON </li></ul><ul><ul><li>JSONT </li></ul></ul><ul><ul><li>JSONPath </li></ul></ul><ul>...
JSON Overview/History <ul><li>JSON born from JavaScript object and array initializer syntax </li></ul><ul><li>{“property”:...
About JSON <ul><li>JSON = { “size” : “compact”, “readable” : true, “purposes” :  [“simple data structures”, ”object serial...
XML… <ul><li><?xml version=&quot;1.0&quot; encoding=&quot;utf-8&quot;?> </li></ul><ul><li><xml xmlns:ajson=&quot;http://ww...
Interoperability <ul><ul><li>Minimizing cost of communication. </li></ul></ul><ul><ul><li>JSON has a lot of flexibility. <...
Cross Domain JSON <ul><li>XHR Same Origin Policy </li></ul><ul><li>Script tags can access cross site scripts </li></ul><ul...
JSONP http://bob.pythonmac.org/archives/2005/12/05/remote-json-jsonp/ <ul><li>Defines a parameter for defining a prefix fo...
CrossSafe <ul><li>How to access cross-domain data securely? </li></ul><ul><ul><li>Proxy – Secure, but slower and more work...
CrossSafe <ul><li>Must use hostname.domain.com and make webservice.domain.com accessible </li></ul><ul><li>Servers must su...
JSONT http://goessner.net/articles/jsont/ <ul><li>Data: {  &quot;link&quot; : { &quot;uri&quot; : &quot;http://company.com...
Referencing <ul><li>Circular References </li></ul><ul><ul><li>Me = {“name”:”Kris Zyp”, “spouse” : {“name”:”Nikki Zyp”}} </...
JSON Referencing www.json.com <ul><li>Scope </li></ul><ul><ul><li>Intramessage </li></ul></ul><ul><ul><ul><li>Circular Ref...
JSON Referencing (Intramessage) www.json.com <ul><li>Reference Methods </li></ul><ul><ul><li>Conventions – in string, fixu...
JSON Referencing www.json.com <ul><li>Intermessage – must use ID referencing </li></ul><ul><ul><li>Intermessage </li></ul>...
Identification <ul><li>Circular References </li></ul><ul><ul><li>Me = {“id”:”kris”,  </li></ul></ul><ul><ul><li>“ name”:”K...
JSPON www.jspon.org <ul><li>Background… </li></ul><ul><li>RESTful approach for interaction and interoperability with persi...
JSPON  Over   HTTP <ul><li>Every id has an implicit (or explicit) URL using the standard relative URL approach </li></ul><...
Identification <ul><ul><li>GET http://mydomain.com/objects/myObj </li></ul></ul><ul><ul><li>{“id”:”myObj”  -> http://mydom...
Persevere Server <ul><li>JSON Server </li></ul><ul><ul><li>Object database server </li></ul></ul><ul><ul><li>Interaction t...
Persevere Server <ul><li>Exposes multiple data sources as JSON (JSPON): </li></ul><ul><ul><li>Internal OO Database </li></...
JSPON Object Browser <ul><li>Capable of browsing, modifying, and observing structural and access rules of data sources. </...
JSONPath <ul><li>XPath for JSON </li></ul><ul><li>Influenced by XPath and E4X syntax, and traditional C/Java/JS property a...
JSON-RPC http://json-rpc.org/ <ul><li>Request </li></ul><ul><ul><li>method  - A string containing the name of the method t...
JSON-RPC <ul><li>Response </li></ul><ul><ul><li>result  - The object that was returned by the invoked method. This must be...
JSON-RPC <ul><li>Example </li></ul><ul><ul><li>{ &quot;method&quot;: &quot;echo&quot;, &quot;params&quot;: [&quot;Hello JS...
Persevere Server <ul><li>Client/Server JavaScript </li></ul><ul><li>Persistent Object Mapping </li></ul><ul><ul><li>Rhino ...
JSON Schema http://www.json.com/json-schema-proposal/ <ul><li>Contract about valid data </li></ul><ul><li>Influenced by XM...
JSON Schema Example <ul><li>{“name”:{ “type”:”string”, “required”:true, “nullable”:false, </li></ul><ul><li>“ length”:25, ...
JSON Schema Example <ul><li>{“address”:{ “type”:{“street”:{“type”:”string”}, “state”:{“type”:”string”}}, </li></ul><ul><li...
JSON Schema Example <ul><li>{“name”:”Kris Zyp” </li></ul><ul><li>“ age”:30, </li></ul><ul><li>“ spouse”:{“id”:”nikki”}, </...
Persevere JS Client <ul><li>Persistent object mapping with REST web services </li></ul><ul><li>Orthogonal Persistence and ...
Example Usage of Persevere <ul><li>var result = pjs.load(“data or query id”); </li></ul><ul><li>var object = result[1]; </...
What Did We Not Have to Write? <ul><li>doAjax… (break up into multiple slides) </li></ul><ul><li>Request controller </li><...
Persevere JS Client Capabilities <ul><li>Compared to Jester – Jester is perfect for RoR </li></ul><ul><li>Robust and scala...
Demo <ul><li>Demonstration of CRUD application with customer database. </li></ul><ul><li>Fits well with other JavaScript l...
Persevere Persisted Applications <ul><li>Functions/Methods can be stored in the persisted object stores </li></ul><ul><ul>...
Persisted Application & Distributed Computing Demonstration <ul><li>Customers Demo </li></ul><ul><li>Find Primes Demo </li...
Thank you for your time <ul><li>See the presentation and links to projects at: </li></ul><ul><li>www.xucia.com/page/Advanc...
Upcoming SlideShare
Loading in...5
×

Advanced Json

11,852

Published on

Presentation on various definitions for JSON including JSON-RPC, JSPON, JSON Schema, JSONP and tools for working these definitions including Persevere client and server..

3 Comments
11 Likes
Statistics
Notes
No Downloads
Views
Total Views
11,852
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
481
Comments
3
Likes
11
Embeds 0
No embeds

No notes for slide

Advanced Json

  1. 1. Advanced JSON Persistence Mapping, RPCs, Cross-Domain and More. Kris Zyp [email_address] www.xucia.com www.json.com
  2. 2. Overview <ul><li>Specifications - JSON </li></ul><ul><ul><li>JSONT </li></ul></ul><ul><ul><li>JSONPath </li></ul></ul><ul><ul><li>JSON Referencing </li></ul></ul><ul><ul><li>JSON Schema </li></ul></ul><ul><ul><li>JSON-RPC </li></ul></ul><ul><ul><li>JSPON </li></ul></ul><ul><ul><li>JSON-P </li></ul></ul><ul><li>Tools </li></ul><ul><ul><li>CrossSafe </li></ul></ul><ul><ul><li>JSPON Browser </li></ul></ul><ul><ul><li>Persevere </li></ul></ul>
  3. 3. JSON Overview/History <ul><li>JSON born from JavaScript object and array initializer syntax </li></ul><ul><li>{“property”:”value”, “number”:2, “boolean”:true, “oddNumbers”:[1,3,5]} </li></ul><ul><li>XML vs JSON </li></ul><ul><ul><li>Strengths of each </li></ul></ul>
  4. 4. About JSON <ul><li>JSON = { “size” : “compact”, “readable” : true, “purposes” : [“simple data structures”, ”object serialization”], “simple” : true, “easily parsed” : true } </li></ul>
  5. 5. XML… <ul><li><?xml version=&quot;1.0&quot; encoding=&quot;utf-8&quot;?> </li></ul><ul><li><xml xmlns:ajson=&quot;http://www.xucia.com/ page/Advanced_JSON&quot; > </li></ul><ul><li><size>bigger</size> <readable type=“boolean” expectation=“consumer defines booleans the same way I do”>true</readable> </li></ul><ul><li><purpose ambiguity=“Is this an array?”>Give semantic meaning to documents</purpose> </li></ul><ul><li><derived_from>SGML</derived_from> </li></ul><ul><li><legacy_uses>many</legacy_uses> </li></ul><ul><li></xml> </li></ul>
  6. 6. Interoperability <ul><ul><li>Minimizing cost of communication. </li></ul></ul><ul><ul><li>JSON has a lot of flexibility. </li></ul></ul><ul><ul><li>Conventions don’t matter as much when we write the client & server, but will with mashups </li></ul></ul><ul><ul><li>JSON Definitions help us to interoperate without having to create or understand custom JSON usage. </li></ul></ul><ul><ul><li>Analogous to RSS, SOAP, and XHTML in the XML world. </li></ul></ul>
  7. 7. Cross Domain JSON <ul><li>XHR Same Origin Policy </li></ul><ul><li>Script tags can access cross site scripts </li></ul><ul><li>Dynamic Script Tag Insertion </li></ul><ul><ul><li>How to know when it loads? </li></ul></ul><ul><ul><li>How to know what was returned? </li></ul></ul><ul><ul><li>Is JSON even a valid script? </li></ul></ul>
  8. 8. JSONP http://bob.pythonmac.org/archives/2005/12/05/remote-json-jsonp/ <ul><li>Defines a parameter for defining a prefix for JSON returned in a script </li></ul><ul><li>www.jsonsource.com/?callback=done </li></ul><ul><li>done({“name”:”my json object”}) </li></ul><ul><li>Yahoo, Flickr provide this for their webservices </li></ul><ul><li>Unsecure used alone! </li></ul>
  9. 9. CrossSafe <ul><li>How to access cross-domain data securely? </li></ul><ul><ul><li>Proxy – Secure, but slower and more work. </li></ul></ul><ul><ul><li>Dynamic Script Tags – Faster, more direct, but insecure, cross domain has full access to your JS environment. </li></ul></ul><ul><ul><li>Alternate technologies – Flash, signed applets </li></ul></ul><ul><ul><li>CrossSafe – Fast, direct access that is secure. </li></ul></ul><ul><ul><ul><li>Implements JSONRequest Specification </li></ul></ul></ul><ul><ul><ul><li>Implements Subspace Approach </li></ul></ul></ul><ul><ul><ul><ul><li>Uses Dynamic Script Tag insertion in nested iframes with domain containment for sandboxing </li></ul></ul></ul></ul>
  10. 10. CrossSafe <ul><li>Must use hostname.domain.com and make webservice.domain.com accessible </li></ul><ul><li>Servers must support JSONP or other callback parameter </li></ul><ul><li>JSONRequest.get(“http://www.yahoo.com/..”, function(id, value) { … } </li></ul><ul><li>Defers to native implementation when available </li></ul><ul><li>Show Demo: </li></ul><ul><li>http://www.xucia.com/page/CrossSafe </li></ul>
  11. 11. JSONT http://goessner.net/articles/jsont/ <ul><li>Data: { &quot;link&quot; : { &quot;uri&quot; : &quot;http://company.com&quot; , &quot;title&quot; : &quot;company homepage&quot; }} </li></ul><ul><li>Transformation: { &quot;link&quot; : &quot;<a href=&quot;{link.uri}&quot;>{link.title}</a>&quot; } </li></ul><ul><li>Result: <a href= &quot;http://company.com&quot; >company homepage</a> </li></ul>
  12. 12. Referencing <ul><li>Circular References </li></ul><ul><ul><li>Me = {“name”:”Kris Zyp”, “spouse” : {“name”:”Nikki Zyp”}} </li></ul></ul><ul><ul><li>MyWife = Me.spouse; </li></ul></ul><ul><ul><li>MyWife.spouse = Me; </li></ul></ul><ul><li>Multiples References to single objects </li></ul><ul><ul><li>list = [{“name”:”first”,”child”:{“name”:”the child”}}, {“name”:”second”}] </li></ul></ul><ul><ul><li>list[1].child = list[0].child; </li></ul></ul>
  13. 13. JSON Referencing www.json.com <ul><li>Scope </li></ul><ul><ul><li>Intramessage </li></ul></ul><ul><ul><ul><li>Circular References </li></ul></ul></ul><ul><ul><ul><li>Multiple References </li></ul></ul></ul><ul><ul><li>Intermessage </li></ul></ul><ul><ul><li>Cross-Domain references </li></ul></ul><ul><li>Reference Methods </li></ul><ul><ul><li>Path - ref: “$.prop[4]” </li></ul></ul><ul><ul><li>ID - ref: “111” </li></ul></ul>
  14. 14. JSON Referencing (Intramessage) www.json.com <ul><li>Reference Methods </li></ul><ul><ul><li>Conventions – in string, fixups, in object </li></ul></ul><ul><ul><li>Path – use $ for JSON root (per JSONPath) </li></ul></ul><ul><ul><ul><li>[{“child”:{“name”:”the child”}}, </li></ul></ul></ul><ul><ul><ul><li>{“child”:{“$ref”:”$[0].child”}}] </li></ul></ul></ul><ul><ul><li>ID </li></ul></ul><ul><ul><ul><li>[{“child”:{“id”:”1”,“name”:”the child”}}, </li></ul></ul></ul><ul><ul><ul><li>{“child”:{“$ref”:”1”}}] </li></ul></ul></ul><ul><ul><li>Combine – {“$ref”:”1.name”} </li></ul></ul>
  15. 15. JSON Referencing www.json.com <ul><li>Intermessage – must use ID referencing </li></ul><ul><ul><li>Intermessage </li></ul></ul><ul><ul><ul><li>{“id”:”1”,”name”:”first”, </li></ul></ul></ul><ul><ul><ul><li> “ child”:{“id”:”3”,“name”:”the child”}} </li></ul></ul></ul><ul><ul><ul><li>{“id”:”2”,”name”:”second”, </li></ul></ul></ul><ul><ul><ul><li> “ child”:{“$ref”:”3”}} </li></ul></ul></ul><ul><ul><li>Remote References </li></ul></ul><ul><ul><ul><li>{“id”:”2”,”name”:”second”, </li></ul></ul></ul><ul><ul><ul><li> “ child”:{“$ref”:”http://www.json.com/jsonObject”}} </li></ul></ul></ul><ul><ul><li>URL rules </li></ul></ul><ul><ul><ul><li>Use the standard HTML rules for relative URLs in context </li></ul></ul></ul><ul><ul><ul><ul><li>GET /users/2 </li></ul></ul></ul></ul><ul><ul><ul><ul><li>{“id”:”2”,”name”:”john”,”group”:{“$ref”:”../groups/1”}} </li></ul></ul></ul></ul>
  16. 16. Identification <ul><li>Circular References </li></ul><ul><ul><li>Me = {“id”:”kris”, </li></ul></ul><ul><ul><li>“ name”:”Kris Zyp”, </li></ul></ul><ul><ul><li>“ spouse”:{“id”:”nikki”, </li></ul></ul><ul><ul><li>“ name”:”Nikki Zyp”: </li></ul></ul><ul><ul><li>“ spouse”:{“$ref”:”kris”}}} </li></ul></ul><ul><ul><li>Library available on json.com </li></ul></ul>
  17. 17. JSPON www.jspon.org <ul><li>Background… </li></ul><ul><li>RESTful approach for interaction and interoperability with persistent data </li></ul><ul><li>Most JSON is used to describe persisted data </li></ul><ul><li>Deals with complex data structures, modifications, and more </li></ul><ul><li>JSPON = REST + JSON + Relative URLs for ids and references </li></ul>
  18. 18. JSPON Over HTTP <ul><li>Every id has an implicit (or explicit) URL using the standard relative URL approach </li></ul><ul><li>References to ids can be used for unloaded values (lazy loading) </li></ul><ul><li>REST service </li></ul><ul><ul><li>POST to an id/url to append to an object </li></ul></ul><ul><ul><li>PUT to an id/url to change an object </li></ul></ul><ul><ul><li>GET to an id/url to get an object </li></ul></ul><ul><ul><li>DELETE to an id/url to delete an object </li></ul></ul>
  19. 19. Identification <ul><ul><li>GET http://mydomain.com/objects/myObj </li></ul></ul><ul><ul><li>{“id”:”myObj” -> http://mydomain.com/objects/myObj </li></ul></ul><ul><ul><li>“ name”:”my object”, </li></ul></ul><ul><ul><li>“ moreInfo”: {“$ref”:”largeObject”}, -> http://mydomain.com/object/myObj </li></ul></ul><ul><ul><li>“ crossSiteRef”: </li></ul></ul><ul><ul><li>{“$ref”:”http://yourdomain.com/yourObj”}, -> http://yourdomain.com/yourObj </li></ul></ul><ul><ul><li>“ user”: </li></ul></ul><ul><ul><li>{“$ref”:”../users/1”}, -> http:// mydomain.com/object/myObj </li></ul></ul><ul><ul><li>} </li></ul></ul><ul><li>Partial Graph Transfer/Lazy Loading </li></ul><ul><li>Object Modification </li></ul><ul><li>Cross Domain Object Trees </li></ul>
  20. 20. Persevere Server <ul><li>JSON Server </li></ul><ul><ul><li>Object database server </li></ul></ul><ul><ul><li>Interaction through REST commands with JSON </li></ul></ul><ul><ul><li>Queries through JSONPath </li></ul></ul><ul><ul><li>JSPON id approach </li></ul></ul><ul><ul><li>Supports JSONP </li></ul></ul><ul><ul><li>JSON-RPC method calls </li></ul></ul><ul><ul><ul><li>Demo distributed calls later </li></ul></ul></ul><ul><ul><li>JSON Schema support </li></ul></ul>
  21. 21. Persevere Server <ul><li>Exposes multiple data sources as JSON (JSPON): </li></ul><ul><ul><li>Internal OO Database </li></ul></ul><ul><ul><li>SQL Databases (MySQL, HSQL, etc) </li></ul></ul><ul><ul><li>XML files </li></ul></ul><ul><li>Data Centric Security </li></ul><ul><ul><li>Avoids application logic centric security </li></ul></ul><ul><li>Modular server – can be used with other servers </li></ul>
  22. 22. JSPON Object Browser <ul><li>Capable of browsing, modifying, and observing structural and access rules of data sources. </li></ul><ul><li>Demo at: http://www.xucia.com/browser.html?id=dyna%2F100788 </li></ul>
  23. 23. JSONPath <ul><li>XPath for JSON </li></ul><ul><li>Influenced by XPath and E4X syntax, and traditional C/Java/JS property access syntax </li></ul><ul><li>Examples: </li></ul><ul><li>$.store.book[0].title -> What you think </li></ul><ul><li>$..author -> Recursive search authors </li></ul><ul><li>$.book[:4]  first four books </li></ul><ul><li>$.book[?(@.price<10)] -> books under 10 </li></ul>
  24. 24. JSON-RPC http://json-rpc.org/ <ul><li>Request </li></ul><ul><ul><li>method - A string containing the name of the method to be invoked. </li></ul></ul><ul><ul><li>params - An array of objects to pass as arguments to the method. </li></ul></ul><ul><ul><li>id - The request id. This can be of any type. It is used to match the response with the request that it is replying to. </li></ul></ul>
  25. 25. JSON-RPC <ul><li>Response </li></ul><ul><ul><li>result - The object that was returned by the invoked method. This must be null in case there was an error invoking the method. </li></ul></ul><ul><ul><li>error - An error object if there was an error invoking the method. It must be null if there was no error. </li></ul></ul><ul><ul><li>id - This must be the same id as the request it is responding to. </li></ul></ul>
  26. 26. JSON-RPC <ul><li>Example </li></ul><ul><ul><li>{ &quot;method&quot;: &quot;echo&quot;, &quot;params&quot;: [&quot;Hello JSON-RPC&quot;], &quot;id&quot;: 1} { &quot;result&quot;: &quot;Hello JSON-RPC&quot;, &quot;error&quot;: null, &quot;id&quot;: 1} </li></ul></ul>
  27. 27. Persevere Server <ul><li>Client/Server JavaScript </li></ul><ul><li>Persistent Object Mapping </li></ul><ul><ul><li>Rhino Environment </li></ul></ul>
  28. 28. JSON Schema http://www.json.com/json-schema-proposal/ <ul><li>Contract about valid data </li></ul><ul><li>Influenced by XML Schema, Kwalify, RelaxNG, and ES4 </li></ul><ul><li>Analogous to Classes in OO Languages or DTDs/Schemas in XML </li></ul><ul><li>Defines requirements for JSON properties and other property attributes </li></ul><ul><li>Uses </li></ul><ul><ul><li>Validation - data integrity </li></ul></ul><ul><ul><li>Documentation </li></ul></ul><ul><ul><li>Interaction </li></ul></ul><ul><ul><ul><li>UI generation (forms and code) </li></ul></ul></ul><ul><li>Can be used on the client and server </li></ul><ul><li>Compact Implementation </li></ul>
  29. 29. JSON Schema Example <ul><li>{“name”:{ “type”:”string”, “required”:true, “nullable”:false, </li></ul><ul><li>“ length”:25, “description”:”Name of the person”}, </li></ul><ul><li>“ age”:{ “type”:”number”, “minimum”:0, “maximum”:125} </li></ul><ul><li>} </li></ul>
  30. 30. JSON Schema Example <ul><li>{“address”:{ “type”:{“street”:{“type”:”string”}, “state”:{“type”:”string”}}, </li></ul><ul><li>“ description”:”Where they live”}, </li></ul><ul><li>“ born”:{“type”:[“number”,”string”]} </li></ul><ul><li>} </li></ul>
  31. 31. JSON Schema Example <ul><li>{“name”:”Kris Zyp” </li></ul><ul><li>“ age”:30, </li></ul><ul><li>“ spouse”:{“id”:”nikki”}, </li></ul><ul><li>“ schema”:{“id”:”person”, </li></ul><ul><li>“ name”:{“type”:”string”}, </li></ul><ul><li>“ age”:{“type”:”number”}, </li></ul><ul><li>“ spouse”:{“type”:{“$ref”:”person”}} // recursive def </li></ul><ul><li>}} </li></ul>
  32. 32. Persevere JS Client <ul><li>Persistent object mapping with REST web services </li></ul><ul><li>Orthogonal Persistence and Lazy Loading Capabilities </li></ul><ul><li>Implements JSON-RPC Method Calls </li></ul><ul><li>Implements Persistent JavaScript API: http://www.persistentjavascript.org </li></ul><ul><li>Implements JSPON </li></ul><ul><li>With Persevere Server – End to end JS </li></ul>
  33. 33. Example Usage of Persevere <ul><li>var result = pjs.load(“data or query id”); </li></ul><ul><li>var object = result[1]; </li></ul><ul><li>var value = object.prop; </li></ul><ul><li>object.prop = “new value”; </li></ul><ul><li>result.push({name:”new object/row”}) </li></ul><ul><li>Array.remove(result,object); // or splice </li></ul>
  34. 34. What Did We Not Have to Write? <ul><li>doAjax… (break up into multiple slides) </li></ul><ul><li>Request controller </li></ul><ul><li>Do sql… </li></ul><ul><li>API to learn… Almost zero, majority of operations are standard JavaScript </li></ul>
  35. 35. Persevere JS Client Capabilities <ul><li>Compared to Jester – Jester is perfect for RoR </li></ul><ul><li>Robust and scalable </li></ul><ul><ul><li>Lazy loading </li></ul></ul><ul><ul><li>Automatic and Explicit Transactions </li></ul></ul><ul><ul><li>Designed for optimistic locking/merging </li></ul></ul><ul><li>Auto save/Orthogonality </li></ul><ul><li>Integration with Strands for threading/continuations </li></ul><ul><li>Bi-directional dynamic object and structure creation and modification </li></ul>
  36. 36. Demo <ul><li>Demonstration of CRUD application with customer database. </li></ul><ul><li>Fits well with other JavaScript libraries </li></ul>
  37. 37. Persevere Persisted Applications <ul><li>Functions/Methods can be stored in the persisted object stores </li></ul><ul><ul><li>Applications can exist as persistent object graphs. </li></ul></ul><ul><li>Persevere server implements Persistent JavaScript on the server. </li></ul><ul><li>Distributed Computing capable with other JSPON/RPC implementators. </li></ul><ul><ul><li>Transparent remote calls </li></ul></ul>
  38. 38. Persisted Application & Distributed Computing Demonstration <ul><li>Customers Demo </li></ul><ul><li>Find Primes Demo </li></ul><ul><li>Reverse Ajax </li></ul><ul><li>Inheritance </li></ul>
  39. 39. Thank you for your time <ul><li>See the presentation and links to projects at: </li></ul><ul><li>www.xucia.com/page/AdvancedJSON </li></ul><ul><li>Xucia Incorporation </li></ul><ul><li>www.xucia.com </li></ul><ul><li>www.json.com </li></ul><ul><li>email: [email_address] </li></ul><ul><li>Kris Zyp </li></ul><ul><li>503-806-1841 </li></ul>
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×