Exploring Public APIs with MongoDB and Analytica
 

Exploring Public APIs with MongoDB and Analytica

on

  • 1,560 views

 

Statistics

Views

Total Views
1,560
Views on SlideShare
1,513
Embed Views
47

Actions

Likes
3
Downloads
11
Comments
0

4 Embeds 47

http://www.10gen.com 37
http://www.mongodb.com 5
http://drupal1.10gen.cc 4
https://twitter.com 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Exploring Public APIs with MongoDB and Analytica  Exploring Public APIs with MongoDB and Analytica Presentation Transcript

  • Exploring Public APIs with MongoDB and Analytica Nosh Petigara nosh@analytica.com @noshp
  • Today• MongoDB and public APIs• What is Analytica?• Demo – Analytica shell (twitter data) – Analytica for Excel (StackOverflow data)
  • MongoDB and public APIs• Most APIs talk JSON – MongoDB’s native JSON import• APIs vary wildly (internally and between one another) – MongoDB is schema-free• Data import is only half the battle – MongoDB’s query language and aggregation framework
  • Some data sets to explore• Twitter API (JSON) – https://dev.twitter.com/• Crunchbase API (JSON) – http://developer.crunchbase.com/• Stackoverflow (JSON and CSV) – http://data.stackexchange.com/• NYTimes (JSON, XML) – http://developer.nytimes.com/docs
  • Importing data sets• Streaming JSON directly into MongoDB – curl https://stream.twitter.com/1/statuses/sample.jso n –uUSERNAME:PASSword| ./mongoimport –d twitter –c tweets• Importing JSON files – ./mongoimport –d mydb –c mycoll file.json• CSV – ./mongoimport –d db –c coll --type csv -- headerline myfile.csv
  • Analytica• Analytics & reporting platform for MongoDB – Natively understands JSON/document hierarchy – Tailored for analytics (not querying) – Works directly on MongoDB• Discovery, analysis, visualization cycle• In private beta [http://analytica.com]
  • What can you do with Analytica?• Inspect and extract data• Augment your data model• Calculate & aggregate• Filter and transform data• Join collections
  • Demos• Today – Twitter stats [using the Analytica Shell] – Stackoverflow community analysis [using Analytica for Excel]• Not shown – REST API – Analytica web (Coming soon)
  • Demo 1: Twitter data
  • Some other examplesTweets vs. retweets count(select(twitter.tweets.where(retweet_count <> 0)))vs. repliesFollower counts max(twitter.tweets.user.followers_count)Popular hashtags set twitter.byhashtag = group(tweets.by(entities.hashtags.text)) set twitter.byhashtag.tweetcount = count(tweets) set twitter.populartags = orderdesc(byhashtag.by(tweetcount)) get twitter.populartags.text
  • Demo 2: StackOverflow User Profiles
  • Next steps• Private beta – http://analytica.com• Get in touch – nosh@analytica.com or info@analytica.com• @analytica_inc on twitter