Vital.AI Creating Intelligent Apps

15,681 views

Published on

Vital.AI's Big Data App Platform allows creating data-driven apps rapidly.

Published in: Technology, Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
15,681
On SlideShare
0
From Embeds
0
Number of Embeds
12,010
Actions
Shares
0
Downloads
25
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Vital.AI Creating Intelligent Apps

  1. 1. Creating Intelligent Apps with Semantics & Big Data O c t o b e r 2 , 2 0 1 3 Marc C. Hadfield, Founder Email: marc@vital.ai Thursday, October 3, 13
  2. 2. <introduction> Marc Hadfield Founder of Vital.AI Vital.AI Big Data Application Platform: Semantics & Big Data in one platform, combining multiple Data Analysis techniques. Thursday, October 3, 13
  3. 3. Intelligent Applications Development Processes Business Value Today: Thursday, October 3, 13
  4. 4. Intelligent Applications: ...learn from experience. Thus, are experience-driven: data-driven. “self-optimizing” Thursday, October 3, 13
  5. 5. Data-Driven Applications Thursday, October 3, 13
  6. 6. Moderni.st Thursday, October 3, 13
  7. 7. Moderni.st Thursday, October 3, 13
  8. 8. Personal Agent App Thursday, October 3, 13
  9. 9. Why are data-driven applications different? Thursday, October 3, 13
  10. 10. User Interface Business Logic Database Traditional Applications Why are data-driven applications different? “sta%c” Thursday, October 3, 13
  11. 11. Why are data-driven applications different? “dynamic” User Interface Business Logic Events Data-Driven Applications Data Analytics Derived Behavior Logic Thursday, October 3, 13
  12. 12. Data-Driven Applications use many different technologies, with many different skill sets: greater power, higher cost. Thursday, October 3, 13
  13. 13. Why do we want a data-driven application? Thursday, October 3, 13
  14. 14. What are the components of a data-driven application? Data Collection Dynamically Adjust Behaviors Data Analysis / Feedback Thursday, October 3, 13
  15. 15. Implementing a Data-Driven Application. Thursday, October 3, 13
  16. 16. Implementation Goals: Off the shelf? Minimize Impedance Mismatch: Mobile/Web User Interface vs. Semantic vs. Big Data vs. ... Efficient Development Processes Thursday, October 3, 13
  17. 17. Vital.AI Platform Stack Clean separation of responsibilities and skill sets. Rapid Development of Data-Driven Apps. VitalSigns: Ontology-based Data Model. Thursday, October 3, 13
  18. 18. Vital Prime REST Interface Collects Real-Time Events Database Interfaces: HBase, Allegrograph, ... Workflow Interface Script Engine In-Memory Analytics User State Management Thursday, October 3, 13
  19. 19. Vital Flows Implements Workflows: Natural Language Processing Run Predictive Analytics Graph Analytics Logical Inference Many open-source components in a common workflow framework. Thursday, October 3, 13
  20. 20. Hadoop Implements Big Data Analysis: Machine Learning Build Predictive Models Thursday, October 3, 13
  21. 21. Vital Core Ontology Thursday, October 3, 13
  22. 22. Vital Core Ontology Vital Domain Ontology Application Domain Ontology Extending the Ontology Thursday, October 3, 13
  23. 23. Generating Data Bindings with VitalSigns: Ontology VitalSigns Groovy Bindings Semantic Bindings Hadoop Bindings Prolog Bindings Graph Bindings HBase Bindings JavaScript Bindings Thursday, October 3, 13
  24. 24. person123.name = "John" person123.worksFor.company456 <person123> <hasName> "John" <worksFor123> <hasSource> <person123> <worksFor123> <hasDestination> <company456> <worksFor123> <hasType> <worksFor> person123, Node:type=Person, Node:hasName="John" worksFor123, Edge:type=worksFor, Edge:hasSource=person123, Edge:hasDestination=company456 Groovy RDF HBase Data Representations Thursday, October 3, 13
  25. 25. Editing the Ontology Thursday, October 3, 13
  26. 26. Developing with the Ontology in UI, Hadoop, NLP, Scripts, ... Node:Person Node:PersonEdge:hasFriend Set<Friend> person123.getFriends() “Best Practices” in Ontology Development. Thursday, October 3, 13
  27. 27. Data Analysis Thursday, October 3, 13
  28. 28. Using Natural Language Processing Topic Categorization Extract Entities Dialogue System Entity Normalization Thursday, October 3, 13
  29. 29. Using Graph Analytics PageRank, Centrality, Interest Graph, ... Thursday, October 3, 13
  30. 30. Using Machine Learning Implemented via Hadoop Algorithms from Mahout Build Predictive Models Models used in Workflows Data defined in Ontology Classification, Clustering... Thursday, October 3, 13
  31. 31. Data Visualization - Cytoscape Thursday, October 3, 13
  32. 32. Data Management - Dashboard, Wiki Thursday, October 3, 13
  33. 33. Examples Shopping Recommendation App Personal Agent App Content Recommendation App Thursday, October 3, 13
  34. 34. Content Recommendation REST Interface Vital Client Vital Prime Vital Flow Queue Integrator NLP HadoopML Model S3 Elastic Map/Reduce Mahout 300M Users 100K Publishers NLP Machine Learning Content + User Signals Recommendations Thursday, October 3, 13
  35. 35. Personal Agent Dialogue System Thursday, October 3, 13
  36. 36. Personal Agent Interest Graph Recommendations Thursday, October 3, 13
  37. 37. Thursday, October 3, 13
  38. 38. Thursday, October 3, 13
  39. 39. Thursday, October 3, 13
  40. 40. Thursday, October 3, 13
  41. 41. Thursday, October 3, 13
  42. 42. Thursday, October 3, 13
  43. 43. Thursday, October 3, 13
  44. 44. Thursday, October 3, 13
  45. 45. Thursday, October 3, 13
  46. 46. Thursday, October 3, 13
  47. 47. Moderni.st App Server Vital Prime Integrator Flow NLP Flow Logger Flow Inference Flow VITAL API VitalSigns Web Browser / Mobile Device HDFS Hbase Hadoop Jobs Mahout Vital Flows Flume Allegrograph Thursday, October 3, 13
  48. 48. Creating an Intelligent App Create User Interface. Use Vital Client, Send Signals Create App Ontology, including Domain Classes & Events/Signals Define Workflows for Data Processing Define Predictive Models, Build Models Create scripts for App Functionality Deploy Components Thursday, October 3, 13
  49. 49. Development Processes Use the right tool for the right job, & the right people for the right job. Integrated Framework. Coordinate on Ontology. Eliminate Data Mis-Matches. Clean code separation of “paradigms.” Solve “Variety” Big Data challenge. Thursday, October 3, 13
  50. 50. Business Value Intelligent App. Efficient, Rapid Development. Flexibility to learn, adapt, improve. Greatly reduce risk. Thursday, October 3, 13
  51. 51. For more information, please contact: Marc C. Hadfield, Founder E: marc@vital.ai P: 917.463.4776 51 THANKYOU! Thursday, October 3, 13
  52. 52. Thursday, October 3, 13
  53. 53. Thursday, October 3, 13
  54. 54. Thursday, October 3, 13

×