Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Object Model

6,213 views

Published on

Published in: Business
  • Be the first to comment

Object Model

  1. 1. Palantir Object Model Shreyas Vijaykumar Forward Deployed Engineer
  2. 2. Data Platform <ul><li>Why are you watching this presentation? (select one) </li></ul><ul><ul><li>You really like watching technical DVDs </li></ul></ul><ul><ul><li>24 is all reruns </li></ul></ul><ul><ul><li>You understand that the object model is at the core of the Palantir data platform </li></ul></ul>
  3. 3. Traditional Approaches <ul><li>Traditional approaches leave something to be desired: </li></ul><ul><ul><li>Users save files like: trends_report.final.friday.10am.xxx </li></ul></ul><ul><ul><li>Every change requires modifying the schema </li></ul></ul><ul><ul><li>Different datasets can’t be explored together </li></ul></ul><ul><ul><li>The phrase ‘data resync’ strikes fear in your heart </li></ul></ul><ul><ul><li>Information can’t be traced back to source </li></ul></ul>
  4. 4. Our Approach <ul><li>The flexibility to model anything </li></ul><ul><li>A lossless data abstraction </li></ul><ul><li>An open format and API </li></ul>structured unstructured
  5. 5. The Object Model <ul><li>Lives in between physical storage and an end user </li></ul>Object model Analyst Developer Admin
  6. 6. What is the Palantir Object Model? Object <ul><li>There are actually three types of object components: </li></ul><ul><ul><li>Properties : Textual object attributes </li></ul></ul><ul><ul><li>Media: Images, videos, documents, binary data </li></ul></ul><ul><ul><li>Notes: free text containers </li></ul></ul>Relationships Object Components
  7. 7. The Object Model and the Ontology Object Model with Ontology: Relationship Object Model: Ontology: Relationships Objects Properties
  8. 8. Schema Maintainability <ul><li>No tables for new types, relationships, and allowances! </li></ul><ul><li>One fixed schema (to rule them all) </li></ul><ul><ul><li>PT_Object </li></ul></ul><ul><ul><li>PT_Property PT_Note </li></ul></ul><ul><ul><li>PT_Media </li></ul></ul><ul><ul><li>PT_Object_Object </li></ul></ul>
  9. 9. The Object Model - revisited <ul><li>Sits in between physical storage and an end user </li></ul>Object model Analyst Developer Admin
  10. 10. Data Sources <ul><li>Every piece of information in Palantir comes from a Data Source </li></ul><ul><li>Why does this matter? </li></ul>
  11. 11. The Object Model and Data Sources <ul><li>Every object component has a Data Source Record, or DSR, that connects the information to its source. </li></ul><ul><li>Multiple data sources can contribute to the same object . </li></ul><ul><li>Multiple data sources can support the same object component/link . </li></ul><ul><li>DSRs point to row number for structured data and sentence/paragraph locators for unstructured data. </li></ul>Data Source A Data Source B Data Source C
  12. 12. A Tree View of the Object Model Name = Shreyas Email = shrey291@aol.com CBP 02201932.txt Attendee List.xls Object A Name = Shreyas Vijaykumar Manually Created Data
  13. 13. Data Integration <ul><li>A data problem as well as a tools problem </li></ul><ul><li>pXML – a complete representation of the object model </li></ul><ul><li>Eating our own dogfood: Raptor </li></ul>
  14. 14. Summary <ul><li>The object model is at the core of the Palantir data platform </li></ul><ul><ul><li>The flexibility to model anything </li></ul></ul><ul><ul><li>A lossless data abstraction </li></ul></ul><ul><ul><li>An open format and API </li></ul></ul>

×