Building the Autodesk Design Graph-(Yotto Koga, Autodesk)
•
3 likes•2,445 views
Presentation at Spark Summit 2015
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (20)
Similar to Building the Autodesk Design Graph-(Yotto Koga, Autodesk)
Similar to Building the Autodesk Design Graph-(Yotto Koga, Autodesk) (20)
More from Spark Summit
More from Spark Summit (20)
Recently uploaded
Recently uploaded (20)
Building the Autodesk Design Graph-(Yotto Koga, Autodesk)
- 1. Building the Autodesk Design Graph using Apache Spark Yotto Koga
- 3. 3
- 4. 4 • focus on the solution • catch problems early • gain insights I can…
- 6. 6 Project Communications markups, workflows, activity, schedules, BOM, etc. Company Data libraries, AVLs, support data People Design Files BREPs, constraints, metadata, revisions, relationships Parts Where to start?
- 7. 7
- 8. 8
- 9. 9
- 10. 10 Parts ~ Words
- 11. 11
- 12. 12 Fasteners
- 16. 16 How do we identify parts?
- 17. 17 UNRELIABLE
- 18. 18
- 19. 19
- 20. 20 Shape is our most reliable and data rich piece of information
- 21. 21
- 22. 22
- 23. 23
- 24. 24 R1024 M. Kazhdan et al,”Rotation Invariant Spherical Harmonic Representation of 3D Shape Descriptors" Spherical Harmonic Shape Descriptor
- 26. 26
- 27. 27
- 28. 28
- 29. 29
- 30. 30
- 31. 31
- 32. 32 Data Source Data Transformation and Machine Learning Pipeline Design Graph
- 33. 33 Design Graph Query Optimized Graph Database Front End API Server Locality Sensitive Hash Custom Redis Elastic Search Search Engine Index
- 34. 34 Data Source Data Transformation and Machine Learning Pipeline Design Graph
- 35. 35 Batch Data Source Design Graph Part Extraction Sp Harmonics Descriptor Generation Data Cleanup Bigram Description Generation Part Clustering/ Labeling Design B of P Model Generation Design Clustering/ Labeling Design Graph Generation
- 38. ≈ 38 Mesh Processing C++ RDD Transform (Batch) Input RDD
- 39. ≈ 39 Mesh Processing C++ RDD Transform (Batch) Output RDD
- 40. ≈ 40 Mesh Processing C++ RDD Transform (Batch) Input RDD
- 41. ≈ 41 Mesh Processing C++ RDD Transform (Batch) Output RDD
- 42. ≈ 42 Mesh Processing C++ RDD Transform (Batch) Input RDD
- 43. ≈ 43 Mesh Processing C++ RDD Transform (Batch) Output RDD
- 44. ≈ 44 Mesh Processing C++ RDD Transform (Batch) Final RDD Fail
- 46. 46 Part Extraction Sp Harmonics Descriptor Generation Data Cleanup Bigram Description Generation Part Clustering/ Labeling Design B of P Model Generation Design Clustering/ Labeling Design Graph Generation
- 47. 47 Part Extraction Sp Harmonics Descriptor Generation Data Cleanup Bigram Description Generation Part Clustering/ Labeling Design B of P Model Generation Design Clustering/ Labeling Design Graph Generation Design Graph Module Persistent Lineage (S3)
- 48. 48 Part Extraction Sp Harmonics Descriptor Generation Data Cleanup Bigram Description Generation Part Clustering/ Labeling Design B of P Model Generation Design Clustering/ Labeling Design Graph Generation Persistent Lineage (S3) Bigram Different Parameters Part Clustering/ Labeling Design B of P Model Generation Design Clustering/ Labeling Design Graph Generation New Mesh Cleanup Bigram Description Generation Part Clustering/ Labeling Design B of P Model Generation Design Clustering/ Labeling Design Graph Generation
- 49. 49 Demo
- 50. 50 Part Extraction Sp Harmonics Descriptor Generation Data Cleanup Bigram Description Generation Design B of P Model Generation Design Clustering /Labeling Design Graph Generation Persistent Lineage (S3) Design Graph Module Batch Data Part Clustering /Labeling
- 51. Classifier Incremental Data Stream 51 Part Extraction Sp Harmonics Descriptor Generation Data Cleanup Bigram Description Generation Design B of P Model Generation Design Clustering /Labeling Design Graph Generation Persistent Lineage (S3) Design Graph Module Data Stream Part Clustering/ Labeling Queue
- 52. 52 The Team! Mike Haley Senthil Gandhi Tara Adiseshan Federico Vezzeso Morgan Dornbush Carlos Olguin Santiago SanchezKhoa Tran Yotto Koga
- 53. 53