Josselin Muller - final defense

805 views

Published on

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
805
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Josselin Muller - final defense

  1. 1. Josselin MullerMTI 2012 Internship defense User Data Analysis, Log Analysis & 3D Graph Visualization 10/07/2012 Josselin Muller - MTI 2012 1 | 28
  2. 2. CONTEXT10/07/2012 Josselin Muller - MTI 2012 2 | 28
  3. 3. Internship Offer • Selection: • Benefits: – Test – $2 500 / month – Interview – Apartment in Upper West Side • Location: New York – Airline tickets & Visa – Transport from JFK – Sports tickets • 6 months – 6 days off“ Welcome in Burgerland ! ” 10/07/2012 Josselin Muller - MTI 2012 3 | 28
  4. 4. Company• 24/7 Real Media & The Media Innovation Group – Digital Marketing• Worldwide company based in New York City – 12 countries – 600+ employees• WPP Group – World’s 2nd largest advertising group10/07/2012 Josselin Muller - MTI 2012 4 | 28
  5. 5. Rebranding10/07/2012 Josselin Muller - MTI 2012 5 | 28
  6. 6. Supervisor• Jad Nehme – VP of Engineering – Master of Science in Information Networking – Previous companies • Alcatel • Sony • DoubleClick • ContextWeb10/07/2012 Josselin Muller - MTI 2012 6 | 28
  7. 7. Internship Subject• User Data Analysis• Log Analysis• 3D Graph for multi-dimensional data visualization10/07/2012 Josselin Muller - MTI 2012 7 | 28
  8. 8. OBJECTIVES10/07/2012 Josselin Muller - MTI 2012 8 | 28
  9. 9. Global objectives• Long study• Quick tasks• R&D project10/07/2012 Josselin Muller - MTI 2012 9 | 28
  10. 10. Planning• 6 months internship (05/02/12 to 31/07/12)• 3 « projects »10/07/2012 Josselin Muller - MTI 2012 10 | 28
  11. 11. Supervising• Weekly meetings – Progression• Special meetings with Jad – Assignments• Meetings with colleagues – Presentation of results10/07/2012 Josselin Muller - MTI 2012 11 | 28
  12. 12. ACCOMPLISHED WORK10/07/2012 Josselin Muller - MTI 2012 12 | 28
  13. 13. User Data Analysis• Data warehouse:• Questions – “What is the probability for a visitor to come back? When ?” – “How long the User Data should be kept?”10/07/2012 Josselin Muller - MTI 2012 13 | 28
  14. 14. User Data Analysis• Subset of data: 3 months• > 1 To• User Data: – Impressions (delivered ads) – Clicks (clicks on delivered ads) – Events (events on advertiser websites, like product purchase)10/07/2012 Josselin Muller - MTI 2012 14 | 28
  15. 15. User Data Analysis• Global statistics• Case study• Theories – Number of previous visits – Last time seen – Age of cookie10/07/2012 Josselin Muller - MTI 2012 15 | 28
  16. 16. User Data Analysis • Meeting to present the results Number of previous visits (absolute) Last time seen (absolute)40000000 40 Millions30000000 3020000000 2010000000 10 0 0 [1000,10… 0 1 [900,1000[ [100,200[ [200,300[ [300,400[ [400,500[ [500,600[ [600,700[ [700,800[ [800,900[ >= 10 000 [80,100[ [14,20[ [20,40[ [40,60[ [60,80[ [8,14[ [2,4[ [4,8[ Come back Dont come back Come back Dont come back Summary 100.00% 50.00% 0.00% [1h, [2h, [4h, [8h, [14h, [1d, [2d, [3d, [4d, [5d, [6d, [7d, [10d, [14d, 0 < 1h 2h[ 4h[ 8h[ 14h[ 24h[ 2d[ 3d[ 4d[ 5d[ 6d[ 7d[ 10d[ 14d[ 31d[ Delta 90. 66. 75. 79. 79. 81. 80. 83. 85. 86. 86. 86. 85. 86. 86. 93. 10/07/2012 Josselin Muller - MTI 2012 16 | 28
  17. 17. Log Analysis • Safari Issue – Problem: some « bad » users still come – Solution: log analysis0 1 2603648971646124 - C 0 imp b3migAgencyId=335&migSource=b3&migTrackDataExt=korea;zapuser/8815;107108;95/450&migRandom=7154171355&migTrackFmtExt=network;account/campaign;ad;page - 210.104.146.253 1330905600 ""200 "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; Trident/5.0; SLCC2; .NET CLR 2.0.50727;.NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; MASM; InfoPath.2; .NET4.0C)""http://adcreative.naver.com/ad3/1035/1035221/120227_HDC_03_475x100_W.swf"UserIDCookie state [C = cookied]Event type [imp, event, click]User Agent 10/07/2012 Josselin Muller - MTI 2012 17 | 28
  18. 18. Log Analysis • 1st step: – 28 « bad » users – User Agent analysis • Results: 3 categories Category DescriptionChanged The UA contains a browser name, like Firefox ou Chrome, but not SafariTruncated There is no browser name in the UASafari The UA contains Safari 10/07/2012 Josselin Muller - MTI 2012 18 | 28
  19. 19. Log Analysis• 2nd step: Project Zebra – Objective: count the number of bad users – Solution: development of an optimized parser• Bad users list (137 133 112 ids, > 2.3 Go)• Log files (155 953 837 rows, > 81 Go)• First version: C++• Second version: full C (10x faster)• Third version: flexible (options)10/07/2012 Josselin Muller - MTI 2012 19 | 28
  20. 20. 3D Graph Visualization• Existing project made by Jerome Champigny• Framework: Three.js10/07/2012 Josselin Muller - MTI 2012 20 | 28
  21. 21. 3D Graph Visualization• 2D Text in 3D World – Canvas for texture – 3D Plan – Material10/07/2012 Josselin Muller - MTI 2012 21 | 28
  22. 22. 3D Graph Visualization• Camera 2.0 – Smart Zoom (Google-map like) – Translation & rotation with mouse – Bounded to the grid – JS Events: • MouseUp • MouseDown • MouseMove, • MouseWheel10/07/2012 Josselin Muller - MTI 2012 22 | 28
  23. 23. 3D Graph Visualization• “Terrain view” – One point = one data – All points linked with the indexbuffer – Special color for each “dataset”10/07/2012 Josselin Muller - MTI 2012 23 | 28
  24. 24. 3D Graph Visualization• “Terrain view”10/07/2012 Josselin Muller - MTI 2012 24 | 28
  25. 25. 3D Graph Visualization• Bar chart – One data = One bar = 8 vertices – Link vertices to make 5 faces (not the bottom one)10/07/2012 Josselin Muller - MTI 2012 25 | 28
  26. 26. 3D Graph Visualization• What’s next – Optimization – “2D mode” feature – Visual effects – Animations• Objective – Integration in Zap Administrator10/07/2012 Josselin Muller - MTI 2012 26 | 28
  27. 27. SUMMARY10/07/2012 Josselin Muller - MTI 2012 27 | 28
  28. 28. Summary• First international experience• Job offer: Software Engineer• Thanks to Jad Nehme and my colleagues10/07/2012 Josselin Muller - MTI 2012 28 | 28

×