• Save
Josselin Muller - final defense
Upcoming SlideShare
Loading in...5
×
 

Josselin Muller - final defense

on

  • 454 views

 

Statistics

Views

Total Views
454
Views on SlideShare
454
Embed Views
0

Actions

Likes
0
Downloads
0
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Josselin Muller - final defense Josselin Muller - final defense Presentation Transcript

  • Josselin MullerMTI 2012 Internship defense User Data Analysis, Log Analysis & 3D Graph Visualization 10/07/2012 Josselin Muller - MTI 2012 1 | 28
  • CONTEXT10/07/2012 Josselin Muller - MTI 2012 2 | 28
  • Internship Offer • Selection: • Benefits: – Test – $2 500 / month – Interview – Apartment in Upper West Side • Location: New York – Airline tickets & Visa – Transport from JFK – Sports tickets • 6 months – 6 days off“ Welcome in Burgerland ! ” 10/07/2012 Josselin Muller - MTI 2012 3 | 28
  • Company• 24/7 Real Media & The Media Innovation Group – Digital Marketing• Worldwide company based in New York City – 12 countries – 600+ employees• WPP Group – World’s 2nd largest advertising group10/07/2012 Josselin Muller - MTI 2012 4 | 28
  • Rebranding10/07/2012 Josselin Muller - MTI 2012 5 | 28
  • Supervisor• Jad Nehme – VP of Engineering – Master of Science in Information Networking – Previous companies • Alcatel • Sony • DoubleClick • ContextWeb10/07/2012 Josselin Muller - MTI 2012 6 | 28
  • Internship Subject• User Data Analysis• Log Analysis• 3D Graph for multi-dimensional data visualization10/07/2012 Josselin Muller - MTI 2012 7 | 28
  • OBJECTIVES10/07/2012 Josselin Muller - MTI 2012 8 | 28
  • Global objectives• Long study• Quick tasks• R&D project10/07/2012 Josselin Muller - MTI 2012 9 | 28
  • Planning• 6 months internship (05/02/12 to 31/07/12)• 3 « projects »10/07/2012 Josselin Muller - MTI 2012 10 | 28
  • Supervising• Weekly meetings – Progression• Special meetings with Jad – Assignments• Meetings with colleagues – Presentation of results10/07/2012 Josselin Muller - MTI 2012 11 | 28
  • ACCOMPLISHED WORK10/07/2012 Josselin Muller - MTI 2012 12 | 28
  • User Data Analysis• Data warehouse:• Questions – “What is the probability for a visitor to come back? When ?” – “How long the User Data should be kept?”10/07/2012 Josselin Muller - MTI 2012 13 | 28
  • User Data Analysis• Subset of data: 3 months• > 1 To• User Data: – Impressions (delivered ads) – Clicks (clicks on delivered ads) – Events (events on advertiser websites, like product purchase)10/07/2012 Josselin Muller - MTI 2012 14 | 28
  • User Data Analysis• Global statistics• Case study• Theories – Number of previous visits – Last time seen – Age of cookie10/07/2012 Josselin Muller - MTI 2012 15 | 28
  • User Data Analysis • Meeting to present the results Number of previous visits (absolute) Last time seen (absolute)40000000 40 Millions30000000 3020000000 2010000000 10 0 0 [1000,10… 0 1 [900,1000[ [100,200[ [200,300[ [300,400[ [400,500[ [500,600[ [600,700[ [700,800[ [800,900[ >= 10 000 [80,100[ [14,20[ [20,40[ [40,60[ [60,80[ [8,14[ [2,4[ [4,8[ Come back Dont come back Come back Dont come back Summary 100.00% 50.00% 0.00% [1h, [2h, [4h, [8h, [14h, [1d, [2d, [3d, [4d, [5d, [6d, [7d, [10d, [14d, 0 < 1h 2h[ 4h[ 8h[ 14h[ 24h[ 2d[ 3d[ 4d[ 5d[ 6d[ 7d[ 10d[ 14d[ 31d[ Delta 90. 66. 75. 79. 79. 81. 80. 83. 85. 86. 86. 86. 85. 86. 86. 93. 10/07/2012 Josselin Muller - MTI 2012 16 | 28
  • Log Analysis • Safari Issue – Problem: some « bad » users still come – Solution: log analysis0 1 2603648971646124 - C 0 imp b3migAgencyId=335&migSource=b3&migTrackDataExt=korea;zapuser/8815;107108;95/450&migRandom=7154171355&migTrackFmtExt=network;account/campaign;ad;page - 210.104.146.253 1330905600 ""200 "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; Trident/5.0; SLCC2; .NET CLR 2.0.50727;.NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; MASM; InfoPath.2; .NET4.0C)""http://adcreative.naver.com/ad3/1035/1035221/120227_HDC_03_475x100_W.swf"UserIDCookie state [C = cookied]Event type [imp, event, click]User Agent 10/07/2012 Josselin Muller - MTI 2012 17 | 28
  • Log Analysis • 1st step: – 28 « bad » users – User Agent analysis • Results: 3 categories Category DescriptionChanged The UA contains a browser name, like Firefox ou Chrome, but not SafariTruncated There is no browser name in the UASafari The UA contains Safari 10/07/2012 Josselin Muller - MTI 2012 18 | 28
  • Log Analysis• 2nd step: Project Zebra – Objective: count the number of bad users – Solution: development of an optimized parser• Bad users list (137 133 112 ids, > 2.3 Go)• Log files (155 953 837 rows, > 81 Go)• First version: C++• Second version: full C (10x faster)• Third version: flexible (options)10/07/2012 Josselin Muller - MTI 2012 19 | 28
  • 3D Graph Visualization• Existing project made by Jerome Champigny• Framework: Three.js10/07/2012 Josselin Muller - MTI 2012 20 | 28
  • 3D Graph Visualization• 2D Text in 3D World – Canvas for texture – 3D Plan – Material10/07/2012 Josselin Muller - MTI 2012 21 | 28
  • 3D Graph Visualization• Camera 2.0 – Smart Zoom (Google-map like) – Translation & rotation with mouse – Bounded to the grid – JS Events: • MouseUp • MouseDown • MouseMove, • MouseWheel10/07/2012 Josselin Muller - MTI 2012 22 | 28
  • 3D Graph Visualization• “Terrain view” – One point = one data – All points linked with the indexbuffer – Special color for each “dataset”10/07/2012 Josselin Muller - MTI 2012 23 | 28
  • 3D Graph Visualization• “Terrain view”10/07/2012 Josselin Muller - MTI 2012 24 | 28
  • 3D Graph Visualization• Bar chart – One data = One bar = 8 vertices – Link vertices to make 5 faces (not the bottom one)10/07/2012 Josselin Muller - MTI 2012 25 | 28
  • 3D Graph Visualization• What’s next – Optimization – “2D mode” feature – Visual effects – Animations• Objective – Integration in Zap Administrator10/07/2012 Josselin Muller - MTI 2012 26 | 28
  • SUMMARY10/07/2012 Josselin Muller - MTI 2012 27 | 28
  • Summary• First international experience• Job offer: Software Engineer• Thanks to Jad Nehme and my colleagues10/07/2012 Josselin Muller - MTI 2012 28 | 28