SlideShare a Scribd company logo
1 of 3
Ingraphs
● Upload page response code
● Uploads Rejected
○ invalid_extension
○ free_user_video_upload
○ video_quota
○ banned_country
○ private_quota
○ upload_limit_reached
○ blacklisted_email_domains
● Uploads Failed
○ register_failed
○ S3_upload_failed
○ queue_failed
○ conv_failed
○ publish_failed
● Uploads Succeeded
○ register_success
○ S3_upload_success
○ queue_success
○ conv_success
○ publish_success
Server File Logging
● Server side logging to track upload flow
○ in detail
○ per user
● Every error condition in the flow is logged
● Common format - “UploadError:UserId-#{user.id}:Step-#{step}: #{msg}”
● Grep errors for particular user
○ grep “UploadError:UserId-3245652”
● Grep errors at particular step
○ grep “UploadError:.*Step-publish”
● Info
○ log_level
○ user_id
○ timestamp
○ workflow step
○ Message
○ ip/country
○ useragent
■ OS
■ Browser
○ device_type
○ preslideshow_id
STEP InGraph Server log
upload_rejected* - refers to one of below events. These events are triggered when the upload is
intentionally rejected as opposed to an error in the upload process.
○ invalid_extension
○ free_user_video_upload
○ video_quota
○ banned_country
○ private_quota
validations
create pre-
upload_reject
S3_upload_fa
validations
update
upload_reject
Register
S3
Queue
register_faile
queue_failed
conversion
factory process
Conversi conversion_f
fill slideshow
with preslideshow
details
Publish publish_failed
register_succe
S3_upload_suc
queue_succ
conversion_succe
publish_succ
grep
grep
grep
○ upload_limit_reached
○ blacklisted_email_domains

More Related Content

Viewers also liked

Viewers also liked (10)

Turkey startup scene
Turkey startup sceneTurkey startup scene
Turkey startup scene
 
Developer guide
Developer guideDeveloper guide
Developer guide
 
Reportal example
Reportal exampleReportal example
Reportal example
 
Developer guide
Developer guideDeveloper guide
Developer guide
 
Developer guide
Developer guideDeveloper guide
Developer guide
 
Developer guide
Developer guideDeveloper guide
Developer guide
 
lead formed 2
lead formed 2lead formed 2
lead formed 2
 
Developer guide
Developer guideDeveloper guide
Developer guide
 
Developer guide
Developer guideDeveloper guide
Developer guide
 
Bizsmart regain-business-direction-150604113954-lva1-app6891
Bizsmart regain-business-direction-150604113954-lva1-app6891Bizsmart regain-business-direction-150604113954-lva1-app6891
Bizsmart regain-business-direction-150604113954-lva1-app6891
 

Similar to Upload flow tracking

Parallel programing in web applications - public.pptx
Parallel programing in web applications - public.pptxParallel programing in web applications - public.pptx
Parallel programing in web applications - public.pptxGuy Bary
 
OutSystems Webinar - Troubleshooting Mobile Apps Performance
OutSystems Webinar - Troubleshooting Mobile Apps PerformanceOutSystems Webinar - Troubleshooting Mobile Apps Performance
OutSystems Webinar - Troubleshooting Mobile Apps PerformanceDaniel Reis
 
Training Webinar: Troubleshooting Mobile Apps Performance
Training Webinar: Troubleshooting Mobile Apps Performance Training Webinar: Troubleshooting Mobile Apps Performance
Training Webinar: Troubleshooting Mobile Apps Performance OutSystems
 
WebCamp:Front-end Developers Day. Алексей Ященко, Сергей Руденко "Фронтенд-мо...
WebCamp:Front-end Developers Day. Алексей Ященко, Сергей Руденко "Фронтенд-мо...WebCamp:Front-end Developers Day. Алексей Ященко, Сергей Руденко "Фронтенд-мо...
WebCamp:Front-end Developers Day. Алексей Ященко, Сергей Руденко "Фронтенд-мо...GeeksLab Odessa
 
Performance & dev tools
Performance & dev toolsPerformance & dev tools
Performance & dev toolsGuy Yogev
 
Progressive Web Apps
Progressive Web AppsProgressive Web Apps
Progressive Web AppsGbolahan Alli
 
At Your Service - Abusing the Service Workers Web API
At Your Service - Abusing the Service Workers Web APIAt Your Service - Abusing the Service Workers Web API
At Your Service - Abusing the Service Workers Web APIDaniel Abeles
 
Secure Developer Access at Decisiv
Secure Developer Access at DecisivSecure Developer Access at Decisiv
Secure Developer Access at DecisivTeleport
 
What Your JavaScript Does When You're Not Around (Influx Days 2017 Edition)
What Your JavaScript Does When You're Not Around (Influx Days 2017 Edition)What Your JavaScript Does When You're Not Around (Influx Days 2017 Edition)
What Your JavaScript Does When You're Not Around (Influx Days 2017 Edition)Emily Nakashima
 
Security .NET.pdf
Security .NET.pdfSecurity .NET.pdf
Security .NET.pdfAbhi Jain
 
DrupalGov 2017: Testing any day: guide to end to end test driven Drupal projects
DrupalGov 2017: Testing any day: guide to end to end test driven Drupal projectsDrupalGov 2017: Testing any day: guide to end to end test driven Drupal projects
DrupalGov 2017: Testing any day: guide to end to end test driven Drupal projectsVladimir Roudakov
 
Electron JS | Build cross-platform desktop applications with web technologies
Electron JS | Build cross-platform desktop applications with web technologiesElectron JS | Build cross-platform desktop applications with web technologies
Electron JS | Build cross-platform desktop applications with web technologiesBethmi Gunasekara
 
Tools and libraries for common problems (Early Draft)
Tools and libraries for common problems (Early Draft)Tools and libraries for common problems (Early Draft)
Tools and libraries for common problems (Early Draft)rc2209
 
From nothing to a video under 2 seconds / Mikhail Sychev (YouTube)
From nothing to a video under 2 seconds / Mikhail Sychev  (YouTube)From nothing to a video under 2 seconds / Mikhail Sychev  (YouTube)
From nothing to a video under 2 seconds / Mikhail Sychev (YouTube)Ontico
 
Userfaultfd and Post-Copy Migration
Userfaultfd and Post-Copy MigrationUserfaultfd and Post-Copy Migration
Userfaultfd and Post-Copy MigrationKernel TLV
 
Userfaultfd and post copy migration
Userfaultfd and post copy migrationUserfaultfd and post copy migration
Userfaultfd and post copy migrationMike Rapoport
 
Why you should use true single-sign-on in Icinga Web 2 - Icinga Camp Stockhol...
Why you should use true single-sign-on in Icinga Web 2 - Icinga Camp Stockhol...Why you should use true single-sign-on in Icinga Web 2 - Icinga Camp Stockhol...
Why you should use true single-sign-on in Icinga Web 2 - Icinga Camp Stockhol...Icinga
 
Pen Testing Development
Pen Testing DevelopmentPen Testing Development
Pen Testing DevelopmentCTruncer
 
Ctrl+F5 Ahmedabad, 2017 - BOOST THE PERFORMANCE OF WORDPRESS WEBSITES by Prat...
Ctrl+F5 Ahmedabad, 2017 - BOOST THE PERFORMANCE OF WORDPRESS WEBSITES by Prat...Ctrl+F5 Ahmedabad, 2017 - BOOST THE PERFORMANCE OF WORDPRESS WEBSITES by Prat...
Ctrl+F5 Ahmedabad, 2017 - BOOST THE PERFORMANCE OF WORDPRESS WEBSITES by Prat...ResellerClub
 

Similar to Upload flow tracking (20)

Parallel programing in web applications - public.pptx
Parallel programing in web applications - public.pptxParallel programing in web applications - public.pptx
Parallel programing in web applications - public.pptx
 
OutSystems Webinar - Troubleshooting Mobile Apps Performance
OutSystems Webinar - Troubleshooting Mobile Apps PerformanceOutSystems Webinar - Troubleshooting Mobile Apps Performance
OutSystems Webinar - Troubleshooting Mobile Apps Performance
 
Training Webinar: Troubleshooting Mobile Apps Performance
Training Webinar: Troubleshooting Mobile Apps Performance Training Webinar: Troubleshooting Mobile Apps Performance
Training Webinar: Troubleshooting Mobile Apps Performance
 
WebCamp:Front-end Developers Day. Алексей Ященко, Сергей Руденко "Фронтенд-мо...
WebCamp:Front-end Developers Day. Алексей Ященко, Сергей Руденко "Фронтенд-мо...WebCamp:Front-end Developers Day. Алексей Ященко, Сергей Руденко "Фронтенд-мо...
WebCamp:Front-end Developers Day. Алексей Ященко, Сергей Руденко "Фронтенд-мо...
 
Performance & dev tools
Performance & dev toolsPerformance & dev tools
Performance & dev tools
 
Progressive Web Apps
Progressive Web AppsProgressive Web Apps
Progressive Web Apps
 
At Your Service - Abusing the Service Workers Web API
At Your Service - Abusing the Service Workers Web APIAt Your Service - Abusing the Service Workers Web API
At Your Service - Abusing the Service Workers Web API
 
Secure Developer Access at Decisiv
Secure Developer Access at DecisivSecure Developer Access at Decisiv
Secure Developer Access at Decisiv
 
What Your JavaScript Does When You're Not Around (Influx Days 2017 Edition)
What Your JavaScript Does When You're Not Around (Influx Days 2017 Edition)What Your JavaScript Does When You're Not Around (Influx Days 2017 Edition)
What Your JavaScript Does When You're Not Around (Influx Days 2017 Edition)
 
Security .NET.pdf
Security .NET.pdfSecurity .NET.pdf
Security .NET.pdf
 
DrupalGov 2017: Testing any day: guide to end to end test driven Drupal projects
DrupalGov 2017: Testing any day: guide to end to end test driven Drupal projectsDrupalGov 2017: Testing any day: guide to end to end test driven Drupal projects
DrupalGov 2017: Testing any day: guide to end to end test driven Drupal projects
 
Electron JS | Build cross-platform desktop applications with web technologies
Electron JS | Build cross-platform desktop applications with web technologiesElectron JS | Build cross-platform desktop applications with web technologies
Electron JS | Build cross-platform desktop applications with web technologies
 
Griffon demo
Griffon demoGriffon demo
Griffon demo
 
Tools and libraries for common problems (Early Draft)
Tools and libraries for common problems (Early Draft)Tools and libraries for common problems (Early Draft)
Tools and libraries for common problems (Early Draft)
 
From nothing to a video under 2 seconds / Mikhail Sychev (YouTube)
From nothing to a video under 2 seconds / Mikhail Sychev  (YouTube)From nothing to a video under 2 seconds / Mikhail Sychev  (YouTube)
From nothing to a video under 2 seconds / Mikhail Sychev (YouTube)
 
Userfaultfd and Post-Copy Migration
Userfaultfd and Post-Copy MigrationUserfaultfd and Post-Copy Migration
Userfaultfd and Post-Copy Migration
 
Userfaultfd and post copy migration
Userfaultfd and post copy migrationUserfaultfd and post copy migration
Userfaultfd and post copy migration
 
Why you should use true single-sign-on in Icinga Web 2 - Icinga Camp Stockhol...
Why you should use true single-sign-on in Icinga Web 2 - Icinga Camp Stockhol...Why you should use true single-sign-on in Icinga Web 2 - Icinga Camp Stockhol...
Why you should use true single-sign-on in Icinga Web 2 - Icinga Camp Stockhol...
 
Pen Testing Development
Pen Testing DevelopmentPen Testing Development
Pen Testing Development
 
Ctrl+F5 Ahmedabad, 2017 - BOOST THE PERFORMANCE OF WORDPRESS WEBSITES by Prat...
Ctrl+F5 Ahmedabad, 2017 - BOOST THE PERFORMANCE OF WORDPRESS WEBSITES by Prat...Ctrl+F5 Ahmedabad, 2017 - BOOST THE PERFORMANCE OF WORDPRESS WEBSITES by Prat...
Ctrl+F5 Ahmedabad, 2017 - BOOST THE PERFORMANCE OF WORDPRESS WEBSITES by Prat...
 

Upload flow tracking

  • 1. Ingraphs ● Upload page response code ● Uploads Rejected ○ invalid_extension ○ free_user_video_upload ○ video_quota ○ banned_country ○ private_quota ○ upload_limit_reached ○ blacklisted_email_domains ● Uploads Failed ○ register_failed ○ S3_upload_failed ○ queue_failed ○ conv_failed ○ publish_failed ● Uploads Succeeded ○ register_success ○ S3_upload_success ○ queue_success ○ conv_success ○ publish_success Server File Logging ● Server side logging to track upload flow ○ in detail ○ per user ● Every error condition in the flow is logged ● Common format - “UploadError:UserId-#{user.id}:Step-#{step}: #{msg}” ● Grep errors for particular user ○ grep “UploadError:UserId-3245652” ● Grep errors at particular step ○ grep “UploadError:.*Step-publish” ● Info ○ log_level ○ user_id ○ timestamp ○ workflow step ○ Message ○ ip/country ○ useragent ■ OS ■ Browser
  • 2. ○ device_type ○ preslideshow_id STEP InGraph Server log upload_rejected* - refers to one of below events. These events are triggered when the upload is intentionally rejected as opposed to an error in the upload process. ○ invalid_extension ○ free_user_video_upload ○ video_quota ○ banned_country ○ private_quota validations create pre- upload_reject S3_upload_fa validations update upload_reject Register S3 Queue register_faile queue_failed conversion factory process Conversi conversion_f fill slideshow with preslideshow details Publish publish_failed register_succe S3_upload_suc queue_succ conversion_succe publish_succ grep grep grep