Computer vision systems allow automating a wide range of different processes related to manufacturing. We will discuss the way how we have built a real-time safety violations detection system, starting from team building and data collection to network optimization. Another crucial point of this speech will touch the difficulties encountered by our team, as well as the approaches and tools that have worked for us to address these challenges. Website: https://fwdays.com/en/event/data-science-fwdays-2019/review/how-we-built-safety-violations-detection-system