Automated Background Removal Using PyTorchDatabricks
Wehkamp is an online department store with more than 500,000 daily visitors. A wide variety of products presented on the Wehkamp website aims to meet the many customers’ needs.
An important aspect of any customer visit to the website is a qualitative and accurate visual experience of the products. To achieve this, thousands of product photos, especially of fashion garments, are processed in the local photo studio. Since these images’ backgrounds are highly varied, background removal is one of the steps in the processing pipeline.
If done manually, this is very tedious and time-consuming work and when it comes to millions of images, the time and resources needed to manually perform background removal are too high to sustain the dynamic flow of the newly arrived products.
In our presentation, we describe our automated end-to-end pipeline which uses machine learning models for removing the background in images.
Data preparation: In the early beginning, after the dataset cleaning, each image was resized to 320*320 pixels. Afterward, we made use of kmeans algorithm to split the data into 6 clusters. We applied various augmentation techniques for classes with a low amount of images.
Background removal model: Our model is built on an architecture inspired by the paper: “U^2 -Net: Going Deeper with Nested U-Structure for Salient Object Detection”.
Training process: We worked in a Databricks environment and used workers with graphical processing units. Horovod and Pytorch helped us to make the training process distributed. To avoid OOM errors, for each epoch it was used a batch training technique. The trained model is stored in S3 bucket.
In this speech, we want to share how to create an efficient pipeline for deep learning image processing within the Databricks environment.
Automated Background Removal Using PyTorchDatabricks
Wehkamp is an online department store with more than 500,000 daily visitors. A wide variety of products presented on the Wehkamp website aims to meet the many customers’ needs.
An important aspect of any customer visit to the website is a qualitative and accurate visual experience of the products. To achieve this, thousands of product photos, especially of fashion garments, are processed in the local photo studio. Since these images’ backgrounds are highly varied, background removal is one of the steps in the processing pipeline.
If done manually, this is very tedious and time-consuming work and when it comes to millions of images, the time and resources needed to manually perform background removal are too high to sustain the dynamic flow of the newly arrived products.
In our presentation, we describe our automated end-to-end pipeline which uses machine learning models for removing the background in images.
Data preparation: In the early beginning, after the dataset cleaning, each image was resized to 320*320 pixels. Afterward, we made use of kmeans algorithm to split the data into 6 clusters. We applied various augmentation techniques for classes with a low amount of images.
Background removal model: Our model is built on an architecture inspired by the paper: “U^2 -Net: Going Deeper with Nested U-Structure for Salient Object Detection”.
Training process: We worked in a Databricks environment and used workers with graphical processing units. Horovod and Pytorch helped us to make the training process distributed. To avoid OOM errors, for each epoch it was used a batch training technique. The trained model is stored in S3 bucket.
In this speech, we want to share how to create an efficient pipeline for deep learning image processing within the Databricks environment.
2. Խնդիրները
• Դուք կծանոթանաք հաջողակ պրեզենտացիա
ստեղծելու հիմնական բաղկացուցիչներին , ինչը կօգնի
ձեր ասելիքն արդյունավետ կերպով տեղ հասցնել։
• Դուք կսովորեք , թե ինչպես կարելի է պարզունակ
ձեւավորման միջոցով ավելի կենդանի դարձնել ձեր
ասելիքը եւ հանդիսատեսի ուշադրությունը հրավիրել
ձեզ վրա։
4. 2
Տեղեկություններ հաղորդելու, գաղափարներ տարածելու,
կարծիքներ փոխանակելու, հանդիսատեսի վրա ազդելու, կարճ
ասած՝ հաղորդակցվելու համար։
Տեղեկատվությունը փաստերի հաղորդումն է։ Հաղորդակցությունը՝
5
մտքերի, գաղափարների փոխանցումն է։ Դուք հաղորդակցվում եք՝
ձեր զրուցակցի վրա ներազդելու նպատակով։
21. Հետին պլանը եւ պատկերները կարեւոր են
Գույների ընտրությունը պետք է թեմայից չշեղի
Օգտագործեք մեծ եւ ընթեռնելի տառատեսակ
Հաջողակ պրեզենտացիաների գաղտնիքը
22. Ամենակարեւորը
Պատրաստված եղեք
Քիչ գրեք
Նախօրոք պատրաստվեք
Տիրապետեք նյութին
Կենտրոնում ավելի լավ է կարդացվում
23. Նախապատրաստվիր
Լրացուցիչ մանրամասներ
հաղորդիր
Հիշիր, որ պատկերը պետք է օգնի
կենտրոնանալ, ոչ թե ուշադրությունը
քեզանից շեղի
Editor's Notes
We make presentations to share information, demonstrate a position, influence audience, motivate change, in short to communicate. Information does just that…it provides data, facts, it informs. Communication influences thoughts and ideas, motivates people to take action, relates complex ideas, allows a connection. When making a presentation, use the 80/20 rule…
This is an example of an informative presentation…provides data.
This is a complex presentation about a complex issue. The intent is to inspire people to change behaviors, become actively involved in the stewardship of the planet. There is a lot of information, but the real point is to move the audience.
It is crucial to the success of the presentation to know your audience. Who are they? Why did they come to the presentation? What motivates them? What do you want them to do as a result of your presentation? Most important, understand the WIIFM—What’s in it for me? Make sure that your message is relevant. You must make that connection.
Boy Scouts are always prepared. So should you be. Know something about the audience, know your material, make sure any handouts or literature are correct and properly targeted to your audience. Make sure you have everything you need prior to the event. You don’t want 11 th hour panics when you are set to make a presentation. As Mark Twain said, you are already likely to be nervous. Don’t add to it.
Nothing will take the place of thorough rehearsal. Try writing out your presentation. I utilize the notes function in PowerPoint to accomplish this. Do Not read this when making your presentation. It merely serves as a vehicle to help you learn the material. Practice with someone you are comfortable with. Tape record yourself. Listen for your vocabulary, pacing, pronunciation, inflection and energy. Practice in the mirror. Practice with a trusted person.
Often the most difficult aspect of making a presentation. When nervous, you are likely to rush the content. Rehearsal will aid you in this. There is nothing wrong with making a brief presentation. In fact, it is often appreciated. But, you don’t want to talk like an auctioneer. This will impede communication.
Crucial! Your presentation slides have been developed with this in mind (hopefully.) Keep in mind your choice of vocabulary and any examples you use. The point is to connect and communicate, not obfuscate (an example of a poor choice of words.)
Very closely related to clarity and timing. Stay on point…less is more. Do not belabor any one point. Each component of your presentation is equally important. If you go long on one point, you will need to gloss over other points to make up the time. You have about 20 minutes, in my experience, to really connect with a passive audience. Do not go over your allotted time.
In order to make a clear, concise, well-timed presentation, you must be able to maintain control of the discussion. You can elect to take questions throughout the presentation or have audiences members hold questions and address them during a planned discussion time at the end of the presentation. Establish this parameter at the beginning of a presentation. If you have an audience member that wants to dominate the session, provide short, but thorough answers to the questions. If the questions are off topic, let them know you will discuss this after the presentation.
Power Point is easy to use, but… A flipchart is only effective if you use it appropriately... A live web demonstration only works with connectivity… Any visual aids must connect with the material. Try running your slideshow a few times before the actual live run. Learn the basic functions in “slideshow” mode in Power Point. Learn to advance slides and go to previous slides in case of questions or an accidental advance in slides. Practice using the projector. Make sure you can connect the laptop to the projector. Become familiar with the projector menu in order to be able to change the default settings if necessary.
You have prepared, become comfortable with the equipment, and rehearsed your presentation. Relax. This will be a rewarding experience where you will gain confidence and develop skills. The audience assumes you are prepared and knowledgeable. You are.
Make sure you convey enthusiasm during the presentation. Remember, you are trying to motivate the audience. Energy, a smile, a sense of humor, and openness will aid you in getting your message across.
Finally, the goal is to motivate, inspire, and influence the audience. In order to achieve this, you must connect with the audience. Eye contact, open body language, moving around the room, and involving the audience will help you achieve this. Ask open ended questions, get feedback, and engage the audience in a conversation. A connected audience learns and makes changes.
Finally, the goal is to motivate, inspire, and influence the audience. In order to achieve this, you must connect with the audience. Eye contact, open body language, moving around the room, and involving the audience will help you achieve this. Ask open ended questions, get feedback, and engage the audience in a conversation. A connected audience learns and makes changes.
Good sources of images: Google Image search—make sure you are using high resolution images; Flickr, Everystockphoto.com Use colors that complement each other and fonts that can be read easily.
Avoid lengthy passages of text. If you must use bullets, limit them to a few per slide. Keep them to the center. Use guides and Align and Distribute functions in PowerPoint.
The image supports the topic of the slide. It will help you remember your key points. Remember, you are the presentation, your visual aids are not.