Microtask crowdsourcing is a trade-off between budget, speed of getting results and their quality. It is a popular approach to quickly build a training dataset for machine learning. There are standard quality assurance mechanics on crowdsourcing platforms but they still might leave an opportunity for scamming. In this presentation I will talk about our experience in improving scammer detection, how to estimate fairness and proficiency of contributors using unsupervised machine learning models