Clemens Valiente

Cologne Area, Germany Germany

Senior Data Engineer at trivago

Technology / Software / Internet

Hi there. For more than two years I have been leading trivago's BI data engineering team. We started out by successfully migrating the BI data warehouse from a mySQL server to our hadoop cluster using traditional hadoop tools like Hive, Oozie, Sqoop, Impala and hdfs/mapreduce. Recently acquired skills and experience around a heavily used Kafka cluster and Samza / Spark applications built on top of that have become the focus after the adoption of hadoop in the entire Business Intelligence department. The most important learning from these projects has been that the passion for data is at least as important as the skills and experience. If you want to join a team where big data and hadoo...