Hadoop distributions contain numerous Open Source components which support data processing at large scale (Hadoop, Hive, Spark, etc). These projects are developed and maintained as Top Level Apache Software Projects which provides them the freedom to innovate and improve in a liberal way. As an example, HDP’s key advantage is the rock-solid quality and integration of the shipped software. In this talk we will provide insights about the process which enables scheduled maintenance releases and yields enterprise ready open source software distribution. Topics: Triaging: identifying the finest selection of patches from upstream Certification process: System, regression, upgrade & unit testing Stack validation using long-running workloads Apache License Compliance

2. ⬢
–
–
⬢
–
–
⬢
–

3. ⬢
–
⬢
⬢
⬢

8. ⬢
⬢
⬢
⬢

14. ⬢

15. ⬢

26. ⬢

27. ⬢
⬢
⬢
⬢
–
–
–
–
–

28. ⬢

29. ⬢
⬢
”The system identifies the root cause of test failures, by correlating the failing test cases, with current and historical error
records, to identify root cause of errors across multiple components. The system works in unsupervised mode with no perfect
model/stable builds/source-code version to refer to.”

31. ⬢
⬢
⬢
⬢

33. ⬢
⬢

34. ⬢
⬢

37. ⬢
⬢

38. Q&A