Hadoop has become a backbone of many enterprises. While it can do wonders for businesses, it sometimes can be overwhelming for its operators and users. Amateurs as well as seasoned operators of Hadoop are caught unaware by common pitfalls of deploying, tuning and operating a Hadoop cluster. Having spent 5+ years working with 100s of Hadoop users, running clusters with 1000s of nodes, managing 10s of petabytes of data and running 100s of 1000s of tasks per day, we have seen people's unintentional acts, suboptimal configurations and common mistakes have resulted into downtimes, SLA violations, many hours of recovery operations and in some cases even data loss! Most of these traumas could have been easily avoided by applying easy to follow best practices that would protect data and optimize performance. In this talk we present real life stories, common pitfalls and most importantly, strategies on how to correctly deploy and manage Hadoop clusters. The talk will empower users and help make their Hadoop journey more fulfilling and rewarding. We will also discuss SmartSense. SmartSense can identify latent problems in a cluster and provide recommendations so that an operator can fix them before they manifest as a service degradation or outage.
Exoscale: Pithos: your personal S3 object store on cassandraDataStax Academy
This talk will give an overview of the distributed file storage ecosystem and will then focus on the promises and compromises of object storage and blob storage.
Pithos will then be presented show-casing how it leverages several aspects of Apache Cassandra to break-up object storage in:
- A global bucket ownership store
- A metadata store
- An inode store
Feedback from running pithos in production for a year and half will then be given, outlining upcoming improvements in pithos.
Hadoop has become a backbone of many enterprises. While it can do wonders for businesses, it sometimes can be overwhelming for its operators and users. Amateurs as well as seasoned operators of Hadoop are caught unaware by common pitfalls of deploying, tuning and operating a Hadoop cluster. Having spent 5+ years working with 100s of Hadoop users, running clusters with 1000s of nodes, managing 10s of petabytes of data and running 100s of 1000s of tasks per day, we have seen people's unintentional acts, suboptimal configurations and common mistakes have resulted into downtimes, SLA violations, many hours of recovery operations and in some cases even data loss! Most of these traumas could have been easily avoided by applying easy to follow best practices that would protect data and optimize performance. In this talk we present real life stories, common pitfalls and most importantly, strategies on how to correctly deploy and manage Hadoop clusters. The talk will empower users and help make their Hadoop journey more fulfilling and rewarding. We will also discuss SmartSense. SmartSense can identify latent problems in a cluster and provide recommendations so that an operator can fix them before they manifest as a service degradation or outage.
Exoscale: Pithos: your personal S3 object store on cassandraDataStax Academy
This talk will give an overview of the distributed file storage ecosystem and will then focus on the promises and compromises of object storage and blob storage.
Pithos will then be presented show-casing how it leverages several aspects of Apache Cassandra to break-up object storage in:
- A global bucket ownership store
- A metadata store
- An inode store
Feedback from running pithos in production for a year and half will then be given, outlining upcoming improvements in pithos.
Hoe betrek je docenten bij het inrichten van de leeromgeving?SURF Events
Maandag 7 november
Sessieronde 1
Titel: Hoe betrek je docenten bij het inrichten van de leeromgeving?
Spreker(s): Chris Blom (Wageningen Universiteit), Mariëtte Siemons (Hogeschool Leiden), Robin Vos (Hogeschool Leiden), Judith Zwerver-Bergman (Saxion)
Zaal: Diamond I
Hoe zijn de ervaringen met de digitale leeromgeving in PO en VO?SURF Events
Maandag 7 november
Sessieronde 1
Titel: Hoe zijn de ervaringen met de digitale leeromgeving in PO en VO?
Spreker(s): Wietse van Bruggen (Kennisnet)
Zaal: J.F. Staal Room
Hoe betrek je docenten bij het inrichten van de leeromgeving?SURF Events
Maandag 7 november
Sessieronde 1
Titel: Hoe betrek je docenten bij het inrichten van de leeromgeving?
Spreker(s): Chris Blom (Wageningen Universiteit), Mariëtte Siemons (Hogeschool Leiden), Robin Vos (Hogeschool Leiden), Judith Zwerver-Bergman (Saxion)
Zaal: Diamond I
Hoe zijn de ervaringen met de digitale leeromgeving in PO en VO?SURF Events
Maandag 7 november
Sessieronde 1
Titel: Hoe zijn de ervaringen met de digitale leeromgeving in PO en VO?
Spreker(s): Wietse van Bruggen (Kennisnet)
Zaal: J.F. Staal Room
