Hadoop has become a backbone of many enterprises. While it can do wonders for businesses, it sometimes can be overwhelming for its operators and users. Amateurs as well as seasoned operators of Hadoop are caught unaware by common pitfalls of deploying, tuning and operating a Hadoop cluster. Having spent 5+ years working with 100s of Hadoop users, running clusters with 1000s of nodes, managing 10s of petabytes of data and running 100s of 1000s of tasks per day, we have seen people's unintentional acts, suboptimal configurations and common mistakes have resulted into downtimes, SLA violations, many hours of recovery operations and in some cases even data loss! Most of these traumas could have been easily avoided by applying easy to follow best practices that would protect data and optimize performance. In this talk we present real life stories, common pitfalls and most importantly, strategies on how to correctly deploy and manage Hadoop clusters. The talk will empower users and help make their Hadoop journey more fulfilling and rewarding. We will also discuss SmartSense. SmartSense can identify latent problems in a cluster and provide recommendations so that an operator can fix them before they manifest as a service degradation or outage.
Hadoop has become a backbone of many enterprises. While it can do wonders for businesses, it sometimes can be overwhelming for its operators and users. Amateurs as well as seasoned operators of Hadoop are caught unaware by common pitfalls of deploying, tuning and operating a Hadoop cluster. Having spent 5+ years working with 100s of Hadoop users, running clusters with 1000s of nodes, managing 10s of petabytes of data and running 100s of 1000s of tasks per day, we have seen people's unintentional acts, suboptimal configurations and common mistakes have resulted into downtimes, SLA violations, many hours of recovery operations and in some cases even data loss! Most of these traumas could have been easily avoided by applying easy to follow best practices that would protect data and optimize performance. In this talk we present real life stories, common pitfalls and most importantly, strategies on how to correctly deploy and manage Hadoop clusters. The talk will empower users and help make their Hadoop journey more fulfilling and rewarding. We will also discuss SmartSense. SmartSense can identify latent problems in a cluster and provide recommendations so that an operator can fix them before they manifest as a service degradation or outage.
Exoscale: Pithos: your personal S3 object store on cassandraDataStax Academy
This talk will give an overview of the distributed file storage ecosystem and will then focus on the promises and compromises of object storage and blob storage.
Pithos will then be presented show-casing how it leverages several aspects of Apache Cassandra to break-up object storage in:
- A global bucket ownership store
- A metadata store
- An inode store
Feedback from running pithos in production for a year and half will then be given, outlining upcoming improvements in pithos.
Hoe betrek je docenten bij het inrichten van de leeromgeving?SURF Events
Maandag 7 november
Sessieronde 1
Titel: Hoe betrek je docenten bij het inrichten van de leeromgeving?
Spreker(s): Chris Blom (Wageningen Universiteit), Mariëtte Siemons (Hogeschool Leiden), Robin Vos (Hogeschool Leiden), Judith Zwerver-Bergman (Saxion)
Zaal: Diamond I
Hoe zijn de ervaringen met de digitale leeromgeving in PO en VO?SURF Events
Maandag 7 november
Sessieronde 1
Titel: Hoe zijn de ervaringen met de digitale leeromgeving in PO en VO?
Spreker(s): Wietse van Bruggen (Kennisnet)
Zaal: J.F. Staal Room
These are the slides to the following TEDx talk: https://www.youtube.com/watch?v=jXCZ9MFBBp4
Did you remember to turn off the lights before leaving home? Did you cut your shower short this morning? While these issues are important in decreasing your carbon footprint, Diana Ivanova argues that how you spend money is significantly more impactful.
Exoscale: Pithos: your personal S3 object store on cassandraDataStax Academy
This talk will give an overview of the distributed file storage ecosystem and will then focus on the promises and compromises of object storage and blob storage.
Pithos will then be presented show-casing how it leverages several aspects of Apache Cassandra to break-up object storage in:
- A global bucket ownership store
- A metadata store
- An inode store
Feedback from running pithos in production for a year and half will then be given, outlining upcoming improvements in pithos.
Hoe betrek je docenten bij het inrichten van de leeromgeving?SURF Events
Maandag 7 november
Sessieronde 1
Titel: Hoe betrek je docenten bij het inrichten van de leeromgeving?
Spreker(s): Chris Blom (Wageningen Universiteit), Mariëtte Siemons (Hogeschool Leiden), Robin Vos (Hogeschool Leiden), Judith Zwerver-Bergman (Saxion)
Zaal: Diamond I
Hoe zijn de ervaringen met de digitale leeromgeving in PO en VO?SURF Events
Maandag 7 november
Sessieronde 1
Titel: Hoe zijn de ervaringen met de digitale leeromgeving in PO en VO?
Spreker(s): Wietse van Bruggen (Kennisnet)
Zaal: J.F. Staal Room
These are the slides to the following TEDx talk: https://www.youtube.com/watch?v=jXCZ9MFBBp4
Did you remember to turn off the lights before leaving home? Did you cut your shower short this morning? While these issues are important in decreasing your carbon footprint, Diana Ivanova argues that how you spend money is significantly more impactful.
2. P E R Q U È L A L L U N A
V E R M E L L A ?
• He escollit aquest tema perquè em resulta fascinant
veure la Lluna d'aquest color i vull esbrinar perquè
passa.
3. P R E G U N T E S
Quan es forma?
LLUNA
VERMELLA
Quins tipus hi
ha?
Quines fases
hi ha?
Curiositats...
4. H I P Ò T E S I
De fet, no ho sé, per això
ho vull investigar i ho vull
cercar.
5. L A M E VA R E C E R C A
Aquest ha sigut un treball individual.
Per tenir un millor resultat en la recerca he
treballat a casa i en l'escola.
6. L LU NA
V E R M E L L AQ U A N
PA S S A ?
T
I
P
U
S
FA S E S
C U R I O S I TAT S
E N E L S E C L I P S I S D E
L L U N A L A G E N T E S TÀ . . .
R A R A
