Tools and Tech for Big Data Success

•

1 like•1,543 views

What do you need to succeed in working with Big Data? RedMonk analyst Donnie Berkholz will present quantitative research on the state of the field, covering the breadth of languages, tools, and infrastructure, to show you which choices to make today and which ones you'll need to get ready for, soon.

Tools and tech
for Big Data success
Donnie Berkholz, Ph.D.
IT Industry Analyst
@dberkholz
[Imagine cheesy clipart of hammers, silicon, etc.]

Tools and tech — huh?
● Languages
● Infrastructure
● Tooling
● It's not about the what, it's about the how

Thesis: Technology adoption
is increasingly bottom-up

The challenges
IT pros delivering data solutions
60/36 IT/biz
Talend, summer 2012

The skills gap
NVP survey of execs, summer 2012

What about the data analysts?
KDNuggets, summer 2012

IT pros delivering data solutions
60/36 IT/biz
Talend, summer 2012

Hadoop distributions: popularity
Google Trends: $VENDOR hadoop

How to run: bare metal / DC, private
cloud, public cloud

Open Building Blocks but not Open
Source: EMR on AWS

Other Options: Hadoop YARN,
HPCC, Cassandra, Mongo, Riak

Abstraction: Mortar, Continuuity,
Qubole, Concurrent Lingual, etc.

Donnie Berkholz, Ph.D.
Analyst, RedMonk
@dberkholz
Disclosure: 10gen, Amazon, Basho, Cloudera,
Continuuity, IBM, MapR, Microsoft, and VMware are
clients.

As you walk into your office on Monday morning, before you've even had a chance to grab a cup of coffee, your CEO asks to see you. He's worried: both customer churn and fraudulent transactions have increased over the past 6 months. As Data Manager, you have 6 months to solve this problem. As Data Manager, you know the challenges ahead: - Multitudes of technology choices to make - Building a team and solving the skill-set disconnect - Data can be deceiving... - Figuring out what the successful data product must be Florian works in the “data” field since 01’, back when it was not yet big. He worked in successful startups in search engine, advertising, and gaming industries, holding various data or CTO roles. He started Dataiku in 2013, his first venture as a CEO, with the goal of alleviating the daily pains encountered by data teams all around.

Neo4j Innovation Lab, Stefan Wendin, Neo4j

Neo4j

Dataiku - google cloud platform roadshow - october 2013Dataiku

Is Data Scientist still the sexiest job of 21st century? Find Out!

Edureka!

Data Culture Series - Keynote - 24th feb

Jonathan Woodward

Big data. Small data. All data. You have access to an ever-expanding volume of data inside the walls of your business and out across the web. The potential in data is endless – from predicting election results to preventing the spread of epidemics. But how can you use it to your advantage to help move your business forward? Data is growing exponentially and it’s now possible to mine and unlock insights from data in new and unexpected ways. Empower your business to take advantage of this data by harnessing the rich capabilities of Microsoft SQL Server and the familiarity of Microsoft Office to help organize, analyze, and make sense of your data—no matter the size.

From Lab to Factory: Or how to turn data into value

Peadar Coyle

Online Games Analytics - Data Science for FunDataiku

Nonprofits + Data: Pathway to Innovation

Tim Sarrantonio

Data Scientist: Sexiest job of the 21st century

Muyeena Khanzada

Back to Square One: Building a Data Science Team from Scratch

Klaas Bosteels

Generally speaking, big data and data science originated in the west and are coming to Europe with a bit of a delay. There is at least one exception though: The London-based music discovery website Last.fm is a data company at heart and has been doing large-scale data processing and analysis for years. It started using Hadoop in early 2006, for instance, making it one of the earliest adopters worldwide. When I left Last.fm to join Massive Media, the social media company behind Netlog.com and Twoo.com, I basically moved from a data science forerunner to a newcomer. Massive Media had at least as much data to play with and tremendous potential, but they were not doing much with it yet. The data science team had to be build from the ground up and every step had to be argued for and justified along the way. Having done this exercise of evaluating everything I learned at Last.fm and starting over completely with a clean slate at Massive Media, I developed a pretty clear perspective on how to find good data scientists, what they should be doing, what tools they should be using, and how to organize them to work together efficiently as team, which is precisely what I would like to share in this talk.

iTrain Malaysia: Data Science by Tarun Sukhani

iTrain

Data science skills and development for the energy sector

Dr. Cher Han Lau

I gave a talk in conjunction with Big Data Week 2018 in Malaysia to talk about data science skills and development for the energy sector. The conference by DEJ is 7 years running in Malaysia. They are collaborating with ADAX as we gear to drive 4IR (digital transformation). I covered how talent harnessing, embracing the wealth of skills & technology is of paramount importance and demands radical change across all sectors. And the pathway to become a data scientist in the Oil and Gas industry.

Symposium 2018 - Big data transport and collaboration - Gregory Vial

PMI-Montréal

Conférence du Symposium 2018 - Le grand événement de la gestion de projet Certaines conférences sont disponibles pour visionnement en différé, voir ici : https://www.pmimontreal.org/webconferences Depuis quelques années, on note un intérêt croissant pour l'analytique, l'intelligence artificielle, ainsi que d'autres domaines d'application dans lesquels les données occupent une place majeure. La digitalisation de nos interactions présente de grandes opportunités: nous pouvons maintenant envoyer et partager des données presque instantanément, notamment pour prendre des décisions dites 'empiriques' (ou simplement pour partager des informations avec nos familles et amis). Par ailleurs, il existe un coût associé à ces opportunités, coût dont nous ne sommes parfois pas toujours conscients. Au fur et à mesure que les barrières techniques sont franchies, d'autres barrières apparaissent, notamment en relation avec des enjeux de légalité, d'éthique, et de moralité quant à la collecte, au transport, et à l'utilisation des données. On fournit ici un aperçu de ces opportunités, des défis, ainsi que des solutions innovantes qui ont été utilisées ou sont en développement pour s'attaquer au défi du transport de données. Plus particulièrement, nous nous tournons vers les avancées dans les domaines de la recherche et de la pratique dans différents domaines et industries pour montrer comment le transport de données et la collaboration peuvent chacun bénéficier de leur influence lorsqu'ils sont utilisés de façon judicieuse.

Data Science Salon: Introduction to Machine Learning - Marketing Use Case

Formulatedby

Big Data and HR - Talk @SwissHR Congress

Marcel Blattner, PhD

What is a Data Scientist

Experian_US

Join our #DataTalk on Thursdays at 5 p.m. ET. This week, we tweeted with Dr. Michael Wu, the Chief Scientist at Lithium, where he applies data-driven methodologies to investigate the complex dynamics of the social web. Michael works with big data and has developed many predictive and prescriptive social analytics with actionable insights. His R&D won him the recognition as a 2010 Influential Leader by CRM Magazine. You can see all tweets and resources here: http://www.experian.com/blogs/news/about/data-scientists/

5 ways to get more from data science

Tyrone Systems

Dataiku r users group v2Cdiscount

451’s Berkholz on How DevOps, Automation and Orchestration Combine for Contin...

Dana Gardner

Viking reprise: Nordic influences on US tech culture

Donnie Berkholz

Commit yourself already: Contributing to open source

Donnie Berkholz

The limits of sharing craftDonnie Berkholz

What's hot

How to Build a Successful Data Team - Florian Douetteau (@Dataiku)

Dataiku

Neo4j Innovation Lab, Stefan Wendin, Neo4j

Neo4j

Dataiku - google cloud platform roadshow - october 2013Dataiku

Is Data Scientist still the sexiest job of 21st century? Find Out!

Edureka!

Data Culture Series - Keynote - 24th feb

Jonathan Woodward

From Lab to Factory: Or how to turn data into value

Peadar Coyle

Online Games Analytics - Data Science for FunDataiku

Nonprofits + Data: Pathway to Innovation

Tim Sarrantonio

Data Scientist: Sexiest job of the 21st century

Muyeena Khanzada

Back to Square One: Building a Data Science Team from Scratch

Klaas Bosteels

iTrain Malaysia: Data Science by Tarun Sukhani

iTrain

Data science skills and development for the energy sector

Dr. Cher Han Lau

Symposium 2018 - Big data transport and collaboration - Gregory Vial

PMI-Montréal

Data Science Salon: Introduction to Machine Learning - Marketing Use Case

Formulatedby

Big Data and HR - Talk @SwissHR Congress

Marcel Blattner, PhD

What is a Data Scientist

Experian_US

5 ways to get more from data science

Tyrone Systems

Dataiku r users group v2Cdiscount

What's hot (18)

How to Build a Successful Data Team - Florian Douetteau (@Dataiku)

Neo4j Innovation Lab, Stefan Wendin, Neo4j

Dataiku - google cloud platform roadshow - october 2013

Is Data Scientist still the sexiest job of 21st century? Find Out!

Data Culture Series - Keynote - 24th feb

From Lab to Factory: Or how to turn data into value

Online Games Analytics - Data Science for Fun

Nonprofits + Data: Pathway to Innovation

Data Scientist: Sexiest job of the 21st century

Back to Square One: Building a Data Science Team from Scratch

iTrain Malaysia: Data Science by Tarun Sukhani

Data science skills and development for the energy sector

Symposium 2018 - Big data transport and collaboration - Gregory Vial

Data Science Salon: Introduction to Machine Learning - Marketing Use Case

Big Data and HR - Talk @SwissHR Congress

What is a Data Scientist

5 ways to get more from data science

Dataiku r users group v2

Viewers also liked

451’s Berkholz on How DevOps, Automation and Orchestration Combine for Contin...

Dana Gardner

Viking reprise: Nordic influences on US tech culture

Donnie Berkholz

Commit yourself already: Contributing to open source

Donnie Berkholz

The limits of sharing craftDonnie Berkholz

Building with containers: How containers will drive cloud services

Donnie Berkholz

Docker is one of the fastest-growing technologies to emerge, not just in the past decade, but ever. This hot new containerization software has changed the game for how software will be built and delivered. And yet, it's still early days in terms of how containers will transform the way teams collaborate and businesses ship and support cloud software. In this talk, we will cover: * How DevOps and containers work together to enable better service delivery. * What the advent of microservices means for cloud users and providers. * What users and service providers require to cope with the changes wrought by containers.

451 Group on Analyst Relations

Heavybit

Parallel universes of DevOps and cloud developers, plus a BONUS config manage...

Donnie Berkholz

Is your community healthy? Metrics on the top CM software

Donnie Berkholz

The parallel universes of DevOps and cloud developers

Donnie Berkholz

The parallel universes of DevOps and cloud developers (GlueCon)Donnie Berkholz

Emerging trends in software development: The next generation of storage

Donnie Berkholz

Donnie Berkholz leads the development, DevOps and IT ops team at 451 Research. In this talk, he will draw on his experience and research to discuss emerging trends in how software across the stack is created and deployed, with a particular focus on relevance to storage development and usage. Donnie will discuss the potential impacts of these trends to how storage software is built as well as what kinds of new use cases it needs to support.

DevOps 101+: From collaboration to microservices

Donnie Berkholz

DevOps 101

Donnie Berkholz

How IT will disrupt in 2016: The ITaaS imperative

Donnie Berkholz

From a joint webinar with Verismic in December 2015 The rise of the “as-a-Service” paradigm is disrupting industries across every market of technology. Join 451 Research’s Donnie Berkholz, Ph.D., and Ashley Leonard, CEO of Verismic Software, in exploring how IT is being disrupted today. This webinar will explore industry changes and how end users have responded to the shift in areas such as cloud, DevOps and IT management. Along with a 20,000+ survey panel, we will discuss what IT teams need to survive and thrive in the era of IT as a Service.

The New Assembly Line: 3 Best Practices for Building (Secure) Connected Cars

Lookout

When an industry without experience in Internet security starts connecting things to the Internet, it typically makes a number of mistakes both in how it implements secure systems, and how it interacts with the security community. With connected automobiles, the stakes for getting security right have never been higher. “What’s the worst that could happen?” is a lot more serious when you’re talking about a computer that can travel 100+ MPH.

China capitulates: Another round of auto stimulus

Bloomberg LP

Viewers also liked (16)

451’s Berkholz on How DevOps, Automation and Orchestration Combine for Contin...

Viking reprise: Nordic influences on US tech culture

Commit yourself already: Contributing to open source

The limits of sharing craft

Building with containers: How containers will drive cloud services

451 Group on Analyst Relations

Parallel universes of DevOps and cloud developers, plus a BONUS config manage...

Is your community healthy? Metrics on the top CM software

The parallel universes of DevOps and cloud developers

The parallel universes of DevOps and cloud developers (GlueCon)

Emerging trends in software development: The next generation of storage

DevOps 101+: From collaboration to microservices

DevOps 101

How IT will disrupt in 2016: The ITaaS imperative

The New Assembly Line: 3 Best Practices for Building (Secure) Connected Cars

China capitulates: Another round of auto stimulus

Similar to Tools and Tech for Big Data Success

Building a Data Platform Strata SF 2019

mark madsen

5 Major Trends in Data You Should Know

Tomasz Tunguz

Architecting a Data Platform For Enterprise Use (Strata NY 2018)

mark madsen

Building a data lake involves more than installing Hadoop or putting data into AWS. The goal in most organizations is to build multi-use data infrastructure that is not subject to past constraints. This tutorial covers design assumptions, design principles, and how to approach the architecture and planning for multi-use data infrastructure in IT. Long: The goal in most organizations is to build multi-use data infrastructure that is not subject to past constraints. This session will discuss hidden design assumptions, review design principles to apply when building multi-use data infrastructure, and provide a reference architecture to use as you work to unify your analytics infrastructure. The focus in our market has been on acquiring technology, and that ignores the more important part: the larger IT landscape within which this technology lives and the data architecture that lies at its core. If one expects longevity from a platform then it should be a designed rather than accidental architecture. Architecture is more than just software. It starts from use and includes the data, technology, methods of building and maintaining, and organization of people. What are the design principles that lead to good design and a functional data architecture? What are the assumptions that limit older approaches? How can one integrate with, migrate from or modernize an existing data environment? How will this affect an organization's data management practices? This tutorial will help you answer these questions. Topics covered: * A brief history of data infrastructure and past design assumptions * Categories of data and data use in organizations * Data architecture * Functional architecture * Technology planning assumptions and guidance

Big data and you

IBM

IT In Europeharsimran768

Seminarppt

Monali Akhare

Big Data: an introduction

Bart Vandewoestyne

The Role of Data Wrangling in Driving Hadoop Adoption

Inside Analysis

The Briefing Room with Mark Madsen and Trifacta Live Webcast September 1, 2015 Watch the archive: https://bloorgroup.webex.com/bloorgroup/onstage/g.php?MTID=eb655874d04ba7d560be87a9d906dd2fd Like all enterprise software solutions, Hadoop must deliver business value in order to be a success. Much of the innovation around the big data industry these days therefore addresses usability. While there will always be a technical side to the Hadoop equation, the need for user-friendly tools to manage the data will continue to focus on business users. That’s why self-service data preparation or "data wrangling" is a serious and growing trend, one which promises to move Hadoop beyond the early adopter phase and more into the mainstream of business. Register for this episode of The Briefing Room to hear veteran Analyst Mark Madsen of Third Nature explain why business users will play an increasingly important role in the evolution of big data. He’ll be briefed by Trifacta's Will Davis and Alon Bartur, who will demonstrate how Trifacta's solution empowers business users to “wrangle" data of all shapes and sizes faster and easier than ever before. They’ll discuss why a new approach to accessing and preparing diverse data is required and how it can accelerate and broaden the use of big data within organizations. Visit InsideAnalysis.com for more information.

Café da manhã - São Paulo - Use-cases and opportunities in BigData with Hadoop

OCTO Technology

How to become a data scientist

Manjunath Sindagi

Data and data scientists are not equal to money david hoyle

Institute of Contemporary Sciences

A lot of companies make the mistake of thinking that just hiring Data Scientists will lead to increased revenue or increased profit. For a company’s investment in Data Science to be successful the Data Scientists need to work on the right problems, with the right people, and with the right tools. In this presentation, I will talk about the lessons I have learned, and mistakes made in applying Data Science in commercial settings over the last 10 years. I will highlight what processes can increase the chances of Data Science investment being successful.

Big Data Visualisation with Hadoop and PowerPivot

Jen Stirrup

SF Data Science: Developing Data Products

Peter Skomoroch

Examples, techniques, and lessons learned building data products over the last 4 years at LinkedIn. Pete Skomoroch is a Principal Data Scientist at LinkedIn where he leads a team focused on building data products leveraging LinkedIn's powerful identity and reputation data. The talk describes some techniques and best practices applied to develop products like LinkedIn Skills & Endorsements. This talk was presented at the SF Data Science Meetup on September 19th, 2013

You're the New CDO, Now What?

Caserta

Joe Caserta was a featured speaker, along with MIT Sloan School faculty and other industry thought-leaders. His session 'You're the New CDO, Now What?' discussed how new CDOs can accomplish their strategic objectives and overcome tactical challenges in this emerging executive leadership role. In its tenth year, the MIT CDOIQ Symposium 2016 continues to explore the developing role of the Chief Data Officer. For more information, visit http://casertaconcepts.com/

TBR IT Trends Study

TBRMarketing

During the last three years users have seen dramatic changes in how they access, consume and interact with technology. These changes have rolled across the enterprise, demanding IT managers incorporate better functionality and modify their environments to meet the needs of users and their businesses. While concerns about consumerization, virtualization, social media and cloud have assailed IT management, the eternal challenges remain. IT management must focus on increased security requirements, delivering results faster, increasing performance, tight budgets and tightening schedules while extracting the greatest possible business value from the available technology. To be able to prepare for what’s changing in IT in 2012, TBR surveyed 105 IT decision makers to find out what they see changing and to what impact. What we learned is that data is controlling the market, and how it is stored, accessed and leveraged can mean the difference between success and failure.

Big Data

NGDATA

The Maturity Model: Taking the Growing Pains Out of Hadoop

Inside Analysis

The Briefing Room with Rick van der Lans and Think Big, a Teradata Company Live Webcast on June 16, 2015 Watch the archive: https://bloorgroup.webex.com/bloorgroup/lsr.php?RCID=197f8106531874cc5c14081ca214eaff Hadoop is arguably one of the most disruptive technologies of the last decade. Once lauded solely for its ability to transform the speed of batch processing, it has marched steadily forward and promulgated an array of performance-enhancing accessories, notably Spark and YARN. Hadoop has evolved into much more than a file system and batch processor, and it now promises to stand as the data management and analytics backbone for enterprises. Register for this episode of The Briefing Room to learn from veteran Analyst Rick van der Lans, as he discusses the emerging roles of Hadoop within the analytics ecosystem. He’ll be briefed by Ron Bodkin of Think Big, a Teradata Company, who will explore Hadoop’s maturity spectrum, from typical entry use cases all the way up the value chain. He’ll show how enterprises that already use Hadoop in production are finding new ways to exploit its power and build creative, dynamic analytics environments. Visit InsideAnalysis.com for more information.

Data scientist the sexiest job of the 21st century by thomas h davenport and ...

Darpan Deoghare

Data In Action: Business Value of Data

Matt Turner

2012 IBM Tech Trends Report: Fast track to the future

Susanne Hupfer, Ph.D.

A study from IBM SWG developerWorks and IBM Center for Applied Insights. To gain a current global snapshot of how organizations are using big data and analytics, cloud, mobile, and social technologies, the IBM Center for Applied Insights conducted a survey of over 1200 IT and business decision makers. The study presents adoption and investment data for these emerging areas and also highlights skills and security challenges. Find out how a Pacesetter group exhibits market-driven, analytical, and experimental traits that allow them to capitalize on these emerging tech areas.

Similar to Tools and Tech for Big Data Success (20)

Building a Data Platform Strata SF 2019

5 Major Trends in Data You Should Know

Architecting a Data Platform For Enterprise Use (Strata NY 2018)

Big data and you

IT In Europe

Seminarppt

Big Data: an introduction

The Role of Data Wrangling in Driving Hadoop Adoption

Café da manhã - São Paulo - Use-cases and opportunities in BigData with Hadoop

How to become a data scientist

Data and data scientists are not equal to money david hoyle

Big Data Visualisation with Hadoop and PowerPivot

SF Data Science: Developing Data Products

You're the New CDO, Now What?

TBR IT Trends Study

Big Data

The Maturity Model: Taking the Growing Pains Out of Hadoop

Data scientist the sexiest job of the 21st century by thomas h davenport and ...

Data In Action: Business Value of Data

2012 IBM Tech Trends Report: Fast track to the future

More from Donnie Berkholz

Pricing and Packaging in Covid-19 Times - Heavybit

Donnie Berkholz

High-resolution slides available here: https://docs.google.com/presentation/d/1MygsJoOjQutdO116xvXHqLNThcwQ9eswyN38YDLjLVk/edit?usp=sharing As the impacts of COVID-19 continue to reveal themselves across the industry, there are some things that we can say for certain: enterprise software budgets have tightened, and the procurement teams who oversee them are showing preference to “tried-and-true” solutions in an effort to minimize risk. As an early stage B2B startup perceived as higher risk by these large organizations, how can you continue making deals and maintain your revenue? In this session, Donnie Berkholz will walk us through the often convoluted enterprise procurement and budgeting process so that you may better understand how to reposition your product, and possibly your pricing, in order to help your enterprise prospects hedge risk and sign new contracts. In addition, Donnie will talk through changes you can make to your overall go to market, including redoubling bottom-up efforts in order to decrease CAC and increase both product adoption and purchase on the ‘low end’ of the market.

Open Source & Open Community at a 100-Year-Old Company

Donnie Berkholz

Over the past 3 years, CWT flipped an 18,000-person enterprise upside-down, turning a travel company with some apps into a software vendor focused on travel. A brand-new product group brought together technologists across the company and around the globe for the first time. 18 months in, I joined to lead the DevOps transformation, aiming to speed time to value, improve customer experience, and increase collaboration. As part of that effort, needs quickly surfaced around areas like: * accelerating development through open-source adoption, * improving recruitment with open-source contribution, and * incorporating inner-source approaches to increase quality and speed. To make those shifts, we drove adoption of a series of new tools — especially around source code and chat. Additionally, I was able to piggy-back onto existing efforts to define an open-source policy, apply a product-centric mindset, and expand that perspective into a cross-functional open-source program office. This talk will describe our journey toward open at CWT, how we determined priorities and solutions, how we built bridges and overcame hurdles, and ultimately how we skipped entire generations in moving toward a modern view of open source in the enterprise. Anyone working toward an open culture in their company could benefit from this talk.

Open Source & Open Community at a 100-Year-Old Company

Donnie Berkholz

Discovering rivers & building bridges: DevOps @ CWT

Donnie Berkholz

Assholes are killing your project (MDC 2017)

Donnie Berkholz

The strength of your team is the best predictor of its long-term viability. What happens when that group is gradually infiltrated by assholes, who infect everyone else with their constant negativity and personal attacks? Although someone may be a valuable technical contributor, that person will never contribute as much to a product as the many others who are scared away and demotivated. This talk will teach you about the dramatic impact assholes are having on your organization today and will show you how you can begin to repair it.

Reality Check: How much influence do developers really have?

Donnie Berkholz

Donnie will describe the evolving state of DX, based on his experience as an industry analyst in his past 3 roles and an open-source developer for 13+ years. He'll present quantitative data on the value and influence of developers. Donnie will also highlight key trends and emerging populations and illustrate how to target them. Finally, he'll include tangible examples from both large and small companies across a broad spectrum of categories to show how they cope with the dynamic state of DX.

Cloud Native: A dose of reality

Donnie Berkholz

Cloud Native in the Enterprise: Real-World Data on Container and Microservice...

Donnie Berkholz

Containers and microservices are two of the fastest-growing trends in technology, enabled by DevOps. This talk will delve into the state of cloud-native prerequisites in the enterprise, the Docker and containers ecosystem including current adoption, and data on companies moving to cloud-native platforms. We'll close by looking at real-world examples of containers and microservices architectures at leading-edge companies.

Mining the Go Developer Community

Donnie Berkholz

How the rise of DevOps and containers is transforming IT service delivery

Donnie Berkholz

One of the fastest-growing trends in technology is containers, enabled by a modern approach to software development and deployment called DevOps. This talk will delve into the increasingly mainstream trend of DevOps, the Docker and containers ecosystem including current enterprise adoption, and how they combine to form a new style of software architecture dubbed microservices. We'll close by looking at real-world case studies at leading companies.

The OpenStack Pulse: Containers and Platforms

Donnie Berkholz

Excerpt on containers and platforms from “The OpenStack Pulse: Unbiased research on enterprise demand, TCO, and market size” given with Al Sadowski at the OpenStack summit in Austin TX in April 2016. Full abstract: 451 Research, an independent analyst firm, has been following the OpenStack space since its early days. During this commercial free presentation, quantitative and qualitative insights will be shared on these topics: - Enterprise adoption survey results—buying behaviors by workload for private cloud and public cloud as well as Docker/containers. - TCO for OpenStack—when a distro is actually cheaper than DIY. - Market sizing and growth projections for the entire OpenStack ecosystem, broken down by business model.

Microservices 101: From DevOps to Docker and beyond

Donnie Berkholz

Containers and microservices are two of the fastest-growing trends in technology, enabled by a modern approach to software development and deployment called DevOps. This talk will delve into the increasingly mainstream trend of DevOps, the Docker and containers ecosystem including current enterprise adoption, and how they combine to form a new style of software architecture dubbed microservices. We'll close by looking at real-world examples of containers and microservices architectures at leading-edge companies.

Can we compare communities or are they all unique snowflakes?

Donnie Berkholz

How microservices are redefining modern application architecture

Donnie Berkholz

DevOps, containers & microservices: Separating the hype from the reality

Donnie Berkholz

In this talk, Donnie shared what he's seen and what he predicts for the future of how we build and deploy applications to generate business value. You'll hear buzzwords like DevOps, Docker, and microservices used in ways that actually make sense (for a change), see real-world examples of companies that have succeeded at the leading edge, and learn how approaches like the one taken by HashiCorp's Terraform (by the authors of Vagrant) will be critical to the future of how we build software.

Hacking industry analysis: Analyst relations for startups

Donnie Berkholz

From 0 to DevOps in 5 minutes

Donnie Berkholz

Commit yourself already: Contributing to Open Source

Donnie Berkholz

The new stack isn’t a stack: Fragmentation and terraforming  the service layer

Donnie Berkholz

Open source, cloud, and the API revolution have already changed the way we build software. What's next? Donnie's spent the past 5 years trying to figure that out through observation and research at RedMonk and now at 451 Research. In this talk, he'll share what he's seen and what he predicts for the future of how we develop applications. You'll hear buzzwords like DevOps and microservices used in ways that actually make sense (for a change), see real-world examples of companies that have succeeded and failed, and learn how approaches like the one taken by HashiCorp's Terraform (by the authors of Vagrant) will be critical to the future of how we build software.

Beyond Linus Pauling: Conformation dependence of ideal geometry in proteins

Donnie Berkholz

More from Donnie Berkholz (20)

Pricing and Packaging in Covid-19 Times - Heavybit

Open Source & Open Community at a 100-Year-Old Company

Discovering rivers & building bridges: DevOps @ CWT

Assholes are killing your project (MDC 2017)

Reality Check: How much influence do developers really have?

Cloud Native: A dose of reality

Cloud Native in the Enterprise: Real-World Data on Container and Microservice...

Mining the Go Developer Community

How the rise of DevOps and containers is transforming IT service delivery

The OpenStack Pulse: Containers and Platforms

Microservices 101: From DevOps to Docker and beyond

Can we compare communities or are they all unique snowflakes?

How microservices are redefining modern application architecture

DevOps, containers & microservices: Separating the hype from the reality

Hacking industry analysis: Analyst relations for startups

From 0 to DevOps in 5 minutes

Commit yourself already: Contributing to Open Source

The new stack isn’t a stack: Fragmentation and terraforming  the service layer

Beyond Linus Pauling: Conformation dependence of ideal geometry in proteins

Recently uploaded

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...

Product School

Designing Great Products: The Power of Design and Leadership by Chief Designe...

Product School

When stars align: studies in data quality, knowledge graphs, and machine lear...

Elena Simperl

GraphRAG is All You need? LLM & Knowledge Graph

Guy Korland

Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs. 1. Unifying Large Language Models and Knowledge Graphs: A Roadmap. https://arxiv.org/abs/2306.08302 2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs: https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/

LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...

DanBrown980551

Do you want to learn how to model and simulate an electrical network from scratch in under an hour? Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)! During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook. PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides: - A fully editable and extendable library for grid component modelling; - Visualization tools to display your network; - Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses; The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well. What you will learn during the webinar: - For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills; - For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.

To Graph or Not to Graph Knowledge Graph Architectures and LLMs

Paul Groth

Securing your Kubernetes cluster_ a step-by-step guide to success !

KatiaHIMEUR1

Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster. However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks. In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.

Generating a custom Ruby SDK for your web service or Rails API using Smithy

g2nightmarescribd

Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.

Essentials of Automations: Optimizing FME Workflows with Parameters

Safe Software

Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place. Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects. Here’s what you’ll gain: - Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows. - Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy. - Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency. - Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity. We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic. Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.

Bits & Pixels using AI for Good.........

Alison B. Lowndes

JMeter webinar - integration with InfluxDB and Grafana

RTTS

Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application. In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics. Length: 30 minutes Session Overview ------------------------------------------- During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana: - What out-of-the-box solutions are available for real-time monitoring JMeter tests? - What are the benefits of integrating InfluxDB and Grafana into the load testing stack? - Which features are provided by Grafana? - Demonstration of InfluxDB and Grafana using a practice web application To view the webinar recording, go to: https://www.rttsweb.com/jmeter-integration-webinar

Epistemic Interaction - tuning interfaces to provide information for AI support

Alan Dix

Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024 https://alandix.com/academic/papers/synergy2024-epistemic/ As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

FIDO Alliance

The Art of the Pitch: WordPress Relationships and Sales

Laura Byrne

Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes? All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.

How world-class product teams are winning in the AI era by CEO and Founder, P...

Product School

Transcript: Selling digital books in 2024: Insights from industry leaders - T...

BookNet Canada

The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more. Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/ Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.

Accelerate your Kubernetes clusters with Varnish Caching

Thijs Feryn

GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...

Sri Ambati

Connector Corner: Automate dynamic content and events by pushing a button

DianaGray10

Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to: Create a campaign using Mailchimp with merge tags/fields Send an interactive Slack channel message (using buttons) Have the message received by managers and peers along with a test email for review But there’s more: In a second workflow supporting the same use case, you’ll see: Your campaign sent to target colleagues for approval If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team But—if the “Reject” button is pushed, colleagues will be alerted via Slack message Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors. And... Speakers: Akshay Agnihotri, Product Manager Charlie Greenberg, Host

Mission to Decommission: Importance of Decommissioning Products to Increase E...

Product School

Recently uploaded (20)

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...

Designing Great Products: The Power of Design and Leadership by Chief Designe...

When stars align: studies in data quality, knowledge graphs, and machine lear...

GraphRAG is All You need? LLM & Knowledge Graph

LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...

To Graph or Not to Graph Knowledge Graph Architectures and LLMs

Securing your Kubernetes cluster_ a step-by-step guide to success !

Generating a custom Ruby SDK for your web service or Rails API using Smithy

Essentials of Automations: Optimizing FME Workflows with Parameters

Bits & Pixels using AI for Good.........

JMeter webinar - integration with InfluxDB and Grafana

Epistemic Interaction - tuning interfaces to provide information for AI support

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

The Art of the Pitch: WordPress Relationships and Sales

How world-class product teams are winning in the AI era by CEO and Founder, P...

Transcript: Selling digital books in 2024: Insights from industry leaders - T...

Accelerate your Kubernetes clusters with Varnish Caching

GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...

Connector Corner: Automate dynamic content and events by pushing a button

Mission to Decommission: Importance of Decommissioning Products to Increase E...

Tools and Tech for Big Data Success

1. Tools and tech for Big Data success Donnie Berkholz, Ph.D. IT Industry Analyst @dberkholz [Imagine cheesy clipart of hammers, silicon, etc.]

2. Tools and tech — huh? ● Languages ● Infrastructure ● Tooling ● It's not about the what, it's about the how

3. Thesis: Technology adoption is increasingly bottom-up

4. The new kingmakers

5. The best DX wins

6. It's all about barriers to entry

7. Ecosystems matter

8. The challenges IT pros delivering data solutions 60/36 IT/biz Talend, summer 2012

9. The skills gap NVP survey of execs, summer 2012

10. What can we learn from book sales?

11.

12. What about the data analysts? KDNuggets, summer 2012

13. What about the data analysts? KDNuggets, summer 2012

14. It's not all about popularity...

15. The real growth isn't in SQL interfaces

16. Developers vs. marketers Google Trends

17. IT pros delivering data solutions 60/36 IT/biz Talend, summer 2012

18. Hadoop distributions: popularity Google Trends: $VENDOR hadoop

19.

20. Developers choose what's easiest

21.

22. How to run: bare metal / DC, private cloud, public cloud

23. Storing Data: HDFS, Ceph, Gluster

24. Open Building Blocks but not Open Source: EMR on AWS

25. Realtime: Impala, Druid

26. In-memory: Redis, Memcached

27. Streaming: Storm, S4

28. Other Options: Hadoop YARN, HPCC, Cassandra, Mongo, Riak

29. Other Options: Spark/Shark/Mesos

30. Abstraction: Mortar, Continuuity, Qubole, Concurrent Lingual, etc.

31. Conclusion: KISS

32. Donnie Berkholz, Ph.D. Analyst, RedMonk @dberkholz Disclosure: 10gen, Amazon, Basho, Cloudera, Continuuity, IBM, MapR, Microsoft, and VMware are clients.

Tools and Tech for Big Data Success

Recommended

Recommended

More Related Content

What's hot

What's hot (18)

Viewers also liked

Viewers also liked (16)

Similar to Tools and Tech for Big Data Success

Similar to Tools and Tech for Big Data Success (20)

More from Donnie Berkholz

More from Donnie Berkholz (20)

Recently uploaded

Recently uploaded (20)

Tools and Tech for Big Data Success