Leeds ML - 2020-03-05

•

0 likes•30 views

What does the journey from Data Engineer to Data Scientist look like? What skills does a Data Engineer *really* need to learn? And what should they forget?

Technology

Data Engineering -> Data Science
Things you’ll need to forget to help you succeed

Ed Thewlis
CTO, The Data Shed
ed@thedatashed.co.uk
@edthewlis

Stuff I want to talk about:
• Shiny! Deep Learning!! When can I start?
• Forget everything* you know.
• Fear the Data Engineer turned Scientist!
*just kidding.

Shiny! Deep Learning!! When can I start?
AKA: What do Engineers think Data Scientists actually do?

Credit: https://selmandesign.com/qa-on-machine-learning/

Most businesses’ problems
aren’t technically complex.

Where we’re going,
we don’t need tickets…*
*or at least, not quite in the same way

Your job isn’t to build a model that predicts
subscription churn, your job is to actually reduce
subscription churn

Forget TDDForget TDD, until you’ve identified value

Things to learn
The Easy Bits
• Business Process modelling
• Value Chain modelling
The Hard Bits
• Influencing others
• Business acumen
• Strong communication skills

F33r The Data Engineer turned Scientist!

Build
Experiment
Publish
Analytical Pipeline
Evaluate Monitor

Build
Hypothesis/
Experiment Publish
Analytical Pipeline
Evaluate Monitor
DevelopSpike/Design Release
Engineering Process
Test Monitor

Time to Insight
How efficiently can you
generate the insight to a
key decision point
Time to Action
How efficiently can the
business act on your
insight
Time to Value
Over what horizon are
you able to measure
your impact

Be realistic! Fix the problems in your business that aren’t
technically challenging
Forget the board! Think about the right and left – the
problem, and the change you’re going to effect in your
organisation
Only write tests when you’ve proven value
Data Scientists - embrace the Data Engineers. They’ll help you
automate the crap out of everything

Similar to Leeds ML - 2020-03-05

Idiots guide to setting up a data science team

Ashish Bansal

Have you heard about the exciting new careers in web development but don't know what that even means? Are you befuddled by the acronym soup and techno-babble that spills out of the internet regularly? Would you like to know what's underneath all those web pages and how the internet is made? In this short presentation, we'll explore the what, why, and how of Web Development and explain some of the mysticism of the internet. We'll cover: * What is "The Web" and how does it work? How is it different from "The Internet"? Where do Facebook and Twitter fit in? * What is "Development" and what skills and technology does it encompass? * What myths and rumors about web development and developers are true and which are bogus? * Who cares about web development anyway? How important is it, and what does it mean to my business? * What does the future of web development look like and how do I become a part of it? Join your host, David Rogers AKA "AL the X" (http://j.mp/al_the_x), career web developer with over 15 years experience, for an entertaining look at the stage-hand of our modern life: the web developer.

Just Enough Web Development: An Introduction!

David Rogers

Future of IT preso

Lorna Garey

How to hire and keep engineers happy public

Piaw Na

Getting from raw data to deploying data-driven solutions requires technology, data, and people. All of which exist. So why aren’t we seeing more truly data-driven companies: what's missing and why? During Strata Hadoop World Singapore 2015, Pauline Brown, Director of Marketing at Dataiku, explains how lack of collaboration is what is keeping companies from building and deploying data products effectively. Learn more about Dataiku and Data Science Studio: www.dataiku.com

The 3 Key Barriers Keeping Companies from Deploying Data Products

Dataiku

Recruiting a founding CTO

alan jones

Oracle SQL Developer Tips and Tricks: Data Edition

Jeff Smith

Doodle Redesign 2011 - Presentation UXCamp Berlin 2011

Reto Laemmler

How to build a data science team 20115.03.13v6

Zhihao Lin

Data Driven Practice with e-MDs

Jonathan Ploudre

Tracking and analyzing how our individual products come together has always been an elusive problem for Steelcase. Our problem can be thought of in the following way: “we know how many Lego pieces we sell, yet we don’t know what Lego set our customers buy.” The Data Science team took over this initiative, which resulted in an evolution of our analytics journey. It is a story of innovation, resilience, agility and grit. The effects of the COVID-19 pandemic on corporate America shined the spotlight on office furniture manufacturers to solve for ways on which the office can be made safe again. The team would have never imagined how relevant our work on product application analytics would become. Product application analytics became an industry priority overnight. The proposal presented this year is the story of how data science is helping corporations bring people back to the office and set the path to lead the reinvention of the office space. After groundbreaking milestones to overcome technical challenges, the most important question is: What do we do with this? How do we scale this? How do we turn this opportunity into a true competitive advantage? The response: stop thinking about this work as a data science project and start to think about this as an analytics-enabled experience. During our session we will cover the technical elements that we overcame as a team to set-up a pipeline that ingests semi-structured and unstructured data at scale, performs analytics and produces digital experiences for multiple users. This presentation will be particularly insightful for Data Scientists, Data Engineers and analytics leaders who are seeking to better understand how to augment the value of data for their organization

Analytics-Enabled Experiences: The New Secret Weapon

Databricks

Project Management 101 - Wordcamp TO 05112011

Liesl Barrell

Pragmatic Enterprise Architecture

E2 Partners

Is IIOT Right for You?

InSource Solutions

Tools and Tech for Big Data Success

Donnie Berkholz

Why and How startup choose tech stacks?

Mizno Kruge

Paytm labs soyouwanttodatascience

Adam Muise

The need for the IT to be fast enough to supply Business demand, is a false problem and can even probably be dangerous, leading to disastrous solutions often creating more and more inertia to IT itself that will be less and less capable of keeping pace with the Business. In addition an IT innovation will boost the business even more leaving IT in the dust. The approach to be fulfill is to make the Business "ride" the IT and create a virtuous circle. The speech will describe the risks in insisting in Business-IT alignment and investigate how to leverage MDA as a way to successfully have the Business to "ride" IT.

Business and IT alignment, how to escape from the sand-trap

pierino23

Scale your Software development process while scaling your team

Florian Motlik

Publishing Strategic Technology for Association of Catholic Publishers

Craig Miller

Similar to Leeds ML - 2020-03-05 (20)

Idiots guide to setting up a data science team

Just Enough Web Development: An Introduction!

Future of IT preso

How to hire and keep engineers happy public

The 3 Key Barriers Keeping Companies from Deploying Data Products

Recruiting a founding CTO

Oracle SQL Developer Tips and Tricks: Data Edition

Doodle Redesign 2011 - Presentation UXCamp Berlin 2011

How to build a data science team 20115.03.13v6

Data Driven Practice with e-MDs

Analytics-Enabled Experiences: The New Secret Weapon

Project Management 101 - Wordcamp TO 05112011

Pragmatic Enterprise Architecture

Is IIOT Right for You?

Tools and Tech for Big Data Success

Why and How startup choose tech stacks?

Paytm labs soyouwanttodatascience

Business and IT alignment, how to escape from the sand-trap

Scale your Software development process while scaling your team

Publishing Strategic Technology for Association of Catholic Publishers

Recently uploaded

[BuildWithAI] Introduction to Gemini.pdf

Sandro Moreira

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

💉💊+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHABI}}+971581248768 +971581248768 Mtp-Kit (500MG) Prices » Dubai [(+971581248768**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Maya Whatsapp +971581248768 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971581248768''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971581248768' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Cl

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@

Architecting Cloud Native Applications

WSO2

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

panagenda

FWD Group - Insurer Innovation Award 2024

The Digital Insurer

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

apidays

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Zilliz

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar. In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

Six Myths about Ontologies: The Basics of Formal Ontology

johnbeverley2021

MS Copilot expands with MS Graph connectors

Nanddeep Nachan

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Edi Saputra

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

Recently uploaded (20)

[BuildWithAI] Introduction to Gemini.pdf

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

Architecting Cloud Native Applications

Why Teams call analytics are critical to your entire business

FWD Group - Insurer Innovation Award 2024

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Six Myths about Ontologies: The Basics of Formal Ontology

MS Copilot expands with MS Graph connectors

presentation ICT roal in 21st century education

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Boost Fertility New Invention Ups Success Rates.pdf

Artificial Intelligence Chap.5 : Uncertainty

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Leeds ML - 2020-03-05

1. Data Engineering -> Data Science Things you’ll need to forget to help you succeed

2. Ed Thewlis CTO, The Data Shed ed@thedatashed.co.uk @edthewlis

3. Stuff I want to talk about: • Shiny! Deep Learning!! When can I start? • Forget everything* you know. • Fear the Data Engineer turned Scientist! *just kidding.

4. Shiny! Deep Learning!! When can I start? AKA: What do Engineers think Data Scientists actually do?

5. DATA ENGINEERING DATA SCIENCE

7. Credit: https://selmandesign.com/qa-on-machine-learning/

8. DATA ENGINEERING DATA SCIENCE

9. Most businesses’ problems aren’t technically complex.

10. Two things you will need to forget

11. Where we’re going, we don’t need tickets…* *or at least, not quite in the same way

12.

13. Your job isn’t to build a model that predicts subscription churn, your job is to actually reduce subscription churn

14. Forget TDDForget TDD, until you’ve identified value

15.

16. Things to learn The Easy Bits • Business Process modelling • Value Chain modelling The Hard Bits • Influencing others • Business acumen • Strong communication skills

17. F33r The Data Engineer turned Scientist!

18. Build Experiment Publish Analytical Pipeline Evaluate Monitor

19. Build Hypothesis/ Experiment Publish Analytical Pipeline Evaluate Monitor DevelopSpike/Design Release Engineering Process Test Monitor

20. Time to Insight How efficiently can you generate the insight to a key decision point Time to Action How efficiently can the business act on your insight Time to Value Over what horizon are you able to measure your impact

21. Be realistic! Fix the problems in your business that aren’t technically challenging Forget the board! Think about the right and left – the problem, and the change you’re going to effect in your organisation Only write tests when you’ve proven value Data Scientists - embrace the Data Engineers. They’ll help you automate the crap out of everything

22. Any questions?

Leeds ML - 2020-03-05

Recommended

Recommended

More Related Content

Similar to Leeds ML - 2020-03-05

Similar to Leeds ML - 2020-03-05 (20)

Recently uploaded

Recently uploaded (20)

Leeds ML - 2020-03-05