Condense Fact from the Vapor of Nuance

•

1 like•464 views

Presenter: Michael Conover, LinkedIn Interesting, impactful problems are rarely easy to define, model, or evaluate - in fact, the very newness of a problem often suggests a scarcity of data and structured thinking about viable approaches. In this talk, we'll work through some of the challenges faced by LinkedIn's machine learning research teams in building and shipping intelligent systems that make sense of the world's economy. From creating novel training data and productionizing models with complex structure to evangelizing and evaluating the results of unsupervised algorithms, this talk will examine real-world case studies describing some of the hardest and most interesting challenges faced by one of the world's largest technology companies.

Technology

Condense Fact from the Vapor of Nuance
Mike Conover, Ph.D.
Staff Data Scientist, LinkedIn

How do industries evolve in time?
Which companies are positioned for explosive growth?
Which jobs will employ the workforce in ten years?
Industrial
Structure
YY Ahn, et al.

Unambiguous
Concrete Response Variables
Ad Clicks
Real Estate Pricing
Flower Species

Qualitative
Multidimensional
Non-Euclidean
Expertise
Nebulous
TrustSerendipity Sentiment

High-Fidelity Proxy Variables
Crowdsourcing / In-House Evaluation
Tip of the Spear
Operationalize
“All models are wrong, but some are useful.”
George Box

Qualitative
Evaluation
Heteroscedasticity
Stratified Sampling
Temporal Factors

Lightweight
Narrative Frame
Toy Examples
Propaganda
“Given enough eyeballs, all bugs are shallow.”
Eric S. Raymond

Infrastructure
Notebooks
Model Viewers
Soup to Nuts

Devil’s Bargain
Feature Transformations
Transcription Errors
Model Specification

Power Tools
Singularity
Something’s Wrong. Go.
Spark & MLLib + Notebooks

Biomorphs
Iterating on Response Variables

Viewers also liked

By Chris Diehl, The Data Guild Our modern world represents an inextricable blend of the cyber and physical domains. Networked devices with sensing and computational capabilities continue to expand the extent of the cyber-physical interface, increasing risks across scales from the individual to the societal level. No longer do we fully understand the extent of what is being collected and assimilated about us. For marginalized populations globally, the consequences of this can be severe. What is the nature of the risk at the level of the individual? How can the data science community respond to improve the current reality? Chris will present some initial thoughts to frame the concerns and outline a way forward.

Wrangle 2016 - Digital Vulnerability: Characterizing Risks and Contemplating ...

WrangleConf

Presenter: Shubha Nabar, Salesforce Statistics, machine learning and programming are commonly referenced tools of the data science trade. A less often talked about, but entirely indispensable skill for building great data products, is knowing what to build and why. In this talk, I will dispel some commonly prevalent myths related to building data products and touch on the increasing convergence between the skills of an effective data scientist and skills that have traditionally fallen in the realm of product management.

The Unreasonable Effectiveness of Product Sense

WrangleConf

By Abe Gong, Aspire Health Abe has spent the last year building data systems to forecast personal medical calamities: hospitalization, debilitation, and death. This talk will share perspective from this experience, with two main goals: Demystify the process of working with highly regulated medical data and legacy healthcare IT Continue last year’s conversation about ethical algorithms and the potential harms of data work Ultimately, all data is high-stakes data. Abe's hope is that discussing data science in a life-and-death medical context can further a community conversation about how to do no harm—and more more good—with data.

Wrangle 2016: Staying Hippocratic with High Stakes Data

WrangleConf

Presenter: Marina Sirota, UCSF Recent advances in genome typing and sequencing technologies have enabled quick generation of a vast amount of molecular data at very low cost. The mining and computational analysis of this type of data can help shape new diagnostic and therapeutic strategies in biomedicine. In this talk, I will discuss how such technological advances in combination with data science and integrative analysis can be applied to drug discovery in the context of drug target identification, computational drug repurposing, and population stratification approaches.

Data Science in Drug Discovery

WrangleConf

By Joel Grus, AI2 FizzBuzz is a ubiquitous, nearly trivial problem used to weed out developer job applicants. Recently, Joel wrote a joking-not-joking blog post about a fictional interviewee who solves it using neural networks. After the blog post went viral, he spent a lot of time thinking about FizzBuzz as a machine-learning problem. It turns out, it's surprisingly interesting and subtle! Here, Joel talks about how and why.

Wrangle 2016: (Lightning Talk) FizzBuzz in TensorFlow

WrangleConf

By Mohammad Saffar, Arimo Time-series (longitudinal) data occurs in nearly every aspect of our lives; including customer activity on a website, financial transactions, sensor/IoT data. Just like in written text, specific events in a sequence of events are affected by the past and affect events in the future, and this can reveal a lot of hidden structure in the source of the events. Yet, today's predictive techniques largely rely on demographic (cross-sectional) data and do not take into account the sequences of events as they occur. In this session, Mohammad will discuss techniques for taking time-series data from a variety of domains and sources and grouping entities based on temporal behavior, using RNNs. These clusters of time-series sequences can either be visualized or used for campaign targeting in the case of user clickstream behavior or understanding stock symbols that behave similarly based on their trading behavior.

Wrangle 2016: Seeing Behaviors as Humans Do: Uncovering Hidden Patterns in Ti...

WrangleConf

Presenter: Andrea Burbank, Pinterest A successful experimentation program consists of much more than mere randomization and measurement. How do you help stakeholders understand the right things to measure, avoid common pitfalls, and learn to rely on A/B tests as the best way to measure a new system or feature? In this talk, Andrea will explain how building a culture of experimentation and the right tools to support it is just as important as the statistics behind the comparisons themselves - and potentially much trickier to get right.

A/B Testing at Pinterest: Building a Culture of Experimentation

WrangleConf

Personalized Content Blending in the Pinterest Homefeed: The Pinterest Homefeed is a personalized feed of content (or “Pins”) drawn from many sources, including followed users, followed topics, and recommendations, among other sources. Each types of content is ranked by its own specialized machine learning model, and then blended with a ratio-based round robin to create the final Homefeed. This presentation dives into how the current system evolved, and describes in depth an approach for personalizing the content blending ratio. This method uses historical user action data and models the Pin action rates of each pin type as a Bernoulli distribution. Each content type’s overall utility is modeled as a sum of the Pin action rate distributions, weighted by action-specific reward constants. I will discuss different methods for assigning blending ratios based on the utility distribution. As we iterate on our blending systems, new questions have arisen as to how we measure success. . Unlike traditional search ranking problems, Pinterest faces both short- and long-term optimization challenges as we balance immediate user-engagement metric movements and long term ecosystem health. This talk concludes with an overview of some of the different dimensions of success we currently monitor as we continue to work on blending.

Stephanie deWet, Software Engineer, Pinterest at MLconf SF 2016

MLconf

Viewers also liked (8)

Wrangle 2016 - Digital Vulnerability: Characterizing Risks and Contemplating ...

The Unreasonable Effectiveness of Product Sense

Wrangle 2016: Staying Hippocratic with High Stakes Data

Data Science in Drug Discovery

Wrangle 2016: (Lightning Talk) FizzBuzz in TensorFlow

Wrangle 2016: Seeing Behaviors as Humans Do: Uncovering Hidden Patterns in Ti...

A/B Testing at Pinterest: Building a Culture of Experimentation

Stephanie deWet, Software Engineer, Pinterest at MLconf SF 2016

Similar to Condense Fact from the Vapor of Nuance

SXSW Interactive 2015 Recap

Juston Western

Mindtrek 2015 - Tampere Finland

Panos Fitsilis

Starting your AI/ML project right (May 2020)

Julien SIMON

Got Myth? Myths in Software Engineering

Thomas Zimmermann

Senior Meeting 2011

Michigan Technological University

Developing an Engineering Mindset by Junaid Javed

Jamil Goheer

Selective 97 things every programmer should know

Muhammad Ahsan

97 thingseveryprogrammershouldknow

REHAN KHAN

ChatGPT-and-Generative-AI-Landscape Working of generative ai search

rohitcse52

Presentation by Peter Shanley, Principle & Evangelist at Neo on August 11, 2014 at Startup Product Talks San Francisco: Going Global With Prezi, Neo And Visiting Guests Peter has a passion for customer-centered product design and organizational change, having worked in both large enterprises and startups to bring new ventures to market. He held intrepreneurial roles at Yahoo! Brickhouse and HP Labs/Snapfish, and he led a strategic pivot at the startup Betable.com. https://www.linkedin.com/pub/peter-shanley/12/348/400 More info: bit.ly/1rj876o http://startupproduct.com/startup-product-sf-going-global-prezi-neo-visiting-guests/

Peter Shanley, Principal & Evangelist at Neo

Startup Product

Prototypes, Prototypes, Prototypes

Shane Morris

Intel Faster Risk Oct08 - Andrew Parry

mikeohara

PDL Distinguished Alumni Talk

Erik Riedel

$SkillSoft\'s 2010 Perspectives Recap$ $SkillSoft\'s 2010 Perspectives Recap$

SkillSoft\'s 2010 Perspectives Recap

BellaMia711

Ownership Transfer of an IT Program

Thoughtworks

From semantic platforms to semantic apps

scroisier

With Fashion Week to inspire us, this webinar focuses on sharing a few favorite digital trends for 2018. Instead of discussing denim separates and art-inspired prints, our team explores hot digital to keep an eye on. The webinar focuses on emerging technologies, exciting design trends and standout digital strategies to adopt in the new year. Associate Creative Director Jessica DeJong and Chief Strategist Kalev Peekna dive into concepts that could disrupt how we think about digital experiences, as well as trends to easily fold into your 2018 marketing strategy. Access the full recording: https://youtu.be/N_4XAsXDoYI

#1NWebinar: Digital on the Runway

One North

Understanding Users Through Ethnography and Modeling - STC Summit 2010

Jim Jarrett

Find Your Passion and Make a Difference in Your Career

Albert Y. C. Chen

Visuals in business consulting

mark_allen

Similar to Condense Fact from the Vapor of Nuance (20)

SXSW Interactive 2015 Recap

Mindtrek 2015 - Tampere Finland

Starting your AI/ML project right (May 2020)

Got Myth? Myths in Software Engineering

Senior Meeting 2011

Developing an Engineering Mindset by Junaid Javed

Selective 97 things every programmer should know

97 thingseveryprogrammershouldknow

ChatGPT-and-Generative-AI-Landscape Working of generative ai search

Peter Shanley, Principal & Evangelist at Neo

Prototypes, Prototypes, Prototypes

Intel Faster Risk Oct08 - Andrew Parry

PDL Distinguished Alumni Talk

$SkillSoft\'s 2010 Perspectives Recap$ $SkillSoft\'s 2010 Perspectives Recap$

SkillSoft\'s 2010 Perspectives Recap

Ownership Transfer of an IT Program

From semantic platforms to semantic apps

#1NWebinar: Digital on the Runway

Understanding Users Through Ethnography and Modeling - STC Summit 2010

Find Your Passion and Make a Difference in Your Career

Visuals in business consulting

Recently uploaded

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

wesley chun

With more memory available, system performance of three Dell devices increased, which can translate to a better user experience Conclusion When your system has plenty of RAM to meet your needs, you can efficiently access the applications and data you need to finish projects and to-do lists without sacrificing time and focus. Our test results show that with more memory available, three Dell PCs delivered better performance and took less time to complete the Procyon Office Productivity benchmark. These advantages translate to users being able to complete workflows more quickly and multitask more easily. Whether you need the mobility of the Latitude 5440, the creative capabilities of the Precision 3470, or the high performance of the OptiPlex Tower Plus 7010, configuring your system with more RAM can help keep processes running smoothly, enabling you to do more without compromising performance.

Boost PC performance: How more available memory can improve productivity

Principled Technologies

Scaling API-first – The story of a global engineering organization

Radu Cotescu

As privacy and data protection regulations evolve rapidly, organizations operating in multiple jurisdictions face mounting challenges to ensure compliance and safeguard customer data. With state-specific privacy laws coming up in multiple states this year, it is essential to understand what their unique data protection regulations will require clearly. How will data privacy evolve in the US in 2024? How to stay compliant? Our panellists will guide you through the intricacies of these states' specific data privacy laws, clarifying complex legal frameworks and compliance requirements. This webinar will review: - The essential aspects of each state's privacy landscape and the latest updates - Common compliance challenges faced by organizations operating in multiple states and best practices to achieve regulatory adherence - Valuable insights into potential changes to existing regulations and prepare your organization for the evolving landscape

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc

Automating Google Workspace (GWS) & more with Apps Script

wesley chun

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Neo4j

Discord is a free app offering voice, video, and text chat functionalities, primarily catering to the gaming community. It serves as a hub for users to create and join servers tailored to their interests. Discord’s ecosystem comprises servers, each functioning as a distinct online community with its own channels dedicated to specific topics or activities. Users can engage in text-based discussions, voice calls, or video chats within these channels. Understanding Discord Servers Discord servers are virtual spaces where users congregate to interact, share content, and build communities. Servers may revolve around gaming, hobbies, interests, or fandoms, providing a platform for like-minded individuals to connect. Communication Features Discord offers a range of communication tools, including text channels for messaging, voice channels for real-time audio conversations, and video channels for face-to-face interactions. These features facilitate seamless communication and collaboration. What Does NSFW Mean? The acronym NSFW stands for “Not Safe For Work,” indicating content that may be inappropriate for professional or public settings. NSFW Content NSFW content encompasses material that is sexually explicit, violent, or otherwise graphic in nature. It often includes nudity, profanity, or depictions of sensitive topics.

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

UK Journal

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Drew Madelung

🐬 The future of MySQL is Postgres 🐘

RTylerCroy

Manulife - Insurer Innovation Award 2024

The Digital Insurer

Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.

Exploring the Future Potential of AI-Enabled Smartphone Processors

debabhi2

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

apidays

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

Created by Mozilla Research in 2012 and now part of Linux Foundation Europe, the Servo project is an experimental rendering engine written in Rust. It combines memory safety and concurrency to create an independent, modular, and embeddable rendering engine that adheres to web standards. Stewardship of Servo moved from Mozilla Research to the Linux Foundation in 2020, where its mission remains unchanged. After some slow years, in 2023 there has been renewed activity on the project, with a roadmap now focused on improving the engine’s CSS 2 conformance, exploring Android support, and making Servo a practical embeddable rendering engine. In this presentation, Rakhi Sharma reviews the status of the project, our recent developments in 2023, our collaboration with Tauri to make Servo an easy-to-use embeddable rendering engine, and our plans for the future to make Servo an alternative web rendering engine for the embedded devices industry. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://ossna2024.sched.com/event/1aBNF/a-year-of-servo-reboot-where-are-we-now-rakhi-sharma-igalia

A Year of the Servo Reboot: Where Are We Now?

Igalia

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

panagenda

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

Partners Life - Insurer Innovation Award 2024

The Digital Insurer

Recently uploaded (20)

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

Powerful Google developer tools for immediate impact! (2023-24 C)

Boost PC performance: How more available memory can improve productivity

Scaling API-first – The story of a global engineering organization

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

Automating Google Workspace (GWS) & more with Apps Script

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

presentation ICT roal in 21st century education

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

🐬 The future of MySQL is Postgres 🐘

Manulife - Insurer Innovation Award 2024

Exploring the Future Potential of AI-Enabled Smartphone Processors

Apidays New York 2024 - The value of a flexible API Management solution for O...

Strategies for Landing an Oracle DBA Job as a Fresher

A Year of the Servo Reboot: Where Are We Now?

Why Teams call analytics are critical to your entire business

AWS Community Day CPH - Three problems of Terraform

Partners Life - Insurer Innovation Award 2024

Condense Fact from the Vapor of Nuance

1. Condense Fact from the Vapor of Nuance Mike Conover, Ph.D. Staff Data Scientist, LinkedIn

2. How do industries evolve in time? Which companies are positioned for explosive growth? Which jobs will employ the workforce in ten years? Industrial Structure YY Ahn, et al.

3. Good Problems

4. Unambiguous Concrete Response Variables Ad Clicks Real Estate Pricing Flower Species

5. Qualitative Multidimensional Non-Euclidean Expertise Nebulous TrustSerendipity Sentiment

6. High-Fidelity Proxy Variables Crowdsourcing / In-House Evaluation Tip of the Spear Operationalize “All models are wrong, but some are useful.” George Box

7. Execution

8. Quality Control

9. Scale is the Premise

10. Spectrum

11. Qualitative Evaluation Heteroscedasticity Stratified Sampling Temporal Factors

12. Confirmation Bias

13. Fit to Print

14. Lightweight Narrative Frame Toy Examples Propaganda “Given enough eyeballs, all bugs are shallow.” Eric S. Raymond

15. Infrastructure Notebooks Model Viewers Soup to Nuts

16. Ship It!

17. Devil’s Bargain Feature Transformations Transcription Errors Model Specification

18. Power Tools Singularity Something’s Wrong. Go. Spark & MLLib + Notebooks