State of RecSys: Recap of RecSys 2012

Data, Responsibly: The Next Decade of Data Science

Machine Learning for Designers

Memi Beltrame

Artificial intelligence is more and more becoming the core of digital products. Designing for Products based on AI requires Designers to know about Machine Learning. This talk is an easy walk through the most important elements of Machine Learning. It looks at the fundamental principles of using practical examples. It showcases applications of the different types of Machine Learning. The use-cases range from text categorization to image recognition, on to speech analysis. The goal is to show what is important for designers and why.

Norman Sasono - Incorporating AI/ML into Your Application Architecture

Agile Impact

Materials for getting started with data science

ihansel

Truth is a Lie: Rules & Semantics from Crowd Perspectives (RR'2015 Keynote)

Telling stories with your data

John Whalen

While providing raw data in places like Data.gov is a great first step in opening up government, it is insufficient. Realizing the spirit of the Open Government Directive will require dramatic improvements in user experience. Concrete examples to demonstrate how government agencies can harness the power of information visualization to give the American people the insights they need (not just the data needed) to make informed decisions and dramatically improve interactions with the government.

Data Science, Data Curation, and Human-Data Interaction

Data science remains a high-touch activity, especially in life, physical, and social sciences. Data management and manipulation tasks consume too much bandwidth: Specialized tools and technologies are difficult to use together, issues of scale persist despite the Cambrian explosion of big data systems, and public data sources (including the scientific literature itself) suffer curation and quality problems. Together, these problems motivate a research agenda around “human-data interaction:” understanding and optimizing how people use and share quantitative information. I’ll describe some of our ongoing work in this area at the University of Washington eScience Institute. In the context of the Myria project, we're building a big data "polystore" system that can hide the idiosyncrasies of specialized systems behind a common interface without sacrificing performance. In scientific data curation, we are automatically correcting metadata errors in public data repositories with cooperative machine learning approaches. In the Viziometrics project, we are mining patterns of visual information in the scientific literature using machine vision, machine learning, and graph analytics. In the VizDeck and Voyager projects, we are developing automatic visualization recommendation techniques. In graph analytics, we are working on parallelizing best-of-breed graph clustering algorithms to handle multi-billion-edge graphs. The common thread in these projects is the goal of democratizing data science techniques, especially in the sciences.

Harnessing Human Semantics at Scale (updated)

The Magic Barrier of Recommender Systems - No Magic, Just Ratings

Recommender Systems need to deal with different types of users who represent their preferences in various ways. This difference in user behaviour has a deep impact on the final performance of the recommender system, where some users may receive either better or worse recommendations depending, mostly, on the quantity and the quality of the information the system knows about the user. Specifically, the inconsistencies of the user impose a lower bound on the error the system may achieve when predicting ratings for that particular user. In this work, we analyse how the consistency of user ratings (coherence) may predict the performance of recommendation methods. More specifically, our results show that our definition of coherence is correlated with the so-called magic barrier of recommender systems, and thus, it could be used to discriminate between easy users (those with a low magic barrier) and difficult ones (those with a high magic barrier). We report experiments where the rating prediction error for the more coherent users is lower than that of the less coherent ones. We further validate these results by using a public dataset, where the magic barrier is not available, in which we obtain similar performance improvements.

A 3D Approach to Recommender System Evaluation

In this work we describe an approach at multi-objective recommender system evaluation based on a previously introduced 3D benchmarking model. The benchmarking model takes user-centric, business-centric and technical constraints into consideration in order to provide a means of comparison of recommender algorithms in similar scenarios. We present a comparison of three recommendation algorithms deployed in a user study using this 3D model and compare to standard evaluation methods. The proposed approach simplifies benchmarking of recommender systems and allows for simple multi-objective comparisons.

Information Retrieval and User-centric Recommender System Evaluation

Yogesh Malhotra, PhD,MSQF, CISSP,CISA,CEH

THE TOTAL MARKET CONFERENCE RECAP AND SUMMARY

REFRAME: THE BRAND

2013 NICSA Annual Conference Picture Recap

NICSA

Multi-Touchpoint Event Marketing Presented at PCMA's 2014 Convening Leaders C...

HighRoad Solution

Suzanne Carawan, CMO of HighRoad Solution, gave this presentation at the 2014 PCMA Convening Leaders annual meeting held in Boston, MA. Focusing on customer experience, the presentation provides a framework for building your own event marketing plan based on user-centric design principles. The presentation focuses on using digital techniques to better market your event pre-during and post-live event. Hi

What's hot

Acs mobile apps for drug discovery-final

Sean Ekins

ACS Summer Institute - Emerging Roles of Librarians - 14_0731

jeffreylancaster

2018 Princeton Fintech & Quant Conference: AI, Machine Learning & Deep Learni...

My ESWC 2017 keynote: Disrupting the Semantic Comfort Zone

US Environmental Protection Agency (EPA), Center for Computational Toxicology and Exposure

Writing Analytics for Epistemic Features of Student Writing #icls2016 talk

Simon Knight

Informatics Transform : Re-engineering Libraries for the Data Decade

Liz Lyon

Mobile apps for drug discovery

Science Data, Responsibly

Data, Responsibly: The Next Decade of Data Science

Machine Learning for Designers

Memi Beltrame

Norman Sasono - Incorporating AI/ML into Your Application Architecture

Agile Impact

Materials for getting started with data science

ihansel

Truth is a Lie: Rules & Semantics from Crowd Perspectives (RR'2015 Keynote)

Telling stories with your data

John Whalen

Data Science, Data Curation, and Human-Data Interaction

Harnessing Human Semantics at Scale (updated)

What's hot (16)

Acs mobile apps for drug discovery-final

ACS Summer Institute - Emerging Roles of Librarians - 14_0731

2018 Princeton Fintech & Quant Conference: AI, Machine Learning & Deep Learni...

My ESWC 2017 keynote: Disrupting the Semantic Comfort Zone

Writing Analytics for Epistemic Features of Student Writing #icls2016 talk

Informatics Transform : Re-engineering Libraries for the Data Decade

Mobile apps for drug discovery

Science Data, Responsibly

Data, Responsibly: The Next Decade of Data Science

Machine Learning for Designers

Norman Sasono - Incorporating AI/ML into Your Application Architecture

Materials for getting started with data science

Truth is a Lie: Rules & Semantics from Crowd Perspectives (RR'2015 Keynote)

Telling stories with your data

Data Science, Data Curation, and Human-Data Interaction

Harnessing Human Semantics at Scale (updated)

Viewers also liked

The Magic Barrier of Recommender Systems - No Magic, Just Ratings

A 3D Approach to Recommender System Evaluation

Information Retrieval and User-centric Recommender System Evaluation

THE TOTAL MARKET CONFERENCE RECAP AND SUMMARY

REFRAME: THE BRAND

2013 NICSA Annual Conference Picture Recap

NICSA

Multi-Touchpoint Event Marketing Presented at PCMA's 2014 Convening Leaders C...

HighRoad Solution

AdAge Digital Conference 2012 Recap

Emily Reeves Dean

A Top-N Recommender System Evaluation Protocol Inspired by Deployed Systems

he evaluation of recommender systems is crucial for their development. In today's recommendation landscape there are many standardized recommendation algorithms and approaches, however, there exists no standardized method for experimental setup of evaluation -- not even for widely used measures such as precision and root-mean-squared error. This creates a setting where comparison of recommendation results using the same datasets becomes problematic. In this paper, we propose an evaluation protocol specifically developed with the recommendation use-case in mind, i.e. the recommendation of one or several items to an end user. The protocol attempts to closely mimic a scenario of a deployed (production) recommendation system, taking specific user aspects into consideration and allowing a comparison of small and large scale recommendation systems. The protocol is evaluated on common recommendation datasets and compared to traditional recommendation settings found in research literature. Our results show that the proposed model can better capture the quality of a recommender system than traditional evaluation does, and is not affected by characteristics of the data (e.g. size. sparsity, etc.).

User-Centric Evaluation of a K-Furthest Neighbor Collaborative Filtering Reco...

Knowledge Management Associates, LLC

Collaborative filtering recommender systems often use nearest neighbor methods to identify candidate items. In this paper we present an inverted neighborhood model, k-Furthest Neighbors, to identify less ordinary neighborhoods for the purpose of creating more diverse recommendations. The approach is evaluated two-fold, once in a traditional information retrieval evaluation setting where the model is trained and validated on a split train/test set, and once through an online user study (N=132) to identify users’ erceived quality of the recommender. A standard k-nearest neighbor recommender is used as a baseline in both evaluation settings. our evaluation shows that even though the proposed furthest neighbor model is outperformed in the traditional evaluation setting, the perceived usefulness of the algorithm shows no significant difference in the results of the user study.

DSGNDAY conference recap

Dennis Hambeukers

SharePoint Conference Recap - Adoption Session

Social Media for Executives

Emily Reeves Dean

SBAC parent info

Corona Norco Unified School District

Comparative Recommender System Evaluation: Benchmarking Recommendation Frame...

University of California Curation Center

Video available here http://www.youtube.com/watch?v=1jHxGCl8RXc Recommender systems research is often based on comparisons of predictive accuracy: the better the evaluation scores, the better the recommender. However, it is difficult to compare results from different recommender systems due to the many options in design and implementation of an evaluation strategy. Additionally, algorithmic implementations can diverge from the standard formulation due to manual tuning and modifications that work better in some situations. In this work we compare common recommendation algorithms as implemented in three popular recommendation frameworks. To provide a fair comparison, we have complete control of the evaluation dimensions being benchmarked: dataset, data splitting, evaluation strategies, and metrics. We also include results using the internal evaluation mechanisms of these frameworks. Our analysis points to large differences in recommendation accuracy across frameworks and strategies, i.e. the same baselines may perform orders of magnitude better or worse across frameworks. Our results show the necessity of clear guidelines when reporting evaluation of recommender systems to ensure reproducibility and comparison of results.

Viewers also liked (14)

The Magic Barrier of Recommender Systems - No Magic, Just Ratings

A 3D Approach to Recommender System Evaluation

Information Retrieval and User-centric Recommender System Evaluation

THE TOTAL MARKET CONFERENCE RECAP AND SUMMARY

2013 NICSA Annual Conference Picture Recap

Multi-Touchpoint Event Marketing Presented at PCMA's 2014 Convening Leaders C...

AdAge Digital Conference 2012 Recap

A Top-N Recommender System Evaluation Protocol Inspired by Deployed Systems

User-Centric Evaluation of a K-Furthest Neighbor Collaborative Filtering Reco...

DSGNDAY conference recap

SharePoint Conference Recap - Adoption Session

Social Media for Executives

SBAC parent info

Comparative Recommender System Evaluation: Benchmarking Recommendation Frame...

Similar to State of RecSys: Recap of RecSys 2012

Making friends with big data resource linksHeather Stark

Digital Curation for Excel (DCXL)

CDL has recently launched a new project dubbed Digital Curation for Excel (DCXL), funded by the Gordon and Betty Moore Foundation and Microsoft Research. The goal of the DCXL project is to facilitate data management, sharing, and archiving for earth, environmental, and ecological scientists. The main result from the project will be an open source add-in for Microsoft Excel that will assist scientists in preparing their Excel data for sharing.

Fixing data science & Accelerating Artificial Super Intelligence Development

ManojKumarR41

This presentation discusses Challenges, Problems, Issues, Measures, Mistakes, Opportunities, Ideas, Technologies, Research and Visions around Data Science HashGraph, Data Mesh, Data Trajectories, Citrix HDX and Anonos BigPrivacy Combination of these 5 and few other ideas will ultimately lead us to the VGB Platform. Will soon come up with other document explaining the vision and how exactly work on the vision to gradually develop this Platform, which fixes Data Science Efforts Globally.

Jonathan hendler deri - galway - feb 25 2008

hendler

QCon São Paulo: Real-Time Analytics with Spark Streaming

Paco Nathan

"Real-Time Analytics with Spark Streaming" presented at QCon São Paulo, 2015-03-26 http://qconsp.com/presentation/real-time-analytics-spark-streaming This talk presents an overview of Spark and its history and applications, then focuses on the Spark Streaming component used for real-time analytics. We compare it with earlier frameworks such as MillWheel and Storm, and explore industry motivations for open-source micro-batch streaming at scale. The talk will include demos for streaming apps that include machine-learning examples. We also consider public case studies of production deployments at scale. We’ll review the use of open-source sketch algorithms and probabilistic data structures that get leveraged in streaming – for example, the trade-off of 4% error bounds on real-time metrics for two orders of magnitude reduction in required memory footprint of a Spark app.

Data Science in 2016: Moving Up

Paco Nathan

Data Science in 2016: Moving up by Paco Nathan at Big Data Spain 2015

Big Data Spain

The term 'Data Science' was first described in scientific literature about 15 years ago. It started to become a major trend in industry about 7 years ago. O'Reilly Media surveys the industry extensively each year. In addition we get a good birds-eye view of industry trends through our conference programs and publications, working closely with some of the best practitioners in Data Science. By now, the field has evolved far beyond its origins eclipsing an earlier generation of Business Intelligence and Data Warehousing approaches. Data Science is moving up, into the business verticals and government spheres of influence where it has true global impact. This talk considers Data Science trends from the past three years in particular. What is emerging? Which parts are evolving? Which seem cluttered and poised for consolidation or other change? Session presented at Big Data Spain 2015 Conference 15th Oct 2015 Kinépolis Madrid http://www.bigdataspain.org Event promoted by: http://www.paradigmatecnologico.com Abstract: http://www.bigdataspain.org/program/thu/slot-2.html

Understanding Products Driven by Machine Learning and AI: A Data Scientist's ...

Amanda Casari

When describing a product as "data-driven" or "fueled by machine learning," it can be difficult to parse a common, fundamental definition of what makes an application "intelligent." In this talk, we will cover how you can peel back the buzzwords from the space of data science, machine learning, and artificial intelligence. You will be able to: - Start sketching your own frameworks for understanding and evaluating these products - Better understand how things can go wrong - Know what questions to ask product vendors, and have a better understanding of their answers - Learn more about data science as a process, as people organizations, as a product and as a service

Practical Machine Ethics @ SXSW2019

Jesus Ramos

Smart Data Webinar: Advances in Natural Language Processing II - NL Generation

DATAVERSITY

Need more than visualization? Generate custom narrative docs from data today. Technology for natural language generation (NLG) has advanced from the production of restricted-domain question-answering and simulation systems to the delivery of general purpose data- or model-driven narratives that are virtually indistinguishable from human-generated correspondence. From sports to stock reports, you’ve probably read a machine-generated report in the past year without realizing that the “author” was a machine. Participants in this webinar will learn how modern approaches have progressed beyond pattern matching and table-driven text selection to algorithms that consider context and tone. We will also present examples of commercially available NLG APIs to help participants experiment with NLG in their own applications right away.

Implementing Big Data, NoSQL, & Hadoop - Bigger Is (Usually) Better

DATAVERSITY

From its widespread formal business practice to the scope of casual popular awareness, “Big Data” has a tendency to live up to its name. Featured in countless headlines, journal articles, and industry reviews, Big Data metrics and methods such as NoSQL and Hadoop have taken up plenty of the spotlight as of late. However, most of what has been written about these topics is focused on the hardware, services, and scale-out involved with them, a misguided focus that ignores the critical questions driving any shift in corporate strategy: what can Big Data do for you? Which approach to it best fits your organization? And perhaps most importantly, what is required on your end in order to spur a successful implementation process? In the interest of answering these and other questions, this webinar will: Provide guidance on how to think about and establish realistic Big Data management plans and expectations for generating business value, as well as on the means by which big data can complement existing data management practices Introduce a framework for evaluating the various choices when it comes to implementing and succeeding with Big Data/NoSQL Elaborate upon the prototyping nature of practicing Big Data techniques Show how to demonstrate a sample use ca

Apache Spark GraphX & GraphFrame Synthetic ID Fraud Use Case

Mo Patel

Designing AI for Humanity at dmi:Design Leadership Conference in Boston

Carol Smith

As design leaders we must enable our teams with skills and knowledge to take on the new and exciting opportunities that building powerful AI systems bring. Dynamic systems require transparency regarding data provenance, bias, training methods, and more, to gain user’s trust. Carol will cover these topics and challenge us as design leaders, to represent our fellow humans by provoking conversations regarding critical ethical and safety needs. Presented at dmi:Design Leadership Conference in Boston in October 2018.

From Virtual Reality to Blockchain: Current and Emerging Tech Trends

Bohyun Kim

Broad Data (India 2015)

James Hendler

Open problems big_data_19_feb_2015_ver_0.1

Vijay Srinivas Agneeswaran, Ph.D

This deck covers some of the open problems in the big data analytics space, starting with a discussion of state-of-art analytics using Spark/Hadoop YARN. It details out whether each of these are appropriate technologies and explores alternatives wherever possible. It ends with an important problem discussion - how to build a single system to handle big data pipelines without explicit data transfers.

Do More with Less: Semantic Technologies

Colin Bell

Smart Content = Smart Business

Seth Grimes

Göteborg university(condensed)

Zenodia Charpy

Data Science Demystified

Emily Robinson

Similar to State of RecSys: Recap of RecSys 2012 (20)

Making friends with big data resource links

Digital Curation for Excel (DCXL)

Fixing data science & Accelerating Artificial Super Intelligence Development

Jonathan hendler deri - galway - feb 25 2008

QCon São Paulo: Real-Time Analytics with Spark Streaming

Data Science in 2016: Moving Up

Data Science in 2016: Moving up by Paco Nathan at Big Data Spain 2015

Understanding Products Driven by Machine Learning and AI: A Data Scientist's ...

Practical Machine Ethics @ SXSW2019

Smart Data Webinar: Advances in Natural Language Processing II - NL Generation

Implementing Big Data, NoSQL, & Hadoop - Bigger Is (Usually) Better

Apache Spark GraphX & GraphFrame Synthetic ID Fraud Use Case

Designing AI for Humanity at dmi:Design Leadership Conference in Boston

From Virtual Reality to Blockchain: Current and Emerging Tech Trends

Broad Data (India 2015)

Open problems big_data_19_feb_2015_ver_0.1

Do More with Less: Semantic Technologies

Smart Content = Smart Business

Göteborg university(condensed)

Data Science Demystified

More from Alan Said

Replication of Recommender Systems Research

RecSysChallenge Opening

Best Practices in Recommender System Challenges

Recommender System Challenges such as the Netflix Prize, KDD Cup, etc. have contributed vastly to the development and adoptability of recommender systems. Each year a number of challenges or contests are organized covering different aspects of recommendation. In this tutorial and panel, we present some of the factors involved in successfully organizing a challenge, whether for reasons purely related to research, industrial challenges, or to widen the scope of recommender systems applications.

Estimating the Magic Barrier of Recommender Systems: A User Study

Recommender systems are commonly evaluated by trying to predict known, withheld, ratings for a set of users. Measures such as the Root-Mean-Square Error are used to estimate the quality of the recommender algorithms. This process does however not acknowledge the inherent rating inconsistencies of users. In this paper we present the first results from a noise measurement user study for estimating the magic barrier of recommender systems conducted on a commercial movie recommendation community. The magic barrier is the expected squared error of the optimal recommendation algorithm, or, the lowest error we can expect from any recommendation algorithm. Our results show that the barrier can be estimated by collecting the opinions of users on already rated items.

Users and Noise: The Magic Barrier of Recommender Systems

Recommender systems are crucial components of most commercial websites to keep users satisfied and to increase revenue. Thus, a lot of effort is made to improve recommendation accuracy. But when is the best possible performance of the recommender reached? The magic barrier, refers to some unknown level of prediction accuracy a recommender system can attain. The magic barrier reveals whether there is still room for improving prediction accuracy or indicates that further improvement is meaningless. In this work, we present a mathematical characterization of the magic barrier based on the assumption that user ratings are afflicted with inconsistencies - noise. In a case study with a commercial movie recommender, we investigate the inconsistencies of the user ratings and estimate the magic barrier in order to assess the actual quality of the recommender system.

Analyzing Weighting Schemes in Collaborative Filtering: Cold Start, Post Cold...

CaRR 2012 Opening Presentation

Personalizing Tags: A Folksonomy-like Approach for Recommending Movies

Inferring Contextual User Proﬁles - Improving Recommender Performance

Using Social- and Pseudo-Social Networks to Improve Recommendation Quality

Recommender Systems