SlideShare a Scribd company logo
1 of 1
Download to read offline
ECWAY TECHNOLOGIES
IEEE PROJECTS & SOFTWARE DEVELOPMENTS
OUR OFFICES @ CHENNAI / TRICHY / KARUR / ERODE / MADURAI / SALEM / COIMBATORE
CELL: +91 98949 17187, +91 875487 2111 / 3111 / 4111 / 5111 / 6111
VISIT: www.ecwayprojects.com MAIL TO: ecwaytechnologies@gmail.com

A GRAPH-BASED CONSENSUS MAXIMIZATION APPROACH FOR COMBINING
MULTIPLE SUPERVISED AND UNSUPERVISED MODELS

ABSTRACT:
Ensemble learning has emerged as a powerful method for combining multiple models. Wellknown methods, such as bagging, boosting, and model averaging, have been shown to improve
accuracy and robustness over single models. However, due to the high costs of manual labeling,
it is hard to obtain sufficient and reliable labeled data for effective training. Meanwhile, lots of
unlabeled data exist in these sources, and we can readily obtain multiple unsupervised models.
Although unsupervised models do not directly generate a class label prediction for each object,
they provide useful constraints on the joint predictions for a set of related objects. Therefore,
incorporating these unsupervised models into the ensemble of supervised models can lead to
better prediction performance.
In this paper, we study ensemble learning with outputs from multiple supervised and
unsupervised models, a topic where little work has been done. We propose to consolidate a
classification solution by maximizing the consensus among both supervised predictions and
unsupervised constraints. We cast this ensemble task as an optimization problem on a bipartite
graph, where the objective function favors the smoothness of the predictions over the graph, but
penalizes the deviations from the initial labeling provided by the supervised models. We solve
this problem through iterative propagation of probability estimates among neighboring nodes and
prove the optimality of the solution. The proposed method can be interpreted as conducting a
constrained embedding in a transformed space, or a ranking on the graph. Experimental results
on different applications with heterogeneous data sources demonstrate the benefits of the
proposed method over existing alternatives.

More Related Content

What's hot (7)

Numerical methods and its applications
Numerical methods and its applicationsNumerical methods and its applications
Numerical methods and its applications
 
real life application in numerical method
real life application in numerical methodreal life application in numerical method
real life application in numerical method
 
Dadm (lys)
Dadm (lys)Dadm (lys)
Dadm (lys)
 
Meta Learning Shared Hierarchies
Meta Learning Shared HierarchiesMeta Learning Shared Hierarchies
Meta Learning Shared Hierarchies
 
Energy Behaviour and Smart Meters
Energy Behaviour and Smart MetersEnergy Behaviour and Smart Meters
Energy Behaviour and Smart Meters
 
Machine learning
Machine learningMachine learning
Machine learning
 
Poster systems
Poster systemsPoster systems
Poster systems
 

Viewers also liked

Identifying cost behavior classifications
Identifying cost behavior classificationsIdentifying cost behavior classifications
Identifying cost behavior classifications
azmatmengal
 
Dotnet on the real-time hardware implementation feasibility of joint radio r...
Dotnet  on the real-time hardware implementation feasibility of joint radio r...Dotnet  on the real-time hardware implementation feasibility of joint radio r...
Dotnet on the real-time hardware implementation feasibility of joint radio r...
Ecwaytech
 
como hacer un blog Alba Rodriguez
como hacer un blog Alba Rodriguezcomo hacer un blog Alba Rodriguez
como hacer un blog Alba Rodriguez
alba_rg_
 
Dotnet a rough-set-based incremental approach for updating approximations un...
Dotnet  a rough-set-based incremental approach for updating approximations un...Dotnet  a rough-set-based incremental approach for updating approximations un...
Dotnet a rough-set-based incremental approach for updating approximations un...
Ecwaytech
 
Debarquement en-normandie-1
Debarquement en-normandie-1Debarquement en-normandie-1
Debarquement en-normandie-1
Dominique Pongi
 
Dotnet a survey of xml tree patterns
Dotnet  a survey of xml tree patternsDotnet  a survey of xml tree patterns
Dotnet a survey of xml tree patterns
Ecwaytech
 
My friend is a real sportsmen
My friend is a real sportsmenMy friend is a real sportsmen
My friend is a real sportsmen
prosvsports
 
Publika Brasil Apresentação
Publika Brasil ApresentaçãoPublika Brasil Apresentação
Publika Brasil Apresentação
Adilso Souza Mmn
 
Dotnet a proxy-based approach to continuous location-based spatial queries i...
Dotnet  a proxy-based approach to continuous location-based spatial queries i...Dotnet  a proxy-based approach to continuous location-based spatial queries i...
Dotnet a proxy-based approach to continuous location-based spatial queries i...
Ecwaytech
 
Dotnet a generalized flow-based method for analysis of implicit relationship...
Dotnet  a generalized flow-based method for analysis of implicit relationship...Dotnet  a generalized flow-based method for analysis of implicit relationship...
Dotnet a generalized flow-based method for analysis of implicit relationship...
Ecwaytech
 
Dotnet a secure payment scheme with low communication and processing overhea...
Dotnet  a secure payment scheme with low communication and processing overhea...Dotnet  a secure payment scheme with low communication and processing overhea...
Dotnet a secure payment scheme with low communication and processing overhea...
Ecwaytech
 
The ultrasonic distance alarm system based on msp430 f449
The ultrasonic distance alarm system based on msp430 f449The ultrasonic distance alarm system based on msp430 f449
The ultrasonic distance alarm system based on msp430 f449
Ecwaytech
 
Dotnet a resource allocation scheme for scalable video multicast in wi max r...
Dotnet  a resource allocation scheme for scalable video multicast in wi max r...Dotnet  a resource allocation scheme for scalable video multicast in wi max r...
Dotnet a resource allocation scheme for scalable video multicast in wi max r...
Ecwaytech
 
Dotnet a scalable server architecture for mobile presence services in social...
Dotnet  a scalable server architecture for mobile presence services in social...Dotnet  a scalable server architecture for mobile presence services in social...
Dotnet a scalable server architecture for mobile presence services in social...
Ecwaytech
 

Viewers also liked (20)

Identifying cost behavior classifications
Identifying cost behavior classificationsIdentifying cost behavior classifications
Identifying cost behavior classifications
 
Dotnet on the real-time hardware implementation feasibility of joint radio r...
Dotnet  on the real-time hardware implementation feasibility of joint radio r...Dotnet  on the real-time hardware implementation feasibility of joint radio r...
Dotnet on the real-time hardware implementation feasibility of joint radio r...
 
como hacer un blog Alba Rodriguez
como hacer un blog Alba Rodriguezcomo hacer un blog Alba Rodriguez
como hacer un blog Alba Rodriguez
 
Dotnet a rough-set-based incremental approach for updating approximations un...
Dotnet  a rough-set-based incremental approach for updating approximations un...Dotnet  a rough-set-based incremental approach for updating approximations un...
Dotnet a rough-set-based incremental approach for updating approximations un...
 
TGIS 2013
TGIS 2013TGIS 2013
TGIS 2013
 
The Road To Takshashila
The Road To TakshashilaThe Road To Takshashila
The Road To Takshashila
 
Виды информационных процессов
Виды информационных процессовВиды информационных процессов
Виды информационных процессов
 
Debarquement en-normandie-1
Debarquement en-normandie-1Debarquement en-normandie-1
Debarquement en-normandie-1
 
Dotnet a survey of xml tree patterns
Dotnet  a survey of xml tree patternsDotnet  a survey of xml tree patterns
Dotnet a survey of xml tree patterns
 
Misthologikes kai syntaksiodotikes_rithmiseis_ekpaideytikin
Misthologikes kai syntaksiodotikes_rithmiseis_ekpaideytikinMisthologikes kai syntaksiodotikes_rithmiseis_ekpaideytikin
Misthologikes kai syntaksiodotikes_rithmiseis_ekpaideytikin
 
ugrmagbil
ugrmagbilugrmagbil
ugrmagbil
 
My friend is a real sportsmen
My friend is a real sportsmenMy friend is a real sportsmen
My friend is a real sportsmen
 
Publika Brasil Apresentação
Publika Brasil ApresentaçãoPublika Brasil Apresentação
Publika Brasil Apresentação
 
Clasificación fondos de inversión
Clasificación fondos de inversiónClasificación fondos de inversión
Clasificación fondos de inversión
 
Dotnet a proxy-based approach to continuous location-based spatial queries i...
Dotnet  a proxy-based approach to continuous location-based spatial queries i...Dotnet  a proxy-based approach to continuous location-based spatial queries i...
Dotnet a proxy-based approach to continuous location-based spatial queries i...
 
Dotnet a generalized flow-based method for analysis of implicit relationship...
Dotnet  a generalized flow-based method for analysis of implicit relationship...Dotnet  a generalized flow-based method for analysis of implicit relationship...
Dotnet a generalized flow-based method for analysis of implicit relationship...
 
Dotnet a secure payment scheme with low communication and processing overhea...
Dotnet  a secure payment scheme with low communication and processing overhea...Dotnet  a secure payment scheme with low communication and processing overhea...
Dotnet a secure payment scheme with low communication and processing overhea...
 
The ultrasonic distance alarm system based on msp430 f449
The ultrasonic distance alarm system based on msp430 f449The ultrasonic distance alarm system based on msp430 f449
The ultrasonic distance alarm system based on msp430 f449
 
Dotnet a resource allocation scheme for scalable video multicast in wi max r...
Dotnet  a resource allocation scheme for scalable video multicast in wi max r...Dotnet  a resource allocation scheme for scalable video multicast in wi max r...
Dotnet a resource allocation scheme for scalable video multicast in wi max r...
 
Dotnet a scalable server architecture for mobile presence services in social...
Dotnet  a scalable server architecture for mobile presence services in social...Dotnet  a scalable server architecture for mobile presence services in social...
Dotnet a scalable server architecture for mobile presence services in social...
 

Similar to Dotnet a graph-based consensus maximization approach for combining multiple supervised and unsupervised models

A graph based consensus maximization approach for combining multiple supervis...
A graph based consensus maximization approach for combining multiple supervis...A graph based consensus maximization approach for combining multiple supervis...
A graph based consensus maximization approach for combining multiple supervis...
ecway
 
Java a graph-based consensus maximization approach for combining multiple su...
Java  a graph-based consensus maximization approach for combining multiple su...Java  a graph-based consensus maximization approach for combining multiple su...
Java a graph-based consensus maximization approach for combining multiple su...
ecwayerode
 
An approach for improved students’ performance prediction using homogeneous ...
An approach for improved students’ performance prediction  using homogeneous ...An approach for improved students’ performance prediction  using homogeneous ...
An approach for improved students’ performance prediction using homogeneous ...
IJECEIAES
 
Strategies for energy efficient resource management of hybrid programming models
Strategies for energy efficient resource management of hybrid programming modelsStrategies for energy efficient resource management of hybrid programming models
Strategies for energy efficient resource management of hybrid programming models
Ecwayt
 
Dotnet strategies for energy-efficient resource management of hybrid program...
Dotnet  strategies for energy-efficient resource management of hybrid program...Dotnet  strategies for energy-efficient resource management of hybrid program...
Dotnet strategies for energy-efficient resource management of hybrid program...
Ecwaytech
 
AN IMPROVED METHOD FOR IDENTIFYING WELL-TEST INTERPRETATION MODEL BASED ON AG...
AN IMPROVED METHOD FOR IDENTIFYING WELL-TEST INTERPRETATION MODEL BASED ON AG...AN IMPROVED METHOD FOR IDENTIFYING WELL-TEST INTERPRETATION MODEL BASED ON AG...
AN IMPROVED METHOD FOR IDENTIFYING WELL-TEST INTERPRETATION MODEL BASED ON AG...
IAEME Publication
 
Maximum likelihood estimation from uncertain data in the belief function fram...
Maximum likelihood estimation from uncertain data in the belief function fram...Maximum likelihood estimation from uncertain data in the belief function fram...
Maximum likelihood estimation from uncertain data in the belief function fram...
ecwayprojects
 
Dotnet maximum likelihood estimation from uncertain data in the belief funct...
Dotnet  maximum likelihood estimation from uncertain data in the belief funct...Dotnet  maximum likelihood estimation from uncertain data in the belief funct...
Dotnet maximum likelihood estimation from uncertain data in the belief funct...
Ecwayt
 
Dotnet maximum likelihood estimation from uncertain data in the belief funct...
Dotnet  maximum likelihood estimation from uncertain data in the belief funct...Dotnet  maximum likelihood estimation from uncertain data in the belief funct...
Dotnet maximum likelihood estimation from uncertain data in the belief funct...
Ecwaytech
 
Clustering large probabilistic graphs
Clustering large probabilistic graphsClustering large probabilistic graphs
Clustering large probabilistic graphs
Ecway2004
 

Similar to Dotnet a graph-based consensus maximization approach for combining multiple supervised and unsupervised models (20)

A graph based consensus maximization approach for combining multiple supervis...
A graph based consensus maximization approach for combining multiple supervis...A graph based consensus maximization approach for combining multiple supervis...
A graph based consensus maximization approach for combining multiple supervis...
 
Java a graph-based consensus maximization approach for combining multiple su...
Java  a graph-based consensus maximization approach for combining multiple su...Java  a graph-based consensus maximization approach for combining multiple su...
Java a graph-based consensus maximization approach for combining multiple su...
 
An Ensemble Approach To Improve Homomorphic Encrypted Data Classification Per...
An Ensemble Approach To Improve Homomorphic Encrypted Data Classification Per...An Ensemble Approach To Improve Homomorphic Encrypted Data Classification Per...
An Ensemble Approach To Improve Homomorphic Encrypted Data Classification Per...
 
An approach for improved students’ performance prediction using homogeneous ...
An approach for improved students’ performance prediction  using homogeneous ...An approach for improved students’ performance prediction  using homogeneous ...
An approach for improved students’ performance prediction using homogeneous ...
 
IEEE Datamining 2016 Title and Abstract
IEEE  Datamining 2016 Title and AbstractIEEE  Datamining 2016 Title and Abstract
IEEE Datamining 2016 Title and Abstract
 
IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Multi label image categorization w...
IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Multi label image categorization w...IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Multi label image categorization w...
IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Multi label image categorization w...
 
Ieee transactions on 2018 knowledge and data engineering topics with abstract .
Ieee transactions on 2018 knowledge and data engineering topics with abstract .Ieee transactions on 2018 knowledge and data engineering topics with abstract .
Ieee transactions on 2018 knowledge and data engineering topics with abstract .
 
Strategies for energy efficient resource management of hybrid programming models
Strategies for energy efficient resource management of hybrid programming modelsStrategies for energy efficient resource management of hybrid programming models
Strategies for energy efficient resource management of hybrid programming models
 
Dotnet strategies for energy-efficient resource management of hybrid program...
Dotnet  strategies for energy-efficient resource management of hybrid program...Dotnet  strategies for energy-efficient resource management of hybrid program...
Dotnet strategies for energy-efficient resource management of hybrid program...
 
AN IMPROVED METHOD FOR IDENTIFYING WELL-TEST INTERPRETATION MODEL BASED ON AG...
AN IMPROVED METHOD FOR IDENTIFYING WELL-TEST INTERPRETATION MODEL BASED ON AG...AN IMPROVED METHOD FOR IDENTIFYING WELL-TEST INTERPRETATION MODEL BASED ON AG...
AN IMPROVED METHOD FOR IDENTIFYING WELL-TEST INTERPRETATION MODEL BASED ON AG...
 
Maximum likelihood estimation from uncertain data in the belief function fram...
Maximum likelihood estimation from uncertain data in the belief function fram...Maximum likelihood estimation from uncertain data in the belief function fram...
Maximum likelihood estimation from uncertain data in the belief function fram...
 
Dotnet maximum likelihood estimation from uncertain data in the belief funct...
Dotnet  maximum likelihood estimation from uncertain data in the belief funct...Dotnet  maximum likelihood estimation from uncertain data in the belief funct...
Dotnet maximum likelihood estimation from uncertain data in the belief funct...
 
Dotnet maximum likelihood estimation from uncertain data in the belief funct...
Dotnet  maximum likelihood estimation from uncertain data in the belief funct...Dotnet  maximum likelihood estimation from uncertain data in the belief funct...
Dotnet maximum likelihood estimation from uncertain data in the belief funct...
 
UNCERTAINTY ESTIMATION IN NEURAL NETWORKS THROUGH MULTI-TASK LEARNING
UNCERTAINTY ESTIMATION IN NEURAL NETWORKS THROUGH MULTI-TASK LEARNINGUNCERTAINTY ESTIMATION IN NEURAL NETWORKS THROUGH MULTI-TASK LEARNING
UNCERTAINTY ESTIMATION IN NEURAL NETWORKS THROUGH MULTI-TASK LEARNING
 
UNCERTAINTY ESTIMATION IN NEURAL NETWORKS THROUGH MULTI-TASK LEARNING
UNCERTAINTY ESTIMATION IN NEURAL NETWORKS THROUGH MULTI-TASK LEARNINGUNCERTAINTY ESTIMATION IN NEURAL NETWORKS THROUGH MULTI-TASK LEARNING
UNCERTAINTY ESTIMATION IN NEURAL NETWORKS THROUGH MULTI-TASK LEARNING
 
When deep learners change their mind learning dynamics for active learning
When deep learners change their mind  learning dynamics for active learningWhen deep learners change their mind  learning dynamics for active learning
When deep learners change their mind learning dynamics for active learning
 
IEEE Pattern analysis and machine intelligence 2016 Title and Abstract
IEEE Pattern analysis and machine intelligence 2016 Title and AbstractIEEE Pattern analysis and machine intelligence 2016 Title and Abstract
IEEE Pattern analysis and machine intelligence 2016 Title and Abstract
 
CAUSALITY LEARNING WITH WASSERSTEIN GENERATIVE ADVERSARIAL NETWORKS
CAUSALITY LEARNING WITH WASSERSTEIN GENERATIVE ADVERSARIAL NETWORKSCAUSALITY LEARNING WITH WASSERSTEIN GENERATIVE ADVERSARIAL NETWORKS
CAUSALITY LEARNING WITH WASSERSTEIN GENERATIVE ADVERSARIAL NETWORKS
 
CAUSALITY LEARNING WITH WASSERSTEIN GENERATIVE ADVERSARIAL NETWORKS
CAUSALITY LEARNING WITH WASSERSTEIN GENERATIVE ADVERSARIAL NETWORKSCAUSALITY LEARNING WITH WASSERSTEIN GENERATIVE ADVERSARIAL NETWORKS
CAUSALITY LEARNING WITH WASSERSTEIN GENERATIVE ADVERSARIAL NETWORKS
 
Clustering large probabilistic graphs
Clustering large probabilistic graphsClustering large probabilistic graphs
Clustering large probabilistic graphs
 

Dotnet a graph-based consensus maximization approach for combining multiple supervised and unsupervised models

  • 1. ECWAY TECHNOLOGIES IEEE PROJECTS & SOFTWARE DEVELOPMENTS OUR OFFICES @ CHENNAI / TRICHY / KARUR / ERODE / MADURAI / SALEM / COIMBATORE CELL: +91 98949 17187, +91 875487 2111 / 3111 / 4111 / 5111 / 6111 VISIT: www.ecwayprojects.com MAIL TO: ecwaytechnologies@gmail.com A GRAPH-BASED CONSENSUS MAXIMIZATION APPROACH FOR COMBINING MULTIPLE SUPERVISED AND UNSUPERVISED MODELS ABSTRACT: Ensemble learning has emerged as a powerful method for combining multiple models. Wellknown methods, such as bagging, boosting, and model averaging, have been shown to improve accuracy and robustness over single models. However, due to the high costs of manual labeling, it is hard to obtain sufficient and reliable labeled data for effective training. Meanwhile, lots of unlabeled data exist in these sources, and we can readily obtain multiple unsupervised models. Although unsupervised models do not directly generate a class label prediction for each object, they provide useful constraints on the joint predictions for a set of related objects. Therefore, incorporating these unsupervised models into the ensemble of supervised models can lead to better prediction performance. In this paper, we study ensemble learning with outputs from multiple supervised and unsupervised models, a topic where little work has been done. We propose to consolidate a classification solution by maximizing the consensus among both supervised predictions and unsupervised constraints. We cast this ensemble task as an optimization problem on a bipartite graph, where the objective function favors the smoothness of the predictions over the graph, but penalizes the deviations from the initial labeling provided by the supervised models. We solve this problem through iterative propagation of probability estimates among neighboring nodes and prove the optimality of the solution. The proposed method can be interpreted as conducting a constrained embedding in a transformed space, or a ranking on the graph. Experimental results on different applications with heterogeneous data sources demonstrate the benefits of the proposed method over existing alternatives.