SlideShare a Scribd company logo
Web Science & Technologies
                          University of Koblenz ▪ Landau, Germany




  Predicting Directed Links using
Nondiagonal Matrix Decompositions
           Jérôme Kunegis & Jörg Fliege


           Int. Conf. on Data Mining 2012
Trust Prediction




                                                        ?




                    Goal: predict trusted edges

           Jérôme Kunegis & Jörg Fliege   Predicting Directed Links using Nondiagonal Matrix Decompositions
           kunegis@uni-koblenz.de         ICDM 2012                                               2
Triangle Closing




                                                ?




           Jérôme Kunegis & Jörg Fliege   Predicting Directed Links using Nondiagonal Matrix Decompositions
           kunegis@uni-koblenz.de         ICDM 2012                                               3
Powers of the Adjacency Matrix

         1                     2


 3                                          4


         5                 6                                          0     1     1     0     1     1
                                                                      0     0     0     1     0     0
                                                                      0     0     0     0     1     1
     (A²)14 = 2                                      A=               0     0     1     0     0     1
                                                                      1     0     0     0     0     0
     (A³)14 = 1                                                       0     0     0     1     0     0

             Jérôme Kunegis & Jörg Fliege       Predicting Directed Links using Nondiagonal Matrix Decompositions
             kunegis@uni-koblenz.de             ICDM 2012                                               4
Computing Ak When A is Symmetric


 Eigenvalue decomposition:                                                  A=UΛU                        T




 Ak = (U Λ UT) (U Λ UT) . . . (U Λ UT)
                                         k   T
                      =UΛ U


                                    Problem: A is asymmetric


          Jérôme Kunegis & Jörg Fliege           Predicting Directed Links using Nondiagonal Matrix Decompositions
          kunegis@uni-koblenz.de                 ICDM 2012                                               5
Asymmetric Eigenvalue Decomposition


When A is diagonalizable:                                          A=UΛU                        −1




  Problem:
   A is not
diagonalizable                                                            Advogato




          Jérôme Kunegis & Jörg Fliege   Predicting Directed Links using Nondiagonal Matrix Decompositions
          kunegis@uni-koblenz.de         ICDM 2012                                               6
Singular Value Decomposition

                                                                                                         T
                                                                             A=UΛV

                                 k            T
                      UΣ V
                 T                        T                             T
   =UΣV VΣU ...UΣV
                                 T
               =AA ...A
                                                                    Problem: This does not
                                                                           equal Ak


           Jérôme Kunegis & Jörg Fliege           Predicting Directed Links using Nondiagonal Matrix Decompositions
           kunegis@uni-koblenz.de                 ICDM 2012                                               7
DEDICOM


                                                                                            T
 Solution:                                               A=UXU


 “DEDICOM – Decomposition into Directed Components”



   X=                                                             Not diagonal

                 Advogato
          Jérôme Kunegis & Jörg Fliege   Predicting Directed Links using Nondiagonal Matrix Decompositions
          kunegis@uni-koblenz.de         ICDM 2012                                               8
Computation of Ak with DEDICOM




      A =UX Uk                                                k                       T


                               k
                         A is easy to compute



          Jérôme Kunegis & Jörg Fliege   Predicting Directed Links using Nondiagonal Matrix Decompositions
          kunegis@uni-koblenz.de         ICDM 2012                                               9
Finding a DEDICOM



   Singular value decomposition:



                                                  T
                    A = U(Σ V U ) U                                  T




                                     Problem: Not computed to full rank


          Jérôme Kunegis & Jörg Fliege    Predicting Directed Links using Nondiagonal Matrix Decompositions
          kunegis@uni-koblenz.de          ICDM 2012                                               10
DEDICOM Algorithms

                                Using singular value decomposition A = U Σ VT



LEFT        A = U (Σ VT U) UT
RIGHT       A = V (VT U Σ) VT
CLO         A = Q X QT
                U Σ UT + V Σ VT = Q Λ QT (eigenvalue decomp.)
                X = QT A Q
ITER        Iterative algorithm



(Harshman 1978)                          (Kliers et al. 1990)
         Jérôme Kunegis & Jörg Fliege     Predicting Directed Links using Nondiagonal Matrix Decompositions
         kunegis@uni-koblenz.de           ICDM 2012                                               11
Approximation of eA = I + A + ½A² + ⅙A³ + . . .

         Approximating A                                               Approximating eA




      Advogato trust
                                                                   Advogato trust




                                                                DEDICOM algorithms


                  Jérôme Kunegis & Jörg Fliege   Predicting Directed Links using Nondiagonal Matrix Decompositions
                  kunegis@uni-koblenz.de         ICDM 2012                                               12
Jérôme Kunegis
kunegis@uni-koblenz.de

Jörg Fliege
j.fliege@soton.ac.uk




                         Thank You

 konect.uni-koblenz.de
References



    Predicting directed links using nondiagonal matrix decompositions
    Jérôme Kunegis & Jörg Fliege
    Int. Conf. on Data Mining, 2012

    Models for analysis of asymmetrical relationships among n objects or stimuli
    Richard A. Harshman
    Contributions to economic analysis 187, 185–204, 1990

    A generalization of Takane's algorithm for DEDICOM
    Henk A. Kliers, Jos M. ten Berge, Yoshio Takane & Jan de Leeuw
    Psychometrika 55(1), 151–158, 1990




              Jérôme Kunegis & Jörg Fliege   Predicting Directed Links using Nondiagonal Matrix Decompositions
              kunegis@uni-koblenz.de         ICDM 2012                                               14

More Related Content

More from Jérôme KUNEGIS

Generating Networks with Arbitrary Properties
Generating Networks with Arbitrary PropertiesGenerating Networks with Arbitrary Properties
Generating Networks with Arbitrary PropertiesJérôme KUNEGIS
 
Karriere Lounge – INFORMATIK 2013
Karriere Lounge – INFORMATIK 2013Karriere Lounge – INFORMATIK 2013
Karriere Lounge – INFORMATIK 2013
Jérôme KUNEGIS
 
Eight Formalisms for Defining Graph Models
Eight Formalisms for Defining Graph ModelsEight Formalisms for Defining Graph Models
Eight Formalisms for Defining Graph Models
Jérôme KUNEGIS
 
What Is the Added Value of Negative Links in Online Social Networks?
What Is the Added Value of Negative Links in Online Social Networks?What Is the Added Value of Negative Links in Online Social Networks?
What Is the Added Value of Negative Links in Online Social Networks?
Jérôme KUNEGIS
 
KONECT – The Koblenz Network Collection
KONECT – The Koblenz Network CollectionKONECT – The Koblenz Network Collection
KONECT – The Koblenz Network Collection
Jérôme KUNEGIS
 
Preferential Attachment in Online Networks: Measurement and Explanations
Preferential Attachment in Online Networks:  Measurement and ExplanationsPreferential Attachment in Online Networks:  Measurement and Explanations
Preferential Attachment in Online Networks: Measurement and Explanations
Jérôme KUNEGIS
 
Online Dating Recommender Systems: The Split-complex Number Approach
Online Dating Recommender Systems: The Split-complex Number ApproachOnline Dating Recommender Systems: The Split-complex Number Approach
Online Dating Recommender Systems: The Split-complex Number Approach
Jérôme KUNEGIS
 
Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures
Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other MeasuresWhy Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures
Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other MeasuresJérôme KUNEGIS
 
Fairness on the Web: Alternatives to the Power Law (WebSci 2012)
Fairness on the Web:  Alternatives to the Power Law (WebSci 2012)Fairness on the Web:  Alternatives to the Power Law (WebSci 2012)
Fairness on the Web: Alternatives to the Power Law (WebSci 2012)Jérôme KUNEGIS
 
Fairness on the Web: Alternatives to the Power Law
Fairness on the Web:  Alternatives to the Power LawFairness on the Web:  Alternatives to the Power Law
Fairness on the Web: Alternatives to the Power Law
Jérôme KUNEGIS
 
KONECT Cloud – Large Scale Network Mining in the Cloud
KONECT Cloud – Large Scale Network Mining in the CloudKONECT Cloud – Large Scale Network Mining in the Cloud
KONECT Cloud – Large Scale Network Mining in the Cloud
Jérôme KUNEGIS
 
On the Spectral Evolution of Large Networks (PhD Thesis by Jérôme Kunegis)
On the Spectral Evolution of Large Networks (PhD Thesis by Jérôme Kunegis)On the Spectral Evolution of Large Networks (PhD Thesis by Jérôme Kunegis)
On the Spectral Evolution of Large Networks (PhD Thesis by Jérôme Kunegis)
Jérôme KUNEGIS
 
Searching Microblogs: Coping with Sparsity and Document Quality
Searching Microblogs: Coping with Sparsity and Document QualitySearching Microblogs: Coping with Sparsity and Document Quality
Searching Microblogs: Coping with Sparsity and Document QualityJérôme KUNEGIS
 
Bad News Travel Fast: A Content-based Analysis of Interestingness on Twitter
Bad News Travel Fast: A Content-based Analysis of Interestingness on TwitterBad News Travel Fast: A Content-based Analysis of Interestingness on Twitter
Bad News Travel Fast: A Content-based Analysis of Interestingness on Twitter
Jérôme KUNEGIS
 
On the Scalability of Graph Kernels Applied to Collaborative Recommenders
On the Scalability of Graph Kernels Applied to Collaborative RecommendersOn the Scalability of Graph Kernels Applied to Collaborative Recommenders
On the Scalability of Graph Kernels Applied to Collaborative Recommenders
Jérôme KUNEGIS
 
Learning Spectral Graph Transformations for Link Prediction
Learning Spectral Graph Transformations for Link PredictionLearning Spectral Graph Transformations for Link Prediction
Learning Spectral Graph Transformations for Link Prediction
Jérôme KUNEGIS
 
The Slashdot Zoo: Mining a Social Network with Negative Edges
The Slashdot Zoo:  Mining a Social Network with Negative EdgesThe Slashdot Zoo:  Mining a Social Network with Negative Edges
The Slashdot Zoo: Mining a Social Network with Negative Edges
Jérôme KUNEGIS
 
Spectral Analysis of Signed Graphs for Clustering, Prediction and Visualization
Spectral Analysis of Signed Graphs for Clustering, Prediction and VisualizationSpectral Analysis of Signed Graphs for Clustering, Prediction and Visualization
Spectral Analysis of Signed Graphs for Clustering, Prediction and Visualization
Jérôme KUNEGIS
 
Network Growth and the Spectral Evolution Model
Network Growth and the Spectral Evolution ModelNetwork Growth and the Spectral Evolution Model
Network Growth and the Spectral Evolution Model
Jérôme KUNEGIS
 

More from Jérôme KUNEGIS (19)

Generating Networks with Arbitrary Properties
Generating Networks with Arbitrary PropertiesGenerating Networks with Arbitrary Properties
Generating Networks with Arbitrary Properties
 
Karriere Lounge – INFORMATIK 2013
Karriere Lounge – INFORMATIK 2013Karriere Lounge – INFORMATIK 2013
Karriere Lounge – INFORMATIK 2013
 
Eight Formalisms for Defining Graph Models
Eight Formalisms for Defining Graph ModelsEight Formalisms for Defining Graph Models
Eight Formalisms for Defining Graph Models
 
What Is the Added Value of Negative Links in Online Social Networks?
What Is the Added Value of Negative Links in Online Social Networks?What Is the Added Value of Negative Links in Online Social Networks?
What Is the Added Value of Negative Links in Online Social Networks?
 
KONECT – The Koblenz Network Collection
KONECT – The Koblenz Network CollectionKONECT – The Koblenz Network Collection
KONECT – The Koblenz Network Collection
 
Preferential Attachment in Online Networks: Measurement and Explanations
Preferential Attachment in Online Networks:  Measurement and ExplanationsPreferential Attachment in Online Networks:  Measurement and Explanations
Preferential Attachment in Online Networks: Measurement and Explanations
 
Online Dating Recommender Systems: The Split-complex Number Approach
Online Dating Recommender Systems: The Split-complex Number ApproachOnline Dating Recommender Systems: The Split-complex Number Approach
Online Dating Recommender Systems: The Split-complex Number Approach
 
Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures
Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other MeasuresWhy Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures
Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures
 
Fairness on the Web: Alternatives to the Power Law (WebSci 2012)
Fairness on the Web:  Alternatives to the Power Law (WebSci 2012)Fairness on the Web:  Alternatives to the Power Law (WebSci 2012)
Fairness on the Web: Alternatives to the Power Law (WebSci 2012)
 
Fairness on the Web: Alternatives to the Power Law
Fairness on the Web:  Alternatives to the Power LawFairness on the Web:  Alternatives to the Power Law
Fairness on the Web: Alternatives to the Power Law
 
KONECT Cloud – Large Scale Network Mining in the Cloud
KONECT Cloud – Large Scale Network Mining in the CloudKONECT Cloud – Large Scale Network Mining in the Cloud
KONECT Cloud – Large Scale Network Mining in the Cloud
 
On the Spectral Evolution of Large Networks (PhD Thesis by Jérôme Kunegis)
On the Spectral Evolution of Large Networks (PhD Thesis by Jérôme Kunegis)On the Spectral Evolution of Large Networks (PhD Thesis by Jérôme Kunegis)
On the Spectral Evolution of Large Networks (PhD Thesis by Jérôme Kunegis)
 
Searching Microblogs: Coping with Sparsity and Document Quality
Searching Microblogs: Coping with Sparsity and Document QualitySearching Microblogs: Coping with Sparsity and Document Quality
Searching Microblogs: Coping with Sparsity and Document Quality
 
Bad News Travel Fast: A Content-based Analysis of Interestingness on Twitter
Bad News Travel Fast: A Content-based Analysis of Interestingness on TwitterBad News Travel Fast: A Content-based Analysis of Interestingness on Twitter
Bad News Travel Fast: A Content-based Analysis of Interestingness on Twitter
 
On the Scalability of Graph Kernels Applied to Collaborative Recommenders
On the Scalability of Graph Kernels Applied to Collaborative RecommendersOn the Scalability of Graph Kernels Applied to Collaborative Recommenders
On the Scalability of Graph Kernels Applied to Collaborative Recommenders
 
Learning Spectral Graph Transformations for Link Prediction
Learning Spectral Graph Transformations for Link PredictionLearning Spectral Graph Transformations for Link Prediction
Learning Spectral Graph Transformations for Link Prediction
 
The Slashdot Zoo: Mining a Social Network with Negative Edges
The Slashdot Zoo:  Mining a Social Network with Negative EdgesThe Slashdot Zoo:  Mining a Social Network with Negative Edges
The Slashdot Zoo: Mining a Social Network with Negative Edges
 
Spectral Analysis of Signed Graphs for Clustering, Prediction and Visualization
Spectral Analysis of Signed Graphs for Clustering, Prediction and VisualizationSpectral Analysis of Signed Graphs for Clustering, Prediction and Visualization
Spectral Analysis of Signed Graphs for Clustering, Prediction and Visualization
 
Network Growth and the Spectral Evolution Model
Network Growth and the Spectral Evolution ModelNetwork Growth and the Spectral Evolution Model
Network Growth and the Spectral Evolution Model
 

Recently uploaded

2024-deutsche-bank-global-consumer-conference.pdf
2024-deutsche-bank-global-consumer-conference.pdf2024-deutsche-bank-global-consumer-conference.pdf
2024-deutsche-bank-global-consumer-conference.pdf
Sysco_Investors
 
Osisko Gold Royalties Ltd - Corporate Presentation, June 2024
Osisko Gold Royalties Ltd - Corporate Presentation, June 2024Osisko Gold Royalties Ltd - Corporate Presentation, June 2024
Osisko Gold Royalties Ltd - Corporate Presentation, June 2024
Osisko Gold Royalties Ltd
 
Collective Mining | Corporate Presentation - June 2024
Collective Mining | Corporate Presentation - June 2024Collective Mining | Corporate Presentation - June 2024
Collective Mining | Corporate Presentation - June 2024
CollectiveMining1
 
一比一原版(UW毕业证)华盛顿大学毕业证成绩单专业办理
一比一原版(UW毕业证)华盛顿大学毕业证成绩单专业办理一比一原版(UW毕业证)华盛顿大学毕业证成绩单专业办理
一比一原版(UW毕业证)华盛顿大学毕业证成绩单专业办理
ybout
 
Corporate Presentation Probe June 2024.pdf
Corporate Presentation Probe June 2024.pdfCorporate Presentation Probe June 2024.pdf
Corporate Presentation Probe June 2024.pdf
Probe Gold
 
Snam 2023-27 Industrial Plan - Financial Presentation
Snam 2023-27 Industrial Plan - Financial PresentationSnam 2023-27 Industrial Plan - Financial Presentation
Snam 2023-27 Industrial Plan - Financial Presentation
Valentina Ottini
 
Osisko Development - Investor Presentation - June 24
Osisko Development - Investor Presentation - June 24Osisko Development - Investor Presentation - June 24
Osisko Development - Investor Presentation - June 24
Philip Rabenok
 

Recently uploaded (7)

2024-deutsche-bank-global-consumer-conference.pdf
2024-deutsche-bank-global-consumer-conference.pdf2024-deutsche-bank-global-consumer-conference.pdf
2024-deutsche-bank-global-consumer-conference.pdf
 
Osisko Gold Royalties Ltd - Corporate Presentation, June 2024
Osisko Gold Royalties Ltd - Corporate Presentation, June 2024Osisko Gold Royalties Ltd - Corporate Presentation, June 2024
Osisko Gold Royalties Ltd - Corporate Presentation, June 2024
 
Collective Mining | Corporate Presentation - June 2024
Collective Mining | Corporate Presentation - June 2024Collective Mining | Corporate Presentation - June 2024
Collective Mining | Corporate Presentation - June 2024
 
一比一原版(UW毕业证)华盛顿大学毕业证成绩单专业办理
一比一原版(UW毕业证)华盛顿大学毕业证成绩单专业办理一比一原版(UW毕业证)华盛顿大学毕业证成绩单专业办理
一比一原版(UW毕业证)华盛顿大学毕业证成绩单专业办理
 
Corporate Presentation Probe June 2024.pdf
Corporate Presentation Probe June 2024.pdfCorporate Presentation Probe June 2024.pdf
Corporate Presentation Probe June 2024.pdf
 
Snam 2023-27 Industrial Plan - Financial Presentation
Snam 2023-27 Industrial Plan - Financial PresentationSnam 2023-27 Industrial Plan - Financial Presentation
Snam 2023-27 Industrial Plan - Financial Presentation
 
Osisko Development - Investor Presentation - June 24
Osisko Development - Investor Presentation - June 24Osisko Development - Investor Presentation - June 24
Osisko Development - Investor Presentation - June 24
 

Predicting Directed Links using Nondiagonal Matrix Decompositions

  • 1. Web Science & Technologies University of Koblenz ▪ Landau, Germany Predicting Directed Links using Nondiagonal Matrix Decompositions Jérôme Kunegis & Jörg Fliege Int. Conf. on Data Mining 2012
  • 2. Trust Prediction ? Goal: predict trusted edges Jérôme Kunegis & Jörg Fliege Predicting Directed Links using Nondiagonal Matrix Decompositions kunegis@uni-koblenz.de ICDM 2012 2
  • 3. Triangle Closing ? Jérôme Kunegis & Jörg Fliege Predicting Directed Links using Nondiagonal Matrix Decompositions kunegis@uni-koblenz.de ICDM 2012 3
  • 4. Powers of the Adjacency Matrix 1 2 3 4 5 6 0 1 1 0 1 1 0 0 0 1 0 0 0 0 0 0 1 1 (A²)14 = 2 A= 0 0 1 0 0 1 1 0 0 0 0 0 (A³)14 = 1 0 0 0 1 0 0 Jérôme Kunegis & Jörg Fliege Predicting Directed Links using Nondiagonal Matrix Decompositions kunegis@uni-koblenz.de ICDM 2012 4
  • 5. Computing Ak When A is Symmetric Eigenvalue decomposition: A=UΛU T Ak = (U Λ UT) (U Λ UT) . . . (U Λ UT) k T =UΛ U Problem: A is asymmetric Jérôme Kunegis & Jörg Fliege Predicting Directed Links using Nondiagonal Matrix Decompositions kunegis@uni-koblenz.de ICDM 2012 5
  • 6. Asymmetric Eigenvalue Decomposition When A is diagonalizable: A=UΛU −1 Problem: A is not diagonalizable Advogato Jérôme Kunegis & Jörg Fliege Predicting Directed Links using Nondiagonal Matrix Decompositions kunegis@uni-koblenz.de ICDM 2012 6
  • 7. Singular Value Decomposition T A=UΛV k T UΣ V T T T =UΣV VΣU ...UΣV T =AA ...A Problem: This does not equal Ak Jérôme Kunegis & Jörg Fliege Predicting Directed Links using Nondiagonal Matrix Decompositions kunegis@uni-koblenz.de ICDM 2012 7
  • 8. DEDICOM T Solution: A=UXU “DEDICOM – Decomposition into Directed Components” X= Not diagonal Advogato Jérôme Kunegis & Jörg Fliege Predicting Directed Links using Nondiagonal Matrix Decompositions kunegis@uni-koblenz.de ICDM 2012 8
  • 9. Computation of Ak with DEDICOM A =UX Uk k T k A is easy to compute Jérôme Kunegis & Jörg Fliege Predicting Directed Links using Nondiagonal Matrix Decompositions kunegis@uni-koblenz.de ICDM 2012 9
  • 10. Finding a DEDICOM Singular value decomposition: T A = U(Σ V U ) U T Problem: Not computed to full rank Jérôme Kunegis & Jörg Fliege Predicting Directed Links using Nondiagonal Matrix Decompositions kunegis@uni-koblenz.de ICDM 2012 10
  • 11. DEDICOM Algorithms Using singular value decomposition A = U Σ VT LEFT A = U (Σ VT U) UT RIGHT A = V (VT U Σ) VT CLO A = Q X QT U Σ UT + V Σ VT = Q Λ QT (eigenvalue decomp.) X = QT A Q ITER Iterative algorithm (Harshman 1978) (Kliers et al. 1990) Jérôme Kunegis & Jörg Fliege Predicting Directed Links using Nondiagonal Matrix Decompositions kunegis@uni-koblenz.de ICDM 2012 11
  • 12. Approximation of eA = I + A + ½A² + ⅙A³ + . . . Approximating A Approximating eA Advogato trust Advogato trust DEDICOM algorithms Jérôme Kunegis & Jörg Fliege Predicting Directed Links using Nondiagonal Matrix Decompositions kunegis@uni-koblenz.de ICDM 2012 12
  • 14. References Predicting directed links using nondiagonal matrix decompositions Jérôme Kunegis & Jörg Fliege Int. Conf. on Data Mining, 2012 Models for analysis of asymmetrical relationships among n objects or stimuli Richard A. Harshman Contributions to economic analysis 187, 185–204, 1990 A generalization of Takane's algorithm for DEDICOM Henk A. Kliers, Jos M. ten Berge, Yoshio Takane & Jan de Leeuw Psychometrika 55(1), 151–158, 1990 Jérôme Kunegis & Jörg Fliege Predicting Directed Links using Nondiagonal Matrix Decompositions kunegis@uni-koblenz.de ICDM 2012 14