Luiz Gomes-JrInstitute of ComputingUnicampquerying and managing complex dataThesis proposalSupervisor: André SantanchèMarc...
Overview• Motivation• Complex Networks• Objective• Complex Data Management System• Targeted Spreading Activation• Query la...
70s 2010s2000s80s 90sDataComplexity/ComputingPower
70s 2010s2000s80s 90sData/ModelComplexityRelational DataRelational ModelSemi-strutured DataXMLUnstrutured DataText Documen...
Arvind Dorai Lily White...Andy CurtisBryanne MGrant Simm...Danny Gues...Mohsen Sha...Laura MartíPatrick Kl...Hossein Fa......
70s 2010s2000s80s 90sQyeryModelComplexitySQLRDBMSXQuery/XPathXML DBsKeyword queriesSearch enginesSPARQLGraph DBs
70s 2010s2000s80s 90sQyeryModelComplexitySQLRDBMSXQuery/XPathXML DBsKeyword queriesSearch enginesSPARQLGraph DBsselections...
Complex NetworksArvind Dorai Lily White...Andy CurtisBryanne MGrant Simm...Danny Gues...Mohsen Sha...Laura MartíPatrick Kl...
Arvind Dorai Lily White...Andy CurtisBryanne MGrant Simm...Danny Gues...Mohsen Sha...Laura MartíPatrick Kl...Hossein Fa......
Complex Networks
70s 2010s2000s80s 90sQyeryModelComplexitySQLRDBMSXQuery/XPathXML DBsKeyword queriesSearch enginesSPARQLGraph DBsrelationsh...
70s 2010s2000s80s 90sQyeryModelComplexitySQLRDBMSXQuery/XPathXML DBsKeyword queriesSearch enginesSPARQLGraph DBsObjective:...
• retrieve candidate diagnosis relevant to a given patientbased on her symptoms and correlations with othersimilar patient...
• retrieve candidate diagnosis relevant to a given patientbased on her symptoms and correlations with othersimilar patient...
• The data model must support a high level ofcomplexity• The query language should be flexible enough toallow correlation ...
Complex Data Management SystemCDMSinGraphData
Complex Data Management SystemCDMSinGraphDatathe query language allows correlation ofdata based on combinations of topolog...
Complex Data Management SystemCDMSinGraphDatathe query language allows correlation ofdata based on combinations of topolog...
START diag=node(*) WHERE has(diag.Type) and diag.Type = "Diagnose" RETURN diagRANK BY2 RELEVANCE OF diag TO node( %p ) WEI...
START diag=node(*) WHERE has(diag.Type) and diag.Type = "Diagnose" RETURN diagRANK BY2 RELEVANCE OF diag TO node( %p ) WEI...
aSELECT DISTINCT ?productWHERE { ?product :type :Product .FILTER NOT EXISTS (:bob :purchased ?product) }RANK BY RELEVANCE ...
Complex Data Management SystemCDMSinGraphDatathe new spreading activation modelcan express several flexible metrics
Targeted Spreading Activation
• it can derive correlations among any two sets ofinitial nodes and destination nodes• the final value of the correlations...
Complex Data Management SystemCDMSinGraphDatathe declarative query combined with theprocessing model allows newmechanisms ...
Rank-preservingoptimizations• Retracing TSA• Caching TSA• TSA transformations• Parallelization and distribution
2 3 4 50123456baselinerTSAcTSAtuning of cnormalizedexecutiontime
Query approximation• TSA parameter tuning• Restricting traversal edges and direction• Shortest Paths TSA• Random Walker-ba...
Complex Data Management SystemCDMSinGraphDatamappers facilitate relationshipmanipulations and increase query flexibility
mappers
mappers
mappers
Red. interact. with peopleRep. painInab. restore energy even after sleepFatigueAlter. ability continue prev. activit.Alter...
Xphone wasreleased today . . .ComparingXY.inc products . . .Xphone vs
Yphone features . . .YphoneXY IncXphonefeaturesProje...
SELECT DISTINCT ?movie WHERE{?movie a movie:film .?movie movie:initial_release_date ?date .FILTER ( fn:substring(?date, 1,...
Related Work
expressivequeryingDB+IRkw queryingover relationaltop-kinformationextraction
expressivequeryingDB+IRkw queryingover relationaltop-kinformationextractionknowledgebasescontext relatednessRodrigues et a...
expressivequeryingDB+IRkw queryingover relationaltop-kinformationextractionknowledgebasescontext relatednessRodrigues et a...
expressivequeryingDB+IRkw queryingover relationaltop-kinformationextractionknowledgebasescontext relatednessRodrigues et a...
• Towards query model integration: topology-aware, IR-inspiredmetrics for declarative graph querying (GraphQ-EDBT 2013)• T...
Challenges• Validate model• Assess performance boundaries• Maintain data statistics• Expand optimization mechanisms
Conclusion• AFAWK this is the first time Complex Networks are beinganalyzed in a databases perspective; the first time the...
AcknowledgmentsThis work was partially financed by CAPES, the Microsoft Research FAPESPVirtual Institute (NavScales projec...
Querying and Managing Complex Networks - Thesis Proposal
Querying and Managing Complex Networks - Thesis Proposal
Querying and Managing Complex Networks - Thesis Proposal
Querying and Managing Complex Networks - Thesis Proposal
Querying and Managing Complex Networks - Thesis Proposal
Upcoming SlideShare
Loading in …5
×

Querying and Managing Complex Networks - Thesis Proposal

546 views
481 views

Published on

Slides for my PhD thesis proposal - March 2013

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
546
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Querying and Managing Complex Networks - Thesis Proposal

  1. 1. Luiz Gomes-JrInstitute of ComputingUnicampquerying and managing complex dataThesis proposalSupervisor: André SantanchèMarch 2013
  2. 2. Overview• Motivation• Complex Networks• Objective• Complex Data Management System• Targeted Spreading Activation• Query language• Query optimization• Mappers• Related work• Conclusion
  3. 3. 70s 2010s2000s80s 90sDataComplexity/ComputingPower
  4. 4. 70s 2010s2000s80s 90sData/ModelComplexityRelational DataRelational ModelSemi-strutured DataXMLUnstrutured DataText DocumentsNetworksGraphs
  5. 5. Arvind Dorai Lily White...Andy CurtisBryanne MGrant Simm...Danny Gues...Mohsen Sha...Laura MartíPatrick Kl...Hossein Fa...Remi Bierm... Byron MarksNabeel Far...Leon De Kl...Michael Ar...Chris KalmanMelanie Mc...Olivier Ng...Pablo Pilo...Jon RiggPeyman Afs...Rebecca Jo...Daniel Gui...Waleed HwyUmar Faroo...Evandro Ba...Eduardo El...Stuart Mel...Arthur Cas...Nathan ChowPaulo Henr...Amin Kamal...Serhan Reb...Diogenes V...Jan Mateu ...Sanderson ...Robin Chri...Joanne Kruk Eric SethnaMarcus Bar...Jurandy So...Daiana SilvaWesley Mes...Mehdi VafaeiGlauber Ca...Alessandro...Leonardo S...Ahmed Atau...Flavio CuntoSaiedeh Sa...Andre NaimeRodrigo Ia...Andrew Kane Babak Ebra...Camilo JacobDerya Demi...Juliana Ba...Juliana Ga...Paulo Lojk...Guilherme ...Johnnatan ...Yann JamesIrene Pivo...Natalie RiosRodrigo Ma...Jeff PoundWalmir Amo...Javier Mon...Alan TaitzAnsis Rosm...Aaditeshwa...Tim Schnei...Eduin MuñozKayo YoshidaBill FragaYelda TurkanCrístian D...Ivan Rodol...Marcio Mat...Julio Césa...Anna-Lina ...Rafael Lot...Leandro Za...Fabien Ben...Marcilio M...Cesar G. C...Tony HuynhFernando M...Keivan Ahm...Peter NelsonCristina M...Steve McFa...Daniel De ...Roohen S. ...Leonardo R...Sabrina de...Shahin Kam...Pia BrunettiAlex Breda...Heike Isem...Diandra Pi...Vitor E. S...Samad Baza...Maria Lore...Mohammad R...Renato Sil...Sonia Waha...Dorothy Fu...Nielsen Ca...Juliana Za...Tim BenkeBernardo V...Shahab Kam...Sara PeyrouxXavier PérezVahid FallahCarlos Edu...Saman MhPourya Sha...Fernanda A...Christophe...Nima RezaeiNádia PkRicardo Da...Michal SkibaTyler EvansFabio DiasAmanda Pe ...Marcel SteinJiewen WuDiego De F...João RicardoFlorencia ...Iury PortoAndréa Pit...Lucas Ferr...Juliana Em...Angel Pont...Diorgenes ...Holger LinkeElio Brune...Alexander ...Paulo CasadoElisangela...Erica Band...Fernanda T...Gilbia Por...Evelyn ChrisElisabete ...Evandro Du...Danilo Lac...Ricardo Pa...Andre CostaJavier Req...Thiago Tho...Xerxes Zam...Laura Mart...Gabriela Ü...Roberta GrafIvo KogaAlessandra...Andreas Br...Fabiola Bu...Daniele Co...Paula KrügerBruno Silv...Veronica M...Fernando S...Felicia Bo...Suzana Mar...Bruno Lenh...Mariella B...Rodrigo Di...Benjamin L...Carolina B...Júlia Farr...Fabricia B...José Augus...Juliana Fr...Júllia Ted...Vítor Bacc...Rafael LopesRodrigo Vi...Erika Mend...Roberto Bi...Gabriel Sa...Gustavo Ja...Renato Tra...Luiz CláudioClaudia St...Mariana Pe...Kristina H...Moises Alm...Dânia NaomiLukas Posn...Luca Diniz...Rafael Art...Daniel LinuxDanilo Mor...Thiago Ton...Wilson Tal...Vanessa St...Luiz Ferna...Caro Recal...Monika Gro...Marilia Br...Yudai Naka...Laura Man...Denise Tel...Roney Celi...Luana Rebo...Helen SimanCleber Val...Cristiano ...Jociel And...Renato Fil...Bruno VilarIvana BorgesRefugio Co...João Sávio...Taísa SantosAfsaneh Na...Wilian Flá...Nelson Rel...Lidia Gald...Marcio Jul...Eric Haine...Lucas C Fr...Facundo Pe...Andre FiorotViviane Al...André Alme...Fernanda B...Adriana Le...Nelio Pinh...Arthur Gás...Eduardo Za...Edson BurgoJoana Mala...Susanne Fr...Evie NegroFelipe Car...Hugo RafachoJosmenio F...Alex MenegãoSaray ChuHumberto S...Rodrigo Sa...Artur GroverIsabella P...Edu PedroNaoki ArimaLeonardo M...Raquel SimanIvelize Ro...Vitor LécioMarcelo El...Victor Dam...Caio Salom...Mari Maroc...Lívia AizawaDiogo RebitXuu ZhangDaniel Lap...Rafael Seco Natassia F...Arthur Cyp...Edi AgrellosIeda ManfreGilberto P...Fabrício A...Peruzzo Fo...Du SandriniCiana Quei...Silvana Li...Lucas MelloAlexandre ...Halysson A...Sandro SouzaAriel VargasAna SimanHugo de So...Nes-k Flow...Redi Sique...Sheila Mor...Douglas Es...Eduardo Ca...Bruno AbreuRenata Rav...Joyce Luca...Telma SantosMarcio GomesDanilo San...Oswaldo Ba...Tiago SantosScheila Fa...Robledo Se...Julia SimanCynthia Ra...Pedro Mosc...Ingrid NunesRenato Cés...Vitor A. F...Leandro Fr...Thiago Kar...Tiago Bita...Isabella S...Joy Gazzon...Gabriel Ca...Fábio FabreEwerton Si...Neeylson M...Vanessa Du...Cláudio Ca...Edson BorinRoberta Si...Randerson ...Hatun Mach...Ricardo To...Josilene S...Sérgio Fre...Ulisses Fu...Luciola Go...Joatane So...Vivian Alv...Matheus MotaRafael Rez...Jociel Per...Thiago GodoiRalph Dard...Elisa CostaRafael Piu...Ádria BentesLuciano An...Hilário Se...Dijalma Fa...Patricia C...Josmercio ...Luiza Mart...Mogai TiMarcelo Pr...Hudson ZaninAce EsTiago Amar...Gabriel Va...Emilio Bed...Oscar Esga...Tatiane Pi...Jeane Alme...Dulcinea P...André Sant...Fabiano RuyVictor Mar...Daniel RoccoThiago Ras...Felipe SertãDaniel Cug...Renato Bes...Paulo Bern...Felipe AlvesCarlos Ale...Laryssa Fl...Ronaldo Lo...Cristian S...Fecatep ESMateuzin F...Nina FragaLukinha Ro...Jefersson ...Braian Car...Rita JuliatoBruno Card...Miguel Di ...Frederico ...Vetinha Fr...Helder DiasNeumar Mal...Fabiano Si...Josmenio F...Pedra VivaJeidi SimanNetwork Data
  6. 6. 70s 2010s2000s80s 90sQyeryModelComplexitySQLRDBMSXQuery/XPathXML DBsKeyword queriesSearch enginesSPARQLGraph DBs
  7. 7. 70s 2010s2000s80s 90sQyeryModelComplexitySQLRDBMSXQuery/XPathXML DBsKeyword queriesSearch enginesSPARQLGraph DBsselections, projections,aggregationspath patterns,unknown nodesrelevance,reputation???
  8. 8. Complex NetworksArvind Dorai Lily White...Andy CurtisBryanne MGrant Simm...Danny Gues...Mohsen Sha...Laura MartíPatrick Kl...Hossein Fa...Remi Bierm... Byron MarksNabeel Far...Leon De Kl...Michael Ar...Chris KalmanMelanie Mc...Olivier Ng...Pablo Pilo...Jon RiggPeyman Afs...Rebecca Jo...Daniel Gui...Waleed HwyUmar Faroo...Evandro Ba...Eduardo El...Stuart Mel...Arthur Cas...Nathan ChowPaulo Henr...Amin Kamal...Serhan Reb...Diogenes V...Jan Mateu ...Sanderson ...Robin Chri...Joanne Kruk Eric SethnaMarcus Bar...Jurandy So...Daiana SilvaWesley Mes...Mehdi VafaeiGlauber Ca...Alessandro...Leonardo S...Ahmed Atau...Flavio CuntoSaiedeh Sa...Andre NaimeRodrigo Ia...Andrew Kane Babak Ebra...Camilo JacobDerya Demi...Juliana Ba...Juliana Ga...Paulo Lojk...Guilherme ...Johnnatan ...Yann JamesIrene Pivo...Natalie RiosRodrigo Ma...Jeff PoundWalmir Amo...Javier Mon...Alan TaitzAnsis Rosm...Aaditeshwa...Tim Schnei...Eduin MuñozKayo YoshidaBill FragaYelda TurkanCrístian D...Ivan Rodol...Marcio Mat...Julio Césa...Anna-Lina ...Rafael Lot...Leandro Za...Fabien Ben...Marcilio M...Cesar G. C...Tony HuynhFernando M...Keivan Ahm...Peter NelsonCristina M...Steve McFa...Daniel De ...Roohen S. ...Leonardo R...Sabrina de...Shahin Kam...Pia BrunettiAlex Breda...Heike Isem...Diandra Pi...Vitor E. S...Samad Baza...Maria Lore...Mohammad R...Renato Sil...Sonia Waha...Dorothy Fu...Nielsen Ca...Juliana Za...Tim BenkeBernardo V...Shahab Kam...Sara PeyrouxXavier PérezVahid FallahCarlos Edu...Saman MhPourya Sha...Fernanda A...Christophe...Nima RezaeiNádia PkRicardo Da...Michal SkibaTyler EvansFabio DiasAmanda Pe ...Marcel SteinJiewen WuDiego De F...João RicardoFlorencia ...Iury PortoAndréa Pit...Lucas Ferr...Juliana Em...Angel Pont...Diorgenes ...Holger LinkeElio Brune...Alexander ...Paulo CasadoElisangela...Erica Band...Fernanda T...Gilbia Por...Evelyn ChrisElisabete ...Evandro Du...Danilo Lac...Ricardo Pa...Andre CostaJavier Req...Thiago Tho...Xerxes Zam...Laura Mart...Gabriela Ü...Roberta GrafIvo KogaAlessandra...Andreas Br...Fabiola Bu...Daniele Co...Paula KrügerBruno Silv...Veronica M...Fernando S...Felicia Bo...Suzana Mar...Bruno Lenh...Mariella B...Rodrigo Di...Benjamin L...Carolina B...Júlia Farr...Fabricia B...José Augus...Juliana Fr...Júllia Ted...Vítor Bacc...Rafael LopesRodrigo Vi...Erika Mend...Roberto Bi...Gabriel Sa...Gustavo Ja...Renato Tra...Luiz CláudioClaudia St...Mariana Pe...Kristina H...Moises Alm...Dânia NaomiLukas Posn...Luca Diniz...Rafael Art...Daniel LinuxDanilo Mor...Thiago Ton...Wilson Tal...Vanessa St...Luiz Ferna...Caro Recal...Monika Gro...Marilia Br...Yudai Naka...Laura Man...Denise Tel...Roney Celi...Luana Rebo...Helen SimanCleber Val...Cristiano ...Jociel And...Renato Fil...Bruno VilarIvana BorgesRefugio Co...João Sávio...Taísa SantosAfsaneh Na...Wilian Flá...Nelson Rel...Lidia Gald...Marcio Jul...Eric Haine...Lucas C Fr...Facundo Pe...Andre FiorotViviane Al...André Alme...Fernanda B...Adriana Le...Nelio Pinh...Arthur Gás...Eduardo Za...Edson BurgoJoana Mala...Susanne Fr...Evie NegroFelipe Car...Hugo RafachoJosmenio F...Alex MenegãoSaray ChuHumberto S...Rodrigo Sa...Artur GroverIsabella P...Edu PedroNaoki ArimaLeonardo M...Raquel SimanIvelize Ro...Vitor LécioMarcelo El...Victor Dam...Caio Salom...Mari Maroc...Lívia AizawaDiogo RebitXuu ZhangDaniel Lap...Rafael Seco Natassia F...Arthur Cyp...Edi AgrellosIeda ManfreGilberto P...Fabrício A...Peruzzo Fo...Du SandriniCiana Quei...Silvana Li...Lucas MelloAlexandre ...Halysson A...Sandro SouzaAriel VargasAna SimanHugo de So...Nes-k Flow...Redi Sique...Sheila Mor...Douglas Es...Eduardo Ca...Bruno AbreuRenata Rav...Joyce Luca...Telma SantosMarcio GomesDanilo San...Oswaldo Ba...Tiago SantosScheila Fa...Robledo Se...Julia SimanCynthia Ra...Pedro Mosc...Ingrid NunesRenato Cés...Vitor A. F...Leandro Fr...Thiago Kar...Tiago Bita...Isabella S...Joy Gazzon...Gabriel Ca...Fábio FabreEwerton Si...Neeylson M...Vanessa Du...Cláudio Ca...Edson BorinRoberta Si...Randerson ...Hatun Mach...Ricardo To...Josilene S...Sérgio Fre...Ulisses Fu...Luciola Go...Joatane So...Vivian Alv...Matheus MotaRafael Rez...Jociel Per...Thiago GodoiRalph Dard...Elisa CostaRafael Piu...Ádria BentesLuciano An...Hilário Se...Dijalma Fa...Patricia C...Josmercio ...Luiza Mart...Mogai TiMarcelo Pr...Hudson ZaninAce EsTiago Amar...Gabriel Va...Emilio Bed...Oscar Esga...Tatiane Pi...Jeane Alme...Dulcinea P...André Sant...Fabiano RuyVictor Mar...Daniel RoccoThiago Ras...Felipe SertãDaniel Cug...Renato Bes...Paulo Bern...Felipe AlvesCarlos Ale...Laryssa Fl...Ronaldo Lo...Cristian S...Fecatep ESMateuzin F...Nina FragaLukinha Ro...Jefersson ...Braian Car...Rita JuliatoBruno Card...Miguel Di ...Frederico ...Vetinha Fr...Helder DiasNeumar Mal...Fabiano Si...Josmenio F...Pedra VivaJeidi Siman
  9. 9. Arvind Dorai Lily White...Andy CurtisBryanne MGrant Simm...Danny Gues...Mohsen Sha...Laura MartíPatrick Kl...Hossein Fa...Remi Bierm... Byron MarksNabeel Far...Leon De Kl...Michael Ar...Chris KalmanMelanie Mc...Olivier Ng...Pablo Pilo...Jon RiggPeyman Afs...Rebecca Jo...Daniel Gui...Waleed HwyUmar Faroo...Evandro Ba...Eduardo El...Stuart Mel...Arthur Cas...Nathan ChowPaulo Henr...Amin Kamal...Serhan Reb...Diogenes V...Jan Mateu ...Sanderson ...Robin Chri...Joanne Kruk Eric SethnaMarcus Bar...Jurandy So...Daiana SilvaWesley Mes...Mehdi VafaeiGlauber Ca...Alessandro...Leonardo S...Ahmed Atau...Flavio CuntoSaiedeh Sa...Andre NaimeRodrigo Ia...Andrew Kane Babak Ebra...Camilo JacobDerya Demi...Juliana Ba...Juliana Ga...Paulo Lojk...Guilherme ...Johnnatan ...Yann JamesIrene Pivo...Natalie RiosRodrigo Ma...Jeff PoundWalmir Amo...Javier Mon...Alan TaitzAnsis Rosm...Aaditeshwa...Tim Schnei...Eduin MuñozKayo YoshidaBill FragaYelda TurkanCrístian D...Ivan Rodol...Marcio Mat...Julio Césa...Anna-Lina ...Rafael Lot...Leandro Za...Fabien Ben...Marcilio M...Cesar G. C...Tony HuynhFernando M...Keivan Ahm...Peter NelsonCristina M...Steve McFa...Daniel De ...Roohen S. ...Leonardo R...Sabrina de...Shahin Kam...Pia BrunettiAlex Breda...Heike Isem...Diandra Pi...Vitor E. S...Samad Baza...Maria Lore...Mohammad R...Renato Sil...Sonia Waha...Dorothy Fu...Nielsen Ca...Juliana Za...Tim BenkeBernardo V...Shahab Kam...Sara PeyrouxXavier PérezVahid FallahCarlos Edu...Saman MhPourya Sha...Fernanda A...Christophe...Nima RezaeiNádia PkRicardo Da...Michal SkibaTyler EvansFabio DiasAmanda Pe ...Marcel SteinJiewen WuDiego De F...João RicardoFlorencia ...Iury PortoAndréa Pit...Lucas Ferr...Juliana Em...Angel Pont...Diorgenes ...Holger LinkeElio Brune...Alexander ...Paulo CasadoElisangela...Erica Band...Fernanda T...Gilbia Por...Evelyn ChrisElisabete ...Evandro Du...Danilo Lac...Ricardo Pa...Andre CostaJavier Req...Thiago Tho...Xerxes Zam...Laura Mart...Gabriela Ü...Roberta GrafIvo KogaAlessandra...Andreas Br...Fabiola Bu...Daniele Co...Paula KrügerBruno Silv...Veronica M...Fernando S...Felicia Bo...Suzana Mar...Bruno Lenh...Mariella B...Rodrigo Di...Benjamin L...Carolina B...Júlia Farr...Fabricia B...José Augus...Juliana Fr...Júllia Ted...Vítor Bacc...Rafael LopesRodrigo Vi...Erika Mend...Roberto Bi...Gabriel Sa...Gustavo Ja...Renato Tra...Luiz CláudioClaudia St...Mariana Pe...Kristina H...Moises Alm...Dânia NaomiLukas Posn...Luca Diniz...Rafael Art...Daniel LinuxDanilo Mor...Thiago Ton...Wilson Tal...Vanessa St...Luiz Ferna...Caro Recal...Monika Gro...Marilia Br...Yudai Naka...Laura Man...Denise Tel...Roney Celi...Luana Rebo...Helen SimanCleber Val...Cristiano ...Jociel And...Renato Fil...Bruno VilarIvana BorgesRefugio Co...João Sávio...Taísa SantosAfsaneh Na...Wilian Flá...Nelson Rel...Lidia Gald...Marcio Jul...Eric Haine...Lucas C Fr...Facundo Pe...Andre FiorotViviane Al...André Alme...Fernanda B...Adriana Le...Nelio Pinh...Arthur Gás...Eduardo Za...Edson BurgoJoana Mala...Susanne Fr...Evie NegroFelipe Car...Hugo RafachoJosmenio F...Alex MenegãoSaray ChuHumberto S...Rodrigo Sa...Artur GroverIsabella P...Edu PedroNaoki ArimaLeonardo M...Raquel SimanIvelize Ro...Vitor LécioMarcelo El...Victor Dam...Caio Salom...Mari Maroc...Lívia AizawaDiogo RebitXuu ZhangDaniel Lap...Rafael Seco Natassia F...Arthur Cyp...Edi AgrellosIeda ManfreGilberto P...Fabrício A...Peruzzo Fo...Du SandriniCiana Quei...Silvana Li...Lucas MelloAlexandre ...Halysson A...Sandro SouzaAriel VargasAna SimanHugo de So...Nes-k Flow...Redi Sique...Sheila Mor...Douglas Es...Eduardo Ca...Bruno AbreuRenata Rav...Joyce Luca...Telma SantosMarcio GomesDanilo San...Oswaldo Ba...Tiago SantosScheila Fa...Robledo Se...Julia SimanCynthia Ra...Pedro Mosc...Ingrid NunesRenato Cés...Vitor A. F...Leandro Fr...Thiago Kar...Tiago Bita...Isabella S...Joy Gazzon...Gabriel Ca...Fábio FabreEwerton Si...Neeylson M...Vanessa Du...Cláudio Ca...Edson BorinRoberta Si...Randerson ...Hatun Mach...Ricardo To...Josilene S...Sérgio Fre...Ulisses Fu...Luciola Go...Joatane So...Vivian Alv...Matheus MotaRafael Rez...Jociel Per...Thiago GodoiRalph Dard...Elisa CostaRafael Piu...Ádria BentesLuciano An...Hilário Se...Dijalma Fa...Patricia C...Josmercio ...Luiza Mart...Mogai TiMarcelo Pr...Hudson ZaninAce EsTiago Amar...Gabriel Va...Emilio Bed...Oscar Esga...Tatiane Pi...Jeane Alme...Dulcinea P...André Sant...Fabiano RuyVictor Mar...Daniel RoccoThiago Ras...Felipe SertãDaniel Cug...Renato Bes...Paulo Bern...Felipe AlvesCarlos Ale...Laryssa Fl...Ronaldo Lo...Cristian S...Fecatep ESMateuzin F...Nina FragaLukinha Ro...Jefersson ...Braian Car...Rita JuliatoBruno Card...Miguel Di ...Frederico ...Vetinha Fr...Helder DiasNeumar Mal...Fabiano Si...Josmenio F...Pedra VivaJeidi SimanUniv. WaterlooBrazilians in WaterlooUnicampUfes
  10. 10. Complex Networks
  11. 11. 70s 2010s2000s80s 90sQyeryModelComplexitySQLRDBMSXQuery/XPathXML DBsKeyword queriesSearch enginesSPARQLGraph DBsrelationshipanalysis, emergenttopologicalproperties
  12. 12. 70s 2010s2000s80s 90sQyeryModelComplexitySQLRDBMSXQuery/XPathXML DBsKeyword queriesSearch enginesSPARQLGraph DBsObjective: propose query andmanagement mechanisms forcomplex data.
  13. 13. • retrieve candidate diagnosis relevant to a given patientbased on her symptoms and correlations with othersimilar patients;• retrieve documents related to the keyword query "USelections" and the topic politics, written by democratjournalists, ranked by relevance to the keyword queryand reputation of the author;• retrieve streets in a given city based on their relevance(specificity) to retail stores of sports goods andconvenience of route in respect to my current location;• retrieve fish species that play an important (influential)role in the marine food web of a given region and thatare related to the biome coral reef.
  14. 14. • retrieve candidate diagnosis relevant to a given patientbased on her symptoms and correlations with othersimilar patients;• retrieve documents related to the keyword query "USelections" and the topic politics, written by democratjournalists, ranked by relevance to the keyword queryand reputation of the author;• retrieve streets in a given city based on their relevance(specificity) to retail stores of sports goods andconvenience of route in respect to my current location;• retrieve fish species that play an important (influential)role in the marine food web of a given region and thatare related to the biome coral reef.
  15. 15. • The data model must support a high level ofcomplexity• The query language should be flexible enough toallow correlation of data when little is known abouthow they are linked and organized• New abstractions for query evaluation should fullysupport the query language while allowing for under-the-hood optimizations.• The data management mechanisms must becoherent with the heightened importance anddiversity of relationships.
  16. 16. Complex Data Management SystemCDMSinGraphData
  17. 17. Complex Data Management SystemCDMSinGraphDatathe query language allows correlation ofdata based on combinations of topology-aware metricsthe new spreading activation modelcan express several flexible metricsthe declarative query combined with theprocessing model allows newmechanisms for query optimizationmappers facilitate relationshipmanipulations and increase query flexibility
  18. 18. Complex Data Management SystemCDMSinGraphDatathe query language allows correlation ofdata based on combinations of topology-aware metrics
  19. 19. START diag=node(*) WHERE has(diag.Type) and diag.Type = "Diagnose" RETURN diagRANK BY2 RELEVANCE OF diag TO node( %p ) WEIGHTED,1 CONNECTIVITY OF diag TO node( %p ) WEIGHTED
  20. 20. START diag=node(*) WHERE has(diag.Type) and diag.Type = "Diagnose" RETURN diagRANK BY2 RELEVANCE OF diag TO node( %p ) WEIGHTED,1 CONNECTIVITY OF diag TO node( %p ) WEIGHTEDCombination ofranking metrics StructuredPredicates
  21. 21. aSELECT DISTINCT ?productWHERE { ?product :type :Product .FILTER NOT EXISTS (:bob :purchased ?product) }RANK BY RELEVANCE OF ?product TO :bobFOLLOW (:friendsWith, :purchased)DEPTH 3 DIRECTION BOTHSELECT ?speciesWHERE { ?species :type :MarineSpecies }RANK BY3 INFLUENCE OF ?species FOLLOW :preysOn DIRECTION OUTBOUND,1 RELEVANCE OF ?species TO :CoralReefBiomecdbSELECT DISTINCT ?actor WHERE {?film movie:director director:8501 .?film movie:actor ?actor .?film movie:initial_release_date ?date .FILTER ( fn:starts-with(?date, "199") ) }RANK BY RELEVANCE OF ?actor TO director:8501START diag=node(*) WHERE has(diag.Type) and diag.Type = "Diagnose" RETURN diagRANK BY1 RELEVANCE OF diag TO node($patient) ,2 CONNECTIVITY OF diag TO node($patient)
  22. 22. Complex Data Management SystemCDMSinGraphDatathe new spreading activation modelcan express several flexible metrics
  23. 23. Targeted Spreading Activation
  24. 24. • it can derive correlations among any two sets ofinitial nodes and destination nodes• the final value of the correlations decreases asthe length of the contributing paths grows• the degradation of the potential imposesboundaries to query processing• it can be implemented as graph traversalpatterns• it is simple
  25. 25. Complex Data Management SystemCDMSinGraphDatathe declarative query combined with theprocessing model allows newmechanisms for query optimization
  26. 26. Rank-preservingoptimizations• Retracing TSA• Caching TSA• TSA transformations• Parallelization and distribution
  27. 27. 2 3 4 50123456baselinerTSAcTSAtuning of cnormalizedexecutiontime
  28. 28. Query approximation• TSA parameter tuning• Restricting traversal edges and direction• Shortest Paths TSA• Random Walker-based Sampling TSA
  29. 29. Complex Data Management SystemCDMSinGraphDatamappers facilitate relationshipmanipulations and increase query flexibility
  30. 30. mappers
  31. 31. mappers
  32. 32. mappers
  33. 33. Red. interact. with peopleRep. painInab. restore energy even after sleepFatigueAlter. ability continue prev. activit.Alterat. depth breathingLoss weight with adeq. food intakeAge 65 or overExtrem. ageChang. skin turgorImp. ability walk requir. distancesDecreas. lower extremity strengthPerceiv. limit. imposed by diseaseRep. inab. reach toilet in time avoid urine lossInab. delay defecationDiarrheaEvaluat. self unable deal sit./event.Dysf. eat. patt.Verb. dif. with prescribed regimensVerb. rep. fatigue/weaknessExertional discomfortExertional dyspneaSedent. activity levelImbal. nutrit. st.Weight 20% over ideal for height/frameMoistureImp. sensationRed. sensationChang. pigmentationInab. wash bodySeeks to be aloneDrowsyTachypneaDyspneaSleep disturb.Facial tensionInsomnia FatigueApprehensiveAnorexiaDif. gaitInab. dry bodyMak. choices inef. meet. health goalsEat. resp. internal cuesLack time meet person. needsUncert. regarding chang. relations. with care receiv.Slowed movementLimit. range motionDif. turningVerb. exp. having no controlExp. dissatisf. over inab. perform prev. activ.AngerMaternal-child interact. def.Failure to thriveFreq. accidentsDiscomf. in social sit.Chang. sleep patt.Chang. patt.Chang. availab. for affect. responsiv.Chang. satisfaction with familyInad. primary defensesTrauma
  34. 34. Xphone wasreleased today . . .ComparingXY.inc products . . .Xphone vs
Yphone features . . .YphoneXY IncXphonefeaturesProjectEmployeeAliceBob“Xphone features”document indexingentitykeywordquerytable record intermediatenode
  35. 35. SELECT DISTINCT ?movie WHERE{?movie a movie:film .?movie movie:initial_release_date ?date .FILTER ( fn:substring(?date, 1, 4) > "1990" ) .FILTER EXISTS { ?movie foaf:page ?page }}RANKED BY 2 RELEVANCE OF ?movie TO TokenMapper("My favorite films are Matrix and Avatar") DEPTH 2 FOLLOW TokenMapper:hasToken,1 RELEVANCE OF ?movie TO movie:film_subject/461 DEPTH 5 FOLLOW skos:subject
  36. 36. Related Work
  37. 37. expressivequeryingDB+IRkw queryingover relationaltop-kinformationextraction
  38. 38. expressivequeryingDB+IRkw queryingover relationaltop-kinformationextractionknowledgebasescontext relatednessRodrigues et al. Kasneci et al.
  39. 39. expressivequeryingDB+IRkw queryingover relationaltop-kinformationextractionknowledgebasescontext relatednessRodrigues et al. Kasneci et al.networkanalysisgraph-basedmetricsrelevanceimportanceWhite & Smyth
  40. 40. expressivequeryingDB+IRkw queryingover relationaltop-kinformationextractionknowledgebasescontext relatednessRodrigues et al. Kasneci et al.networkanalysisgraph-basedmetricsrelevanceimportanceWhite & Smythquerying complex networks
  41. 41. • Towards query model integration: topology-aware, IR-inspiredmetrics for declarative graph querying (GraphQ-EDBT 2013)• The Web Within: leveraging Web standards and graphanalysis to enable application-level integration of institutional• Graph-based DB/IR integration: flexible querying and•Querying complex data (submitted to SIGKDD 2013)data (submitted to ICWE 2013)management for heterogeneous data models (submitted toJCDL 2013)•Attributing fuzzy values to nursing diagnoses and theirelements: the specialists’ opinion (International Journal ofNursing Knowledge)
  42. 42. Challenges• Validate model• Assess performance boundaries• Maintain data statistics• Expand optimization mechanisms
  43. 43. Conclusion• AFAWK this is the first time Complex Networks are beinganalyzed in a databases perspective; the first time thecorrelation metrics are encoded in the same framework• Combining the TSA model and a declarative querylanguage offers many opportunities for query optimization• The proposed query model covers a wide range ofapplications• Many implications for architectures, query optimization,data management
  44. 44. AcknowledgmentsThis work was partially financed by CAPES, the Microsoft Research FAPESPVirtual Institute (NavScales project), CNPq (MuZOO Project and PRONEX-FAPESP), INCT in Web Science (CNPq 557.128/2009-9)

×