Download to read offline
Uploaded byFrancisco Restivo
Archives, data structures and visualization.pdf
This document discusses archives, data structures, and visualization. It begins with an introduction to the speaker and some initial comments. It then covers various topics related to data science approaches like working with datasets, obtaining data, using tools, and challenges around data management and skills. The document also discusses basic concepts of data structures, databases, algorithms, and networks. It provides examples of social networks and metrics for analyzing networks.
More Related Content
Similar to Archives, data structures and visualization.pdf
![제 23회 보아즈(BOAZ) 빅데이터 컨퍼런스 - [MBOAX] : ABSA를 활용한 소비자 반응 분석 기반 운영 효율화 대시보드 설계](https://cdn.slidesharecdn.com/ss_thumbnails/3-1boaz23rdconferencemboax-260203102709-9d519923-thumbnail.jpg?width=640&height=640&fit=bounds)
Archives, data structures and visualization.pdf
- 1. Archives, data structuresand visualization Francisco Restivo frestivo@ucp.pt slideshare.net/frestivo favinks.com/board/FranciscoRestivo
- 2. Agradecimento • Agradeço o convitee a vossa presença • Gosto destes diálogos • Perguntem, interrompam, não deixem dúvidas persistir • O professor aprende sempre... 2 Escola das Artes 2022
- 3. Avisos prévios (1/2) • Aminha área é Informática, ou seja, Informação automática • No fundo, trata-se de ensinar máquinas a resolver problemas • Interessam-me problemas de Dados → Informação → Conhecimento • Vejam-me como um tradutor... 3 Escola das Artes 2022
- 4. Avisos prévios (2/2) • Umedifício informático escapa aos olhares de quase toda a gente • Há deficiências invisíveis • O cliente normalmente não tem competência para avaliar o produto... • Há muitos exemplos de soluções falhadas 4 Escola das Artes 2022
- 5. About me 5 Escola dasArtes 2022 Lic. EE (6 anos) D.Phil. Prof. Assoc. Director Prof. Assoc Signals DSP Multiprocessor systems Biomedical Systems Complex systems Manufacturing systems Multi-agent systems Social systems Networks Lic. EE (6 anos) D.Phil. Prof. Assoc. Director Prof. Assoc Lic. EE (6 anos) D.Phil. Prof. Assoc. Director Prof. Assoc. 1970
- 6. IBM PC 1981 6 Escoladas Artes 2022
- 7. Internet timeline 7 Escola dasArtes 2022
- 8. Where are we? • Theexplosion of Big Data • Networks everywhere • Social Networks • Technologies • Tools • Projects • Digitization 8 Escola das Artes 2022
- 9. 9 Escola das Artes2022 An Internet minute
- 10. And heritage! • Documents • Pictures, etc • Digitized? • Aquick tour 10 Escola das Artes 2022
- 11. A quick tour • Someprojects • Basic ideas • How does a 'data scientist' think? • Digital Humanities 11 Escola das Artes 2022
- 12. 12 Escola das Artes2022 slideshare.net/frestvo
- 13. 13 Escola das Artes2022 htp://www.martngrandjean.ch/
- 14.
- 15.
- 16.
- 17.
- 18. 18 Escola das Artes2022 htps://www.familysearch.org/
- 19.
- 20.
- 21.
- 22.
- 23. Challenges and opportunities • Existingdata and changing management • Data discovery, access and reuse • Digital skills • There is an enormous potential in the network approach 23 Escola das Artes 2022
- 24. Data science approach • Regularities • Correlations • Causality • Relations/networks/distances • Co-occurrences • Deeplearning, etc 24 Escola das Artes 2022
- 25. Escola das Artes2022 25 Questions?
- 26. The plan fortoday • A realistic plan – Part 1: some work hands on with real data – Part 2: very basic ideas on data structures and networks • Please feel free to question, interrupt, etc 26 Escola das Artes 2022
- 27. Part 1 27 Escola dasArtes 2022
- 28. Characters, Les Misérables 28 Escoladas Artes 2022
- 29.
- 30. Co-authors, in aDepartment 30 Escola das Artes 2022
- 31. Datasets Escola das Artes2022 31
- 32. Where to obtain? • Makeor get! • Usually, we know our subject • There are many sites you can visit – kaggle – data.world 32 Escola das Artes 2022
- 33. Escola das Artes2022 33 polsys.net
- 34. MARO musical universe 34 Escoladas Artes 2022
- 35. My FB, LostCircles 35 Escola das Artes 2022
- 36.
- 37.
- 38. Limits? • Property of data • Privacy • Business Escoladas Artes 2022 38
- 39. Tools Escola das Artes2022 39
- 40.
- 41.
- 42.
- 43.
- 44.
- 45. Escola das Artes2022 45
- 46. Escola das Artes2022 46
- 47. Escola das Artes2022 47
- 48.
- 49. Escola das Artes2022 49
- 50. Escola das Artes2022 50 Questions?
- 51. Part 2 51 Escola dasArtes 2022
- 52. Computer programs • Algorithms +Data Structures • Many programming language (your choice) • Programming is a communication task – Shared concepts – Well defined actions 52 Escola das Artes 2022
- 53. Data structures • Lists • Stacks • Queues • Linked lists • Trees • Graphs –Objects + attributes + relations 53 Escola das Artes 2022
- 54.
- 55. Graph database 55 Escola dasArtes 2022 htps://neo4j.com/
- 56. Algorithms • Sort • Search • Insert/delete • Data analysis, datamining, etc • Graph algorithms 56 Escola das Artes 2022
- 57. Networks • Social, biological, financial,etc • Complex networks • Communities • Contagion • Controversies • Society! 57 Escola das Artes 2022
- 58. Social interactions • Like, comment,share, cite • Dating • e-Commerce • Payments • Digital marketing • Political marketing • Crime 58 Escola das Artes 2022
- 59. Metaverse? • Virtual • Augmented • Fake • Holograms • New, or more ofthe same? 59 Escola das Artes 2022
- 60. SO?! Escola das Artes2022 60 • Let's have a look at networks and graphs
- 61. Euler 1707 -1783 Escola das Artes 2022 61
- 62. Actors and interactions • Networksare made of actors and interactions • Actors from one or more sets – People and movies, eg • Interactions of one or more types – Follow and retweet, eg • Actors and interactions may have other atributes Escola das Artes 2022 62
- 63. Basics of graphsand networks • G = (V, E) vertices and edges • O(G) = |V| order • S(G) = |E| size • A adjacency matrix • Ki degree of vertex i • Directed/undirected Escola das Artes 2022 63
- 64. ● Directed/undirected? ● Usually not transitive –a likes b and b likes c does not imply a likes c ● Directed > Order (total/partial) – Rankings, proeminence indexes, etc ● Undirected > Equivalence – Communities, clusters, etc Escola das Artes 2022 64 Network edges
- 65. Representations of networks • Matrixes,graphs, edge lists, etc A B A C A D B A B C B E C D D B D C E A E B Escola das Artes 2022 65 A B C D E A 0 1 1 1 0 B 1 0 1 0 1 C 0 0 0 1 0 D 0 1 1 0 0 E 1 1 0 0 0
- 66. Global metrics • Number ofvertices 5 • Number of edges 11 • Number of components 1 • Diameter 2 • Density 0.55 Escola das Artes 2022 66
- 67. Centrality Measures • Degree centrality –Edges per node • Closeness centrality – How close the node is to every other node • Betweenness centrality – How many shortest paths go through the node • Bibliometric + Internet style (quality of edges) – PageRank, eigenvector 67 Escola das Artes 2022
- 68. Which metrics? • Depend ofthe answers we need – Key nodes – Ranking – Influence, contagion – Communities, etc • That's what network science is all about • You have to know the problem 68 Escola das Artes 2022
- 69. Which networks? • Identifying networksmay be not intuitive • But at the end is all about actors and interactions – Vertices = nodes = actors – Edges = relations = interactions • Going through examples is helpful 69 Escola das Artes 2022
- 70. Countries, FIFA WorldCup 70 Escola das Artes 2022
- 71. Dynamics • Networks may havea temporal dimension • Interactions – follow, like, share, mention, retweet, hashtag, etc – occur in sequence • Network properties evolve in time Escola das Artes 2022 71
- 72. Thank you! Escola dasArtes 2022 72