Phylogeny VIZBI 2011
•Download as PPTX, PDF•
1 like•1,318 views
This document discusses trees and phylogeny, including: 1. Various software for visualizing and analyzing phylogenetic trees such as TreeView, PHYLIP, NJPLOT, MacClade, and PAUP. 2. Challenges with phylogeny that do not exist with maps, as phylogeny lacks predictable navigation and the concept of absolute location. 3. Possible representations of additional dimensions on phylogenetic trees, such as time, genes/copies, or latitude and longitude. This could make trees more useful and informative.
Report
Share
Report
Share
Recommended
Palestra LPI - Julho de 2009
O documento discute a importância da certificação Linux Professional Institute (LPI) para carreira profissional, destacando que a certificação fornece um caminho rápido para reposicionamento no mercado e maior produtividade. Também apresenta os níveis de certificação LPI, locais de provas e cursos oferecidos pela 4Linux para preparação.
ALEC (A List of Everything Cool)
This document describes ALEC (A List of Everything Cool), a project that aims to create a "Bibliography of Life" containing information on every taxonomic paper, taxonomist, and species in Wikidata. It provides an overview of the current status and capabilities of ALEC, including live queries to Wikidata and examples of information that can be viewed. It also discusses the major tools used, challenges faced populating Wikidata with bibliographic data, and plans for future improvements to the interface and expanding the data in Wikidata.
Wikidata and the Biodiversity Knowledge Graph
Wikidata could serve several roles in building a biodiversity knowledge graph:
1) Wikidata could provide identifiers, labels, and a way to query relationships (nodes and edges) between biodiversity items to form the basis of a knowledge graph.
2) Individual biodiversity databases could link their data to relevant Wikidata items while maintaining their own specialized knowledge graphs.
3) Wikidata could serve as a centralized source of both core biodiversity information and related contextual information like people, organizations, and locations, essentially becoming the biodiversity knowledge graph itself due to its large community and scope.
BioStor Next
This document discusses challenges with accessing and processing biodiversity literature and describes efforts to make literature from Biodiversity Heritage Library (BHL) more accessible and machine-readable. BioStor extracts text and figures from over 200,000 BHL articles and makes them searchable online. Efforts are underway to link BHL content to databases and Wikidata to connect literature to species and other entities. The goal is to extract more articles from BHL, enable geographic searches of content, break articles into smaller pieces, and embed literature within a biodiversity knowledge graph.
Ozymandias - from an atlas to a knowledge graph of living Australia
This document discusses building a knowledge graph called Ozymandias to link biodiversity data for Australian fauna. It describes linking specimens, publications, researchers and more using identifiers. Demos are proposed to link the Australian Fauna Database to literature to add images and information about taxonomists. Knowledge graphs integrate diverse data sources and make more connections and information visible than traditional databases. They rely on unique identifiers for people, publications and other objects.
SLiDInG6 talk on biodiversity knowledge graph
This document discusses building knowledge graphs by connecting various data sources using identifiers and vocabularies. It identifies technical and social obstacles to doing so, including the need for globally unique identifiers, agreed-upon vocabularies, and standards for transmitting the graph. It notes that some of these obstacles are being overcome with solutions like DOIs, JSON-LD, and Wikidata, but that measuring progress on connectivity is more difficult than linear growth. It concludes that knowledge graphs already exist but are not evenly distributed, and that any combined graph should be free, open, and used for good.
Wild idea for TDWG17 Bitcoins, biodiversity and micropayments
Open data is freely available with attribution as currency, while funding work and demonstrating value can be difficult. Closed data requires monetary access through subscriptions, where development is funded and value is obvious financially. The document proposes using micropayments of bitcoins for accessing raw or cleaned biodiversity data, with the community mining bitcoins to fund processing raw data into cleaned datasets.
Recommended
Palestra LPI - Julho de 2009
O documento discute a importância da certificação Linux Professional Institute (LPI) para carreira profissional, destacando que a certificação fornece um caminho rápido para reposicionamento no mercado e maior produtividade. Também apresenta os níveis de certificação LPI, locais de provas e cursos oferecidos pela 4Linux para preparação.
ALEC (A List of Everything Cool)
This document describes ALEC (A List of Everything Cool), a project that aims to create a "Bibliography of Life" containing information on every taxonomic paper, taxonomist, and species in Wikidata. It provides an overview of the current status and capabilities of ALEC, including live queries to Wikidata and examples of information that can be viewed. It also discusses the major tools used, challenges faced populating Wikidata with bibliographic data, and plans for future improvements to the interface and expanding the data in Wikidata.
Wikidata and the Biodiversity Knowledge Graph
Wikidata could serve several roles in building a biodiversity knowledge graph:
1) Wikidata could provide identifiers, labels, and a way to query relationships (nodes and edges) between biodiversity items to form the basis of a knowledge graph.
2) Individual biodiversity databases could link their data to relevant Wikidata items while maintaining their own specialized knowledge graphs.
3) Wikidata could serve as a centralized source of both core biodiversity information and related contextual information like people, organizations, and locations, essentially becoming the biodiversity knowledge graph itself due to its large community and scope.
BioStor Next
This document discusses challenges with accessing and processing biodiversity literature and describes efforts to make literature from Biodiversity Heritage Library (BHL) more accessible and machine-readable. BioStor extracts text and figures from over 200,000 BHL articles and makes them searchable online. Efforts are underway to link BHL content to databases and Wikidata to connect literature to species and other entities. The goal is to extract more articles from BHL, enable geographic searches of content, break articles into smaller pieces, and embed literature within a biodiversity knowledge graph.
Ozymandias - from an atlas to a knowledge graph of living Australia
This document discusses building a knowledge graph called Ozymandias to link biodiversity data for Australian fauna. It describes linking specimens, publications, researchers and more using identifiers. Demos are proposed to link the Australian Fauna Database to literature to add images and information about taxonomists. Knowledge graphs integrate diverse data sources and make more connections and information visible than traditional databases. They rely on unique identifiers for people, publications and other objects.
SLiDInG6 talk on biodiversity knowledge graph
This document discusses building knowledge graphs by connecting various data sources using identifiers and vocabularies. It identifies technical and social obstacles to doing so, including the need for globally unique identifiers, agreed-upon vocabularies, and standards for transmitting the graph. It notes that some of these obstacles are being overcome with solutions like DOIs, JSON-LD, and Wikidata, but that measuring progress on connectivity is more difficult than linear growth. It concludes that knowledge graphs already exist but are not evenly distributed, and that any combined graph should be free, open, and used for good.
Wild idea for TDWG17 Bitcoins, biodiversity and micropayments
Open data is freely available with attribution as currency, while funding work and demonstrating value can be difficult. Closed data requires monetary access through subscriptions, where development is funded and value is obvious financially. The document proposes using micropayments of bitcoins for accessing raw or cleaned biodiversity data, with the community mining bitcoins to fund processing raw data into cleaned datasets.
Towards a biodiversity knowledge graph
The document discusses obstacles to and progress in building knowledge graphs. It outlines technical obstacles like needing globally unique identifiers and agreed-upon vocabularies. Social obstacles include economic issues. Identifiers are key to connecting knowledge graphs. Metrics are needed to measure graph connectivity rather than just growth. Network effects are important to make graphs truly useful. Wikidata and Google's knowledge graph are examples of existing large knowledge graphs.
The Sam Adams talk
The document discusses several topics related to taxonomy and biodiversity data. It summarizes that sequencing may be focused more on phylogeny than taxonomy. It also discusses visualizing data using tools like OneZoom and web maps. Another topic is rethinking how publications are linked and referenced, comparing current one-way links to the potential of two-way links. It proposes building a Biodiversity Knowledge Graph by linking data, descriptions, specimens, and publications. Finally, it suggests treating biodiversity data like source code by allowing edits and tracking changes.
Unknown knowns, long tails, and long data
Talk given at Scientific Collections International: Food Security Research Initiative, USDA National Agriculture Library
In praise of grumpy old men: Open versus closed data and the challenge of cre...
The document discusses the history and evolution of linking in documents from printed floras to Xanadu, the World Wide Web, and modern annotations. It advocates for open data and open access to scientific literature to enable the creation of a 21st century digital flora that can embed multimedia content like descriptions, specimens, and data. Making scientific names and literature openly accessible remains a challenge.
BHL, BioStor, and beyond
This document summarizes the capabilities and potential of the Biodiversity Heritage Library (BHL) and BioStor resources. It discusses how BHL provides open access to digitized biodiversity literature but does not easily surface the journal articles. However, the data is downloadable and has APIs, allowing the articles within to be programmatically extracted. It proposes linking specimens to articles for improved findability and creating a "PubMed Central for biodiversity" to better organize and surface taxonomic facts and documents.
Cisco Digital Catapult
Digitisation involves making physical specimens, literature, and metadata available in digital form, including DNA barcodes. This allows joining up different types of biological data that were previously separate, such as specimens, published literature, and genetic sequences. Digitising collections allows broader access and use of biodiversity data through databases like GBIF, which has over 500 million occurrence records available online. However, different intellectual property policies can apply to literature, specimens, and genetic data. Efforts are underway to better link related biological records and publications through identifiers like ORCID for people, DOIs for publications, and LSIDs for plant names. The goal is to build a comprehensive knowledge graph that integrates all these different types of digital biological data.
Built in the 19th century, rebuilt for the 21st
The document discusses several topics related to digitization of biological data collections:
1) It describes how databases like GenBank rely on both experimentalist and natural history traditions by collecting and comparing natural facts from experiments.
2) Debates around creating GenBank in 1982 illuminated different moral economies regarding collecting/sharing data and attributing credit.
3) Both experimentalism and natural history traditions have shaped new ways of producing knowledge in life sciences through articulating these approaches in databases.
Two graphs, three responses
This document discusses two graphs related to taxonomy and barcoding. It then presents three potential responses: 1) Modernize taxonomy by digitizing specimens, literature, and linking data sources. 2) Imagine a world where only barcodes exist and how we would visualize biodiversity. 3) Integrate taxonomy and barcodes by linking names to barcodes using specimens as the connection point, though challenges remain around building complete trees and visualizing communities. Integrating data from sources like BOLD, GBIF, and literature would help but requires resolving issues of duplicate records and name interpretations.
GrBio Workshop talk
This document discusses three problems related to linking specimens to evidence in biological databases: 1) linking specimens to DNA barcodes, sequences, and literature citations in databases like GBIF, 2) the relationship between physical biological collections and institutions and their digital representations in databases like GBIF, and 3) making Wikipedia pages on species more structured and machine-readable similar to Bouchout declarations. Suggestions are made to map specimen identifiers to other databases, provide live updates of digitization efforts, and allow for user-editable structured data.
Biodiversity Knowledge Graphs
This document discusses building knowledge graphs to connect biodiversity data from various sources like publications, specimens, sequences, and locations. It notes some challenges like an increasing amount of sequencing data not connected to formal taxonomic names, disconnects between taxonomy and genomics, and much of the historical taxonomic literature being difficult to access. It also discusses imbalances in available data across regions, taxa, and between well-studied and under-studied species. Integrating these diverse data sources into knowledge graphs could help address these issues but also comes with its own challenges.
Visualing phylogenies: a personal view
This document discusses challenges and opportunities in visualizing phylogenetic trees. It notes that while maps have predictable navigation, trees can be drawn in many different ways. The document explores using additional dimensions like time, latitude and longitude to represent evolutionary relationships. It highlights projects like GenGIS, OneZoom and Dendroscope that attempt to make large trees more intuitive to navigate. Finally, it questions why more phylogenetic trees are not archived in databases and how software could generate publication-quality visualizations directly from analyses.
Biodiversity informatics: digitising the living world
The document discusses biodiversity informatics and efforts to digitize information about the living world. It notes that GBIF has over 500 million specimen records but that none of the Kenya data actually comes from Kenya. It also discusses challenges with the Biodiversity Heritage Library in emphasizing older publications over recent scientific articles and representing information by scanned book pages rather than articles. The document raises issues about ensuring all scientific names are published and unique, and about making publications containing names accessible online.
Ebbe Nielsen Challenge GBIF #gb21
The document discusses the Ebbe Nielsen GBIF Challenge, which is a competition that offers cash prizes. The challenge is open to individuals, teams, and companies and asks participants to submit innovative uses of data mobilized by the Global Biodiversity Information Facility (GBIF). Winning submissions could include new visualizations of biodiversity data or utilizing new types of data. Prizes will be awarded to semifinalists and top finishers, with the top prize being €20,000.
GBIF Science Committee Report GB21, Delhi, India
The GBIF Science Committee met in Glasgow where they awarded prizes and developed the Ebbe Nielsen Challenge. CSIRO's Tony Rees was named the 2014 Ebbe Nielsen Prize winner. Young Researcher Awards were given to Vijay Barve and Caoimhe Marshall. The GBIF Ebbe Nielsen Challenge will foster innovation using GBIF data and have cash prizes. The committee discussed challenges around data types from sources like DNA sequences and literature, as well as data quality and coverage issues.
Building the Biodiversity Knowledge Graph
Slides from 4th Global Online Biodiversity Informatics Seminar https://plus.google.com/events/clvk6nd14d9fhh7e4a6oe5mt9s0
GBIF ideas
The document discusses ways to improve the Global Biodiversity Information Facility (GBIF) data by addressing issues of coverage, quality, annotation, and incorporating new types of data. It suggests adding other literature sources to increase coverage, developing methods to measure reliability and allow editing to ensure quality, using stable identifiers and annotations on a platform like GitHub to enable corrections, and incorporating additional data types like names from nomenclators, phylogenies, and sequences from GenBank.
Biodiversity informatics: why aren't we there yet?
This document discusses challenges in biodiversity informatics based on various data visualizations. It finds that while sequencing data is growing exponentially, the description of new taxa is relatively constant. Much taxonomic literature from the 20th century is "dark" or inaccessible. Data is unevenly distributed across taxa, with more known about few species and little known about most. Integrating legacy literature and connecting it to modern genomic data remains a challenge. Crowd-sourcing of data is concentrated in areas with more smartphone users. GenBank contains valuable location and ecological interaction data beyond gene sequences.
Something about links
This document discusses linking data on the semantic web. It questions when data providers will value links enough to consistently create and maintain them between resources. It also questions how to link data in the absence of persistent identifiers. Specifically, it raises challenges around making persistent links without identifiers that remain constant over time.
Why I blog instead of writing papers
This document discusses why the author blogs instead of writing papers. Some key reasons include: getting immediate feedback, having conversations in the comments, not being limited by journal space constraints, and establishing an "attention filter" through citations and social media engagement of blog posts. While blogging is a form of "vanity publishing," the author argues it can still be valid if the blog gets cited in peer-reviewed literature. Blogging also allows for a more open and transparent discussion of scientific findings compared to traditional peer-reviewed papers.
Social media
This document discusses various social media platforms and how they can be used for professional purposes. It outlines popular platforms like LinkedIn, Facebook, blogging and Twitter. It provides tips on using hashtags, retweets and follow Fridays on Twitter. It also discusses how these tools can be used for conference broadcasting, attracting attention to projects, asking for help and creating a consistent online identity or "brand".
National Security Agency - NSA mobile device best practices
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
Things to Consider When Choosing a Website Developer for your Website | FODUU
Choosing the right website developer is crucial for your business. This article covers essential factors to consider, including experience, portfolio, technical skills, communication, pricing, reputation & reviews, cost and budget considerations and post-launch support. Make an informed decision to ensure your website meets your business goals.
More Related Content
More from Roderic Page
Towards a biodiversity knowledge graph
The document discusses obstacles to and progress in building knowledge graphs. It outlines technical obstacles like needing globally unique identifiers and agreed-upon vocabularies. Social obstacles include economic issues. Identifiers are key to connecting knowledge graphs. Metrics are needed to measure graph connectivity rather than just growth. Network effects are important to make graphs truly useful. Wikidata and Google's knowledge graph are examples of existing large knowledge graphs.
The Sam Adams talk
The document discusses several topics related to taxonomy and biodiversity data. It summarizes that sequencing may be focused more on phylogeny than taxonomy. It also discusses visualizing data using tools like OneZoom and web maps. Another topic is rethinking how publications are linked and referenced, comparing current one-way links to the potential of two-way links. It proposes building a Biodiversity Knowledge Graph by linking data, descriptions, specimens, and publications. Finally, it suggests treating biodiversity data like source code by allowing edits and tracking changes.
Unknown knowns, long tails, and long data
Talk given at Scientific Collections International: Food Security Research Initiative, USDA National Agriculture Library
In praise of grumpy old men: Open versus closed data and the challenge of cre...
The document discusses the history and evolution of linking in documents from printed floras to Xanadu, the World Wide Web, and modern annotations. It advocates for open data and open access to scientific literature to enable the creation of a 21st century digital flora that can embed multimedia content like descriptions, specimens, and data. Making scientific names and literature openly accessible remains a challenge.
BHL, BioStor, and beyond
This document summarizes the capabilities and potential of the Biodiversity Heritage Library (BHL) and BioStor resources. It discusses how BHL provides open access to digitized biodiversity literature but does not easily surface the journal articles. However, the data is downloadable and has APIs, allowing the articles within to be programmatically extracted. It proposes linking specimens to articles for improved findability and creating a "PubMed Central for biodiversity" to better organize and surface taxonomic facts and documents.
Cisco Digital Catapult
Digitisation involves making physical specimens, literature, and metadata available in digital form, including DNA barcodes. This allows joining up different types of biological data that were previously separate, such as specimens, published literature, and genetic sequences. Digitising collections allows broader access and use of biodiversity data through databases like GBIF, which has over 500 million occurrence records available online. However, different intellectual property policies can apply to literature, specimens, and genetic data. Efforts are underway to better link related biological records and publications through identifiers like ORCID for people, DOIs for publications, and LSIDs for plant names. The goal is to build a comprehensive knowledge graph that integrates all these different types of digital biological data.
Built in the 19th century, rebuilt for the 21st
The document discusses several topics related to digitization of biological data collections:
1) It describes how databases like GenBank rely on both experimentalist and natural history traditions by collecting and comparing natural facts from experiments.
2) Debates around creating GenBank in 1982 illuminated different moral economies regarding collecting/sharing data and attributing credit.
3) Both experimentalism and natural history traditions have shaped new ways of producing knowledge in life sciences through articulating these approaches in databases.
Two graphs, three responses
This document discusses two graphs related to taxonomy and barcoding. It then presents three potential responses: 1) Modernize taxonomy by digitizing specimens, literature, and linking data sources. 2) Imagine a world where only barcodes exist and how we would visualize biodiversity. 3) Integrate taxonomy and barcodes by linking names to barcodes using specimens as the connection point, though challenges remain around building complete trees and visualizing communities. Integrating data from sources like BOLD, GBIF, and literature would help but requires resolving issues of duplicate records and name interpretations.
GrBio Workshop talk
This document discusses three problems related to linking specimens to evidence in biological databases: 1) linking specimens to DNA barcodes, sequences, and literature citations in databases like GBIF, 2) the relationship between physical biological collections and institutions and their digital representations in databases like GBIF, and 3) making Wikipedia pages on species more structured and machine-readable similar to Bouchout declarations. Suggestions are made to map specimen identifiers to other databases, provide live updates of digitization efforts, and allow for user-editable structured data.
Biodiversity Knowledge Graphs
This document discusses building knowledge graphs to connect biodiversity data from various sources like publications, specimens, sequences, and locations. It notes some challenges like an increasing amount of sequencing data not connected to formal taxonomic names, disconnects between taxonomy and genomics, and much of the historical taxonomic literature being difficult to access. It also discusses imbalances in available data across regions, taxa, and between well-studied and under-studied species. Integrating these diverse data sources into knowledge graphs could help address these issues but also comes with its own challenges.
Visualing phylogenies: a personal view
This document discusses challenges and opportunities in visualizing phylogenetic trees. It notes that while maps have predictable navigation, trees can be drawn in many different ways. The document explores using additional dimensions like time, latitude and longitude to represent evolutionary relationships. It highlights projects like GenGIS, OneZoom and Dendroscope that attempt to make large trees more intuitive to navigate. Finally, it questions why more phylogenetic trees are not archived in databases and how software could generate publication-quality visualizations directly from analyses.
Biodiversity informatics: digitising the living world
The document discusses biodiversity informatics and efforts to digitize information about the living world. It notes that GBIF has over 500 million specimen records but that none of the Kenya data actually comes from Kenya. It also discusses challenges with the Biodiversity Heritage Library in emphasizing older publications over recent scientific articles and representing information by scanned book pages rather than articles. The document raises issues about ensuring all scientific names are published and unique, and about making publications containing names accessible online.
Ebbe Nielsen Challenge GBIF #gb21
The document discusses the Ebbe Nielsen GBIF Challenge, which is a competition that offers cash prizes. The challenge is open to individuals, teams, and companies and asks participants to submit innovative uses of data mobilized by the Global Biodiversity Information Facility (GBIF). Winning submissions could include new visualizations of biodiversity data or utilizing new types of data. Prizes will be awarded to semifinalists and top finishers, with the top prize being €20,000.
GBIF Science Committee Report GB21, Delhi, India
The GBIF Science Committee met in Glasgow where they awarded prizes and developed the Ebbe Nielsen Challenge. CSIRO's Tony Rees was named the 2014 Ebbe Nielsen Prize winner. Young Researcher Awards were given to Vijay Barve and Caoimhe Marshall. The GBIF Ebbe Nielsen Challenge will foster innovation using GBIF data and have cash prizes. The committee discussed challenges around data types from sources like DNA sequences and literature, as well as data quality and coverage issues.
Building the Biodiversity Knowledge Graph
Slides from 4th Global Online Biodiversity Informatics Seminar https://plus.google.com/events/clvk6nd14d9fhh7e4a6oe5mt9s0
GBIF ideas
The document discusses ways to improve the Global Biodiversity Information Facility (GBIF) data by addressing issues of coverage, quality, annotation, and incorporating new types of data. It suggests adding other literature sources to increase coverage, developing methods to measure reliability and allow editing to ensure quality, using stable identifiers and annotations on a platform like GitHub to enable corrections, and incorporating additional data types like names from nomenclators, phylogenies, and sequences from GenBank.
Biodiversity informatics: why aren't we there yet?
This document discusses challenges in biodiversity informatics based on various data visualizations. It finds that while sequencing data is growing exponentially, the description of new taxa is relatively constant. Much taxonomic literature from the 20th century is "dark" or inaccessible. Data is unevenly distributed across taxa, with more known about few species and little known about most. Integrating legacy literature and connecting it to modern genomic data remains a challenge. Crowd-sourcing of data is concentrated in areas with more smartphone users. GenBank contains valuable location and ecological interaction data beyond gene sequences.
Something about links
This document discusses linking data on the semantic web. It questions when data providers will value links enough to consistently create and maintain them between resources. It also questions how to link data in the absence of persistent identifiers. Specifically, it raises challenges around making persistent links without identifiers that remain constant over time.
Why I blog instead of writing papers
This document discusses why the author blogs instead of writing papers. Some key reasons include: getting immediate feedback, having conversations in the comments, not being limited by journal space constraints, and establishing an "attention filter" through citations and social media engagement of blog posts. While blogging is a form of "vanity publishing," the author argues it can still be valid if the blog gets cited in peer-reviewed literature. Blogging also allows for a more open and transparent discussion of scientific findings compared to traditional peer-reviewed papers.
Social media
This document discusses various social media platforms and how they can be used for professional purposes. It outlines popular platforms like LinkedIn, Facebook, blogging and Twitter. It provides tips on using hashtags, retweets and follow Fridays on Twitter. It also discusses how these tools can be used for conference broadcasting, attracting attention to projects, asking for help and creating a consistent online identity or "brand".
More from Roderic Page (20)
In praise of grumpy old men: Open versus closed data and the challenge of cre...
In praise of grumpy old men: Open versus closed data and the challenge of cre...
Biodiversity informatics: digitising the living world
Biodiversity informatics: digitising the living world
Biodiversity informatics: why aren't we there yet?
Biodiversity informatics: why aren't we there yet?
Recently uploaded
National Security Agency - NSA mobile device best practices
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
Things to Consider When Choosing a Website Developer for your Website | FODUU
Choosing the right website developer is crucial for your business. This article covers essential factors to consider, including experience, portfolio, technical skills, communication, pricing, reputation & reviews, cost and budget considerations and post-launch support. Make an informed decision to ensure your website meets your business goals.
Building Production Ready Search Pipelines with Spark and Milvus
Spark is the widely used ETL tool for processing, indexing and ingesting data to serving stack for search. Milvus is the production-ready open-source vector database. In this talk we will show how to use Spark to process unstructured data to extract vector representations, and push the vectors to Milvus vector database for search serving.
CAKE: Sharing Slices of Confidential Data on Blockchain
Presented at the CAiSE 2024 Forum, Intelligent Information Systems, June 6th, Limassol, Cyprus.
Synopsis: Cooperative information systems typically involve various entities in a collaborative process within a distributed environment. Blockchain technology offers a mechanism for automating such processes, even when only partial trust exists among participants. The data stored on the blockchain is replicated across all nodes in the network, ensuring accessibility to all participants. While this aspect facilitates traceability, integrity, and persistence, it poses challenges for adopting public blockchains in enterprise settings due to confidentiality issues. In this paper, we present a software tool named Control Access via Key Encryption (CAKE), designed to ensure data confidentiality in scenarios involving public blockchains. After outlining its core components and functionalities, we showcase the application of CAKE in the context of a real-world cyber-security project within the logistics domain.
Paper: https://doi.org/10.1007/978-3-031-61000-4_16
Mind map of terminologies used in context of Generative AI
Mind map of common terms used in context of Generative AI.
HCL Notes and Domino License Cost Reduction in the World of DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-and-domino-license-cost-reduction-in-the-world-of-dlau/
The introduction of DLAU and the CCB & CCX licensing model caused quite a stir in the HCL community. As a Notes and Domino customer, you may have faced challenges with unexpected user counts and license costs. You probably have questions on how this new licensing approach works and how to benefit from it. Most importantly, you likely have budget constraints and want to save money where possible. Don’t worry, we can help with all of this!
We’ll show you how to fix common misconfigurations that cause higher-than-expected user counts, and how to identify accounts which you can deactivate to save money. There are also frequent patterns that can cause unnecessary cost, like using a person document instead of a mail-in for shared mailboxes. We’ll provide examples and solutions for those as well. And naturally we’ll explain the new licensing model.
Join HCL Ambassador Marc Thomas in this webinar with a special guest appearance from Franz Walder. It will give you the tools and know-how to stay on top of what is going on with Domino licensing. You will be able lower your cost through an optimized configuration and keep it low going forward.
These topics will be covered
- Reducing license cost by finding and fixing misconfigurations and superfluous accounts
- How do CCB and CCX licenses really work?
- Understanding the DLAU tool and how to best utilize it
- Tips for common problem areas, like team mailboxes, functional/test users, etc
- Practical examples and best practices to implement right away
Choosing The Best AWS Service For Your Website + API.pptx
Have you ever been confused by the myriad of choices offered by AWS for hosting a website or an API?
Lambda, Elastic Beanstalk, Lightsail, Amplify, S3 (and more!) can each host websites + APIs. But which one should we choose?
Which one is cheapest? Which one is fastest? Which one will scale to meet our needs?
Join me in this session as we dive into each AWS hosting service to determine which one is best for your scenario and explain why!
20240609 QFM020 Irresponsible AI Reading List May 2024
Everything I found interesting about the irresponsible use of machine intelligence in May 2024
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers:
* What is Vector Search?
* Importance and benefits of vector search
* Practical use cases across various industries
* Step-by-step implementation guide
* Live demos with code snippets
* Enhancing LLM capabilities with vector search
* Best practices and optimization strategies
Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications.
#MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology
June Patch Tuesday
Ivanti’s Patch Tuesday breakdown goes beyond patching your applications and brings you the intelligence and guidance needed to prioritize where to focus your attention first. Catch early analysis on our Ivanti blog, then join industry expert Chris Goettl for the Patch Tuesday Webinar Event. There we’ll do a deep dive into each of the bulletins and give guidance on the risks associated with the newly-identified vulnerabilities.
How to Get CNIC Information System with Paksim Ga.pptx
Pakdata Cf is a groundbreaking system designed to streamline and facilitate access to CNIC information. This innovative platform leverages advanced technology to provide users with efficient and secure access to their CNIC details.
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift
Overview
Dive into the world of anomaly detection on edge devices with our comprehensive hands-on tutorial. This SlideShare presentation will guide you through the entire process, from data collection and model training to edge deployment and real-time monitoring. Perfect for those looking to implement robust anomaly detection systems on resource-constrained IoT/edge devices.
Key Topics Covered
1. Introduction to Anomaly Detection
- Understand the fundamentals of anomaly detection and its importance in identifying unusual behavior or failures in systems.
2. Understanding Edge (IoT)
- Learn about edge computing and IoT, and how they enable real-time data processing and decision-making at the source.
3. What is ArgoCD?
- Discover ArgoCD, a declarative, GitOps continuous delivery tool for Kubernetes, and its role in deploying applications on edge devices.
4. Deployment Using ArgoCD for Edge Devices
- Step-by-step guide on deploying anomaly detection models on edge devices using ArgoCD.
5. Introduction to Apache Kafka and S3
- Explore Apache Kafka for real-time data streaming and Amazon S3 for scalable storage solutions.
6. Viewing Kafka Messages in the Data Lake
- Learn how to view and analyze Kafka messages stored in a data lake for better insights.
7. What is Prometheus?
- Get to know Prometheus, an open-source monitoring and alerting toolkit, and its application in monitoring edge devices.
8. Monitoring Application Metrics with Prometheus
- Detailed instructions on setting up Prometheus to monitor the performance and health of your anomaly detection system.
9. What is Camel K?
- Introduction to Camel K, a lightweight integration framework built on Apache Camel, designed for Kubernetes.
10. Configuring Camel K Integrations for Data Pipelines
- Learn how to configure Camel K for seamless data pipeline integrations in your anomaly detection workflow.
11. What is a Jupyter Notebook?
- Overview of Jupyter Notebooks, an open-source web application for creating and sharing documents with live code, equations, visualizations, and narrative text.
12. Jupyter Notebooks with Code Examples
- Hands-on examples and code snippets in Jupyter Notebooks to help you implement and test anomaly detection models.
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
Imagine a world where machines not only perform tasks but also learn, adapt, and make decisions. This is the promise of Artificial Intelligence (AI), a technology that's not just enhancing our lives but revolutionizing entire industries.
Fueling AI with Great Data with Airbyte Webinar
This talk will focus on how to collect data from a variety of sources, leveraging this data for RAG and other GenAI use cases, and finally charting your course to productionalization.
Taking AI to the Next Level in Manufacturing.pdf
Read Taking AI to the Next Level in Manufacturing to gain insights on AI adoption in the manufacturing industry, such as:
1. How quickly AI is being implemented in manufacturing.
2. Which barriers stand in the way of AI adoption.
3. How data quality and governance form the backbone of AI.
4. Organizational processes and structures that may inhibit effective AI adoption.
6. Ideas and approaches to help build your organization's AI strategy.
Generating privacy-protected synthetic data using Secludy and Milvus
During this demo, the founders of Secludy will demonstrate how their system utilizes Milvus to store and manipulate embeddings for generating privacy-protected synthetic data. Their approach not only maintains the confidentiality of the original data but also enhances the utility and scalability of LLMs under privacy constraints. Attendees, including machine learning engineers, data scientists, and data managers, will witness first-hand how Secludy's integration with Milvus empowers organizations to harness the power of LLMs securely and efficiently.
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
Recently uploaded (20)
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Things to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUU
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
CAKE: Sharing Slices of Confidential Data on Blockchain
CAKE: Sharing Slices of Confidential Data on Blockchain
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Phylogeny VIZBI 2011
- 2. TreeView
- 3. PHYLIP NJPLOT MacClade PAUP
- 6. Mature
- 7. Problem has been solved
- 8. Thank you
- 10. Trees suck…
- 11. …in ways that maps don’t
- 20. Ground truth
- 25. Relative and absolute navigation
- 28. Phylogeny has none of this
- 29. A B Y C D X
- 30. B A Y D C X We can reorder Y
- 31. @broadinstitute
- 32. B A Y D C X X is a partial order
- 33. B A Y D C X X is a partial order
- 34. B A Y D C X: evolutionary distance
- 35. B A Y D C X: time
- 36. Y Z? X What would third dimension represent?
- 37. Paloverde
- 38. @wellcometrust
- 40. Pretty, but…
- 41. Is 3D useful?
- 42. @systbiol
- 43. Y: evolutionary distance Z: genes/copies X: species
- 45. @DavKidd @andrewxhill Y: latitude Z: evolutionary distance X:longitude
- 46. @rdmpage
- 47. @andrewxhill
- 49. @dr_pi
- 50. @kzelnio Think how great of a tool that could be at museums on a large flat screen at 4 year old height.
- 53. Dendroscope
- 55. Big trees
- 56. 11 June 2003
- 57. “best viewed when enlarged to a 1.5-meter diameter”
- 58. add
- 61. @rdmpage
- 62. @rdmpage
- 63. 1 2 3
- 64. 1 4 2 5 3
- 65. What’s next… Geophylogenies Touch Zoomable viewers http://iphylo.blogspot.com
Editor's Notes
- http://taxonomy.zoology.gla.ac.uk/rod/treeview.html
- http://evolution.genetics.washington.edu/phylip/software.html#Plotting and “A reference guide for tree analysis and visualization” http://dx.doi.org/10.1186/1756-0381-3-1
- http://loco.biosci.arizona.edu/paloverde/paloverde.html
- http://www.wellcometreeoflife.org/
- “Visualising very large phylogenetic trees in three dimensional hyperbolic space” http://dx.doi.org/10.1186/1471-2105-5-48
- June 2007 issue of Systematic Biology, a homage to Wayne Maddison, SystBiol (1997) 46 (3): 523-536. doi: 10.1093/sysbio/46.3.523
- Three-Dimensional Phylogeny Explorer: Distinguishing paralogs, lateral transfer, and violation of "molecular clock" assumption with 3D visualization NamshinKim and ChristopherLeehttp://dx.doi.org/10.1186/1471-2105-8-213
- http://iphylo.blogspot.com/2007/06/earth-not-flat-official.html
- http://systbio.org/?q=node/184, see http://dx.doi.org/10.1080/10635150701266848
- Petra Isenberg, see “Interactive tree comparison for co-located collaborative information visualization” http://www.ncbi.nlm.nih.gov/pubmed/17968069 and http://innovis.cpsc.ucalgary.ca/Research/CollaborativeTreeComparison
- http://www.perceptivepixel.com/ and http://iphylo.blogspot.com/2008/08/perceptive-pixel-taxonomy-demo.html
- http://www.senchatouch.com/
- http://www-ab.informatik.uni-tuebingen.de/software/dendroscope
- Image from Mike Sanderson’s Lab (http://loco.biosci.arizona.edu/)
- http://msdn.microsoft.com/en-us/library/cc645050(v=vs.95).aspx
- http://iphylo.blogspot.com/2007/08/visualising-very-big-trees-part-iv.html