How I spend my summer vacations
•Download as PPT, PDF•
1 like•3,174 views
- The document discusses how the author spends their summer vacations studying the archivability of web resources by capturing 1,000 URIs each from Twitter and Archive-It. - The author analyzes the captured data to measure how perfectly the resources were archived, finding only 4.2% of Twitter and 34.2% of Archive-It were perfectly archived, with missing embedded resources, stylesheets, and functionality impacting the archivability. - The author plans future work evaluating the importance of missing elements, measuring damage to archives, and developing methods to predict and potentially improve archivability.
Report
Share
Report
Share
Recommended
resume_bio
Aileen Cheng is seeking a position in biotech using computer science skills in software development, modeling, data analysis, and databases. She has a Bachelor of Science in Bioengineering and Computer Science from Caltech with relevant coursework and projects developing databases, algorithms, simulations, and more. Her experience includes software engineering at Cisco and internships developing assays and LIMS systems in biotech startups and research laboratories at Caltech and abroad.
Web Archiving Profile - WADL 2013
This document discusses profiling web archives to characterize them by age, top-level domains, languages, and growth rate. Profiling web archives can optimize query routing for aggregators and determine what parts of the web are missing from archives. The author proposes sampling URIs from sources like DMOZ and search engine queries to analyze the timemaps from various archives and profile their coverage of top-level domains and languages.
Archiving the Mobile Web
The document discusses archiving mobile web pages using Heritrix, an open-source web crawler. It describes modifying Heritrix to support crawling both desktop and mobile versions of sites. The Mobile Finder web service identifies if a given URL has a mobile version. Heritrix was configured with two crawl options - using desktop or mobile user-agents. URLs were crawled using both options and differences analyzed. While Heritrix cannot execute JavaScript, Mobile Finder finds mobile pages so crawling continues correctly. Analysis found distribution of content like HTML, images and CSS between desktop and mobile versions.
Site story wadl2013
This document summarizes a presentation about SiteStory, an alternative approach to web archiving. SiteStory allows transactional archiving by capturing HTTP transactions between browsers and servers. This addresses issues with traditional crawler-based archiving like timing problems and inability to archive certain content. The presentation describes how SiteStory works, current status including benchmark testing, and how to access a SiteStory testbed installation.
Word Clouds from Twitter Follower Descriptions
This document lists the Twitter handles of various alumni associations for colleges and universities located in Virginia. There are over 20 colleges and universities represented, including Christopher Newport University, College of William and Mary, George Mason University, Hampden-Sydney College, Hampton University, and others. The Twitter handles provide a way for alumni to connect with their alma maters and fellow alumni through social media.
Who and What Links to the Internet Archive
This document analyzes access patterns for robots and humans on web archives. It finds that English pages are the most requested, followed by European languages. Most human sessions come to the Wayback Machine via referrals, led by Wikipedia, the Internet Archive homepage, Reddit, and Google. The analysis also shows that most links from outside archives go to past versions ("mementos") of pages, and 83% of linked mementos no longer exist on the live web. The study provides insights into what content languages users look for and how people discover and link to archived web pages.
iPRES2015: Archiving Deferred Representations Using a Two-Tiered Crawling App...
This document proposes a two-tiered crawling approach using PhantomJS and Heritrix to better archive deferred representations, which are web pages that require JavaScript execution or user interaction to fully render. The approach uses PhantomJS to execute JavaScript and interact with deferred representations, while Heritrix crawls non-deferred representations for better performance. Test results found the PhantomJS frontier was 1.5 times larger but crawling was 10.5 times slower. The approach provides a better method for archiving deferred representations compared to the current workflow.
The Revolution Will Not Be Archived
If twitter is the "fi rst draft of history", then we should be doing a better job of preserving it. For the one
year anniversary of the Egyptian revolution (2012) we revisited a sample of the shared social media content and found nearly 11% missing from the current web, and only 20% available in public web archives. Spurred by this, we sampled tweets for ve other culturally important events from 2009-2012 and found similar rates for archiving and loss.
Recommended
resume_bio
Aileen Cheng is seeking a position in biotech using computer science skills in software development, modeling, data analysis, and databases. She has a Bachelor of Science in Bioengineering and Computer Science from Caltech with relevant coursework and projects developing databases, algorithms, simulations, and more. Her experience includes software engineering at Cisco and internships developing assays and LIMS systems in biotech startups and research laboratories at Caltech and abroad.
Web Archiving Profile - WADL 2013
This document discusses profiling web archives to characterize them by age, top-level domains, languages, and growth rate. Profiling web archives can optimize query routing for aggregators and determine what parts of the web are missing from archives. The author proposes sampling URIs from sources like DMOZ and search engine queries to analyze the timemaps from various archives and profile their coverage of top-level domains and languages.
Archiving the Mobile Web
The document discusses archiving mobile web pages using Heritrix, an open-source web crawler. It describes modifying Heritrix to support crawling both desktop and mobile versions of sites. The Mobile Finder web service identifies if a given URL has a mobile version. Heritrix was configured with two crawl options - using desktop or mobile user-agents. URLs were crawled using both options and differences analyzed. While Heritrix cannot execute JavaScript, Mobile Finder finds mobile pages so crawling continues correctly. Analysis found distribution of content like HTML, images and CSS between desktop and mobile versions.
Site story wadl2013
This document summarizes a presentation about SiteStory, an alternative approach to web archiving. SiteStory allows transactional archiving by capturing HTTP transactions between browsers and servers. This addresses issues with traditional crawler-based archiving like timing problems and inability to archive certain content. The presentation describes how SiteStory works, current status including benchmark testing, and how to access a SiteStory testbed installation.
Word Clouds from Twitter Follower Descriptions
This document lists the Twitter handles of various alumni associations for colleges and universities located in Virginia. There are over 20 colleges and universities represented, including Christopher Newport University, College of William and Mary, George Mason University, Hampden-Sydney College, Hampton University, and others. The Twitter handles provide a way for alumni to connect with their alma maters and fellow alumni through social media.
Who and What Links to the Internet Archive
This document analyzes access patterns for robots and humans on web archives. It finds that English pages are the most requested, followed by European languages. Most human sessions come to the Wayback Machine via referrals, led by Wikipedia, the Internet Archive homepage, Reddit, and Google. The analysis also shows that most links from outside archives go to past versions ("mementos") of pages, and 83% of linked mementos no longer exist on the live web. The study provides insights into what content languages users look for and how people discover and link to archived web pages.
iPRES2015: Archiving Deferred Representations Using a Two-Tiered Crawling App...
This document proposes a two-tiered crawling approach using PhantomJS and Heritrix to better archive deferred representations, which are web pages that require JavaScript execution or user interaction to fully render. The approach uses PhantomJS to execute JavaScript and interact with deferred representations, while Heritrix crawls non-deferred representations for better performance. Test results found the PhantomJS frontier was 1.5 times larger but crawling was 10.5 times slower. The approach provides a better method for archiving deferred representations compared to the current workflow.
The Revolution Will Not Be Archived
If twitter is the "fi rst draft of history", then we should be doing a better job of preserving it. For the one
year anniversary of the Egyptian revolution (2012) we revisited a sample of the shared social media content and found nearly 11% missing from the current web, and only 20% available in public web archives. Spurred by this, we sampled tweets for ve other culturally important events from 2009-2012 and found similar rates for archiving and loss.
Tweet Visibility Dynamics in a Tweet Conversation Graph
We sought to understand how to extract not just a single tweet, but the conversation of which the tweet belongs to. In order to do this we sought to understand how the visibility of tweets in a conversation graph changes based on the tweet selected (the tweet in hand).
Old Dominion University Computer Science IIPC New Member
Old Dominion University WS-DL new member presentation at IIPC 2013 Ljubljana Slovenia April 22, 2013 http://netpreserve.org/general-assembly/2013/
Making Enterprise-Level Archive Tools Accessible for Personal Web Archiving
The document describes a set of tools that make enterprise-level web archiving accessible for personal use. The tools include a crawler (Heritrix), a web archive player (Wayback Machine), and an archive inspector (WARC-Proxy) that are installed locally on a personal machine. The interface provides one-click options to set up crawls, view archived pages in the local Wayback installation, and check archive status. It aims to support personal web archiving through a graphical user interface that allows customizing crawls, starting/stopping services, and works with existing WARC files from other tools on Windows, MacOS, and Linux systems.
Combining Heritrix and PhantomJS for Better Crawling of Pages with Javascript
Justin F. Brunelle
Michele C. Weigle
Michael L. Nelson
Web Science and Digital Libraries Research Group
Old Dominion University
@WebSciDL
IIPC 2016
Reykjavik, Iceland, April 11, 2016
Libyan digital newspapers_after_revolution
The Internet Archive has captured an important part of the Libyan digital newspapers which are currently no longer available on the live web.
PID Signposting Pattern
Presentation for PIDapalooza 2016. PIDs need to be used to achieve their intended persistence. Our research (reported at WWW2016, see http://arxiv.org/1602.09102) found that a disturbing percentage of references to papers that have DOIs actually use the landing page HTTP URI instead of the DOI HTTP URI. The problem is likely related to tools used for collecting references such as bookmarks and reference managers. These select the landing page URI instead of the DOI URI because the former is what's available in the address bar. It can safely be assumed that the same problem exists for other types of PIDs. The net result is that the true potential of PIDs is not realized. In order to ameliorate this problem we propose a Signposting pattern for PIDs (http://signposting.org/identifier/). It consists of adding a Link header to HTTP HEAD/GET responses for all resources identified by a DOI, including the landing page and content resources such as "the PDF" and "the dataset". The Link header contains a link, which points with the "identifier" relation type to the DOI HTTP URI. When such a link is available, tools can automatically discover and use the DOI URI instead of the other URIs (landing page, PDF, dataset) associated with the DOI-identified object.
Learning Analytics - CET Seminar 2012
This document discusses learning analytics and ways of visualizing educational data. It outlines understandings of learning analytics and describes the data landscape in education including institutional data from systems like LMSs, individual social media data, and personal learning environments. The document discusses tools for reproducible research, looking for trends in large datasets, and visualizing data beyond dashboards. It provides examples of learning analytics tools and visualizations used at institutions like Purdue and explores analyzing social media and networks. The document concludes by discussing future scenarios for learning analytics research.
We Went Mobile! (Or Did We?)
The document summarizes a presentation given by Laura Turner and Alejandra Nann on their efforts to test the mobile accessibility of third-party online resources accessible through their library website. They tested 258 resources on various mobile devices and found that 67 met Google's criteria for optimal mobile usability. Issues encountered included security warnings, outdated content, and resources not supporting mobile devices. The presenters discussed promoting resources that are mobile-friendly and ways to standardize the user experience across devices.
Big Data Curricula at the UW eScience Institute, JSM 2013
A 25 minute talk from a panel on big data curricula at JSM 2013
http://www.amstat.org/meetings/jsm/2013/onlineprogram/ActivityDetails.cfm?SessionID=208664
Data Sets, Ensemble Cloud Computing, and the University Library: Getting the ...
This document discusses research data management and the role of university libraries. It describes the SEAD (Sustainable Environment Actionable Data) project, which provides data services like curation, preservation, and a social community network to support research data across its lifecycle. SEAD aims to support interdisciplinary research by allowing researchers to define and manage related collections of data and metadata called Research Objects in a scalable way. The document argues that research organizations are best positioned to provide comprehensive long-term data services that integrate across the entire research process.
Designing a synergistic relationship between undergraduate Data Science educa...
Biodiversity data is extremely approachable – the concept of a specimen existing in time and place is clear to grasp and interesting to a wide range of people. I exploited this inherent feature of Biodiversity data to create an educational framework for teaching undergraduate Data Science. The project utilized Discovery Learning theory, based in the belief that it is best for learners to discover facts and relationships for themselves. Students were given a choice of databases and were mentored through an entire data analysis pipeline, including gathering, cleaning, analyzing, and visualization of the data. Their work culminates into a tutorial posted online (curiositydata.org) – instilling proper documentation, open science, and data management techniques. These tutorials can then be used and remixed as documentation for the databases, curriculum, and workshops detailing how to access and analyze the databases data. Increased documentation will overcome accessibility challenges that plague many Biodiversity databases, in an overarching aim to increase the usage and in turn value of these vital data resources. Computer Science, Statistics, and Biology undergraduates are increasingly “data literate”, and if mentored properly, we can foster a symbiotic relationship between the real-world Data Science education and the increase of usability of Biodiversity databases.
552 guestlecture 20140308
The document summarizes a guest lecture about the changing landscape of academic librarianship and data curation. It discusses the speaker's background and job responsibilities as a data curation librarian, which include advocating for data management, consulting on data practices, educating researchers, and supporting other librarians. The speaker's job also involves liaison work with a college and engaging in professional service, research, and librarianship. Their graduate program in information sciences prepared them through coursework, internships, and faculty support. Tips are provided for the job search process.
#mytweet via Instagram: Exploring User Behaviour Across Multiple Social Networks
We study how users of multiple online social net- works (OSNs) employ and share information by studying a common user pool that use six OSNs – Flickr, Google+, Instagram, Tumblr, Twitter, and YouTube. We analyze the temporal and topical signature of users’ sharing behaviour, showing how they exhibit distinct behaviorial patterns on different networks. We also examine cross-sharing (i.e., the act of user broadcasting their activity to multiple OSNs near-simultaneously), a previously unstudied behaviour and demonstrate how certain OSNs play the roles of originating source and destination sinks.
#CitSciNZ2018 - Andrea Wiggins (University of Nebraska) Fitness for Intended ...
#CitSciNZ2018 - Citizen Science Symposium 2018
9 April 2018, Monday; Te Papa Museum, Wellington
Speaker: Andrea Wiggins (Keynote Speaker)
Organization: Univesity of Nebraska
Topic: Fitness for Intended Use: Designing, Managing, and Accessing Data Quality in Citizen Science
Planning a Successful Digital Project
Slides from the "Planning a Successful Digital Project" start-to-finish session presented at the Wisconsin Library Association annual conference, Green Bay, October 25, 2013. Presenters: Sarah Grimm, Electronic Records Archivist, Wisconsin Historical Society and Emily Pfotenhauer, Recollection Wisconsin Program Manager, WiLS.
Data sharing in the age of the Social Machine
Social machines generate and consume data. A Web Observatory is proposed as an infrastructure to support data sharing among social machines and the human elements involved in data generation, analysis, and consumption. Key challenges include designing such an infrastructure for generality while addressing ethical, legal, and technological issues around metadata standards, access control, and performance across different computing platforms and stakeholder needs.
When Search becomes Research and Research becomes Search
SIGIR'13 Workshop on Exploration, Navigation and Retrieval of Information in Cultural Heritage (ENRICH).
Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...
This document discusses the Sustainable Environment Actionable Data (SEAD) project, which aims to lower the costs and increase the value of data curation through a data lifecycle approach. SEAD provides lightweight data services to support sustainability research, including secure project workspaces, active and social curation tools, and integrated lifecycle support for data from ingest to long-term preservation. By leveraging technologies like Web 2.0 and standards, SEAD simplifies and automates curation processes using metadata captured from data producers and users. This allows curation activities to begin earlier in the data lifecycle and be distributed across researchers and curators.
Ethnographically-inspired usability testing
This presentation to the 2015 i3 Conference in Aberdeen describes two weeks of ethnographically-inspired, synchronous usability testing which will have been conducted on a prototype for a new library search tool at a small university in the United Kingdom. Phase one of testing is complete and the presentation covers the design process, initial analysis and reflection on the methods, as well as the demands placed on the research design by the practitioner setting.
Visualising activity in learning networks using open data and educational ...
Delivered October13, 2011 in Cape Town South Africa at the 2011 Southern African Association for Institutional Research forum
Abstract
As more student academic activities involve both institutional and social networks, educational analysts are needing to investigate ways in which this data can be collected and interpreted to enhance learning experiences. Data recorded as students explore personal learning environments is most often not accessible or incomplete. Here we explore some of the approaches that exist to use these social networking platforms along with information from the learning management system and academic records. Combining and analysing this data has allowed us to create a number of interesting visualizations exposing patterns which would have been impossible to glean from looking at the data alone. In an age of data abundance we reflect on using some of these new measures in relation to improving learning design, increasing academic responsiveness and enhanced student experiences.
Jaffe o'brien-rosetta
This document discusses metadata best practices for describing digital objects entered into the digital preservation system Rosetta at Binghamton University Libraries. It recommends using consistent, simple, and intelligible Dublin Core metadata fields structured in a custom metadata form. The workflow involves assessing digital objects, arranging their metadata, and approving them as intellectual entities in Rosetta for long-term preservation and discovery in the Primo library catalog.
Big and Small Web Data
Workshop session given at the Institutional Web Management Workshop 2012 (IWMW 2012) event held at the University of Edinburgh on 18th - 20th June 2012.
More Related Content
Viewers also liked
Tweet Visibility Dynamics in a Tweet Conversation Graph
We sought to understand how to extract not just a single tweet, but the conversation of which the tweet belongs to. In order to do this we sought to understand how the visibility of tweets in a conversation graph changes based on the tweet selected (the tweet in hand).
Old Dominion University Computer Science IIPC New Member
Old Dominion University WS-DL new member presentation at IIPC 2013 Ljubljana Slovenia April 22, 2013 http://netpreserve.org/general-assembly/2013/
Making Enterprise-Level Archive Tools Accessible for Personal Web Archiving
The document describes a set of tools that make enterprise-level web archiving accessible for personal use. The tools include a crawler (Heritrix), a web archive player (Wayback Machine), and an archive inspector (WARC-Proxy) that are installed locally on a personal machine. The interface provides one-click options to set up crawls, view archived pages in the local Wayback installation, and check archive status. It aims to support personal web archiving through a graphical user interface that allows customizing crawls, starting/stopping services, and works with existing WARC files from other tools on Windows, MacOS, and Linux systems.
Combining Heritrix and PhantomJS for Better Crawling of Pages with Javascript
Justin F. Brunelle
Michele C. Weigle
Michael L. Nelson
Web Science and Digital Libraries Research Group
Old Dominion University
@WebSciDL
IIPC 2016
Reykjavik, Iceland, April 11, 2016
Libyan digital newspapers_after_revolution
The Internet Archive has captured an important part of the Libyan digital newspapers which are currently no longer available on the live web.
PID Signposting Pattern
Presentation for PIDapalooza 2016. PIDs need to be used to achieve their intended persistence. Our research (reported at WWW2016, see http://arxiv.org/1602.09102) found that a disturbing percentage of references to papers that have DOIs actually use the landing page HTTP URI instead of the DOI HTTP URI. The problem is likely related to tools used for collecting references such as bookmarks and reference managers. These select the landing page URI instead of the DOI URI because the former is what's available in the address bar. It can safely be assumed that the same problem exists for other types of PIDs. The net result is that the true potential of PIDs is not realized. In order to ameliorate this problem we propose a Signposting pattern for PIDs (http://signposting.org/identifier/). It consists of adding a Link header to HTTP HEAD/GET responses for all resources identified by a DOI, including the landing page and content resources such as "the PDF" and "the dataset". The Link header contains a link, which points with the "identifier" relation type to the DOI HTTP URI. When such a link is available, tools can automatically discover and use the DOI URI instead of the other URIs (landing page, PDF, dataset) associated with the DOI-identified object.
Viewers also liked (6)
Tweet Visibility Dynamics in a Tweet Conversation Graph
Tweet Visibility Dynamics in a Tweet Conversation Graph
Old Dominion University Computer Science IIPC New Member
Old Dominion University Computer Science IIPC New Member
Making Enterprise-Level Archive Tools Accessible for Personal Web Archiving
Making Enterprise-Level Archive Tools Accessible for Personal Web Archiving
Combining Heritrix and PhantomJS for Better Crawling of Pages with Javascript
Combining Heritrix and PhantomJS for Better Crawling of Pages with Javascript
Similar to How I spend my summer vacations
Learning Analytics - CET Seminar 2012
This document discusses learning analytics and ways of visualizing educational data. It outlines understandings of learning analytics and describes the data landscape in education including institutional data from systems like LMSs, individual social media data, and personal learning environments. The document discusses tools for reproducible research, looking for trends in large datasets, and visualizing data beyond dashboards. It provides examples of learning analytics tools and visualizations used at institutions like Purdue and explores analyzing social media and networks. The document concludes by discussing future scenarios for learning analytics research.
We Went Mobile! (Or Did We?)
The document summarizes a presentation given by Laura Turner and Alejandra Nann on their efforts to test the mobile accessibility of third-party online resources accessible through their library website. They tested 258 resources on various mobile devices and found that 67 met Google's criteria for optimal mobile usability. Issues encountered included security warnings, outdated content, and resources not supporting mobile devices. The presenters discussed promoting resources that are mobile-friendly and ways to standardize the user experience across devices.
Big Data Curricula at the UW eScience Institute, JSM 2013
A 25 minute talk from a panel on big data curricula at JSM 2013
http://www.amstat.org/meetings/jsm/2013/onlineprogram/ActivityDetails.cfm?SessionID=208664
Data Sets, Ensemble Cloud Computing, and the University Library: Getting the ...
This document discusses research data management and the role of university libraries. It describes the SEAD (Sustainable Environment Actionable Data) project, which provides data services like curation, preservation, and a social community network to support research data across its lifecycle. SEAD aims to support interdisciplinary research by allowing researchers to define and manage related collections of data and metadata called Research Objects in a scalable way. The document argues that research organizations are best positioned to provide comprehensive long-term data services that integrate across the entire research process.
Designing a synergistic relationship between undergraduate Data Science educa...
Biodiversity data is extremely approachable – the concept of a specimen existing in time and place is clear to grasp and interesting to a wide range of people. I exploited this inherent feature of Biodiversity data to create an educational framework for teaching undergraduate Data Science. The project utilized Discovery Learning theory, based in the belief that it is best for learners to discover facts and relationships for themselves. Students were given a choice of databases and were mentored through an entire data analysis pipeline, including gathering, cleaning, analyzing, and visualization of the data. Their work culminates into a tutorial posted online (curiositydata.org) – instilling proper documentation, open science, and data management techniques. These tutorials can then be used and remixed as documentation for the databases, curriculum, and workshops detailing how to access and analyze the databases data. Increased documentation will overcome accessibility challenges that plague many Biodiversity databases, in an overarching aim to increase the usage and in turn value of these vital data resources. Computer Science, Statistics, and Biology undergraduates are increasingly “data literate”, and if mentored properly, we can foster a symbiotic relationship between the real-world Data Science education and the increase of usability of Biodiversity databases.
552 guestlecture 20140308
The document summarizes a guest lecture about the changing landscape of academic librarianship and data curation. It discusses the speaker's background and job responsibilities as a data curation librarian, which include advocating for data management, consulting on data practices, educating researchers, and supporting other librarians. The speaker's job also involves liaison work with a college and engaging in professional service, research, and librarianship. Their graduate program in information sciences prepared them through coursework, internships, and faculty support. Tips are provided for the job search process.
#mytweet via Instagram: Exploring User Behaviour Across Multiple Social Networks
We study how users of multiple online social net- works (OSNs) employ and share information by studying a common user pool that use six OSNs – Flickr, Google+, Instagram, Tumblr, Twitter, and YouTube. We analyze the temporal and topical signature of users’ sharing behaviour, showing how they exhibit distinct behaviorial patterns on different networks. We also examine cross-sharing (i.e., the act of user broadcasting their activity to multiple OSNs near-simultaneously), a previously unstudied behaviour and demonstrate how certain OSNs play the roles of originating source and destination sinks.
#CitSciNZ2018 - Andrea Wiggins (University of Nebraska) Fitness for Intended ...
#CitSciNZ2018 - Citizen Science Symposium 2018
9 April 2018, Monday; Te Papa Museum, Wellington
Speaker: Andrea Wiggins (Keynote Speaker)
Organization: Univesity of Nebraska
Topic: Fitness for Intended Use: Designing, Managing, and Accessing Data Quality in Citizen Science
Planning a Successful Digital Project
Slides from the "Planning a Successful Digital Project" start-to-finish session presented at the Wisconsin Library Association annual conference, Green Bay, October 25, 2013. Presenters: Sarah Grimm, Electronic Records Archivist, Wisconsin Historical Society and Emily Pfotenhauer, Recollection Wisconsin Program Manager, WiLS.
Data sharing in the age of the Social Machine
Social machines generate and consume data. A Web Observatory is proposed as an infrastructure to support data sharing among social machines and the human elements involved in data generation, analysis, and consumption. Key challenges include designing such an infrastructure for generality while addressing ethical, legal, and technological issues around metadata standards, access control, and performance across different computing platforms and stakeholder needs.
When Search becomes Research and Research becomes Search
SIGIR'13 Workshop on Exploration, Navigation and Retrieval of Information in Cultural Heritage (ENRICH).
Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...
This document discusses the Sustainable Environment Actionable Data (SEAD) project, which aims to lower the costs and increase the value of data curation through a data lifecycle approach. SEAD provides lightweight data services to support sustainability research, including secure project workspaces, active and social curation tools, and integrated lifecycle support for data from ingest to long-term preservation. By leveraging technologies like Web 2.0 and standards, SEAD simplifies and automates curation processes using metadata captured from data producers and users. This allows curation activities to begin earlier in the data lifecycle and be distributed across researchers and curators.
Ethnographically-inspired usability testing
This presentation to the 2015 i3 Conference in Aberdeen describes two weeks of ethnographically-inspired, synchronous usability testing which will have been conducted on a prototype for a new library search tool at a small university in the United Kingdom. Phase one of testing is complete and the presentation covers the design process, initial analysis and reflection on the methods, as well as the demands placed on the research design by the practitioner setting.
Visualising activity in learning networks using open data and educational ...
Delivered October13, 2011 in Cape Town South Africa at the 2011 Southern African Association for Institutional Research forum
Abstract
As more student academic activities involve both institutional and social networks, educational analysts are needing to investigate ways in which this data can be collected and interpreted to enhance learning experiences. Data recorded as students explore personal learning environments is most often not accessible or incomplete. Here we explore some of the approaches that exist to use these social networking platforms along with information from the learning management system and academic records. Combining and analysing this data has allowed us to create a number of interesting visualizations exposing patterns which would have been impossible to glean from looking at the data alone. In an age of data abundance we reflect on using some of these new measures in relation to improving learning design, increasing academic responsiveness and enhanced student experiences.
Jaffe o'brien-rosetta
This document discusses metadata best practices for describing digital objects entered into the digital preservation system Rosetta at Binghamton University Libraries. It recommends using consistent, simple, and intelligible Dublin Core metadata fields structured in a custom metadata form. The workflow involves assessing digital objects, arranging their metadata, and approving them as intellectual entities in Rosetta for long-term preservation and discovery in the Primo library catalog.
Big and Small Web Data
Workshop session given at the Institutional Web Management Workshop 2012 (IWMW 2012) event held at the University of Edinburgh on 18th - 20th June 2012.
Crowdsourcing for HCI Research with Amazon Mechanical Turk
Crowdsourcing allows researchers to access a large user pool and quickly collect data at low cost through online platforms like Mechanical Turk. However, careful task design is required to obtain good results. Experiment 1 on Mechanical Turk to rate Wikipedia articles only marginally correlated with expert ratings and had many invalid responses. Experiment 2 improved task design by adding verifiable questions, making malicious answers costly, and putting objective tasks before subjective ratings. This led to significantly higher correlation with experts and fewer invalid responses. While crowdsourcing has limitations, it can be useful for user studies with the right task design.
Hany's JCDL Doctoral Consortium
The document discusses detecting and modeling user temporal intention in social media. It presents a dissertation plan to analyze how shared resources change over time as links and content are updated. The plan includes collecting data from archives and social media, analyzing factors like shortened URLs and intention, developing models to predict intention, and creating applications to maintain temporal consistency. The goal is to better understand how users' intentions change as shared content changes and to build tools that preserve the intended version.
Lecture4 Social Web
How can we mine, analyse and visualise the Social Web?
In this lecture, you will learn about mining social web data for analysis. Data preparation and gathering basic statistics on your data.
Hany's Doctoral Consortium
This document outlines the plan for a dissertation that aims to estimate users' temporal intention when sharing and accessing resources on social media. The plan involves analyzing archived web coverage, shortened URI persistence, the loss of shared social media resources over time, and contextual factors that influence intention. The goal is to build a model that can predict intention and induce preservation of vulnerable content to maintain temporal consistency. Key steps include collecting intention-based datasets, extracting intention features, training and evaluating predictive models, and developing applications. Publications will analyze coverage of archives, shortened URIs, and the persistence of shared social media resources.
Similar to How I spend my summer vacations (20)
Big Data Curricula at the UW eScience Institute, JSM 2013
Big Data Curricula at the UW eScience Institute, JSM 2013
Data Sets, Ensemble Cloud Computing, and the University Library: Getting the ...
Data Sets, Ensemble Cloud Computing, and the University Library: Getting the ...
Designing a synergistic relationship between undergraduate Data Science educa...
Designing a synergistic relationship between undergraduate Data Science educa...
#mytweet via Instagram: Exploring User Behaviour Across Multiple Social Networks
#mytweet via Instagram: Exploring User Behaviour Across Multiple Social Networks
#CitSciNZ2018 - Andrea Wiggins (University of Nebraska) Fitness for Intended ...
#CitSciNZ2018 - Andrea Wiggins (University of Nebraska) Fitness for Intended ...
When Search becomes Research and Research becomes Search
When Search becomes Research and Research becomes Search
Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...
Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...
Visualising activity in learning networks using open data and educational ...
Visualising activity in learning networks using open data and educational ...
Crowdsourcing for HCI Research with Amazon Mechanical Turk
Crowdsourcing for HCI Research with Amazon Mechanical Turk
More from Justin Brunelle
Scripts in a Frame: A Two-Tiered Crawling Approach to Archiving Deferred Repr...
This document summarizes Justin Brunelle's dissertation defense on archiving deferred web representations using a two-tiered crawling approach. It discusses how current archival tools are unable to fully capture dynamic and interactive web pages that use JavaScript to modify page content after load. The dissertation measures the impact of missing JavaScript resources on memento quality and proposes crawling pages using PhantomJS to execute scripts and archive the complete representation as seen by users. Future work is needed to scale this approach for archiving large portions of the deferred web at risk of being lost to history.
Not All Mementos Are Created Equal: Measuring The Impact Of Missing Mementos
This document discusses measuring the quality of archived webpages or "mementos" when some embedded resources like images or CSS are missing. It found that a "damage rating" approach, which considers factors like the size, position and importance of missing resources, was a better indicator of memento quality than just the percentage of missing resources. A study with Amazon Mechanical Turk users found they agreed more with damage ratings than percentage missing when comparing mementos. The quality of mementos in the Internet Archive was also found to generally improve over time despite more resources being missing.
An Evaluation of Caching Policies for Memento TimeMaps
This document evaluates caching policies for Memento TimeMaps. The authors observed changes to over 4,000 TimeMaps for 92 days and analyzed caching policies based on the changes. They found that TimeMaps either remained unchanged (77.4%) or increased in size through new archives or mementos (22.6%). An optimal TimeMap cache Time-To-Live of 15 days balances freshness with reduced load on archives by caching incrementally improving TimeMaps.
Filling in the Blanks: Capturing Dynamically Generated Content
JCDL 2012 Doctoral Consortium presentation by Justin F. Brunelle. Covers the problem Web 2.0 creates for preservation, and proposes a solution for client-side capture of content.
Day in the Life of a Computer Scientist
Justin F. Brunelle is a computer scientist who works at The MITRE Corporation and received his BS and MS in computer science from Old Dominion University. He is currently pursuing his PhD in digital preservation from ODU under Dr. Nelson, focusing on ensuring web pages are archived over time. Previously he conducted research in serious games and intelligent tutoring systems.
Agile Engineering - ODU ACM
This document provides an introduction to agile methodologies and Scrum. It explains that agile promotes iterative development, user feedback, and rapid prototyping. Scrum is then defined as a common agile framework using self-organizing teams, sprints, product backlogs to prioritize work, and retrospectives to improve. Key Scrum roles of Product Owner, Scrum Master, and Development Team are outlined along with processes like storyboarding, backlogs, sprints, and reviews.
Records expo
The document discusses how to find archived web pages from the past using two different services - http://web.archive.org and Memento. It explains that web.archive.org allows searching for and accessing cached pages of a website like CNN from specific past dates, while Memento aims to make navigating archived past web pages easier through its framework and development community.
Digital Preservation - ODU
This is the slide deck of the presentation given to the RRAC national group meeting on 10-20-2010. It is a summary of the research efforts in Digital Preservation at ODU.
Digital Preservation at ODU
The presentation given for the RRAC meeting on 10-20-2010. This is a summary of the research efforts in Digital Preservation at Old Dominion University.
More from Justin Brunelle (9)
Scripts in a Frame: A Two-Tiered Crawling Approach to Archiving Deferred Repr...
Scripts in a Frame: A Two-Tiered Crawling Approach to Archiving Deferred Repr...
Not All Mementos Are Created Equal: Measuring The Impact Of Missing Mementos
Not All Mementos Are Created Equal: Measuring The Impact Of Missing Mementos
An Evaluation of Caching Policies for Memento TimeMaps
An Evaluation of Caching Policies for Memento TimeMaps
Filling in the Blanks: Capturing Dynamically Generated Content
Filling in the Blanks: Capturing Dynamically Generated Content
Recently uploaded
Heartfulness Magazine - June 2024 (Volume 9, Issue 6)
Dear readers,
This month we continue with more inspiring talks from the Global Spirituality Mahotsav that was held from March 14 to 17, 2024, at Kanha Shanti Vanam.
We hear from Daaji on lifestyle and yoga in honor of International Day of Yoga, June 21, 2024. We also hear from Professor Bhavani Rao, Dean at Amrita Vishwa Vidyapeetham University, on spirituality in action, the Venerable BhikkuSanghasena on how to be an ambassador for compassion, Dr. Tony Nader on the Maharishi Effect, Swami Mukundananda on the crossroads of modernization, Tejinder Kaur Basra on the purpose of work, the Venerable GesheDorjiDamdul on the psychology of peace, the Rt. Hon. Patricia Scotland, KC, Secretary-General of the Commonwealth, on how we are all related, and world-renowned violinist KumareshRajagopalan on the uplifting mysteries of music.
Dr. Prasad Veluthanar shares an Ayurvedic perspective on treating autism, Dr. IchakAdizes helps us navigate disagreements at work, Sravan Banda celebrates World Environment Day by sharing some tips on land restoration, and Sara Bubber tells our children another inspiring story and challenges them with some fun facts and riddles.
Happy reading,
The editors
The Vulnerabilities of Individuals Born Under Swati Nakshatra.pdf
Individuals born under Swati Nakshatra often exhibit a strong sense of independence and adaptability, yet they may also face vulnerabilities such as indecisiveness and a tendency to be easily swayed by external influences. Their quest for balance and harmony can sometimes lead to inner conflict and a lack of assertiveness. To know more visit: astroanuradha.com
Sanatan Vastu | Experience Great Living | Vastu Expert
Santan Vastu Provides Vedic astrology courses & Vastu remedies, If you are searching Vastu for home, Vastu for kitchen, Vastu for house, Vastu for Office & Factory. Best Vastu in Bahadurgarh. Best Vastu in Delhi NCR
Trusting God's Providence | Verse: Romans 8: 28-31
Trusting God's Providence.
Providence - God’s active preservation and care over His creation. God is both the Creator and the Sustainer of all things Heb. 1:2-3; Col. 1:17
-God keep His promises.
-God’s general providence is toward all creation
- All things were made through Him
God’s special providence is toward His children.
We may suffer now, but joy can and will come
God can see what we cannot see
Astronism, Cosmism and Cosmodeism: the space religions espousing the doctrine...
This lecture created by Brandon Taylorian (aka Cometan) specially for the CESNUR Conference held Bordeaux in June 2024 provides a brief introduction to the legacy of religious and philosophical thought that Astronism emerges from, namely the discourse on transcension started assuredly by the Cosmists in Russia in the mid-to-late nineteenth century and then carried on and developed by Mordecai Nessyahu in Cosmodeism in the twentieth century. Cometan also then provides some detail on his story in founding Astronism in the early twenty-first century from 2013 along with details on the central Astronist doctrine of transcension. Finally, the lecture concludes with some contributions made by space religions and space philosophy and their influences on various cultural facets in art, literature and film.
Monthly Khazina-e-Ruhaniyaat Jun’2024 (Vol.15, Issue 2)
2nd issue of Volume 15. A magazine in urdu language mainly based on spiritual treatment and learning. Many topics on ISLAM, SUFISM, SOCIAL PROBLEMS, SELF HELP, PSYCHOLOGY, HEALTH, SPIRITUAL TREATMENT, Ruqya etc.A very useful magazine for everyone.
English - The Book of 1st Samuel the Prophet.pdf
The Book of Samuel is a book in the Hebrew Bible, found as two books in the Old Testament. The book is part of the Deuteronomistic history, a series of books that constitute a theological history of the Israelites and that aim to explain God's law for Israel under the guidance of the prophets.
Is Lucid Dreaming Dangerous? Risks and Benefits!
Lucid Dreaming: Understanding the Risks and Benefits
The ability to control one's dreams or for the dreamer to be aware that he or she is dreaming. This process, called lucid dreaming, has some potential risks as well as many fascinating benefits. However, many people are hesitant to try it initially for fear of the potential dangers. This article aims to clarify these concerns by exploring both the risks and benefits of lucid dreaming.
The Benefits of Lucid Dreaming
Lucid dreaming allows a person to take control of their dream world, helping them overcome their fears and eliminate nightmares. This technique is particularly useful for mental health. By taking control of their dreams, individuals can face challenging scenarios in a controlled environment, which can help reduce anxiety and increase self-confidence.
Addressing Common Concerns
Physical Harm in Dreams Lucid dreaming is fundamentally safe. In a lucid dream, everything is a creation of your mind. Therefore, nothing in the dream can physically harm you. Despite the vividness and realness of the dream experience, it remains entirely within your mental landscape, posing no physical danger.
Mental Health Risks Concerns about developing PTSD or other mental illnesses from lucid dreaming are unfounded. As soon as you wake up, it's clear that the events experienced in the dream were not real. On the contrary, lucid dreaming is often seen as a therapeutic tool for conditions like PTSD, as it allows individuals to reframe and manage their thoughts.
Potential Risks of Lucid Dreaming
While generally safe, lucid dreaming does come with a few risks as well:
Mixing Dream Memories with Reality Long-term lucid dreamers might occasionally confuse dream memories with real ones, creating false memories. This issue is rare and preventable by maintaining a dream journal and avoiding lucid dreaming about real-life people or places too frequently.
Escapism Using lucid dreaming to escape reality can be problematic if it interferes with your daily life. While it is sometimes beneficial to escape and relieve the stress of reality, relying on lucid dreaming for happiness can hinder personal growth and productivity.
Feeling Tired After Lucid Dreaming Some people report feeling tired after lucid dreaming. This tiredness is not due to the dreams themselves but often results from not getting enough sleep or using techniques that disrupt sleep patterns. Taking breaks and ensuring adequate sleep can prevent this.
Mental Exhaustion Lucid dreaming can be mentally taxing if practiced excessively without breaks. It’s important to balance lucid dreaming with regular sleep to avoid mental fatigue.
Lucid dreaming is safe and beneficial if done with caution. It has many benefits, such as overcoming fear and improving mental health, and minimal risks. There are many resources and tutorials available for those interested in trying it.
Chandra Dev: Unveiling the Mystery of the Moon God
Shining brightly in the sky, some days more than others, the Moon in popular culture is a symbol of love, romance, and beauty. The ancient Hindu texts, however, mention the Moon as an intriguing and powerful being, worshiped by sages as Chandra.
Lesson 12 - The Blessed Hope: The Mark of the Christian.pptx
Lesson 12 - The Blessed Hope: The Mark of the Christian
SBS – Sunday Bible School
Adult Bible Lessons 2nd quarter 2024 CPAD
MAGAZINE: THE CAREER THAT IS PROPOSED TO US: The Path of Salvation, Holiness and Perseverance to Reach Heaven
Commentator: Pastor Osiel Gomes
Presentation: Missionary Celso Napoleon
Renewed in Grace
Recently uploaded (12)
Heartfulness Magazine - June 2024 (Volume 9, Issue 6)
Heartfulness Magazine - June 2024 (Volume 9, Issue 6)
The Vulnerabilities of Individuals Born Under Swati Nakshatra.pdf
The Vulnerabilities of Individuals Born Under Swati Nakshatra.pdf
Sanatan Vastu | Experience Great Living | Vastu Expert
Sanatan Vastu | Experience Great Living | Vastu Expert
Trusting God's Providence | Verse: Romans 8: 28-31
Trusting God's Providence | Verse: Romans 8: 28-31
Astronism, Cosmism and Cosmodeism: the space religions espousing the doctrine...
Astronism, Cosmism and Cosmodeism: the space religions espousing the doctrine...
Monthly Khazina-e-Ruhaniyaat Jun’2024 (Vol.15, Issue 2)
Monthly Khazina-e-Ruhaniyaat Jun’2024 (Vol.15, Issue 2)
Chandra Dev: Unveiling the Mystery of the Moon God
Chandra Dev: Unveiling the Mystery of the Moon God
Lesson 12 - The Blessed Hope: The Mark of the Christian.pptx
Lesson 12 - The Blessed Hope: The Mark of the Christian.pptx
How I spend my summer vacations
- 1. How I spend my summer vacations Justin F. Brunelle WS-DL Research Group Department of Computer Science Old Dominion University WADL 2013
- 2. Justin in a nutshell • PhD Student at ODU • Dynamic representations –in the archives –Improved quality from –archived data –Alter-ego: Application Developer • at The MITRE Corporation –Big data & cloud computing
- 3. How much can we archive?
- 4. The setup • 1,000 URIs from Twitter • 1,000 URIs from Archive-it • Capture with tools • Study the archivability
- 5. Good
- 6. Good
- 7. Good
- 8. Meh… Zombies in the Archives
- 9. Bad
- 10. Bad
- 11. Bad
- 12. Bad
- 13. Bad
- 14. Why?
- 15. Losing the Moment • What we share != What we curate • 4.2% of Twitter is perfectly archived –Losing My Revolution: 11% gone in 2 years • 34.2% of Archive-it is perfectly archived • Accessibility? Gov vs. non-Gov?
- 17. VS.
- 18. Not all embedded resources are created equal
- 19. Not all embedded resources are created equal
- 20. Planned Work • Evaluate importance of missing stuff –Size, position –# CSS Classes –Not all stylesheets created equal – Missing border vs missing functionality – “Whitespace” –Provide Web service • Mechanical Turk evaluation of “damage” • Evaluate collections of mementos
- 21. What does it all mean? • Archivability is measurable • Damage is measurable • If we can predict archivability…. –We can try new methods of archiving on “hard to capture” mementos –Attempt repairs on existing mementos –Gauge our successes in real-time • Next step: capturing dynamic content