Semantic Annotation Tool Presentation-DH2017

•Download as PPTX, PDF•

0 likes•140 views

A description of how the Semantic Annotation Tool was used in a prototype machine vision project for indexing and search.

Software

SEMANTIC
ANNOTATION TOOL
AND
KNIGHT SEARCH
PROTOTYPE
Combined Machine/Human
Annotation Ecosystems
John Bell (Dartmouth) | @nmdjohn
Dimitrios Latsis (Ryerson)
Lorenzo Torresani (Dartmouth)
Mark Williams (Dartmouth) |
@markj2

ARCLIGHT GUIDEBOOK
THE ARCLIGHT GUIDEBOOK TO MEDIA HISTORY
AND THE DIGITAL HUMANITIES

KNIGHT PROTOTYPE GRANT
Visual Learning Group at Dartmouth (Prof.
Lorenzo Torresani)
Internet Archive/Dartmouth College Library
(Educational Films)
Virtual Environment and Multimodal
Interaction Lab at University of Maine (Prof.
Nicholas Giudice and Dr. Richard Corey)
Computer Vision and Machine Learning to recognize
Objects, Actions, Locations, Speech, Audio, Written Text

DU TRAN, LUBOMIR
BOURDEV, ROB FERGUS,
LORENZO TORRESANI,
MANOHAR PALURI
SPORT CLASSIFICATION
USING C3D ON SPORTS-1M
DATASET
VIDEO FRAMES ARE
VISUALIZED WITH TOP 2
PREDICTIONS
VISUAL LEARNING GROUP VIDS
C3D: Generic Features for Video Analysis

ANNOTATE, SHARE, ARCHIVE!
Access, Outreach, Pedagogy
Annotate, Share, Archive!

SEMANTIC ANNOTATION TOOL
Waldorf.js Statler
• jQuery plugin
• Annotation interface
• Merges annotations,
vocabularies, and video
in browser
• Ruby on Rails
• Annotation aggregator
• API-based interactions
• W3C Open Annotations

WALDORF.JS & STATLER
Interface
jQuery plugin wraps videos on
page with annotation interface
• Time and geometry delimited
annotations
• Meant for integration with other
research and CMS tools
• Designed for accessibility and
screen reader compatibility

WALDORF.JS & STATLER
Features
• Add annotation to an existing
page with only a few lines of
Javascript
• Suggest tags loaded from
external vocabulary files
(onomy.org)
• Identify annotation authors by
email address
• Identify videos by URI

CODE
RC1 Code
Waldorf.js http://dartgo.org/mep-waldorf
Statler http://dartgo.org/mep-statler
API docs and install instructions for AWS

Project page: http://digitalnature.slis.tsukuba.ac.jp/2016/08/holographic_whisper Pixie Dust Technologies, Inc.: http://pixiedusttech.com/ Holographic Whisper: Rendering Audible Sound Spots in Three-dimensional Space by Focusing Ultrasonic Waves CHI 2017 Paper Abstract: We propose a novel method of three-dimensional spatial audio rendering by expanding the ultrasonic phased array technique. We employ an ultrasonic phased array as a holographic acoustic generator to focus ultrasound at arbitrary three-dimensional positions. The sound pressure at the ultrasonic focal points is sufficiently high to radiate audible sound based on the self-demodulation effect in air. Consequently, the ultrasonic focal points act as audible sound sources. This sound-point method enables us to control aerial audio distributions more flexibly and more precisely in comparison with conventional superdirectional (sound-beam) loudspeakers. This method can generate and vanish the sound sources freely in air. These point sound sources can deliver private messages or music to individuals. Yoichi Ochiai * ***, Takayuki Hoshi** ***, Ippei Suzuki* *University of Tsukuba, **The University of Tokyo, ***Pixie Dust Technologies, Inc.

presentation of Lähellä kaupungissa -project and website

Helsingin yliopisto

Haystack App Presentationtjhillard

There is a philosophical tension in outdoor education about the role of technology. On one hand, outdoor educators seek to distance participants from technology in order to provide “a place apart”. On the other hand, most outdoor education programs rely on a growing plethora of outdoor and safety gear, electronic navigation and communication, and transport technologies. Despite this, outdoor education tends to be somewhat unadventurous in its pedagogical use of technology. Instead, we might experiment with a wider spectrum of technologies (from low tech to high tech). By considering possibilities from across the technological gamut – e.g., from survival programs (low tech) to urban challenges with mobile electronic devices (high tech) – we might enrich our understanding of outdoor learning processes and engage different types of participants.

Mapping Experiences with Actor Network Theory

Liza Potts

My presentation from ATTW's annual conference. I talk about how we can better design for experiences if we first understand the context in which we are building products and services. This simple mapping system helps visualize these contexts. Want more? Check out my book on social media and disaster, filled with more information on how to map networks using actor-network theory http://www.amazon.com/dp/0415817412

Towards User-friendly Audio Creation

Jean Vanderdonckt

This paper presents a new approach to sound composition for soundtrack composers and sound designers. We propose a tool for usable sound manipulation and composition that targets sound variety and expressive rendering of the composition. We rst automatically segment audio recordings into atomic grains which are displayed on our navigation tool ac- cording to signal properties. To perform the synthesis, the user selects one recording as model for rhythmic pattern and timbre evolution, and a set of audio grains. Our synthesis system then processes the chosen sound material to create new sound sequences based on onset detection on the recording model and similarity measurements between the model and the selected grains. With our method, we can create a large variety of sound events such as those encountered in virtual environments or other training simulations, but also sound sequences that can be integrated in a music composition. We present a usability-minded interface that allows to manipulate and tune sound sequences in an appropriate way for sound design.

Ubiquitous Computing and Natural Interfaces for Environmental InformationDiogo Almeida

PhD Thesis: Interaction with a personalised smart space for enhancing everyda...

Università degli Studi di Torino

In the last years the interest for designing and implementing smart spaces grew significantly. Many researchers adopted a top-down approach, focusing on embedding smartness in buildings, objects and everyday artefacts. In my research work I propose the adoption of a user-centred design approach to reach a new definition of smart spaces based on people's needs and requirements. The main goal will be the definition of a new interaction paradigm supporting natural and spontaneous ways of exchanging information between people and their surroundings.

Emerging Forms of Data and Analytics

David De Roure

Morphogenetic Engineering: Reconciling Architecture and Self-Organization Thr...

FET AWARE project - Self Awareness in Autonomic Systems

A theoretical model of differential social attributions toward computing tech...UltraUploader

Current and Future Trends of Media and Information - Part 2.pptx

MarylieNoran2

IVACS 2010

nottyknight

DelRio-Humanidades digitales y big data

Gimena Del Rio Riande

DART_Workshop_Impact_270411

DART Project

Spatial Information Systems yesterday, today and tomorrow

Beniamino Murgante

Mixable reality, Collaboration, and Evaluation (S36: User Experience Design ...

University of South Australlia

Technology and the outdoors: Some experiential possibilities

James Neill

There is a philosophical tension in outdoor education about the role of technology. On the one hand, we strip clients of modern technology and engage them in simple living, adventurous activities in natural environments. On the other hand, there are new experiential learning opportunities available via mobile devices, the internet, and multi-media, etc. How might 21st century technology be used to enhance outdoor education? Possibilities include digital photography, video, audio, maps, blogs, wikis, geocaching, pedometers, and virtual environments. More information: http://wilderdom.com/tech

Archaeology and cultural heritage application working groupManolis Vavalis

Ben Shneiderman: Thrill of Discovery

russ9595

Using Maltego Tungsten to Explore Cyber-Physical Confluence in Geolocation

Shalin Hai-Jew

University of Nottingham - NGI Geospatial Science Example Activities

Jeremy Morley

Scholarship in the Digital World

David De Roure

Seminar at CSAIL, MIT, Cambridge, Mass. Date: Friday October 30, 2015. Time: 4:00 pm - 5:00 pm, Location: D463 (Star) Abstract: Today we are witnessing several shifts in scholarly practice, in and across multiple disciplines, as researchers embrace digital techniques to tackle established research questions in new ways and new questions afforded by digital and digitized collections, approaches, and technologies. Pervasive adoption of technology, coupled with the co-creation of new social processes, has created a new and complex space for scholarship where citizens both generate and analyse data as they interact at the intersection of the physical and digital. Drawing on a background in distributed computing, and adopting the lens of Social Machines, this talk discusses current activity in digital scholarship, framing it in its interdisciplinary settings. Bio: David De Roure is Professor of e-Research at University of Oxford, Director of the Oxford e-Research Centre, and chairs Oxford’s Digital Humanities research programme. He previously directed the Digital Social Research programme for the UK Economic and Social Research Council, and serves as a strategic advisor in new forms of data and realtime analytics. Trained in electronics and computer science, his career has involved interdisciplinary collaborations in chemistry, astrophysics, bioinformatics, social computing, digital libraries, and sensor networks. His personal research is in Computational Musicology, Web Science, and Internet of Things. He is a frequent speaker and writer on digital research and the future of scholarly communications. URL: http://www.oerc.ox.ac.uk/people/dder

W3C Web Annotation in the Semantic Annotation Tool

nmdjohn

Media Ecology Project: Archival Access Online, Born-Networked Scholarship

nmdjohn

NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to help end-users visualize and reason about large data transfers. NetSage traditionally has used a combination of passive measurements, including SNMP and flow data, as well as active measurements, mainly perfSONAR, to provide longitudinal network performance data visualization. It has been deployed by dozens of networks world wide, and is supported domestically by the Engagement and Performance Operations Center (EPOC), NSF #2328479. We have recently expanded the NetSage data sources to include logs for Globus data transfers, following the same privacy-preserving approach as for Flow data. Using the logs for the Texas Advanced Computing Center (TACC) as an example, this talk will walk through several different example use cases that NetSage can answer, including: Who is using Globus to share data with my institution, and what kind of performance are they able to achieve? How many transfers has Globus supported for us? Which sites are we sharing the most data with, and how is that changing over time? How is my site using Globus to move data internally, and what kind of performance do we see for those transfers? What percentage of data transfers at my institution used Globus, and how did the overall data transfer performance compare to the Globus users?

Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...

informapgpstrackings

Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better

XfilesPro

Quarkus Hidden and Forbidden Extensions

Max Andersen

Orion Context Broker introduction 20240604

Fermin Galan

A Sighting of filterA in Typelevel Rite of Passage

Philip Schwarz

Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...

Shahin Sheidaei

Games are powerful teaching tools, fostering hands-on engagement and fun. But they require careful consideration to succeed. Join me to explore factors in running and selecting games, ensuring they serve as effective teaching tools. Learn to maintain focus on learning objectives while playing, and how to measure the ROI of gaming in education. Discover strategies for pitching gaming to leadership. This session offers insights, tips, and examples for coaches, team leads, and enterprise leaders seeking to teach from simple to complex concepts.

Vitthal Shirke Microservices Resume Montevideo

Vitthal Shirke

Recently uploaded (20)

First Steps with Globus Compute Multi-User Endpoints

Globus Connect Server Deep Dive - GlobusWorld 2024

Cyaniclab : Software Development Agency Portfolio.pdf

SOCRadar Research Team: Latest Activities of IntelBroker

top nidhi software solution freedownload

Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf

Graphic Design Crash Course for beginners

Into the Box 2024 - Keynote Day 2 Slides.pdf

Developing Distributed High-performance Computing Capabilities of an Open Sci...

Prosigns: Transforming Business with Tailored Technology Solutions

Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...

Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf

Understanding Globus Data Transfers with NetSage

Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...

Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better

Quarkus Hidden and Forbidden Extensions

Orion Context Broker introduction 20240604

A Sighting of filterA in Typelevel Rite of Passage

Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...

Vitthal Shirke Microservices Resume Montevideo

Semantic Annotation Tool Presentation-DH2017

1. SEMANTIC ANNOTATION TOOL AND KNIGHT SEARCH PROTOTYPE Combined Machine/Human Annotation Ecosystems John Bell (Dartmouth) | @nmdjohn Dimitrios Latsis (Ryerson) Lorenzo Torresani (Dartmouth) Mark Williams (Dartmouth) | @markj2

2. MEP WORDPRESS SITE

3. ARCLIGHT GUIDEBOOK THE ARCLIGHT GUIDEBOOK TO MEDIA HISTORY AND THE DIGITAL HUMANITIES

4. MEDIA ECOLOGY PROJECT

5. KNIGHT PROTOTYPE GRANT

6. KNIGHT PROTOTYPE GRANT Visual Learning Group at Dartmouth (Prof. Lorenzo Torresani) Internet Archive/Dartmouth College Library (Educational Films) Virtual Environment and Multimodal Interaction Lab at University of Maine (Prof. Nicholas Giudice and Dr. Richard Corey) Computer Vision and Machine Learning to recognize Objects, Actions, Locations, Speech, Audio, Written Text

7. DU TRAN, LUBOMIR BOURDEV, ROB FERGUS, LORENZO TORRESANI, MANOHAR PALURI SPORT CLASSIFICATION USING C3D ON SPORTS-1M DATASET VIDEO FRAMES ARE VISUALIZED WITH TOP 2 PREDICTIONS VISUAL LEARNING GROUP VIDS C3D: Generic Features for Video Analysis

9. ANNOTATE, SHARE, ARCHIVE! Access, Outreach, Pedagogy Annotate, Share, Archive!

10. PRELIMINARY RESULTS

11. PRELIMINARY RESULTS

12. PRELIMINARY RESULTS

13. PRELIMINARY RESULTS

14. PRELIMINARY RESULTS

15. PRELIMINARY RESULTS

16. PRELIMINARY RESULTS

17. SEMANTIC ANNOTATION TOOL

18. SEMANTIC ANNOTATION TOOL Waldorf.js Statler • jQuery plugin • Annotation interface • Merges annotations, vocabularies, and video in browser • Ruby on Rails • Annotation aggregator • API-based interactions • W3C Open Annotations

19. WALDORF.JS & STATLER Interface jQuery plugin wraps videos on page with annotation interface • Time and geometry delimited annotations • Meant for integration with other research and CMS tools • Designed for accessibility and screen reader compatibility

20. WALDORF.JS & STATLER Features • Add annotation to an existing page with only a few lines of Javascript • Suggest tags loaded from external vocabulary files (onomy.org) • Identify annotation authors by email address • Identify videos by URI

21. WALDORF.JS INTEGRATION

22. WORKFLOW Statler Waldorf.j s

23. CODE RC1 Code Waldorf.js http://dartgo.org/mep-waldorf Statler http://dartgo.org/mep-statler API docs and install instructions for AWS

24. THANKS

Editor's Notes

Scalar and mediathread, while good, are repurposed tools. To see where we want to go with this really requires looking at Waldorf.js and Statler, the annotation plugins we created with an NEH grant
Addresses question of “the computer only sees x but my question is about y” Not quant vs. qual, quant as connective tissue that creates links between qualitative observations What are we exposting publicly? Nothing that we need to be legally responsible for

Semantic Annotation Tool Presentation-DH2017

Recommended

Recommended

More Related Content

Similar to Semantic Annotation Tool Presentation-DH2017

Similar to Semantic Annotation Tool Presentation-DH2017 (20)

More from nmdjohn

More from nmdjohn (8)

Recently uploaded

Recently uploaded (20)

Semantic Annotation Tool Presentation-DH2017

Editor's Notes