The idea behind this project is to use a wearable WSN to produce music. The user wears a certain number of sensors, sampling accelerometric data: these data are mapped into MIDI messages, that are routed toward a musical software. The WSN is seen as a standard input MIDI peripheral.
The platform allows new expressive forms based on gestuality: using more sensors placed on the body (with an appropriate mapping), it could be possible to link different forms of expressivity, such dance and music.
In this presentation, Swetha presents an innovative solution that aims to solve traffic problems in the country. Her solution uses sensors to collect information and relay the information to users over a mobile app.
DESIGN AND IMPLEMENTATION OF CAMERA-BASED INTERACTIVE TOUCH SCREENJournal For Research
Camera-based Interactive Touch Screen is a touch detection technique that uses a camera to provide a large display with very high spatial and temporal resolutions. The conventional touch screen technology and presentation methods face a range of restrictions. However, the camera-based touch detection can overcome all these restrictions and turn projection screens into interactive touch displays, creating a through-window experience. It uses a coated sheet of glass as the projection surface to form a two-dimensional display. The camera captures images of the projection surface continuously, which are processed by the Atmega16 microcontroller. A UART module connected to the microcontroller, provides asynchronous serial communication with external devices, synchronisation of the serial data stream and recovery of data characters. This technology has several advantages over other touch detection technologies, such as its low cost, simple design and scalable structure. The applications of this technology include advertising, presentations and outdoor displays.
In this presentation, Swetha presents an innovative solution that aims to solve traffic problems in the country. Her solution uses sensors to collect information and relay the information to users over a mobile app.
DESIGN AND IMPLEMENTATION OF CAMERA-BASED INTERACTIVE TOUCH SCREENJournal For Research
Camera-based Interactive Touch Screen is a touch detection technique that uses a camera to provide a large display with very high spatial and temporal resolutions. The conventional touch screen technology and presentation methods face a range of restrictions. However, the camera-based touch detection can overcome all these restrictions and turn projection screens into interactive touch displays, creating a through-window experience. It uses a coated sheet of glass as the projection surface to form a two-dimensional display. The camera captures images of the projection surface continuously, which are processed by the Atmega16 microcontroller. A UART module connected to the microcontroller, provides asynchronous serial communication with external devices, synchronisation of the serial data stream and recovery of data characters. This technology has several advantages over other touch detection technologies, such as its low cost, simple design and scalable structure. The applications of this technology include advertising, presentations and outdoor displays.
Education set for collecting and visualizing data using sensor system based o...IJMER
This article presents the issues of the wireless sensor measuring systems design which might
be used in education process of computer science faculty. The work shows the integration of a simple
measuring system, data management system, visual system and the hardware. Education set is designed
to consolidate knowledge in many fields of computer science and the interdependence between them, as
programming techniques, database, Web server, communications protocols, software and hardware.
Presented measuring sensor system consists of a number of measurement nodes, whose role is to
provide information about certain desirable characteristics, warning against natural hazards or
violation of the physical safety. An important part of the sensor system is a measuring subsystem and
the collecting measurement data subsystem. The article presents the temperature measurement sensor
system concepts and measurement data storage and visualization methods
Experimental Analysis of an Energy-Efficient WSNidescitation
A wireless sensor network (WSN) is a collection of many tiny wireless sensor
nodes which keep collecting various physical phenomena related data from their
surrounding areas, where they are deployed and the same is sent towards the gateway.
Different and many pieces of information, such as the occurrence of an event in the field and
associated statistical values are computed from the collected data by these nodes. This data
needs to be provided to authenticated end users, who are also remotely located, without any
delays. This work presents an experimental WSN set up making use of accelerometer
sensors and the experimental results of the same are presented. This work also presents the
underlying XMesh routing protocol and an analysis of the its usage in the experimental set
up is also provided.
StadtLärm - A Distributed Urban Noise Monitoring System M2M Alliance e.V.
StadtLärm - A Distributed Urban Noise Monitoring System by
Tino Hutschenreuther, IMMS Institut für Mikroelektronik- und Mechatronik-Systeme gemeinnützige GmbH
Education set for collecting and visualizing data using sensor system based ...IJMER
This article presents the issues of the wireless sensor measuring systems design which might
be used in education process of computer science faculty. The work shows the integration of a simple
measuring system, data management system, visual system and the hardware. Education set is designed
to consolidate knowledge in many fields of computer science and the interdependence between them, as
programming techniques, database, Web server, communications protocols, software and hardware.
Presented measuring sensor system consists of a number of measurement nodes, whose role is to
provide information about certain desirable characteristics, warning against natural hazards or
violation of the physical safety. An important part of the sensor system is a measuring subsystem and
the collecting measurement data subsystem. The article presents the temperature measurement sensor
system concepts and measurement data storage and visualization methods
In last few years there is a rapid growth in urbandevelopment plans, the concept of smart cities.While the thought comes up for Smart cities there is a requirement for Smart waste management. The idea of Garbage monitoring system is for the Smart buildings, Colleges, Hospitals and Bus stands. The Garbage monitoring system thought is an improvement of normal dustbin by elevating it to be smart using sensors. Garbage monitoring system is a new idea of implementation which makes a normal dustbin smart using ultrasonic sensors for garbage level detection, display and sending message to the concern department person updating the status of the bin using GSM modem. P. Ramchandar Rao | S. Sanjay Kumar | Ch. Rajendra Prasad"Garbage Monitoring System using Arduino" Published in International Journal of Trend in Scientific Research and Development (ijtsrd), ISSN: 2456-6470, Volume-1 | Issue-6 , October 2017, URL: http://www.ijtsrd.com/papers/ijtsrd4602.pdf http://www.ijtsrd.com/engineering/electronics-and-communication-engineering/4602/garbage-monitoring-system-using-arduino/p-ramchandar-rao
A proposed model for traffic signal preemption using global positioning syste...csandit
A Traffic Signal Preemption system is an automated system that allows normal operation of
traffic lights at automated signalized intersections to be preempted. Preemption of signals is
generally done to assist emergency vehicles, such as ambulances, so that response times are
reduced and right-of-way is provided in a smooth and controlled manner. This paper proposes
an innovative and cost-effective server-centric model to facilitate preemption using a simple
mobile phone app which uses Global Positioning System (GPS) and a microcontroller which
controls traffic signals.
A PROPOSED MODEL FOR TRAFFIC SIGNAL PREEMPTION USING GLOBAL POSITIONING SYSTE...cscpconf
A Traffic Signal Preemption system is an automated system that allows normal operation of traffic lights at automated signalized intersections to be preempted. Preemption of signals is
generally done to assist emergency vehicles, such as ambulances, so that response times are reduced and right-of-way is provided in a smooth and controlled manner. This paper proposes an innovative and cost-effective server-centric model to facilitate preemption using a simple mobile phone app which uses Global Positioning System (GPS) and a microcontroller which controls traffic signals.
A ZigBee Based Wireless Sensor Network for an Agricultural Environmentijsrd.com
This paper reports the design and development of a smart wireless sensor network (WSN) for an agricultural environment. Monitoring agricultural environments for various factors such as light, temperature and humidity along with other factors can be of significance. The sensor data is transmitted to network coordinator which is heart of the wireless personal area network. In the modern scenario wireless networks contains sensors as well as actuators. ZigBee is newly developed technology that works on IEEE standard 802.15.4, which can be used in the wireless sensor network (WSN). The low data rates, low power consumption, low cost are main features of ZigBee. WSN is composed of ZigBee coordinator (network coordinator), ZigBee router and ZigBee end device. The sensor nodes information in the network will be sent to the coordinator, the coordinator collects sensor data, stores the data in memory, process the data, and route the data to appropriate node.
The aim of this project is to provide a device capable of collecting data from various sensors and send such data on the internet, so that you can view with different client.
The data collect is fundamental for research activity and for to have large amounts of data, so that immediately brings many benefits.
Through telecommunication technologies and devices can have a good battery outdoor, you can communicate different data remotely to as many clients.
Teleoperating a robotic arm through a gyroscopic helmetFrancesco Corucci
I worked on this project for a Real Time Systems class. It is basically a pointing device, based on a gyroscopic helmet controlling a little robotic arm. The hardware consists of Evidence FLEX boards running a Real-Time OS called Erika Enterprise (Open Source RTOS for single- and multi-core applications)
This project was developed for an Embedded systems class: we implemented a PID controller for a mechanical inverted pendulum. It was very interesting to experiment in practice with a simple control plant.
More Related Content
Similar to A wearable MIDI interface using a wireless sensor network
Education set for collecting and visualizing data using sensor system based o...IJMER
This article presents the issues of the wireless sensor measuring systems design which might
be used in education process of computer science faculty. The work shows the integration of a simple
measuring system, data management system, visual system and the hardware. Education set is designed
to consolidate knowledge in many fields of computer science and the interdependence between them, as
programming techniques, database, Web server, communications protocols, software and hardware.
Presented measuring sensor system consists of a number of measurement nodes, whose role is to
provide information about certain desirable characteristics, warning against natural hazards or
violation of the physical safety. An important part of the sensor system is a measuring subsystem and
the collecting measurement data subsystem. The article presents the temperature measurement sensor
system concepts and measurement data storage and visualization methods
Experimental Analysis of an Energy-Efficient WSNidescitation
A wireless sensor network (WSN) is a collection of many tiny wireless sensor
nodes which keep collecting various physical phenomena related data from their
surrounding areas, where they are deployed and the same is sent towards the gateway.
Different and many pieces of information, such as the occurrence of an event in the field and
associated statistical values are computed from the collected data by these nodes. This data
needs to be provided to authenticated end users, who are also remotely located, without any
delays. This work presents an experimental WSN set up making use of accelerometer
sensors and the experimental results of the same are presented. This work also presents the
underlying XMesh routing protocol and an analysis of the its usage in the experimental set
up is also provided.
StadtLärm - A Distributed Urban Noise Monitoring System M2M Alliance e.V.
StadtLärm - A Distributed Urban Noise Monitoring System by
Tino Hutschenreuther, IMMS Institut für Mikroelektronik- und Mechatronik-Systeme gemeinnützige GmbH
Education set for collecting and visualizing data using sensor system based ...IJMER
This article presents the issues of the wireless sensor measuring systems design which might
be used in education process of computer science faculty. The work shows the integration of a simple
measuring system, data management system, visual system and the hardware. Education set is designed
to consolidate knowledge in many fields of computer science and the interdependence between them, as
programming techniques, database, Web server, communications protocols, software and hardware.
Presented measuring sensor system consists of a number of measurement nodes, whose role is to
provide information about certain desirable characteristics, warning against natural hazards or
violation of the physical safety. An important part of the sensor system is a measuring subsystem and
the collecting measurement data subsystem. The article presents the temperature measurement sensor
system concepts and measurement data storage and visualization methods
In last few years there is a rapid growth in urbandevelopment plans, the concept of smart cities.While the thought comes up for Smart cities there is a requirement for Smart waste management. The idea of Garbage monitoring system is for the Smart buildings, Colleges, Hospitals and Bus stands. The Garbage monitoring system thought is an improvement of normal dustbin by elevating it to be smart using sensors. Garbage monitoring system is a new idea of implementation which makes a normal dustbin smart using ultrasonic sensors for garbage level detection, display and sending message to the concern department person updating the status of the bin using GSM modem. P. Ramchandar Rao | S. Sanjay Kumar | Ch. Rajendra Prasad"Garbage Monitoring System using Arduino" Published in International Journal of Trend in Scientific Research and Development (ijtsrd), ISSN: 2456-6470, Volume-1 | Issue-6 , October 2017, URL: http://www.ijtsrd.com/papers/ijtsrd4602.pdf http://www.ijtsrd.com/engineering/electronics-and-communication-engineering/4602/garbage-monitoring-system-using-arduino/p-ramchandar-rao
A proposed model for traffic signal preemption using global positioning syste...csandit
A Traffic Signal Preemption system is an automated system that allows normal operation of
traffic lights at automated signalized intersections to be preempted. Preemption of signals is
generally done to assist emergency vehicles, such as ambulances, so that response times are
reduced and right-of-way is provided in a smooth and controlled manner. This paper proposes
an innovative and cost-effective server-centric model to facilitate preemption using a simple
mobile phone app which uses Global Positioning System (GPS) and a microcontroller which
controls traffic signals.
A PROPOSED MODEL FOR TRAFFIC SIGNAL PREEMPTION USING GLOBAL POSITIONING SYSTE...cscpconf
A Traffic Signal Preemption system is an automated system that allows normal operation of traffic lights at automated signalized intersections to be preempted. Preemption of signals is
generally done to assist emergency vehicles, such as ambulances, so that response times are reduced and right-of-way is provided in a smooth and controlled manner. This paper proposes an innovative and cost-effective server-centric model to facilitate preemption using a simple mobile phone app which uses Global Positioning System (GPS) and a microcontroller which controls traffic signals.
A ZigBee Based Wireless Sensor Network for an Agricultural Environmentijsrd.com
This paper reports the design and development of a smart wireless sensor network (WSN) for an agricultural environment. Monitoring agricultural environments for various factors such as light, temperature and humidity along with other factors can be of significance. The sensor data is transmitted to network coordinator which is heart of the wireless personal area network. In the modern scenario wireless networks contains sensors as well as actuators. ZigBee is newly developed technology that works on IEEE standard 802.15.4, which can be used in the wireless sensor network (WSN). The low data rates, low power consumption, low cost are main features of ZigBee. WSN is composed of ZigBee coordinator (network coordinator), ZigBee router and ZigBee end device. The sensor nodes information in the network will be sent to the coordinator, the coordinator collects sensor data, stores the data in memory, process the data, and route the data to appropriate node.
The aim of this project is to provide a device capable of collecting data from various sensors and send such data on the internet, so that you can view with different client.
The data collect is fundamental for research activity and for to have large amounts of data, so that immediately brings many benefits.
Through telecommunication technologies and devices can have a good battery outdoor, you can communicate different data remotely to as many clients.
Teleoperating a robotic arm through a gyroscopic helmetFrancesco Corucci
I worked on this project for a Real Time Systems class. It is basically a pointing device, based on a gyroscopic helmet controlling a little robotic arm. The hardware consists of Evidence FLEX boards running a Real-Time OS called Erika Enterprise (Open Source RTOS for single- and multi-core applications)
This project was developed for an Embedded systems class: we implemented a PID controller for a mechanical inverted pendulum. It was very interesting to experiment in practice with a simple control plant.
This is the final report for a Social Network Analysis class, within the context of the Excellence Program in Computer Engineering, University of Pisa, Italy
Implementation of a lane-tracking system for autonomous driving using Kalman ...Francesco Corucci
This project was developed for a Digital Control class. It consists of a system that is able to identify and track lane marks in a video acquired by webcam. It's interesting how the Kalman filter is used in such a context in order to make the lane detection computationally feasible in the small amount of time between two subsequent video frames
An overview on Quantum Key Distribution, final presentation for a Quantum Computing Class within the Excellence Program in Computer Engineering, University of Pisa, Italy
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
A wearable MIDI interface using a wireless sensor network
1. A WEARABLE MUSICAL
INTERFACE USING A WIRELESS
SENSOR NETWORK
Francesco Corucci – – 2012
MSc in Computer Engineering – University of Pisa
2. Introduction
Goal: implement a platform that allows the use of a
wireless sensor network as a wearable interface
that can be used for producing music
Requirements:
Modular
Flexible
MIDI-compliant
2
3. What is MIDI
MIDI (Musical Instrument Digital Interface) is a
standard technology for the interaction between
musical devices
It standardizes:
A communication protocol
An hardware interface
Versatile technology, widely used since the 80’s and still
reliable after more than 30 years
3
4. Shimmer sensor nodes
For setting up the WSN we choose Shimmer sensor
nodes :
Suitable for wearable applications
Integrate a 3-axis accelerometer
Optional gyroscope shield
(not used in this project)
Bluetooth or 802.15.4
communication
Support TinyOS
4
6. Overview of the system
USB
802.15.4
• Two or more wireless sensors on the body
• The sensors sample accelerometric data
associated with movements
• Data are then collected from the sink and
forwarded to the computer
Sink
6
7. Overview of the system (cont’d)
Oscilloscope application
(extended with MIDI map module)
Virtual MIDI
device
Musical software
Data from sink
• Filtering
• Displaying
• Mapping in MIDI commands
7
9. MIDI controller
This way the WSN become a standard MIDI controller,
that can interoperate with every musical software
9
10. How to choose the mapping
The way to map sensed data into MIDI messages is
absolutely arbitrary, and can lead to a multitude of
expressive results
Every data channel can be mapped in a different
instrument
effect
note/chord
etc…
…and this can be done in a variety of ways!
10
12. Features
Modular, extensible:
Is it possible to use an arbitrary number of sensor nodes, and
choose which on-board sensors must be used as data sources
Flexible:
Many degrees of freedom in the mapping
Many expressive possibilities
Sound generation is left to specialized and mature softwares
Standard:
Since the WSN becomes a MIDI controller, it is able to
interoperate with a moltitude of software platforms
12
13. Possible applications
The platform can be used for several purposes:
New expressive forms based on gestuality
In combination with traditional instruments
(e.g. influence of on-stage movements on played music)
Any application that asks for sonification of human movements:
Sport training
Rehabilitation
…
13
14. References
Shimmer sensor nodes
http://www.shimmer-research.com/
General information about MIDI
http://en.wikipedia.org/wiki/MIDI
VST
http://en.wikipedia.org/wiki/Virtual_Studio_Technology
rtMidi, a cross-platform C++ library for MIDI
http://www.music.mcgill.ca/~gary/rtmidi/
Sonification
http://en.wikipedia.org/wiki/Sonification
14
17. OscilloscopeAppC - overview
OscilloscopeAppC is the TinyOS application running
on sensor nodes
Receives commands from the sink:
start/stop/change_freq
Samples the on-board tri-axis accelerometer using
three ADC channels in DMA mode
When a block of samples has been collected, the
sensor node sends it to the sink via radio
17
20. BasestationC - overview
BasestationC is the TinyOS application running on
the sink node
Acts as a bridge between the serial and the radio
link
Implements queues in both direction to handle
traffic spikes
20
22. MIDI map module
Offers a simple GUI: the user can choose how to map
the active data channels into MIDI messages from a
predefined set of mappings
22
The module then catches
incoming data, maps it into
MIDI command according
to user-defined
preferences, and forwards
them via TCP/IP socket
toward the MIDI forwarder
23. MIDI forwarder
Implements a virtual
MIDI device: the WSN is
seen as an input MIDI
peripheral plugged into
the computer
It then acts as a bridge:
Waits for incoming MIDI
messages from a TCP/IP
socket
Forwards MIDI messages
to the virtual MIDI port
23
