SlideShare a Scribd company logo
1 of 120
ART AND TECHNOSCIENCE: creative technologies and the radical
digital reinventing life for a healthier future
Life is reengineered
Profa. Dra. Diana Domingues
LART Founder and Director– Laboratory of Research in Art and Techno Science
University of Brasília – Senior collaborator Professor
Senior National Visitant Researcher CAPES at UNB FGA GAMA 2010 2014
CNPq (National Council for Scientific and Technological Development) Researcher PQ 1A
Post Graduate Program in Biomedical Engineering
Post Graduate Program Sciences and Technologies in Healt Ceilandia UnB
Researcher at Camera Culture MIT Media Lab - MIT/CNPq (2012 2015)
http://dgp.cnpq.br/buscaoperacional/detalhegrupo.jsp?grupo=0240803DKU6FNW
dgdomingues@gmail.com
skype:dgdomingues1 Diana Domingues
Diana Domingues selected historical remarks
with respect to Art and Techno Science
Publications:
SPIE
SIGGRAPH
ACM HCI
IEEE
SVR
SIBIGRAPI
SVR
Leonardo
ISEA
Digital Creativity
RECENT GRANTS and International Cooperation : MIT/CNPq Camera Culture Media Lab,
OCADU- CIVDDD- Danube University .Senior researcher CAPES CNPq 1 A
The Art in the XX1st Century:
The Humanization of Technologies
Edunesp, Diana Domingues,
1995 SP
2011 MIT
“We must humanize technology before it
dehumanizes us “
- Oliver Sacks, neurologist and author
• HUMANIZATION OF TECHNOLOGIES , 1995
• I have always taken into account the human factor when investigating interactive technologies in their potential to
transform ways of living. How can we understand types, levels and intensities of changes in post-biological, post-human,
neo-biological, trans-human life installed by technologies? At the end of the 20th century, when interactive technologies –
and mainly the inclusion of the WWW – started to invade and feed the creative minds of artists in the Media Art scenario, I
had already anticipated
• NATURALIZATION OF TECHNOLOGIES
• Without intending to be taken for a visionary I dare to forecast that in
the next couple of years, people will normally use wireless interfaces,
and matter-of-factly will be connected in all microtimes of their lives.
Existence will become a cybrid existence during the twenty four hours of
life time. People will increasingly have interfaces and will be rather TV-
like, to use an analogy to the contemporary technological and the
society of the spectacle. Symbiotic technologies will be facilitated as
permanent prostheses and they will be attached on us and into our
bodies and thus we will be reinventing our lives and the ultimate nature
of our species.
About LART UnB Gama
A transdisciplinary group working at the
Laboratory of Art and TechnoScience (LART),
at the University of Brasília at Gama (FGA),
holds collaborative researches integrating
professors and students at the BIOMEDICAL
ENGINEERING GRADUATE PROGRAM and
five engineering undergraduate programs
ENGINEERING OF
Software
Automotive
Energy
Electronic
AeroSpatial
LART and
New Leonardos at Gama
We work in the transdisciplinary field of Art
and Technoscience and the action of
“New Leonardos” (ISAST Plataform)
at FGA Gama.
Advanced researches by integrating a team of
Collective intelligence, trying to synthesize the
genius in a bottom-up environment.
E sciences
by acting in several domains and approaches,
covering arts, science and technology by proposing
“levels of reality” and “creative reality”, or searching
for innovation such as a world as a
reengineered reality.
For forty years the Leonardo organizations have
had the privilege of witnessing, and helping to
document, a birth of new forms of innovative
and creative practices.
Especially during the last ten years a new
generation of artists scientifically and technically
literate, “new Leonardos” , have been
creating contemporary art forms, and in the
process making new technical
inventions and in some cases, scientific
discoveries.
Roger Malina /ISAST
NEW LEONARDOS
HOW TO SYNTHESIZE LEONARDO?
Efficient collaborative practices dissolves the old rupture and
the well-known historical divergences between artists and
scientists.
The main point of convergence is:
when all disciplines investigate the same problems, all
sciences become one unique new science.
MYSTERIES OF LIFE
Art and Science propitiate the ontology of life with
levels of creative reality that challenge paradigms
and risks related to “mysteries” of life covering
living systems with the the same unpredictable
approach of emergent realities. Interactive systems
in digital culture develop evolutionary processes,
configuring complex levels of life states now
expanded by mutual and reciprocal exchanges in a
coupled condition called enactive condition, a
feature not seen before.
COMPLEX THEORIES AND TRANSDICIPLINARY
PRACTICES
Art and Science for the generation of living systems
relink the
HEURISTICS + LOGICS
The articulation between the poet’s creative intuition
and the analytical tools of thinking and discourse,
such as logic, mathematics and information technology
that makes possible transdiciplinary approaches.
(Ivan Domingues) - IEAT
•TRANSdisciplinar
• ANTI (mitmedia lab)
In transdisciplinary practices, work is
usually developed in "ignorance zones",
(Domingues , Ivan) not acknowledged by
universities.
People from different domains establish a
common workplace, looking for
new problems, approaches, secret bridges
between areas of study, creating the
transit of research topics.
Different from classical, traditional
paradigms, we are no longer prisoners
of truths.
The outcomes of such artists and
scientists’ network exceed what is normal
and ordinary in institutions and official
places.
• Stonehenge
• Paleolithic masters of engineering and
astronomy
CHERCHEURS OU ARTISTES?
Entre Art et Science ils rêvent le monde
(Monique Sicard)
Mondrian biologia molecular
Kandinsky e física nuclear
Julio Verne e a missão Challenger
Degas explorou a pausa do tempo na fotografia
Futuristas discutiram o tempo usando a cronofotografia;
A linguagem do cinema ,incorporou o tempo às imagens ópticas;
Os impressionistas e uma revolução na representação artística
baseada nos fenômenos de síntese óptica;
os pós-impressionistas dividiram formas em unidades matemáticas
que é a fonte das técnicas fotomecânicas, amplificadas e automatizadas
NICOLAS POUSSIN
Landscape and climate issues
William Turner
dinâmica das forças vivas
natural forces dynamic
eScience
engineering, social sciences, medecine, biology, computer science, art ,
education , physics, geography, history....
Common issues all the sciences become an unique science
The transit of disciplines and the urgency for
eliminating the barriers between types of
knowledge and immediately integrate
common issues of several areas respond the
complex questions of life.
The territory of freedom of experimental art
puts experts in an area of dissipation and
create cognitive frameworks, working
procedures, communities of interest and
methods by mixing rationality, intuition, and
emotion.
Common problems dissolve domain
constraints and result in a migration of
concepts and hybrid activities in mixed areas
through discussions about unpredictability,
looking at the same object from different
disciplines.
.
Main Domains:
• Biomedical Engineering , Bioart,
Cognitive Science, Visual
Analytics, Neuroscience
Creativity – invention:
Big risks and challenges :
Health, environment and
education
The birth of “digital “ culture
Success of the computer art pioneers
R and D budgets of game/entertainment now driving technology
But now we need
RADICAL DIGITAL ( Malina. 2007)
Artists and Scientists:
Creativity - invention and innovation
Big risks and challenges for society:
Creative technologies and Innovation for challenges related to
health, environment and education,
social behaviors
http://userwww.sfsu.edu/infoarts/links/gen.art.res.present
/currentslide%20show/slide_show_summary.html
• Thames & Hudson (2010)
Stephen Wilson PhD, MFA
Professor, Art, San Francisco State
University
swilson at
sfsu.edu http://userwww.sfsu.edu
/~swilson/
ISBN - 9780500238684
A visual survey of artists working at
the frontiers of science and
technology. Focus on work since
2000. Covers artistic
experimentation in fields such as
biology, ecology, medical research,
physics, geology, robotics,
telecommunications, artificial
intelligence, information
visualization, and body sensing
computer interfaces.
KRUEGER, Ted;
DOMINGUES, Diana;
POISSANT, Louise ( Guest
editors ).
Special Issue of Digital
Creativity 27:4. 267-270,
Creative
Technologies and
Innovation: Health
and Wellbeing
(Exeter). Taylor& Francis,
2016
TRANSDISCIPLINARITY AND INSTITUTES
Historical intersections among arts, sciences, and humanities
pioneers
•Santa Fé Institute, in California - founded in 1985.
•Max Planck Institut, in Germany
•Stanford
•Berkeley
•Princeton
In Brazil, IEAT Institute of Advanced Transdisciplinary Studies
(Instituto de Estudos Avançados Transdisciplinares) of the
Federal University of Minas Gerais (UFMG)
Eminent Brazilian intellectuals from several areas working
together
pioneers LABS - MEETING PLACES FOR
COLLABORATIVE PRACTICES
•Massachusetts Institute of Technology - MIT. In the 1950s
opened its doors to Art History
•Later in 1967, Gyorgy Kepes founded the CAVS (Center for
Advanced Visual Studies).
•After 1974, Otto Piene was the director of CAVS, and introduced
laser, holography magnetism, synthesizers, video and electric
and electronic technologies, before the intense use of computer
in art practices.
•In 1985, Nicholas Negroponte founded the Media Laboratory at
MIT, and gave the start to the phenomenon of Labs in
institutions hosting collaborative practices worldwide.
• The Sound of Trees
Growing
• David Dunn
– composer, sound artist
• Jim Crutchfield
– complexity scientist
• Recording of sounds of trees
growing led to research project in
the coupling of ultrasound from
trees, beetles,… forest fires
Artists can make science intimate
Pigeon Blog Inside Outside Handbag
( Beatrice Da Costa) (Katherine Moriwaki )
Burning issues
The art in the intimate territory of sciences facing the
human history that have the challenges of the asustainable
civilization on our planet.
What is body now?
What is landscape now? What is urban now?
What is life now?
May Artists and Scientists collaborate for burning issues in daily life?
What are the paradigms and sensorial boundaries for affective perception
and embodied cogntion ?
How to expand bodies and our creative relationships in daily
environment?
How to supplement and give the same freedom to (dis) able bodies?
The world can be better, healthier and socially improved with biocybrid
enactive technologies ?
Questions? and the humanization /naturalization of
technologies
ART AND TECHNOSCIENCE: REENGINEERING LIFE
LART PROJECT CAPES/CNPq
Three Main Research axes
(i) the reengineering of sensorium and enactive affective enactive
Embedded systems and physiological sensors , signal processing and data
visualization for synaesthetics investigations , in daily life
(ii) the reengineering of nature and biodiversity challenges
The challenges of the infirmity of landscapes in the sense of affective geographies
(iii) the reengineering of culture
Envisioning the infirmity of territories and the social engine and well being of
social platforms in Ubicomp (mhealth) which enhance the awareness of human
presence and reinvents urban ecologies amplified by mobile technologies
targeting the reengineered future
HYBRID CYBRID BIOCYBRID
Nowadays by the effects of mobile technologies as calm and transparent interfaces
installed “in the periphery”, as proposed by Mark Weiser’s , ubiquitous computing,
sensory interfaces in the post-desktop era, the computer is almost invisible and has
disappeared in the hybrid world. The cybrid human condition living by interacting
with data, now is expanded to BIOCYBRID ( BIO+CYBER+data+ hybrid word).
Technologies have gained biological tasks and are increasingly installed in our habitat,
I propose the biocybrid condition to the living systems and the naturalization of
technologies enhancing the humanization technologies scenario of the 1990s. HCI
technologies have now the and enactive technologies with their devices and
systems, taking part in the organisms and working as part of the nature itself by
expanding our sensorium and no human things as living systems in our landscapes
and in the social engine.
By interacting, we can experience human altered identities during social, cognitive and
emotional behaviors shared with the responsive environments of social platforms,
mixed reality, or other technologies.
We are in enaction, reaffirming the ecological perception with the environment, and
the mutual influences exchanged with the invisible data modify our perception and
cognition.
In the case of the recent mobile technology, the interfaced body feels and acts by sharing qualities that come
from the connectivity of the synthetic vision of cameras, satellites, physiological sensors, Bluetooth, tags,
codes, wireless devices, GPS, or other technological components that transmit and exchange data, and co-
locate us in virtual and physical worlds, thus transforming us into biocybrid humans. All those technologies
provide us with altered limits of the human condition.
• The enactive condition is referred to the
theories of embodied cognition.
• It is about the interdependence between the organism and its environment, and their mutual, reciprocal exchanges,
bringing the idea of autopoietic and emergent phenomena. In the relation with mestizaje, it gave me the inspirational figure
of ouroborus to make visible the seamless condition lived by the interface of body and technologies.
• Creative technologies and the and artificial systems empower artists’ exploration of how technologies are changing our
world perception. This is a huge challenge for creativity and to social presence of the
artists.
• Since the beginning of my career I have proposed environments for a strong
experiential dimension in interactive installations and immersion in VR Caves,
requiring software development and specific hardware. I have always been an
artist-engineer of communication interested in developing a hermeneutic and
metaphorical proposal for those systems.
•
•
•
The computer "disappear" and goes to the "peripheries : “ubiquitous computing”
-calm technologies”- transparent interfaces ( Weiser) - mobile and portable
devices, sentient objects ( Rheingold) _ internet of things ERA POST DESKTOP
Virtual Reality and immersion –, Cyberspace ( Gibson) , Now Cyberspace is
everywhere : mobile augmented reality ( GPS, android, human sensors Penland) ;
People eco-located and live in social platforms here and there, data mining and
mining reality, life and interventions of data in the physical world integrated
to the material objects, fantasmagories appear and reinvente private and
public spaces, physiological interfaces, mobile phones and locativity
everywhere, social softwares, apps.ad mobile experience computer and
ubiquity as social engine.
My role as an artist-engineer is to propose the relation art, life, and technologies.
What esthetical qualities will I explore with the kind of system being proposed?
What behaviors will I create for an expanded sensorium?
What kind of social relationship can people share in a certain environment? What kind
of post-biological nature am I generating?
Can I visualize physical phenomena such as water pollution, climate change, disease
proliferation, the narratives of a healthy or sick body?
Consequently, my task is to decide on the system design following the interface
conception and the embedded systems’ dynamics in levels of unpredictability
originated by concrete experiences to the coupled body and its enactions with the
environment.
Every technology embeds different esthetical qualities, and supplies specific
responses. Ted Krueger highlights that perception is a laboratory
phenomenon and we create the kind of perception following the qualities
of the device output.
Animal and human
net based installations
1998, web art, telepresence and telerobotics
seamless condition – body and robot
connected - remote actions - enactions and
telepresence :intertwinned and mutual
influences body and remote environment
Expanding Hypermedia to physical territory and
remote actions. Helping the daily life of remote
serpentarium: giving water and food to the
snakes
.
BIO ART and biologists collaboration.
Figura – INSN(H)AK(R)ES
net based installation
SERPENTARIUM
(1998)
Telerobotic event, telepresence and remote action
seamless condition by sharing the body of a robot-snake
living in a serpentarium in Brazil.
The Cavern of Trance
Considering my discussions from the 1990s,regarding the artworks’ interactions and the use of interfaces in
rituals. In art we have the concepts of support and surface. Interactive art enhances the sensorial experience
by the principle of feedback provided by the interfaces and the dialogue between body and environment. It is
the art of experience, which is no longer the restricted visual, retinal art, but now the entire body is involved.
Interfaces and body actions go back to the tradition of body paintings, tattoos, masks, feathers, maracas,
whistles, just as in rituals, which imply communication and collaboration. The body is invited to act, dance,
breathe, drink in order to participate in the ceremony that is performed to exchange unexpectedsensations
and meaning in dialogues with the ecosystem.
TRANS-E – my body , my blood
97
Unesco Prize , 7th Biennial Habana
gramma
“Trans-e my body, my blood”, became an emblematic artwork and inserted the theme of interactivity and
ritual into the artistic-scientific community, it is related to Afro-Brazilian rituals. North Brazil’s Inga Stone’s
projections show metamorphoses sprouting from prehistoric inscriptions. People interacting become
metaphorically shamans who consider the stone as a ‘veil’ between their world and the ‘spirits’ world.
The software “shaman 32,” based on artificial intelligence researches, has autonomy to self-regenerate the life
of the cavern and the ‘mutant visions’ by surprising people with unexpected emergent ‘realities’. In 2007, the
piece reincarnated in a new, more complex version called “The Cavern of Trance,” a more complex
version of the embedded system – it was expanded to immersive and crossmodal technologies, multi-sensorial
interfaces and immersive multi-display synchronized large screens in VR – and it was also adapted for mobile
connections. Neural network , sensorized carpet, and the special quality of this artwork was to provide
physically-impaired people with equal capability to act using infrared sensors zones and/or by multi-sensorial
interfaces of sound interfaces using Afro-Brazilian musical instruments: flute, maracas, whistles, afuches,
rainsticks, shakers and other ritualistic instruments.
People were tracked to synthetic objects that moved according to sounds and noises. Non-mobile people
could only interact with their mouth making sounds with whistles, flutes, or singing, making noises, and so
interacting with the system in a kind of ritual. On the other hand, people’s displacements and gestures
generate several proprioceptive interactions. A wireless tracker and an accelerometer with a gyroscope provide
responses and motions in proprioceptive interaction, and by focusing with a flashlight the walls of the cave,
magically people manipulate the objects: thunders, butterflies, spiders, vases, crosses, worms, animals appear
in the room in stereoscopic visions creating a sensation of enhanced trance.
.
The Cavern of Trance
Interactive and immersive system
Embedded and cross modal interfaces
• presence sensors
haptic interface
sound interface
steroscopic interface
Interactive and immersive system
Embedded and cross-modal technologies
Virtual reality
VIRTUAL REALITY
THE CAVE
IMMERSIVE ENVIRONMENTS
PROPRIOCEPTION
TRACKED BODY – PHYSIOLOGY
Algorithms generating particles gave the
environment qualities typical of physical
laws such as gravity and dynamics.
HEARTscapes virtual reality inside a CAVE
algorithms and physical laws create a synthetic ground for immersion and simulation experiences inside
data landscapes- textures in animation
natural phenomena effects
(rain and fire, explosions, snow, twisters)
Heart beat sounds of ecographies are mixed with noises of indigenous rituals, noises of natural
environments, among other sound data
Technological apparatus
and antropological issues
esthetical qualities ways of living .
William Gibson, in Neuromancer (1984
),
Rheingold to Scott Fischer-virtual reality and head mounted displays
“Oh, My God .Cyberspace arrived”
VirtualReality at Nasa and placelessness, evasion and immersion in the 90s .
“Oh my God, cyberspace is everywhere”
Era post-desktop
(
William Gibson 2007 Spook Country: a novel
Laura Beloff
VR and immersive poetics inside a Cave, I highlight the magic of
“HEARTSCAPES”.
It allows responses from synthetic objects and navigation in the 3D ground,
and offers the atmosphere of a ritual, metaphorically giving shamanic powers
inside data landscapes of a heart, and the immersion in a synthetic landscape,
mixing visual effects with noises of indigenous rituals, natural environments
and phenomena of the ecocosmos. Physiological devices and biofeedback of
electrical waves in EOG electrical signals offer mutations of forms in real time
and are also commanded by another biological interface that captures
heartbeats, sending signals from the participant's heart to the system. The
interactivity of physiological signals results from the heartbeat frequency
(ranges 60/80, 80/100, 100/200, 120/140, 140/160). The action of the
biofeedback sensors activates a VR particle system of HEARTSCAPES, move
the position of the objects, and changes colors on the screens, confirming the
dynamics and kinematics of the virtual, by communication by the electric
waves of the eyes with the VR world.
Firmamento pop stars
mobile connexion, a-life - data mining,
collaborative texts, touch screen alife
Firmamento_Pop Stars (2004-2005)
Museu da Telemar RJ - Itau Cultural
• installation, “FIRMAMENTO” [16]. It allows a conversation with the stars in a synthetic ecocosmos, inside a biocybrid
landscape in A-Life. People receive shamanic powers for affecting natural phenomena when absorbed in an aesthetic
experience in front of a huge lake, the "eye of the earth". People have a dialogue with the lake as if it were a mirror of the
firmament of the synthetic cosmos peopled by idols. The behaviors of the stars represented by dots of light in A-Life, create
a living organism in a stereoscopic vision. By interacting with a tablet, visitors move the stars in the lake visualized on the
floor. The stars represent different idols of cultures given by a flocking algorithm, and are activated by the stars’ proximity
and their desire for light. Internet searches of a list of words come from the database stored on the system, which return
through data mining as surprising sentences written on the walls of the dark room. The same process could be performed by
sending SMS messages from the mobile phones to the stars. By using a list of idols, i. e. famous people of the human
culture, such as Einstein, Marilyn Monroe, Mother Theresa, Cleopatra, Carmen Miranda, and a list of terms related to their
life and actions that characterize their life, we send SMS messages and the cell phones return sentences by associating in
data mine process, surprising narratives about their lives. It is the collective voice of the planet in emergent states. Unknown
authors write sentences related to the idols’ personality, and the dots in A-Life projected in the lake of the landscape change
in a surprising, mutant firmament.
• Firmamentum is the collective voice of the planet in emergent states. The system proposes an utopic cosmos, eliminating
social and political constraints in an associative and free model, coming from everywhere and everyone. Unexpected
relationships manifest free groups of people which lights compose unexpected constellations, and free narratives write
histories resulting from people and stored values of myths on the net. The system addresses ecological, social, and political
issues in imaginative and innovative ways, by eliminating the diversity among people, race, gender, idiom, or other
differences and constraints. Concerning language differences, the system writes collective texts in several idioms. The
connections to the Net (Google), by activating words of a linguistic database are expanded for SMS messages using mobile
phones. The messages sent in the country idiom write sentences in the correspondent idiom of people, in accordance with
the list of words translated and stored in the linguistic database of the system. For instance, by using a database for
interactions in France, a list of French words connect Google and return sentences in French. The same system works in
other languages ( Spanish, Polish, German, only changing the language of the words in the database. Consequently, the
interface design of the installation offers a complex system with dialogues that expand human life in the cosmos. The main
goal of the artwork is to adapt the apparatus confirming that digital technologies configure a post-biological way of life in
Cyberculture. Metaphorically, we receive shamanic powers from technologies and we are able for dialogues with natural
forces of the cosmos. We receive post-human capacity to collect global ideas and intervene in political domain, by rewriting
collectively the history of human culture.
•
• Reengeneering life and mixed reality
• Mobile technologies and society
• Practices respondent to mobility in
contemporary society and wearable
tecnologies
• ONTOLOGICAL PRESENCE Co-located in physique and cyberspace,
coupled to cameras and tags , computer vision, ecolocated, tagued, and
ecotagued , satellites,, mixing data , ways of perception in other
dimensions, spatial origine, sensors variables, physiological manners,
vision synthètiques geolocalisés , reinventioin of the scenarion
- Living Tattoos, 2007 HCI Florence , 2007
Social mobile platform - data mining – mining reality-
social behaviors and machine learning data visualization – graphos and
artificial life- flashmobs
Living Tattoos,© Diana Domingues - NTAV Lab / CNPq, Brazil, 2008.
LIVING TATTOOS” social platform
enables people to produce contents by adding information on their lives.
Each person sends us his/her own tattoo by mobile phone or by email. The
shapes are turned into 3D models and placed on the synthetic ground of the
tattooarium, where they can live together. They become living creatures in A-
Life. Their evolution is determined by their dialogue coming from a search
engine – data-mining system - which provides us with specific traits of their
personalities. The other proposal is the urban interventions in flash mobs
titled “tattoos mob,” another part of the project that installs tattooed
communities in different locations of the city and also develops data
visualization of the urban tattoo flows in the mobile mobilization in the
physical space of the city. Their communication generated through ubiquitous
computing, locative, pervasive and sentient mobile technologies (cell phones
MMS and SMS) communicate with locative interfaces as GPS and Google
Maps. It is a storytelling mobile narrative of tattooed people in urban spaces.
•
Datavisualization e redes sociais
Datamining
Mineração de dados
Mobile experience artworks
Augmented mobile reality
The sense of presence now
The end of reality?
Or the onto spatial creative reality?
Memory _ ubiquity and virtuality of memory ,
locativity, lost the historical awareness
(Chartier)
IPIRANGA RIVER historical place where the Emperor D. Pedro I proclaimed
the independence of Brazil's independence in 1922
Memorial da América Latina building
- Niemayer architect
Galeria Marta Traba
ENVIRONMENTAL ART – ARCHITECTURE AND COMMUNICATION – MODEM – HYDROPHONE – SONIC
LANDSCAPE- SOCIAL PLATFORM- MOBILE CONNECTION- DATAMINING –MMS- SMS-
TRANSfronteiras contemporâneas
MEMORIAL DA AMÉRICA LATINA – BIENAL DE SÃO PAULO
17 de setembro - 17 de outubro de 2010
BICENTENARIO DA INDENDENCIA PAISES AMERICA LATINA
BIOCYBRID LATIN AMERICAN MEMORIAL
ENVIRONMENTAL ART – MOBILE TECh AND SOCIAL
PLATFORM – Enactive systems and sonic landscapes
T
h
w
The sound of the Ipiranga river translocated to the silent water/mirror embraced the building.
The sound of the Ipiranga river translocated to the
silent water/mirror which embraces the building.
http://www.youtube.com/watch?v=9FemTc5OtZg
Presence sensors activates a database
of voices of latin
american idols when entering into the
the building as phantons...
Anamorphosis of idols in the ceiling as a living memorial!!!!
Memorial of America Latina internal
scenarios
interatividade pelo twitter:
Escolhendo com quem quer twittar numa lista de personalidades
da história da América Latina, entrando no Twitter e digitando
#BioCybrid e o nome da personalidade,
Ex: #BioCybrid Senna ,
a resposta entrava no espaço do Memorial da América Latina em
São Paulo, projetada numa grande tela. O sistema de busca e
classificação utilizava um algoritmo para executar a classificação do
dado de entrada (Twitt) de um dos personagens em hipermídia. A
resposta do sistema se dá na exposição de vídeos, áudios e textos
por sistema de mineração na web do personagem reconhecido,
classificado e passa a escrever sua narrativa por scrolling text
enquanto o áudio e o vídeo são tocados .
living memorial -
mash up and data mining
qudata mining and unpredictible
narratives in global memory.
Collaborative mobile texts; .
Crawler and data base in mash up.
Ex: CHE
GUEVARA+IDEALISTA+HAVANA+REVOLUÇÃO+LIBERTAR
Outcome. “alguém conhece um cubano que deu as
costas à Revolução para, ao contrário, seguir os passos
de Che Guevara, como verdadeiro revolucionário”.
Twitter
Augmented Mobile Reality and Geotagness for
Urban Mixed Landscapes
The 14 Bis Biocybrid Plane,2011 LART
14 Bis – SAN FRANCISCO AIRPORT
Terminal-SPIE 2011
GEOLOCATION
Latitude 37°35'40.28"N
Longitude 122°21'53.31"O
URBAN MIXED REALITY
• What is vision in the post biological era ?
• The MAR system reaffirms the post biological extrusion of
human vision, by the act of seeing shared with the satellite
eye in the sky and the handled eye of the mobile device, by
expanding the human perception. Tags in MAR placed in GPS
(Global Positioning System) and the possibility of geodesic
coordinates create a co-located event for human body.
• It is the neuropsychophysiological expanded perception that
is propitiated by the technology, characterizing the biocybrid
human condition.
• Mobile data visualization and computer vision.
• Guest artist at the 2010 art exhibition at the San Martin
Cultural Center (Argentina), and LART research group
invented the artwork 'BIOCYBRID FABLES: Borges fantastic
creatures.' In the augmented reality (AR) installation inside
the building, the use of tags allowed reading a book in
synthetic vision, with its pages showing animations and
pictures of Borges’ fantastic creatures (s. Figure 7), thus
reinventing daily life things (domotics).
• Jorge Luis Borges’ fantastic universe and urban
intervention: synthetic creatures were geolocated, in real
scale, in Buenos Aires streets. People using mobile
technologies and Layar system geolocated them in the
streets in real scale as fantasmagorias in Urban Mixed Life
and Mixed Reality
Biocybrid BORGES Creatures Fables:
AR reinventing the act of reading
Urban mixed life and domotic s
Fábulas Biocíbridas: criaturas fantásticas de Borges, 2010
BUENOS AIRES Centro Cultural San Mrtin
BIOCYBRID FABLES: Borges fantastic creatures
BUENOS AIRES 2010
AUGMENTED REALITY INSTALLATION - the enactiv e act of reading
Fig.6. I'Myth: zapping zone.©Douglas Trancoso, ©NTAV Lab, Universidade de Caxias do Sul/ CNPq, Brasil, 2005.
Fig.6. I'Myth: zapping zone.©Douglas Trancoso, ©NTAV Lab/CNPq, Brasil
REENGINEERING SENSES
EXPANDED SENSORIUM
the drama of life
Art and Technoscience combine developments in biomedical engineering in
physiology and synaesthesya and embodiments during the drama of life.
Ontological levels of creative reality and the reengineering of life provided by
microcircuits of sensors configure the expanded sensorium with enactive
affective systems.
The continuum and symbiotic zone between body and flesh - cyberspace and data -
and the hybrid properties of physical world.
to consider
the myths and the old ontologies
Remote theory of enaction
Aristotle and enactment
creative levels for the understanding of our
relationship human/environment expanded as
pointed out Aristotle's Poetics and drama .
Baugartner – 1750 synaesthesia
Reaffirming the origins of the discipline Aesthetica, postulated by the German
philosopher Baungartner in 1750, the ability to perceive the world with the five
bodily senses
ENACTIVE AFFECTIVE SYSTEMS
physiology
kynesthesia
Enactions - em´bodued cognition Embodiements-enactions ( Varela)
Affection –effects of actions – (Spinoza )in physical ad physiological rates body and
environment EX: hearth rates, Breathing rythms, skin temperature.
Ecological Perception ( James Gibson)
Ouroboric Perception ( Domingues)
Synaesthesya ( all senses ) Poissant and Daubner BioArt and Transformation of the Living
synaesthesia
Interactive
ENACTIVE/AFFECTIVE SYSTEMS
The expanded sensorium: from interactive systems
to enactive affective systems
Bioart faces the “transformation du vivant”, by evolving from earlier
proposals from interactive art, and developing enactive affective systems.
Concepts of perception and enactions, related to human−environment
mutual exchanges, in cognitive approaches and physiological levels.
Chilean philosophers Humberto Maturana and Francisco Varela are references
of philosophy and biology to the mutual influence on the
relationship of organisms with the environment and the
autopoietic feedback that technologies extend to the complexity of
sensors equipped with synesthetic affective biofeedback, sending vital data
measured during enactions.
.
Humberto Maturana
and Francisco Varela
Poissant and Daubner
Ted Krueger
cognitivist/ enactionist approach and
BIOART –practices enactive systems
• enactions , perception and action , (Noe)
• ecological perception
• , ouroboric perception [Domingues)
• expanded perception, regarding body
potential and affections ( Massumi). Affects
and is affected
• The Spinozan body is endowed with affections (
sensations/physiological rates) ability to communicate with the
environment by sensors EOG, EMG, EEG, GSR and others,
recognizing the environment and averages/rates, intensity of
heat, cardiac output, respiratory flow, muscles activity, tactile
vibrations, and other measured sensations, earned by sending
and receiving, exchanging signals and the intertwined relation
with the environment, i.e. the enactive affective system
response
We expand kinaesthesia, or motion sensors activity, that recognizes
the environment for proprioception, body movement schemes, by
adding physiological data from all directions by signal processing, skin
temperature, heart rate, cardiac flow, breathing, muscles rhythm.
Noé, Action in
Perception
Ecological perception
James. J. Gibson
BRIAN MASSUMI
Affections
Spinoozian Body
Living maps
Domingues
ouroboric
perception
• New ways of deciphering human behaviors and
body/environment influences in microscales allowing in
diagnostic and introspective ways, meditation, self-identity
and other application .
• DIAGNOSTICS - Human actions in enactive affective systems
and the processes of knowing, learning and teaching about
their affections generate LIVING MAPS and Affective
Narratives-
• Enhanced in its sensorial properties of synaesthetic
biofeedback added to the language of movement in a
transphysiological dimension, that is, aspects of motion,
electricity, graphic design, in data visualization and data
sonification
ENACTIONS AND EXPANDED SENSORIUM
The whole body in action lives mutual
exchanges and emergent properties with the
environment resulting in reciprocal changes.
For perception: the act of seeing with the entire
body
 Rates of affective exchanges? Human
environment mutual influences
Content and Context
AFFECTIVE AESTHETICS
ENACTIVE SYSTEMS
BIOART
BIOMEDICAL ENGINEERING
LIVING MAPS
PHYSIOLOGICAL SENSORS
EXPANDED SENSORIUM
AMPLIFY KINESTHESIA TO SYNAESTHESIA
DATA VISUALIZATION
REENGINEERING SENSES
EXPANDED SENSORIUM
ENGINEERING HEALTH LAB at MIT Camera Culture Media Lab and LART UnB
In general aspects and Biomedical Engineering applications,
our sensors and technologies are able to monitor vital signs in everyday life,
and can constitute personal assistants. They can also be used for social
interactions, entertainment, innovative performing, training, safety etc.
Concerning the validation and tests, the performance of controlled experiments
in order to measure and validate how the studied variables relate to different
types of user actions and/or states, includes diabetes, and the methods to
specific communities, such as native Brazilian tribes where there are many
reported cases of diabetes.
Embodiments and affections
• In Art and Techno Science embodiments and affective aesthetics , we enhanced
the studies on kinesthetics to synasthesya.
• Kinemas as the language of movement,
• The transphysiological dimension, i.e. aspects of motion, electricity, graphic design, in data visualization
and data sonification.
• Body movements, gestures, postures, fragmentation, reinstatements, dynamics, internal-external
connections and motor schemes, dealing with gestures, rhythms, not only at each stage of the movement,
but also considering what affects you, the environment and the coupled interior and affection in the flows
of life with affective enactive sensors. Biofeedback with outside environment in enactive affective
conditions .
• Synaesthemas - the immediate impression of the senses, or by a complicated chain of senses’
impressions, previously experienced, stored in the memory of sensations, affections and emotions and
thoughts. Attempts are being made for the system to read the rhythmic patterns of movement
“Transphysiology of the Ecstasy”
11th Havana Biennial (2012):artwork
Biocybrid Ouroborus: Ecstasys
Geographisms.
we developed a system that captures and analyzes
information about several peoples' movements
during rituals, simultaneously. Information was sent
wirelessly to a central computer, which generated
visualizations and sound patterns associated to the
different types of detected movements We used this
system to study the energy and synesthesia of bodies
during rituals, being similar to Brazilian dances
performed by artists from Havana, as we could
translate the ritualistic states in terms of different
visual patterns, as well as to observe how these
patterns acted in the described feedback loop.
• “Transphysiology of Ecstasy”, rooted in
the concept the trance, proposed by
Diana Domingues and Maria Aparecida
Donato’s (CNPq PDJ) discussion in her
postdoctoral research in LART on body
and Bioart, focused on the electrical
potential of the body and thel trance
states, rising to ecstasies in Brazilian
rituals such as carnival and Candomblé .
The research results affirm that shamanic
trances differ from ecstasy states. Into
ecstasy state, sensations, emotions and
thoughts come from bodies conscious of
their sense of presence, albeit in a
condition of transcendence ecstasy here is
significantly different.
TRANSPHYSIOLOGY : FROM TRANS-E TO ECSTASY
We propose the biograms (datavisualization) of corporeal living maps in kinesthesia and
synaesthesia as result of perceiving and processing data of human physiology for the
understanding of body actions and their cosmic relationships (in daily rituals).
Experts in human motion explain that movements and gestures in rituals (candomblé, samba,
tai chi chuan) can make us understand every other ones in everyday life
Trance is significantly different from ecstasy (Trance is an
unconscious state, while during ecstasy we are aware and live
rythms and structures of the body autopoiesis.
Rudolf Laban 1879 - 1858
Laban's paradigm postulate that human movements in daily life are always composed
of the same elements, whether in art, at work, rituals than in everyday life.
Consequently, we search for a method with emphasis on the psychological and
physiological aspects that lead human beings and electrical biopotential of a body
, which in their combination produce states, qualities, actions and parallel
motion feature psychic actions present in our actions −
recognition in the form of rhythms and structures −
Investigation of Brazilian Rituals
Pos Doc Prof. Dr. Maria Aparecida Donato
Pos doc Junior CNPq LART 2010/2011
Biocybrid Ouroborus: Ecstasys Geographisms
11 Habana Bienial 2012 - Gran Teatro de Haban
expanded sensorium and datavisualization
workshop and installation
Imagen catalogo
11ª. Bienal de la Habana, 2012
CAVE and CINEMATIC FLOOR - BIOCYBRID SPACE FOR IMMERSIVE SYNAESTHESIA
• LART collection artworks are now in the phase of expanding the sensorial apparatus in terms of
physiological signals. In the beginning of our research we used trackers for interactive and
immersive experiences of proprioceptive devices for movement to map a participant’s
displacements or gestures and providing feedback for navigation and positioning. We amplify
the previous paradigms of Cinetic Art of the 80s and the experiences are enhanced now with
disruptive technologies for perception and sensorial measurement, offering a compelling
experience in the real world. The world is visualized with all the senses and not only with
haptic and tactile interfaces. It constitutes a disruptive technology for perception and sensorial
measurement, in compelling moments mixing effects of real world during immersion with
images. Simulators technologically add to displacements the effects of collisions, vibrations,
trepidations, unbalance etc., when inhabiting synthetic spaces. Also, the historical intuitive
interfaces, such as shutter glasses, data gloves, trackers, emitters, force biofeedback devices,
joysticks, among others, are empowered by sensors of biological variables, which capture
physiological signals in order to enhance the immersion experience and make it more intense.
This body sends and receives data make the data landscapes and virtual reality is reengineered
• (The projet was presented at the SPIE conference, 2012, San Francisco. The application is
expanded beyond art and entertainment, mainly in games studies, and it is applied to
automotive and biomedical engineering. In fact, the kinesthetic sensations replicate the
sensation of displacement inside an automobile, as well as the sensations of vibration and
vertical movements typical of a vehicle, different speeds, collisions, etc. These various conditions
may be created by the system in terms of physical sensations and synthetic data provided by
actuators, as well as by the biofeedback using breathing, heat, heart beats and other signals
collected by our biosensor circuits. The Cave is also a special place for aero spatial Engineering
training.
The cinematic floor
CAVE and CINEMATIC FLOOR as a BIOCYBRID SPACE FOR IMMERSIVE
SYNAESTHESIA
(a) (b)
Treadmill with different sizes of springs includes the sense
of unbalance.
Sensations can be
experienced in the treadmill,
such as : (i) movement or
displacement, and (ii)
unbalance or oscillation.
Thus, some episodes are
performed and different
scenarios emerges form the
immersion with respective
physiological rates.
The cinematic floor
INTERACTIVE DATA VISUALIZATION –
CINEMATIC FLOOR AND BIOCYBRID IMMERSIVE SYNAESTHESIA
(a) User testing the oscillatory motion and (b), (c) detail of springs of different sizes.
(a) (b) (c)
Affective immersion LART CAVE, SPIE2012
The Cavern of Trance is
an immersive
installation conceived
by Diana Domingues in
2004 which is restored
in the current project
and expanded by the
enactive affective
system adapted to the
LART CAVE. The
participant uses sound
instruments and
sensorial microcircuits
and the cinematic floor
provides enactions a
biocybrid space, by
coexisting in both in the
physical and synthetic
landscapes. .
The reengineering of the urban and the
expanded sensorium
Sense of presence and human biology are altered by innovative
technologies and the creative use that artists make of technology.
DIANA DOMINGUES SUPERVISOR UNB RAMESH RASKAR MIT MEDIA LAB CAMERA CULTURE CNPQ
APPLICATIONS: TWO STUDY CASES
Diagnostic and treatment of diabetes; Post-doc work by Suélia Fleury Rosa
PhD thesis by Tiago Lucena – Cidadepathia UnB CNPq
The project takes advantage of the sensorized insole built with latex (Havea brasiliensis) as a mobile (wearable) device
and microcircuit of physiological sensors . Figure 1 shows the process of producing the insole for placing the sensors,
based on the Brazilian latex. Using physiological sensors we built (s. Figure 2), the insole acquires physiological data
(galvanic skin response, foot pressure, temperature) combined with locative tools (GPS), allowing the creation of a kind
of affective living map during the enactions with the city. Previous tests have showed the insole is a good personal
health assistant, especially for people with diabetes (potentially affected by foot ulcer). Biomaterial and pressure
sensors used can predict some of the most affected areas and contribute to healing [35] in experiments led also by
Suélia Rodrigues (Reis et al. 2010).
The Reenginnering of Urban – Bioart and mHealth
Enactive Affective Systems and Affective Narratives
The possibility of recording users’
journeys alludes to the mythological
figure Hermes and his winged sandals.
Hermes could move quickly between
places, and created a wearable
technology that could be said to have
enhanced his relationship with the
environment. While this insole does
not supplement human ability, it
provides an intuitive tool to see where
and when the body responds less than
optimally.
Following the user along his/her daily
life our system is as a kind of tool to
tell stories about user’s habits and
urban activity. The system creates a
kind of documentary – a real-life
storytelling – in the shape of a
dynamic (living) map
CITYPATHIA
Tiago Franklin Lucena – PhD fellow CNPq at MIT
Media Lab Camera Culture
SUPERVISOR Diana Domingues LART UnB,
Ramesh Raskar / MIT Media Lab.
Different environmnents and acts in daily life:
Path realized in he MIT campus - Cambridge - United States. About 25 minutes walk offering different
situations such as: crossing the street, crossing the corridor with people, up and down stairs, step on grass,
open doors, pick up elevator.. etc.. Map: MIT, ESRI. Available: http://whereis.mit.edu/ and Photo (right) by:
Mirella Altoé and Tiago Lucena.
Trajeto realizado pelo campus MIT – Cambridge – EUA. Cerca de 25 minutos de caminhada oferecendo diferentes situações tais
quais: atravessar rua, cruzar com pessoas no corredor, subir e descer escadas, pisar em grama, abrir portas,
pegar elevador, etc. Mapa: MIT, ESRI. Disponível: http://whereis.mit.edu/ e Fotos (dir.) por: Mirella Altoé e Tiago
Lucena.
Visual analytics: mobility, locativity and variables of velocity-
accelerometer
8/ 28/ 13 10:47 PM
tro_caminhada2_15_agosto_2013- 2 - Google Fusion Tables
Page 1 of 1
gle.com/ fusiontables/ data?docid= 1gn3IEBImukHGOSKpvOGzCPijWRrhBJ0k4vwzOuc#chartnew:id= 3
_acelerometro_caminhada2_15_agosto_2013-2
Wed Aug 28 18:19:38 PDT 2013 from tabela_acelerometro_caminhada2_15_agosto_20… more >>
on - Edited at 10:21 PM
Share
Tools Help Chart 1 Rows 1 Cards 1 Chart 2
+
No filters applied. Sorted by Time Saved 12,696 rows
average(x) average(z) average(y)
100
100 500
500 900
900 1,300
1,300
170.0
177.5
185.0
192.5
200.0
Ricardo Torres
– sinal do acelerômetro nos três eixos: x, y e z.
(tempo normalizado) Acervo Pessoal e
gerado por Ricardo Torres (Unicamp) Pontos consideráveis de alteração na velocidade
da caminhada, plotados no mapa. Imagem
gerada por Ricardo Torres (Unicamp). Acervo pessoal do
pesquisador.
Etapa de testes com sensor de GPS - realizado dia 10 de agosto de 2013 em trajeto pela cidade de
Boston (EUA).
Identification of transport used during experimental path with
GPS, accompanied by Prof. Cristiano Miosso.
Relating and combining the time path with the speeds and longitudes given by the
sensor, we can infer the mode of transportation that has been used for some time
(normalized time)
Identificação do meio de transporte utilizado durante trajeto
experimental com GPS, acompanhado pelo Prof. Cristiano Miosso.
Relacionando e combinando o tempo do trajeto com as
velocidades e longitudes dadas pelo sensor, pudemos inferir o
meio de transporte que foi utilizado durante algum tempo (tempo
normalizado).
GPS: Time, locativity and
Velocity and longitudes :
kinds of
transportation
SENSÓRIO EXPANDIDO COM SISTEMA EMBARCADO DE SENSORES FISIOLÓGICOS:
“III ENCONTRO INTERNACIONAL DE ARTE E TECNOCIÊNCIA: SENSÓRIO EXPANDIDO E SAÚDE
19 a 20 de março de 2015, Rio de Janeiro, Rio de Janeiro – Brasil
RESUMO: Apresenta-se uma síntese do desenvolvimento do Workshop “III Encontro Internacional de Arte e TecnoCiência: sensório expandido, saúde e
Bioarte, realizado nos dias19 e 20 de março de 2015, na cidade do Rio de Janeiro (RJ),nas dependências do Instituto Superior de Educação do Rio de Janeiro
(ISERJ) no dia 19 de maio, e nas dependências da E Escola Especial Favo de Mel no dia 20 de maio, a realização do WorkShop faz parte das ações
desenvolvidas pelo Laboratório de e Pesquisa Artes e TecnoCiência
•
•
•
•
•
•
•
• AVALIAÇÃO DE VARIÁVEIS FISIOLÓGICAS em um contexto não habitual, ou seja, não clinico ou laboratorial, utilizando camiseta
desenvolvida por alunos da graduação em engenharia eletrônica e do mestrado em Engenharia Biomédica, com sensores capazes de
medir a aceleração do corpo e variação da inclinação do corporal.
• Esta experiência reuniu uma equipe transdisciplinar ( artes: musica, performance, artes visuais, ciências médicas, engenharia
eletrônica, ciência da computação, educação, arquitetura, ciências sociais), durante dois dias na cidade do Rio de Janeiro, coordenados
pelos pesquisadores Profa. Dra. Diana Domingues e Prof. Dr. Adson da Rocha e Universidade de Brasília, FGA Gama , LART, CNPq, e
ainda na UnB pela Profa. Dra. Suelia Rodrigues Fleury Rosa do Bio Eng. Lab e no RJaneiro pela e pela Profa. Dra Cida Donato da
FAETEC, ISERJ. Os Professores contaram com na equipe executora com atividades de : alunos da graduação em engenharia eletrônica,
engenharia de software, mestrado em engenharia com biomédica, doutorado em ciências médicas, e Professores Doutores e Mestres
do Grupo Arte e TecnoCiência , e ainda de Perfomers Artistas visuais, convidados a participar e a atuar no evento. O grupo formado
por graduandas em pedagogia e pedagogas do Rio de Janeiro foi orientado pela Profa. Dra. Cida Donato.
• No primeiro momento foi realizada reunião com a equipe executora (figura 1 e 2), sendo que na oportunidade foram discutidas as
ações que seriam realizadas, o cronograma, e principalmente, a singularidade de cada um dos grupos – alunos especiais e performers.
• O aparato tecnológico previsto para o workshop:
• - camiseta com sensores;
• - data base sonoro e sons orgânicos;
• - projeções gráficas em data visualização interativa das médias fisiológicas auferidas;
• foram testados na manhã que antecederam às performances.
• Foi decidido que seria inserida a utilização de um sistema de sensores embarcados que oferece uma cinta com sensores de respiração
e frequência cardíaca, sensores comercializados, adquiridos pela responsável pelo workshop Profa. Dra. Diana Domingues e trazidos ao
país pelo pesquisador Ted Krueger. O aparato serve para aumentar a quantidade de variáveis fisiológicas durante as atividades, bem
como, conhecer e discutir a influência dos sons orgânicos e das paisagens gráficas em na frequência cardíaca e respiratória de pessoas
com disfunção intelectual e pessoas hígidas.
• OBJETIVOS: Testar sensores para aferição de variáveis fisiológicas – frequência respiratória, cardíaca, aceleração e inclinação dos eixos
corporais durante dois momentos performances corporais mediadas por sons orgânicos. Promover reflexão e debate sobre a utilização
destas tecnologias para assistir ou suplementar funções fisiológicas em contextos não excludentes
Ecology of sensors
Tab. 4 - Redes de Sensores
Sensores Descrição Localização
GSR Galvanic Skin Response – registra a as alterações na condutividade
elétrica da pele.
Dedos da mão
EMG Eletromiografia – registra a atividade elétrica produzida pelos
músculos. Atividade muscular.
Em fase de seleção
FSR (pressão) Force Sensor Resistor - Pressão plantar. Consiste em uma superfície
com um polímero que muda a resistência de acordo com a aplicação
de força em sua superfície.
Pés - Planta -
Palmilha
Acelerômetro Movimento – aceleração em três eixos Pés
GPS Global Positioning System - Movimento - deslocamento pelo espaço Palmilha ou Bolso
Temperatura Variação de temperatura em uma dada região Palmilha
Umidade Mudam a resistência conforme a umidade relativa Palmilha
Respiração Registra o movimento do tórax exercido durante o ato de respirar Tórax
Pulso Pulsação arterial - registra o ritmo da pulsação arterial Mão
SOCIAL BEHAVIORS AND MHEALTH
AND WELL BEING
REENGINEERING OF NATURE
and biodiversity challenges
The challenges of the infirmity of landscapes in
the sense of affective geographies and
health care, biodiversity, affectivity and the
infirmity and preservation of the landscapes and
life of the planet
3> REENGINEERING OF CULTURE
The role of social and mobile platforms (mhealth) which
enhance the awareness of human presence and reinvents
urban ecologies amplified by mobile technologies targeting a
healthy reengineered future
3.1 > REENGINEERING OF THE URBAN
REENGINEERING OF THE NATURE
Biodiversity and the preservation of the life and
the species
Biodiversity and the preservation of the species: “Frogs’
signatures”
• Innovative technologies investigates biodiversity and life protection related to the preservation of frog
populations in Brazilian biomes. Frogs’ vocalizations are visualize exploring the acquisition of sounds and
their properties. The automatic system provides the classification of the species and the number of frogs
living in remote biomes, replacing the old analogic way methods.Abstract images, correspond to different
levels of physical parameters determined from the sounds: temperature, humidity, and light conditions.
The sonic enactive landscape is the PhD thesis of André Gonçalves de Oliveira’s, supervisor Dr. Diana
Domingues, in collaborative practices with investigations in signal processing, intelligent systems and data
visualization by Prof. Dr. Cristiano Miosso. Different types of physical and behavioral properties, as well as
environmental parameters, can be extracted from frogs callings as shown in a recent bioacoustics
research.
• Regarding scientific visualization techniques to analyze frog vocalizations, we explore e.g. different forms of spectrograms,
representing time-frequency distributions using gray levels and colors in bidimensional and tridimensional representations.
Furthermore, we develop dynamic spectrograms, showing the evolution of time-frequency distributions as time passes and
as the frogs (or other animals) react to environmental changes. Building these spectrograms, we compare different
techniques, such as the windowed Fourier transform and filter banks. In enactive soundscapes and data visualization, we use
our affective enactive system in Virtual Reality and the simulation of human proximity using our physiological sensors for
enactions and the immersion in data landscapes as in the LART Cave. Biofeedback systems and data landscape (large data
screen and the compelling experience in the cave), the manipulation of visual and sonic information dialoguing with distant
biomes are proposals for the naturalization of aesthetics in the enaction to living organisms, here the frogs, using
teleproxemics. Metaphorically, we propose frogs’ signatures and the human behavior dealing with laws and phenomena of
the cosmos, by influencing life of nature as a living organism, exchanging electrical potentials, heats, sounds, vibrations and
the sense of presence being advanced by the technological apparatus and affective biofeedback for the responsibility of
humans and a healthier territory.
REENGINEERING OF NATURE
AND THE PRESERVATION OF THE SPECIES
Life of the planet and BIODIVERSITY
Enactive sonic landscapes and the
naturalization of the aesthetics ( PhD thesis André
Oliveira, Dr. Diana Dominguues Supervisor , Cristiano Miosso-
Frogs’signatures and biocybrid ecologies – data
visualization
Healthy Ecosystem and Fighting
Dengue: Biodiversity, Affectivity
and Infirmity of Landscapes in
Social Software and Data
Visualization
Mhealth
• Researchers Diana M.Gallicchio Domingues*, Sara Diamond**, Ana Paula
Machado*** Ricardo da Silva Torres**** Carla Ferreira Rocha*, , Tiago Franklin
Lucena***
• * LART, Post Eng. Bio. University of Brasília at Gama, Gama/Brasília, Brazil; CAPES
,CNPq, Brazil
• ** OCAD U University, Ontario, Canada
• *** University Center of Cesumar, UniCesumar , Maringá, Brazil
• **** Institute of Computing, University of Campinas, UNICAMP, CAMPINAS, Brazil
Dengue and mhealth
Mhealth social softwares
METHODOLOGY
• Scientific information from technicians and from the communities are gathered in a
database, with geographical information.
• Participatory Design and Ethnographic Protocols for Visualization
Tools and specific technologies (emergent systems, model-based scientific
visualizations of complex data sets, data mining for volumetric visualization, cloud
computing and architecture) large use of mobile devices and participatory design
strategies.
• The system is based on networked cyberinfrastructure and physic territory
actions. These actions use advanced scientific methods for analysing and evaluating
biodiversity research on continental-scale environmental issues
• Also, they are based on accelerated research strategies, and on communication strategies
for collaborative network on biodiversity, ecological and geographic informatics, social
platforms, mobile technologies and health process learning experiences in the physical
world and in the digital environment, in collaborations and reciprocity, by using
technological common network protocols.
• Transdisciplinar/antidisciplinar methods in social software and data visualization in a
cyber infrastructure of intelligent systems and visualization technologies enable an
affective aesthetics regarding the infirm landscapes and to fight the dengue problem,
joining the scientific methods and the social behaviors that aim at a healthier future for
the planet.
Proposal in mobile apps and affective
narratives – MHEALTH
• Micronarratives , mobile devices and apps:
• Exploring mobile techs : devices iPod?s, iPhone?s, Ipads, Android..
• Hardware, and GPS locativity -,
• Google maps, MySpace, Facebook, Skype, Twitter, blogs,
Instagrams, What?s app
• Youtube and narratives .
• REALITY MINING – data mining of people everywhere , social
physics, contamination of behaviors, EPIDEMIOLOGY and FICCION
and REALITY , biocyber affective ficcion .
• Hiperfiçcion, intelligent systems, automatisme, dataming, machime
learning, surveillance and GPs, geolocativity.
• Visual analytics techniques for healthcare :
Final comments : Life is reinvented –
life is reengineered
• We are facing the transformation in our life , in the “nature itself” and
its evident the emergence of “the engineered reality for a healthier
future ”..
• The digital magicians every where and their creative technologies may
transform life.
• We humanize technologies , WE NATURALIZE TECHNOLOGIES
• New Leonardos” eScience Institute of Innovation for Living Systems
Proposal in mobile apps and affective
narratives – BIOART and MHEALTH
]Mobile mobilization
Data information and social platforms
affective geographies and Bioart and mhealth
• Micronarratives , mobile devices and apps:
• Exploring mobile techs : Cell phones, devices iPod?s, iPhone?s, Ipads, Android..
• Hardware, and GPS locativity -,
• Google maps, Facebook, Skype, Twitter, blogs, Instagrams, What?s app
• Youtube and narratives .
• REALITY MINING – data mining of people everywhere , social physics, contamination of behaviors, EPIDEMIOLOGY and FICCION and REALITY ,
biocyber affective narratives .
• Hipernarratives, intelligent systems, automatisme, dataming, machime learning, surveillance and GPs, geolocativity.
• Visual analytics techniques for health.
• Scientific information from technicians and from the communities are gathered in a database, with geographical information.
• Participatory Design and Ethnographic Protocols for Visualization Tools and specific technologies (emergent systems, model-based
scientific visualizations of complex data sets, data mining for volumetric visualization, cloud computing and architecture) large use of mobile
devices and participatory design strategies.
• The system is based on networked cyberinfrastructure and physic territory actions. These actions use advanced scientific methods for analysing
and evaluating biodiversity research on continental-scale environmental issues
• Also, they are based on accelerated research strategies, and on communication strategies for collaborative network on biodiversity, ecological and
geographic informatics, social platforms, mobile technologies and health process learning experiences in the physical world and in the digital
environment, in collaborations and reciprocity, by using technological common network protocols.
• Transdisciplinar/antidisciplinar methods in social software and data visualization in a cyber infrastructure of intelligent systems and visualization
technologies enable an affective aesthetics regarding the infirm landscapes and to fight the dengue problem, joining the scientific methods and the
social behaviors that aim at a healthier future for the planet
Youtube: http://www.youtube.com/channel/UCIRaxl0HRT-Uaclj1Q94rMw
Facebook :
Tecnodengue
O Drama da Dengue: jornalismo e ativismo nos softwares sociais
Maringá :case study
Ana Paula Machado Velho Pos Doc , PDJ CNPq 2013, Dr.Diana Domingues
How to mobilize communities?
Product: metodology to activism and social mobilization.
Theories: social physics (Alex Pentland), social engagement on online networks (Rheingold, Castells)
2 - Ethnojournalistic narratives (group using smartphones, apps and online social network
will generate content about dengue)
3 - Generate content (activation workshops)
4 - Identify requirements for the social software
Final comments
Life is reengineered
• Challenges of the world, increasingly faced by circuits of
sensors and transparent technologies are blurring the
limits of the natural and physical world and are
reengineering reality.
We are facing transformation in our life , in the “nature
itself” and its evident the emergence of
“the engineered reality for a healthier future ”
• The digital magicians , every where , with their creative
minds transform life. They humanize technologies .
They naturalize technologies!
Final discussion
• Prototypes for the industry, art and culture
application.
• Biofeedback based on synaesthesya and expanded
sensorium generated sounds and images and avoiding
patterns that correspond to the (un)desired
physiological states during physical activity.
• Concerning (re) habilitation of parts of body activities,
or simply body behaviors, the identity is revealed in
affective zones.
• Light and liveness entails new ways of deciphering
human behaviors and body embodiments and
behaviors in microscales allowing the self-perception
in introspective ways, meditation, self-identity, behind
externalized traces.
Body is reinvented – life is
reengineered
• Challenges of the world, increasingly faced by
biocybrid circuits of sensors, blurring the limits of
the natural worlds and the engineered reality and
the “nature itself” and the emergence and “the
future engineered reality”..
• The digital magicians every where in the world and
their creative technologies will transform life. We
humanize technologies or “technologies
dehumanizes us”.
• LART – Laboratory of Research in
Art and TechnoScience
• Biomedical Engineering Graduate
Program - FGA/GAMA
• Science Technologies in Health
Graduate Program- Ceilândia UnB
• University of Brasilia at Gama ––
CNPq/CAPES:
Discussions and perspective
Embodiments and affections
• In cognitive science and human embodiments arts domain, we enhance studies on
kinesthetics by mixing the Kinemas, as a language of movement, proposed by
Rudolf Laban, in a transphysiological dimension, i.e. aspects of motion, electricity,
graphic design, in data visualization and data sonification. Body movements,
gestures, postures, fragmentation, reinstatements, dynamics, internal-external
connections and motor schemes, dealing with gestures, rhythms, not only at each
stage of the movement, but also considering what affects you, the environment
and the coupled interior and affection in the flows of life with affective enactive
sensors. Biofeedback with outside environment in enactive affective conditions
can help understanding the internal excitation of nerves or the immediate
impression of the senses, or by a complicated chain of senses’ impressions,
previously experienced, stored in the memory of sensations, emotions and
thoughts. Attempts are being made for the system to read the rhythmic patterns
of movement.
• Data mining and mobile Technologies (EAGLE
e PENTLAND, 2006) waerables (OLGUIN et al.,
2009), generating wearable Affective maps
based on te physiological data of people
design the enactive Affective system afetivo.
discussion
• - Biomedical Engineeering and prototypes for the medical
industry, art and culture application.
• Enactive Affective System as personal assistant based on
synaesthesya and expanded sensorium generated data and
diagnostics avoiding patterns that correspond to the
(un)desired physiological states during physical activity.
• Concerning (re) habilitation of parts of body activities, or simply
body behaviors, the identity is revealed in affective zones.
• Light and liveness entails new ways of deciphering human
behaviors and body embodiments and behaviors in
microscales allowing the self-perception in introspective ways,
meditation, self-identity, behind externalized traces.
Perspectives
Biograms and living maps
Perspectiva de Massumi (2002), que ressalta a impossibilidade de textos ou estruturas linguísticas captarem o
afeto, desde que não trazem o élan vital do afeto (no setido spinoziano). Ou seja, o método não se resume no
metafórico representacional, baseado em dados de experiências vividas que não são traduzidas por um
sistema de natureza textual. A afetiva é a intensidade de uma experiência não consciente, “it is a moment of
unformed and unstructured potential. Of the three central terms in this essay – feeling, emotion, and affect –
affect is the most abstract because affect cannot be fully realised in language, and because affect is always
prior to and/or outside of consciousness (Massumi, 2002).” Affect is the body’s way of preparing itself for action
in a given circumstance by adding a quantitative dimension of intensity to the quality of an experience.
u-health (Ubiquitous health –
saúde ubíqua). O termo vem sendo
usado em textos específicos no
campo médico (Seo, Jin Woo; Park,
Final comments
Life is reengineered
• Challenges of the world, increasingly faced by circuits of
sensors and transparent technologies are blurring the limits
of the natural and physical world and are reengineering
reality.
We are facing transformation in life , in the “nature itself”
and its evident the emergence of
“the engineered reality transformed for a healthier future ”
• The digital magicians , every where , with their creative
minds transform life.
• They humanize technologies . They naturalize technologies!
lart@gmail.com
dgdomingues@gmail.com
http://dgp.cnpq.br/buscaoperacional/detalhegrupo.jsp?
grupo=0240803DKU6FNW

More Related Content

Similar to creative technologies and radical digital for reinventing life.pptx

Science and technology in question
Science and technology in questionScience and technology in question
Science and technology in questionFernando Alcoforado
 
Ict assignment
Ict assignmentIct assignment
Ict assignmentInikaAdamu
 
Handout09 mith
 Handout09 mith Handout09 mith
Handout09 mithKatie King
 
Can science be social? Collective and Citizen Experimentation in Computationa...
Can science be social? Collective and Citizen Experimentation in Computationa...Can science be social? Collective and Citizen Experimentation in Computationa...
Can science be social? Collective and Citizen Experimentation in Computationa...Josep Perelló
 
SuperLux International Symposium: Smart Light Art, Design and Architecture f...
SuperLux International Symposium:  Smart Light Art, Design and Architecture f...SuperLux International Symposium:  Smart Light Art, Design and Architecture f...
SuperLux International Symposium: Smart Light Art, Design and Architecture f...Thomas Schielke
 
Smithies cologne 2017
Smithies cologne 2017Smithies cologne 2017
Smithies cologne 2017jamessmithies
 
SR-1011_S&T_Map_2005-2055
SR-1011_S&T_Map_2005-2055SR-1011_S&T_Map_2005-2055
SR-1011_S&T_Map_2005-2055Jake Wachman
 
Malina beijing 2018
Malina beijing 2018Malina beijing 2018
Malina beijing 2018roger malina
 
53987 Futurescan Tillotson 2013
53987 Futurescan Tillotson 201353987 Futurescan Tillotson 2013
53987 Futurescan Tillotson 2013Jenny Tillotson
 
IMAGINE! - SOME TRENDS IN RECREATIONAL SCIENCE AND
IMAGINE! - SOME TRENDS IN RECREATIONAL SCIENCE ANDIMAGINE! - SOME TRENDS IN RECREATIONAL SCIENCE AND
IMAGINE! - SOME TRENDS IN RECREATIONAL SCIENCE ANDMiquel Duran
 
roger Malina for diana dominguez 09
roger Malina for diana dominguez 09roger Malina for diana dominguez 09
roger Malina for diana dominguez 09roger malina
 
Science interpretation 01
Science interpretation   01Science interpretation   01
Science interpretation 01Simon Schneider
 
Roger malina nsf nea workshop 2011 ss
Roger malina nsf nea workshop 2011 ssRoger malina nsf nea workshop 2011 ss
Roger malina nsf nea workshop 2011 ssroger malina
 
Turn stem to steam
Turn stem to steamTurn stem to steam
Turn stem to steamfunpathshala
 
Roger Malina isea keynote 2012
Roger Malina isea keynote 2012Roger Malina isea keynote 2012
Roger Malina isea keynote 2012roger malina
 
All Hands on Deck - Getting Visitors Involved in the Work of the Museum (AAM ...
All Hands on Deck - Getting Visitors Involved in the Work of the Museum (AAM ...All Hands on Deck - Getting Visitors Involved in the Work of the Museum (AAM ...
All Hands on Deck - Getting Visitors Involved in the Work of the Museum (AAM ...sloverlinett
 
Cultureplex Lab Presentation
Cultureplex Lab Presentation Cultureplex Lab Presentation
Cultureplex Lab Presentation CameliaN
 

Similar to creative technologies and radical digital for reinventing life.pptx (20)

Science and technology in question
Science and technology in questionScience and technology in question
Science and technology in question
 
Ict assignment
Ict assignmentIct assignment
Ict assignment
 
Handout09 mith
 Handout09 mith Handout09 mith
Handout09 mith
 
Can science be social? Collective and Citizen Experimentation in Computationa...
Can science be social? Collective and Citizen Experimentation in Computationa...Can science be social? Collective and Citizen Experimentation in Computationa...
Can science be social? Collective and Citizen Experimentation in Computationa...
 
SuperLux International Symposium: Smart Light Art, Design and Architecture f...
SuperLux International Symposium:  Smart Light Art, Design and Architecture f...SuperLux International Symposium:  Smart Light Art, Design and Architecture f...
SuperLux International Symposium: Smart Light Art, Design and Architecture f...
 
Smithies cologne 2017
Smithies cologne 2017Smithies cologne 2017
Smithies cologne 2017
 
SR-1011_S&T_Map_2005-2055
SR-1011_S&T_Map_2005-2055SR-1011_S&T_Map_2005-2055
SR-1011_S&T_Map_2005-2055
 
Malina beijing 2018
Malina beijing 2018Malina beijing 2018
Malina beijing 2018
 
Congresul AEDE-Romania
Congresul AEDE-RomaniaCongresul AEDE-Romania
Congresul AEDE-Romania
 
53987 Futurescan Tillotson 2013
53987 Futurescan Tillotson 201353987 Futurescan Tillotson 2013
53987 Futurescan Tillotson 2013
 
IMAGINE! - SOME TRENDS IN RECREATIONAL SCIENCE AND
IMAGINE! - SOME TRENDS IN RECREATIONAL SCIENCE ANDIMAGINE! - SOME TRENDS IN RECREATIONAL SCIENCE AND
IMAGINE! - SOME TRENDS IN RECREATIONAL SCIENCE AND
 
roger Malina for diana dominguez 09
roger Malina for diana dominguez 09roger Malina for diana dominguez 09
roger Malina for diana dominguez 09
 
Science interpretation 01
Science interpretation   01Science interpretation   01
Science interpretation 01
 
Roger malina nsf nea workshop 2011 ss
Roger malina nsf nea workshop 2011 ssRoger malina nsf nea workshop 2011 ss
Roger malina nsf nea workshop 2011 ss
 
Turn stem to steam
Turn stem to steamTurn stem to steam
Turn stem to steam
 
Roger Malina isea keynote 2012
Roger Malina isea keynote 2012Roger Malina isea keynote 2012
Roger Malina isea keynote 2012
 
All Hands on Deck - Getting Visitors Involved in the Work of the Museum (AAM ...
All Hands on Deck - Getting Visitors Involved in the Work of the Museum (AAM ...All Hands on Deck - Getting Visitors Involved in the Work of the Museum (AAM ...
All Hands on Deck - Getting Visitors Involved in the Work of the Museum (AAM ...
 
note present eng
note present engnote present eng
note present eng
 
Cultureplex Lab Presentation
Cultureplex Lab Presentation Cultureplex Lab Presentation
Cultureplex Lab Presentation
 
Digicraft and 'Systemic' Thinking in Digital Humanities Reasoning on the Per...
Digicraft and 'Systemic' Thinking  in Digital Humanities Reasoning on the Per...Digicraft and 'Systemic' Thinking  in Digital Humanities Reasoning on the Per...
Digicraft and 'Systemic' Thinking in Digital Humanities Reasoning on the Per...
 

Recently uploaded

RAK Call Girls Service # 971559085003 # Call Girl Service In RAK
RAK Call Girls Service # 971559085003 # Call Girl Service In RAKRAK Call Girls Service # 971559085003 # Call Girl Service In RAK
RAK Call Girls Service # 971559085003 # Call Girl Service In RAKedwardsara83
 
FULL ENJOY - 9953040155 Call Girls in Shahdara | Delhi
FULL ENJOY - 9953040155 Call Girls in Shahdara | DelhiFULL ENJOY - 9953040155 Call Girls in Shahdara | Delhi
FULL ENJOY - 9953040155 Call Girls in Shahdara | DelhiMalviyaNagarCallGirl
 
Deira Call Girls # 0522916705 # Call Girls In Deira Dubai || (UAE)
Deira Call Girls # 0522916705 #  Call Girls In Deira Dubai || (UAE)Deira Call Girls # 0522916705 #  Call Girls In Deira Dubai || (UAE)
Deira Call Girls # 0522916705 # Call Girls In Deira Dubai || (UAE)wdefrd
 
Akola Call Girls #9907093804 Contact Number Escorts Service Akola
Akola Call Girls #9907093804 Contact Number Escorts Service AkolaAkola Call Girls #9907093804 Contact Number Escorts Service Akola
Akola Call Girls #9907093804 Contact Number Escorts Service Akolasrsj9000
 
Lucknow 💋 Call Girls in Lucknow | Service-oriented sexy call girls 8923113531...
Lucknow 💋 Call Girls in Lucknow | Service-oriented sexy call girls 8923113531...Lucknow 💋 Call Girls in Lucknow | Service-oriented sexy call girls 8923113531...
Lucknow 💋 Call Girls in Lucknow | Service-oriented sexy call girls 8923113531...anilsa9823
 
Young⚡Call Girls in Lajpat Nagar Delhi >༒9667401043 Escort Service
Young⚡Call Girls in Lajpat Nagar Delhi >༒9667401043 Escort ServiceYoung⚡Call Girls in Lajpat Nagar Delhi >༒9667401043 Escort Service
Young⚡Call Girls in Lajpat Nagar Delhi >༒9667401043 Escort Servicesonnydelhi1992
 
(NEHA) Call Girls Ahmedabad Booking Open 8617697112 Ahmedabad Escorts
(NEHA) Call Girls Ahmedabad Booking Open 8617697112 Ahmedabad Escorts(NEHA) Call Girls Ahmedabad Booking Open 8617697112 Ahmedabad Escorts
(NEHA) Call Girls Ahmedabad Booking Open 8617697112 Ahmedabad EscortsCall girls in Ahmedabad High profile
 
Aminabad @ Book Call Girls in Lucknow - 450+ Call Girl Cash Payment 🍵 8923113...
Aminabad @ Book Call Girls in Lucknow - 450+ Call Girl Cash Payment 🍵 8923113...Aminabad @ Book Call Girls in Lucknow - 450+ Call Girl Cash Payment 🍵 8923113...
Aminabad @ Book Call Girls in Lucknow - 450+ Call Girl Cash Payment 🍵 8923113...akbard9823
 
Hazratganj / Call Girl in Lucknow - Phone 🫗 8923113531 ☛ Escorts Service at 6...
Hazratganj / Call Girl in Lucknow - Phone 🫗 8923113531 ☛ Escorts Service at 6...Hazratganj / Call Girl in Lucknow - Phone 🫗 8923113531 ☛ Escorts Service at 6...
Hazratganj / Call Girl in Lucknow - Phone 🫗 8923113531 ☛ Escorts Service at 6...akbard9823
 
Lucknow 💋 Virgin Call Girls Lucknow | Book 8923113531 Extreme Naughty Call Gi...
Lucknow 💋 Virgin Call Girls Lucknow | Book 8923113531 Extreme Naughty Call Gi...Lucknow 💋 Virgin Call Girls Lucknow | Book 8923113531 Extreme Naughty Call Gi...
Lucknow 💋 Virgin Call Girls Lucknow | Book 8923113531 Extreme Naughty Call Gi...anilsa9823
 
FULL ENJOY - 9953040155 Call Girls in Uttam Nagar | Delhi
FULL ENJOY - 9953040155 Call Girls in Uttam Nagar | DelhiFULL ENJOY - 9953040155 Call Girls in Uttam Nagar | Delhi
FULL ENJOY - 9953040155 Call Girls in Uttam Nagar | DelhiMalviyaNagarCallGirl
 
Deconstructing Gendered Language; Feminist World-Making 2024
Deconstructing Gendered Language; Feminist World-Making 2024Deconstructing Gendered Language; Feminist World-Making 2024
Deconstructing Gendered Language; Feminist World-Making 2024samlnance
 
exhuma plot and synopsis from the exhuma movie.pptx
exhuma plot and synopsis from the exhuma movie.pptxexhuma plot and synopsis from the exhuma movie.pptx
exhuma plot and synopsis from the exhuma movie.pptxKurikulumPenilaian
 
FULL ENJOY - 9953040155 Call Girls in Burari | Delhi
FULL ENJOY - 9953040155 Call Girls in Burari | DelhiFULL ENJOY - 9953040155 Call Girls in Burari | Delhi
FULL ENJOY - 9953040155 Call Girls in Burari | DelhiMalviyaNagarCallGirl
 
FULL ENJOY - 9953040155 Call Girls in Shaheen Bagh | Delhi
FULL ENJOY - 9953040155 Call Girls in Shaheen Bagh | DelhiFULL ENJOY - 9953040155 Call Girls in Shaheen Bagh | Delhi
FULL ENJOY - 9953040155 Call Girls in Shaheen Bagh | DelhiMalviyaNagarCallGirl
 
Lucknow 💋 Escorts Service Lucknow Phone No 8923113531 Elite Escort Service Av...
Lucknow 💋 Escorts Service Lucknow Phone No 8923113531 Elite Escort Service Av...Lucknow 💋 Escorts Service Lucknow Phone No 8923113531 Elite Escort Service Av...
Lucknow 💋 Escorts Service Lucknow Phone No 8923113531 Elite Escort Service Av...anilsa9823
 
Vip Hisar Call Girls #9907093804 Contact Number Escorts Service Hisar
Vip Hisar Call Girls #9907093804 Contact Number Escorts Service HisarVip Hisar Call Girls #9907093804 Contact Number Escorts Service Hisar
Vip Hisar Call Girls #9907093804 Contact Number Escorts Service Hisarsrsj9000
 
Islamabad Escorts # 03080115551 # Escorts in Islamabad || Call Girls in Islam...
Islamabad Escorts # 03080115551 # Escorts in Islamabad || Call Girls in Islam...Islamabad Escorts # 03080115551 # Escorts in Islamabad || Call Girls in Islam...
Islamabad Escorts # 03080115551 # Escorts in Islamabad || Call Girls in Islam...wdefrd
 

Recently uploaded (20)

RAK Call Girls Service # 971559085003 # Call Girl Service In RAK
RAK Call Girls Service # 971559085003 # Call Girl Service In RAKRAK Call Girls Service # 971559085003 # Call Girl Service In RAK
RAK Call Girls Service # 971559085003 # Call Girl Service In RAK
 
FULL ENJOY - 9953040155 Call Girls in Shahdara | Delhi
FULL ENJOY - 9953040155 Call Girls in Shahdara | DelhiFULL ENJOY - 9953040155 Call Girls in Shahdara | Delhi
FULL ENJOY - 9953040155 Call Girls in Shahdara | Delhi
 
Indian Deira Call Girls # 0522916705 # Indian Call Girls In Deira Dubai || (UAE)
Indian Deira Call Girls # 0522916705 # Indian Call Girls In Deira Dubai || (UAE)Indian Deira Call Girls # 0522916705 # Indian Call Girls In Deira Dubai || (UAE)
Indian Deira Call Girls # 0522916705 # Indian Call Girls In Deira Dubai || (UAE)
 
Deira Call Girls # 0522916705 # Call Girls In Deira Dubai || (UAE)
Deira Call Girls # 0522916705 #  Call Girls In Deira Dubai || (UAE)Deira Call Girls # 0522916705 #  Call Girls In Deira Dubai || (UAE)
Deira Call Girls # 0522916705 # Call Girls In Deira Dubai || (UAE)
 
Akola Call Girls #9907093804 Contact Number Escorts Service Akola
Akola Call Girls #9907093804 Contact Number Escorts Service AkolaAkola Call Girls #9907093804 Contact Number Escorts Service Akola
Akola Call Girls #9907093804 Contact Number Escorts Service Akola
 
Lucknow 💋 Call Girls in Lucknow | Service-oriented sexy call girls 8923113531...
Lucknow 💋 Call Girls in Lucknow | Service-oriented sexy call girls 8923113531...Lucknow 💋 Call Girls in Lucknow | Service-oriented sexy call girls 8923113531...
Lucknow 💋 Call Girls in Lucknow | Service-oriented sexy call girls 8923113531...
 
Young⚡Call Girls in Lajpat Nagar Delhi >༒9667401043 Escort Service
Young⚡Call Girls in Lajpat Nagar Delhi >༒9667401043 Escort ServiceYoung⚡Call Girls in Lajpat Nagar Delhi >༒9667401043 Escort Service
Young⚡Call Girls in Lajpat Nagar Delhi >༒9667401043 Escort Service
 
(NEHA) Call Girls Ahmedabad Booking Open 8617697112 Ahmedabad Escorts
(NEHA) Call Girls Ahmedabad Booking Open 8617697112 Ahmedabad Escorts(NEHA) Call Girls Ahmedabad Booking Open 8617697112 Ahmedabad Escorts
(NEHA) Call Girls Ahmedabad Booking Open 8617697112 Ahmedabad Escorts
 
Aminabad @ Book Call Girls in Lucknow - 450+ Call Girl Cash Payment 🍵 8923113...
Aminabad @ Book Call Girls in Lucknow - 450+ Call Girl Cash Payment 🍵 8923113...Aminabad @ Book Call Girls in Lucknow - 450+ Call Girl Cash Payment 🍵 8923113...
Aminabad @ Book Call Girls in Lucknow - 450+ Call Girl Cash Payment 🍵 8923113...
 
Hazratganj / Call Girl in Lucknow - Phone 🫗 8923113531 ☛ Escorts Service at 6...
Hazratganj / Call Girl in Lucknow - Phone 🫗 8923113531 ☛ Escorts Service at 6...Hazratganj / Call Girl in Lucknow - Phone 🫗 8923113531 ☛ Escorts Service at 6...
Hazratganj / Call Girl in Lucknow - Phone 🫗 8923113531 ☛ Escorts Service at 6...
 
Lucknow 💋 Virgin Call Girls Lucknow | Book 8923113531 Extreme Naughty Call Gi...
Lucknow 💋 Virgin Call Girls Lucknow | Book 8923113531 Extreme Naughty Call Gi...Lucknow 💋 Virgin Call Girls Lucknow | Book 8923113531 Extreme Naughty Call Gi...
Lucknow 💋 Virgin Call Girls Lucknow | Book 8923113531 Extreme Naughty Call Gi...
 
FULL ENJOY - 9953040155 Call Girls in Uttam Nagar | Delhi
FULL ENJOY - 9953040155 Call Girls in Uttam Nagar | DelhiFULL ENJOY - 9953040155 Call Girls in Uttam Nagar | Delhi
FULL ENJOY - 9953040155 Call Girls in Uttam Nagar | Delhi
 
Deconstructing Gendered Language; Feminist World-Making 2024
Deconstructing Gendered Language; Feminist World-Making 2024Deconstructing Gendered Language; Feminist World-Making 2024
Deconstructing Gendered Language; Feminist World-Making 2024
 
exhuma plot and synopsis from the exhuma movie.pptx
exhuma plot and synopsis from the exhuma movie.pptxexhuma plot and synopsis from the exhuma movie.pptx
exhuma plot and synopsis from the exhuma movie.pptx
 
FULL ENJOY - 9953040155 Call Girls in Burari | Delhi
FULL ENJOY - 9953040155 Call Girls in Burari | DelhiFULL ENJOY - 9953040155 Call Girls in Burari | Delhi
FULL ENJOY - 9953040155 Call Girls in Burari | Delhi
 
FULL ENJOY - 9953040155 Call Girls in Shaheen Bagh | Delhi
FULL ENJOY - 9953040155 Call Girls in Shaheen Bagh | DelhiFULL ENJOY - 9953040155 Call Girls in Shaheen Bagh | Delhi
FULL ENJOY - 9953040155 Call Girls in Shaheen Bagh | Delhi
 
Lucknow 💋 Escorts Service Lucknow Phone No 8923113531 Elite Escort Service Av...
Lucknow 💋 Escorts Service Lucknow Phone No 8923113531 Elite Escort Service Av...Lucknow 💋 Escorts Service Lucknow Phone No 8923113531 Elite Escort Service Av...
Lucknow 💋 Escorts Service Lucknow Phone No 8923113531 Elite Escort Service Av...
 
Pakistani Deira Call Girls # 00971589162217 # Pakistani Call Girls In Deira D...
Pakistani Deira Call Girls # 00971589162217 # Pakistani Call Girls In Deira D...Pakistani Deira Call Girls # 00971589162217 # Pakistani Call Girls In Deira D...
Pakistani Deira Call Girls # 00971589162217 # Pakistani Call Girls In Deira D...
 
Vip Hisar Call Girls #9907093804 Contact Number Escorts Service Hisar
Vip Hisar Call Girls #9907093804 Contact Number Escorts Service HisarVip Hisar Call Girls #9907093804 Contact Number Escorts Service Hisar
Vip Hisar Call Girls #9907093804 Contact Number Escorts Service Hisar
 
Islamabad Escorts # 03080115551 # Escorts in Islamabad || Call Girls in Islam...
Islamabad Escorts # 03080115551 # Escorts in Islamabad || Call Girls in Islam...Islamabad Escorts # 03080115551 # Escorts in Islamabad || Call Girls in Islam...
Islamabad Escorts # 03080115551 # Escorts in Islamabad || Call Girls in Islam...
 

creative technologies and radical digital for reinventing life.pptx

  • 1. ART AND TECHNOSCIENCE: creative technologies and the radical digital reinventing life for a healthier future Life is reengineered Profa. Dra. Diana Domingues LART Founder and Director– Laboratory of Research in Art and Techno Science University of Brasília – Senior collaborator Professor Senior National Visitant Researcher CAPES at UNB FGA GAMA 2010 2014 CNPq (National Council for Scientific and Technological Development) Researcher PQ 1A Post Graduate Program in Biomedical Engineering Post Graduate Program Sciences and Technologies in Healt Ceilandia UnB Researcher at Camera Culture MIT Media Lab - MIT/CNPq (2012 2015) http://dgp.cnpq.br/buscaoperacional/detalhegrupo.jsp?grupo=0240803DKU6FNW dgdomingues@gmail.com skype:dgdomingues1 Diana Domingues
  • 2. Diana Domingues selected historical remarks with respect to Art and Techno Science Publications: SPIE SIGGRAPH ACM HCI IEEE SVR SIBIGRAPI SVR Leonardo ISEA Digital Creativity RECENT GRANTS and International Cooperation : MIT/CNPq Camera Culture Media Lab, OCADU- CIVDDD- Danube University .Senior researcher CAPES CNPq 1 A
  • 3. The Art in the XX1st Century: The Humanization of Technologies Edunesp, Diana Domingues, 1995 SP 2011 MIT “We must humanize technology before it dehumanizes us “ - Oliver Sacks, neurologist and author
  • 4. • HUMANIZATION OF TECHNOLOGIES , 1995 • I have always taken into account the human factor when investigating interactive technologies in their potential to transform ways of living. How can we understand types, levels and intensities of changes in post-biological, post-human, neo-biological, trans-human life installed by technologies? At the end of the 20th century, when interactive technologies – and mainly the inclusion of the WWW – started to invade and feed the creative minds of artists in the Media Art scenario, I had already anticipated • NATURALIZATION OF TECHNOLOGIES • Without intending to be taken for a visionary I dare to forecast that in the next couple of years, people will normally use wireless interfaces, and matter-of-factly will be connected in all microtimes of their lives. Existence will become a cybrid existence during the twenty four hours of life time. People will increasingly have interfaces and will be rather TV- like, to use an analogy to the contemporary technological and the society of the spectacle. Symbiotic technologies will be facilitated as permanent prostheses and they will be attached on us and into our bodies and thus we will be reinventing our lives and the ultimate nature of our species.
  • 5. About LART UnB Gama A transdisciplinary group working at the Laboratory of Art and TechnoScience (LART), at the University of Brasília at Gama (FGA), holds collaborative researches integrating professors and students at the BIOMEDICAL ENGINEERING GRADUATE PROGRAM and five engineering undergraduate programs ENGINEERING OF Software Automotive Energy Electronic AeroSpatial
  • 6. LART and New Leonardos at Gama We work in the transdisciplinary field of Art and Technoscience and the action of “New Leonardos” (ISAST Plataform) at FGA Gama. Advanced researches by integrating a team of Collective intelligence, trying to synthesize the genius in a bottom-up environment. E sciences by acting in several domains and approaches, covering arts, science and technology by proposing “levels of reality” and “creative reality”, or searching for innovation such as a world as a reengineered reality.
  • 7. For forty years the Leonardo organizations have had the privilege of witnessing, and helping to document, a birth of new forms of innovative and creative practices. Especially during the last ten years a new generation of artists scientifically and technically literate, “new Leonardos” , have been creating contemporary art forms, and in the process making new technical inventions and in some cases, scientific discoveries. Roger Malina /ISAST NEW LEONARDOS
  • 8. HOW TO SYNTHESIZE LEONARDO? Efficient collaborative practices dissolves the old rupture and the well-known historical divergences between artists and scientists. The main point of convergence is: when all disciplines investigate the same problems, all sciences become one unique new science.
  • 9. MYSTERIES OF LIFE Art and Science propitiate the ontology of life with levels of creative reality that challenge paradigms and risks related to “mysteries” of life covering living systems with the the same unpredictable approach of emergent realities. Interactive systems in digital culture develop evolutionary processes, configuring complex levels of life states now expanded by mutual and reciprocal exchanges in a coupled condition called enactive condition, a feature not seen before.
  • 10. COMPLEX THEORIES AND TRANSDICIPLINARY PRACTICES Art and Science for the generation of living systems relink the HEURISTICS + LOGICS The articulation between the poet’s creative intuition and the analytical tools of thinking and discourse, such as logic, mathematics and information technology that makes possible transdiciplinary approaches. (Ivan Domingues) - IEAT
  • 11. •TRANSdisciplinar • ANTI (mitmedia lab) In transdisciplinary practices, work is usually developed in "ignorance zones", (Domingues , Ivan) not acknowledged by universities. People from different domains establish a common workplace, looking for new problems, approaches, secret bridges between areas of study, creating the transit of research topics. Different from classical, traditional paradigms, we are no longer prisoners of truths. The outcomes of such artists and scientists’ network exceed what is normal and ordinary in institutions and official places.
  • 12. • Stonehenge • Paleolithic masters of engineering and astronomy
  • 13. CHERCHEURS OU ARTISTES? Entre Art et Science ils rêvent le monde (Monique Sicard) Mondrian biologia molecular Kandinsky e física nuclear Julio Verne e a missão Challenger Degas explorou a pausa do tempo na fotografia Futuristas discutiram o tempo usando a cronofotografia; A linguagem do cinema ,incorporou o tempo às imagens ópticas; Os impressionistas e uma revolução na representação artística baseada nos fenômenos de síntese óptica; os pós-impressionistas dividiram formas em unidades matemáticas que é a fonte das técnicas fotomecânicas, amplificadas e automatizadas
  • 14.
  • 16. William Turner dinâmica das forças vivas natural forces dynamic
  • 17. eScience engineering, social sciences, medecine, biology, computer science, art , education , physics, geography, history.... Common issues all the sciences become an unique science The transit of disciplines and the urgency for eliminating the barriers between types of knowledge and immediately integrate common issues of several areas respond the complex questions of life. The territory of freedom of experimental art puts experts in an area of dissipation and create cognitive frameworks, working procedures, communities of interest and methods by mixing rationality, intuition, and emotion. Common problems dissolve domain constraints and result in a migration of concepts and hybrid activities in mixed areas through discussions about unpredictability, looking at the same object from different disciplines. . Main Domains: • Biomedical Engineering , Bioart, Cognitive Science, Visual Analytics, Neuroscience Creativity – invention: Big risks and challenges : Health, environment and education
  • 18. The birth of “digital “ culture Success of the computer art pioneers R and D budgets of game/entertainment now driving technology But now we need RADICAL DIGITAL ( Malina. 2007) Artists and Scientists: Creativity - invention and innovation Big risks and challenges for society: Creative technologies and Innovation for challenges related to health, environment and education, social behaviors http://userwww.sfsu.edu/infoarts/links/gen.art.res.present /currentslide%20show/slide_show_summary.html
  • 19. • Thames & Hudson (2010) Stephen Wilson PhD, MFA Professor, Art, San Francisco State University swilson at sfsu.edu http://userwww.sfsu.edu /~swilson/ ISBN - 9780500238684 A visual survey of artists working at the frontiers of science and technology. Focus on work since 2000. Covers artistic experimentation in fields such as biology, ecology, medical research, physics, geology, robotics, telecommunications, artificial intelligence, information visualization, and body sensing computer interfaces.
  • 20. KRUEGER, Ted; DOMINGUES, Diana; POISSANT, Louise ( Guest editors ). Special Issue of Digital Creativity 27:4. 267-270, Creative Technologies and Innovation: Health and Wellbeing (Exeter). Taylor& Francis, 2016
  • 21. TRANSDISCIPLINARITY AND INSTITUTES Historical intersections among arts, sciences, and humanities pioneers •Santa Fé Institute, in California - founded in 1985. •Max Planck Institut, in Germany •Stanford •Berkeley •Princeton In Brazil, IEAT Institute of Advanced Transdisciplinary Studies (Instituto de Estudos Avançados Transdisciplinares) of the Federal University of Minas Gerais (UFMG) Eminent Brazilian intellectuals from several areas working together
  • 22. pioneers LABS - MEETING PLACES FOR COLLABORATIVE PRACTICES •Massachusetts Institute of Technology - MIT. In the 1950s opened its doors to Art History •Later in 1967, Gyorgy Kepes founded the CAVS (Center for Advanced Visual Studies). •After 1974, Otto Piene was the director of CAVS, and introduced laser, holography magnetism, synthesizers, video and electric and electronic technologies, before the intense use of computer in art practices. •In 1985, Nicholas Negroponte founded the Media Laboratory at MIT, and gave the start to the phenomenon of Labs in institutions hosting collaborative practices worldwide.
  • 23. • The Sound of Trees Growing • David Dunn – composer, sound artist • Jim Crutchfield – complexity scientist • Recording of sounds of trees growing led to research project in the coupling of ultrasound from trees, beetles,… forest fires
  • 24. Artists can make science intimate Pigeon Blog Inside Outside Handbag ( Beatrice Da Costa) (Katherine Moriwaki )
  • 25. Burning issues The art in the intimate territory of sciences facing the human history that have the challenges of the asustainable civilization on our planet. What is body now? What is landscape now? What is urban now? What is life now? May Artists and Scientists collaborate for burning issues in daily life? What are the paradigms and sensorial boundaries for affective perception and embodied cogntion ? How to expand bodies and our creative relationships in daily environment? How to supplement and give the same freedom to (dis) able bodies? The world can be better, healthier and socially improved with biocybrid enactive technologies ? Questions? and the humanization /naturalization of technologies
  • 26. ART AND TECHNOSCIENCE: REENGINEERING LIFE LART PROJECT CAPES/CNPq Three Main Research axes (i) the reengineering of sensorium and enactive affective enactive Embedded systems and physiological sensors , signal processing and data visualization for synaesthetics investigations , in daily life (ii) the reengineering of nature and biodiversity challenges The challenges of the infirmity of landscapes in the sense of affective geographies (iii) the reengineering of culture Envisioning the infirmity of territories and the social engine and well being of social platforms in Ubicomp (mhealth) which enhance the awareness of human presence and reinvents urban ecologies amplified by mobile technologies targeting the reengineered future
  • 27. HYBRID CYBRID BIOCYBRID Nowadays by the effects of mobile technologies as calm and transparent interfaces installed “in the periphery”, as proposed by Mark Weiser’s , ubiquitous computing, sensory interfaces in the post-desktop era, the computer is almost invisible and has disappeared in the hybrid world. The cybrid human condition living by interacting with data, now is expanded to BIOCYBRID ( BIO+CYBER+data+ hybrid word). Technologies have gained biological tasks and are increasingly installed in our habitat, I propose the biocybrid condition to the living systems and the naturalization of technologies enhancing the humanization technologies scenario of the 1990s. HCI technologies have now the and enactive technologies with their devices and systems, taking part in the organisms and working as part of the nature itself by expanding our sensorium and no human things as living systems in our landscapes and in the social engine. By interacting, we can experience human altered identities during social, cognitive and emotional behaviors shared with the responsive environments of social platforms, mixed reality, or other technologies. We are in enaction, reaffirming the ecological perception with the environment, and the mutual influences exchanged with the invisible data modify our perception and cognition.
  • 28. In the case of the recent mobile technology, the interfaced body feels and acts by sharing qualities that come from the connectivity of the synthetic vision of cameras, satellites, physiological sensors, Bluetooth, tags, codes, wireless devices, GPS, or other technological components that transmit and exchange data, and co- locate us in virtual and physical worlds, thus transforming us into biocybrid humans. All those technologies provide us with altered limits of the human condition. • The enactive condition is referred to the theories of embodied cognition. • It is about the interdependence between the organism and its environment, and their mutual, reciprocal exchanges, bringing the idea of autopoietic and emergent phenomena. In the relation with mestizaje, it gave me the inspirational figure of ouroborus to make visible the seamless condition lived by the interface of body and technologies. • Creative technologies and the and artificial systems empower artists’ exploration of how technologies are changing our world perception. This is a huge challenge for creativity and to social presence of the artists. • Since the beginning of my career I have proposed environments for a strong experiential dimension in interactive installations and immersion in VR Caves, requiring software development and specific hardware. I have always been an artist-engineer of communication interested in developing a hermeneutic and metaphorical proposal for those systems. • • •
  • 29. The computer "disappear" and goes to the "peripheries : “ubiquitous computing” -calm technologies”- transparent interfaces ( Weiser) - mobile and portable devices, sentient objects ( Rheingold) _ internet of things ERA POST DESKTOP Virtual Reality and immersion –, Cyberspace ( Gibson) , Now Cyberspace is everywhere : mobile augmented reality ( GPS, android, human sensors Penland) ; People eco-located and live in social platforms here and there, data mining and mining reality, life and interventions of data in the physical world integrated to the material objects, fantasmagories appear and reinvente private and public spaces, physiological interfaces, mobile phones and locativity everywhere, social softwares, apps.ad mobile experience computer and ubiquity as social engine.
  • 30. My role as an artist-engineer is to propose the relation art, life, and technologies. What esthetical qualities will I explore with the kind of system being proposed? What behaviors will I create for an expanded sensorium? What kind of social relationship can people share in a certain environment? What kind of post-biological nature am I generating? Can I visualize physical phenomena such as water pollution, climate change, disease proliferation, the narratives of a healthy or sick body? Consequently, my task is to decide on the system design following the interface conception and the embedded systems’ dynamics in levels of unpredictability originated by concrete experiences to the coupled body and its enactions with the environment. Every technology embeds different esthetical qualities, and supplies specific responses. Ted Krueger highlights that perception is a laboratory phenomenon and we create the kind of perception following the qualities of the device output.
  • 31. Animal and human net based installations 1998, web art, telepresence and telerobotics seamless condition – body and robot connected - remote actions - enactions and telepresence :intertwinned and mutual influences body and remote environment Expanding Hypermedia to physical territory and remote actions. Helping the daily life of remote serpentarium: giving water and food to the snakes . BIO ART and biologists collaboration. Figura – INSN(H)AK(R)ES net based installation
  • 32. SERPENTARIUM (1998) Telerobotic event, telepresence and remote action seamless condition by sharing the body of a robot-snake living in a serpentarium in Brazil.
  • 33. The Cavern of Trance Considering my discussions from the 1990s,regarding the artworks’ interactions and the use of interfaces in rituals. In art we have the concepts of support and surface. Interactive art enhances the sensorial experience by the principle of feedback provided by the interfaces and the dialogue between body and environment. It is the art of experience, which is no longer the restricted visual, retinal art, but now the entire body is involved. Interfaces and body actions go back to the tradition of body paintings, tattoos, masks, feathers, maracas, whistles, just as in rituals, which imply communication and collaboration. The body is invited to act, dance, breathe, drink in order to participate in the ceremony that is performed to exchange unexpectedsensations and meaning in dialogues with the ecosystem.
  • 34. TRANS-E – my body , my blood 97 Unesco Prize , 7th Biennial Habana
  • 36. “Trans-e my body, my blood”, became an emblematic artwork and inserted the theme of interactivity and ritual into the artistic-scientific community, it is related to Afro-Brazilian rituals. North Brazil’s Inga Stone’s projections show metamorphoses sprouting from prehistoric inscriptions. People interacting become metaphorically shamans who consider the stone as a ‘veil’ between their world and the ‘spirits’ world. The software “shaman 32,” based on artificial intelligence researches, has autonomy to self-regenerate the life of the cavern and the ‘mutant visions’ by surprising people with unexpected emergent ‘realities’. In 2007, the piece reincarnated in a new, more complex version called “The Cavern of Trance,” a more complex version of the embedded system – it was expanded to immersive and crossmodal technologies, multi-sensorial interfaces and immersive multi-display synchronized large screens in VR – and it was also adapted for mobile connections. Neural network , sensorized carpet, and the special quality of this artwork was to provide physically-impaired people with equal capability to act using infrared sensors zones and/or by multi-sensorial interfaces of sound interfaces using Afro-Brazilian musical instruments: flute, maracas, whistles, afuches, rainsticks, shakers and other ritualistic instruments. People were tracked to synthetic objects that moved according to sounds and noises. Non-mobile people could only interact with their mouth making sounds with whistles, flutes, or singing, making noises, and so interacting with the system in a kind of ritual. On the other hand, people’s displacements and gestures generate several proprioceptive interactions. A wireless tracker and an accelerometer with a gyroscope provide responses and motions in proprioceptive interaction, and by focusing with a flashlight the walls of the cave, magically people manipulate the objects: thunders, butterflies, spiders, vases, crosses, worms, animals appear in the room in stereoscopic visions creating a sensation of enhanced trance. . The Cavern of Trance
  • 37.
  • 38. Interactive and immersive system Embedded and cross modal interfaces • presence sensors haptic interface sound interface steroscopic interface Interactive and immersive system Embedded and cross-modal technologies Virtual reality
  • 39. VIRTUAL REALITY THE CAVE IMMERSIVE ENVIRONMENTS PROPRIOCEPTION TRACKED BODY – PHYSIOLOGY
  • 40. Algorithms generating particles gave the environment qualities typical of physical laws such as gravity and dynamics. HEARTscapes virtual reality inside a CAVE algorithms and physical laws create a synthetic ground for immersion and simulation experiences inside data landscapes- textures in animation natural phenomena effects (rain and fire, explosions, snow, twisters) Heart beat sounds of ecographies are mixed with noises of indigenous rituals, noises of natural environments, among other sound data
  • 41.
  • 42. Technological apparatus and antropological issues esthetical qualities ways of living . William Gibson, in Neuromancer (1984 ), Rheingold to Scott Fischer-virtual reality and head mounted displays “Oh, My God .Cyberspace arrived” VirtualReality at Nasa and placelessness, evasion and immersion in the 90s . “Oh my God, cyberspace is everywhere” Era post-desktop ( William Gibson 2007 Spook Country: a novel Laura Beloff
  • 43. VR and immersive poetics inside a Cave, I highlight the magic of “HEARTSCAPES”. It allows responses from synthetic objects and navigation in the 3D ground, and offers the atmosphere of a ritual, metaphorically giving shamanic powers inside data landscapes of a heart, and the immersion in a synthetic landscape, mixing visual effects with noises of indigenous rituals, natural environments and phenomena of the ecocosmos. Physiological devices and biofeedback of electrical waves in EOG electrical signals offer mutations of forms in real time and are also commanded by another biological interface that captures heartbeats, sending signals from the participant's heart to the system. The interactivity of physiological signals results from the heartbeat frequency (ranges 60/80, 80/100, 100/200, 120/140, 140/160). The action of the biofeedback sensors activates a VR particle system of HEARTSCAPES, move the position of the objects, and changes colors on the screens, confirming the dynamics and kinematics of the virtual, by communication by the electric waves of the eyes with the VR world.
  • 44.
  • 45. Firmamento pop stars mobile connexion, a-life - data mining, collaborative texts, touch screen alife
  • 46. Firmamento_Pop Stars (2004-2005) Museu da Telemar RJ - Itau Cultural • installation, “FIRMAMENTO” [16]. It allows a conversation with the stars in a synthetic ecocosmos, inside a biocybrid landscape in A-Life. People receive shamanic powers for affecting natural phenomena when absorbed in an aesthetic experience in front of a huge lake, the "eye of the earth". People have a dialogue with the lake as if it were a mirror of the firmament of the synthetic cosmos peopled by idols. The behaviors of the stars represented by dots of light in A-Life, create a living organism in a stereoscopic vision. By interacting with a tablet, visitors move the stars in the lake visualized on the floor. The stars represent different idols of cultures given by a flocking algorithm, and are activated by the stars’ proximity and their desire for light. Internet searches of a list of words come from the database stored on the system, which return through data mining as surprising sentences written on the walls of the dark room. The same process could be performed by sending SMS messages from the mobile phones to the stars. By using a list of idols, i. e. famous people of the human culture, such as Einstein, Marilyn Monroe, Mother Theresa, Cleopatra, Carmen Miranda, and a list of terms related to their life and actions that characterize their life, we send SMS messages and the cell phones return sentences by associating in data mine process, surprising narratives about their lives. It is the collective voice of the planet in emergent states. Unknown authors write sentences related to the idols’ personality, and the dots in A-Life projected in the lake of the landscape change in a surprising, mutant firmament. • Firmamentum is the collective voice of the planet in emergent states. The system proposes an utopic cosmos, eliminating social and political constraints in an associative and free model, coming from everywhere and everyone. Unexpected relationships manifest free groups of people which lights compose unexpected constellations, and free narratives write histories resulting from people and stored values of myths on the net. The system addresses ecological, social, and political issues in imaginative and innovative ways, by eliminating the diversity among people, race, gender, idiom, or other differences and constraints. Concerning language differences, the system writes collective texts in several idioms. The connections to the Net (Google), by activating words of a linguistic database are expanded for SMS messages using mobile phones. The messages sent in the country idiom write sentences in the correspondent idiom of people, in accordance with the list of words translated and stored in the linguistic database of the system. For instance, by using a database for interactions in France, a list of French words connect Google and return sentences in French. The same system works in other languages ( Spanish, Polish, German, only changing the language of the words in the database. Consequently, the interface design of the installation offers a complex system with dialogues that expand human life in the cosmos. The main goal of the artwork is to adapt the apparatus confirming that digital technologies configure a post-biological way of life in Cyberculture. Metaphorically, we receive shamanic powers from technologies and we are able for dialogues with natural forces of the cosmos. We receive post-human capacity to collect global ideas and intervene in political domain, by rewriting collectively the history of human culture. •
  • 47. • Reengeneering life and mixed reality • Mobile technologies and society • Practices respondent to mobility in contemporary society and wearable tecnologies • ONTOLOGICAL PRESENCE Co-located in physique and cyberspace, coupled to cameras and tags , computer vision, ecolocated, tagued, and ecotagued , satellites,, mixing data , ways of perception in other dimensions, spatial origine, sensors variables, physiological manners, vision synthètiques geolocalisés , reinventioin of the scenarion
  • 48. - Living Tattoos, 2007 HCI Florence , 2007 Social mobile platform - data mining – mining reality- social behaviors and machine learning data visualization – graphos and artificial life- flashmobs Living Tattoos,© Diana Domingues - NTAV Lab / CNPq, Brazil, 2008.
  • 49. LIVING TATTOOS” social platform enables people to produce contents by adding information on their lives. Each person sends us his/her own tattoo by mobile phone or by email. The shapes are turned into 3D models and placed on the synthetic ground of the tattooarium, where they can live together. They become living creatures in A- Life. Their evolution is determined by their dialogue coming from a search engine – data-mining system - which provides us with specific traits of their personalities. The other proposal is the urban interventions in flash mobs titled “tattoos mob,” another part of the project that installs tattooed communities in different locations of the city and also develops data visualization of the urban tattoo flows in the mobile mobilization in the physical space of the city. Their communication generated through ubiquitous computing, locative, pervasive and sentient mobile technologies (cell phones MMS and SMS) communicate with locative interfaces as GPS and Google Maps. It is a storytelling mobile narrative of tattooed people in urban spaces. •
  • 50. Datavisualization e redes sociais Datamining Mineração de dados
  • 51. Mobile experience artworks Augmented mobile reality The sense of presence now The end of reality? Or the onto spatial creative reality? Memory _ ubiquity and virtuality of memory , locativity, lost the historical awareness (Chartier)
  • 52. IPIRANGA RIVER historical place where the Emperor D. Pedro I proclaimed the independence of Brazil's independence in 1922 Memorial da América Latina building - Niemayer architect Galeria Marta Traba ENVIRONMENTAL ART – ARCHITECTURE AND COMMUNICATION – MODEM – HYDROPHONE – SONIC LANDSCAPE- SOCIAL PLATFORM- MOBILE CONNECTION- DATAMINING –MMS- SMS- TRANSfronteiras contemporâneas MEMORIAL DA AMÉRICA LATINA – BIENAL DE SÃO PAULO 17 de setembro - 17 de outubro de 2010 BICENTENARIO DA INDENDENCIA PAISES AMERICA LATINA BIOCYBRID LATIN AMERICAN MEMORIAL ENVIRONMENTAL ART – MOBILE TECh AND SOCIAL PLATFORM – Enactive systems and sonic landscapes
  • 53. T h w The sound of the Ipiranga river translocated to the silent water/mirror embraced the building.
  • 54. The sound of the Ipiranga river translocated to the silent water/mirror which embraces the building. http://www.youtube.com/watch?v=9FemTc5OtZg Presence sensors activates a database of voices of latin american idols when entering into the the building as phantons...
  • 55. Anamorphosis of idols in the ceiling as a living memorial!!!!
  • 56. Memorial of America Latina internal scenarios
  • 57. interatividade pelo twitter: Escolhendo com quem quer twittar numa lista de personalidades da história da América Latina, entrando no Twitter e digitando #BioCybrid e o nome da personalidade, Ex: #BioCybrid Senna , a resposta entrava no espaço do Memorial da América Latina em São Paulo, projetada numa grande tela. O sistema de busca e classificação utilizava um algoritmo para executar a classificação do dado de entrada (Twitt) de um dos personagens em hipermídia. A resposta do sistema se dá na exposição de vídeos, áudios e textos por sistema de mineração na web do personagem reconhecido, classificado e passa a escrever sua narrativa por scrolling text enquanto o áudio e o vídeo são tocados .
  • 58. living memorial - mash up and data mining qudata mining and unpredictible narratives in global memory. Collaborative mobile texts; . Crawler and data base in mash up. Ex: CHE GUEVARA+IDEALISTA+HAVANA+REVOLUÇÃO+LIBERTAR Outcome. “alguém conhece um cubano que deu as costas à Revolução para, ao contrário, seguir os passos de Che Guevara, como verdadeiro revolucionário”. Twitter
  • 59. Augmented Mobile Reality and Geotagness for Urban Mixed Landscapes The 14 Bis Biocybrid Plane,2011 LART
  • 60.
  • 61.
  • 62. 14 Bis – SAN FRANCISCO AIRPORT Terminal-SPIE 2011 GEOLOCATION Latitude 37°35'40.28"N Longitude 122°21'53.31"O
  • 63. URBAN MIXED REALITY • What is vision in the post biological era ? • The MAR system reaffirms the post biological extrusion of human vision, by the act of seeing shared with the satellite eye in the sky and the handled eye of the mobile device, by expanding the human perception. Tags in MAR placed in GPS (Global Positioning System) and the possibility of geodesic coordinates create a co-located event for human body. • It is the neuropsychophysiological expanded perception that is propitiated by the technology, characterizing the biocybrid human condition. • Mobile data visualization and computer vision.
  • 64. • Guest artist at the 2010 art exhibition at the San Martin Cultural Center (Argentina), and LART research group invented the artwork 'BIOCYBRID FABLES: Borges fantastic creatures.' In the augmented reality (AR) installation inside the building, the use of tags allowed reading a book in synthetic vision, with its pages showing animations and pictures of Borges’ fantastic creatures (s. Figure 7), thus reinventing daily life things (domotics). • Jorge Luis Borges’ fantastic universe and urban intervention: synthetic creatures were geolocated, in real scale, in Buenos Aires streets. People using mobile technologies and Layar system geolocated them in the streets in real scale as fantasmagorias in Urban Mixed Life and Mixed Reality
  • 65. Biocybrid BORGES Creatures Fables: AR reinventing the act of reading Urban mixed life and domotic s Fábulas Biocíbridas: criaturas fantásticas de Borges, 2010 BUENOS AIRES Centro Cultural San Mrtin
  • 66. BIOCYBRID FABLES: Borges fantastic creatures BUENOS AIRES 2010
  • 67. AUGMENTED REALITY INSTALLATION - the enactiv e act of reading
  • 68. Fig.6. I'Myth: zapping zone.©Douglas Trancoso, ©NTAV Lab, Universidade de Caxias do Sul/ CNPq, Brasil, 2005. Fig.6. I'Myth: zapping zone.©Douglas Trancoso, ©NTAV Lab/CNPq, Brasil
  • 70. the drama of life Art and Technoscience combine developments in biomedical engineering in physiology and synaesthesya and embodiments during the drama of life. Ontological levels of creative reality and the reengineering of life provided by microcircuits of sensors configure the expanded sensorium with enactive affective systems. The continuum and symbiotic zone between body and flesh - cyberspace and data - and the hybrid properties of physical world. to consider the myths and the old ontologies
  • 71. Remote theory of enaction Aristotle and enactment creative levels for the understanding of our relationship human/environment expanded as pointed out Aristotle's Poetics and drama . Baugartner – 1750 synaesthesia Reaffirming the origins of the discipline Aesthetica, postulated by the German philosopher Baungartner in 1750, the ability to perceive the world with the five bodily senses
  • 72. ENACTIVE AFFECTIVE SYSTEMS physiology kynesthesia Enactions - em´bodued cognition Embodiements-enactions ( Varela) Affection –effects of actions – (Spinoza )in physical ad physiological rates body and environment EX: hearth rates, Breathing rythms, skin temperature. Ecological Perception ( James Gibson) Ouroboric Perception ( Domingues) Synaesthesya ( all senses ) Poissant and Daubner BioArt and Transformation of the Living synaesthesia
  • 73. Interactive ENACTIVE/AFFECTIVE SYSTEMS The expanded sensorium: from interactive systems to enactive affective systems Bioart faces the “transformation du vivant”, by evolving from earlier proposals from interactive art, and developing enactive affective systems. Concepts of perception and enactions, related to human−environment mutual exchanges, in cognitive approaches and physiological levels. Chilean philosophers Humberto Maturana and Francisco Varela are references of philosophy and biology to the mutual influence on the relationship of organisms with the environment and the autopoietic feedback that technologies extend to the complexity of sensors equipped with synesthetic affective biofeedback, sending vital data measured during enactions. . Humberto Maturana and Francisco Varela Poissant and Daubner Ted Krueger
  • 74. cognitivist/ enactionist approach and BIOART –practices enactive systems • enactions , perception and action , (Noe) • ecological perception • , ouroboric perception [Domingues) • expanded perception, regarding body potential and affections ( Massumi). Affects and is affected • The Spinozan body is endowed with affections ( sensations/physiological rates) ability to communicate with the environment by sensors EOG, EMG, EEG, GSR and others, recognizing the environment and averages/rates, intensity of heat, cardiac output, respiratory flow, muscles activity, tactile vibrations, and other measured sensations, earned by sending and receiving, exchanging signals and the intertwined relation with the environment, i.e. the enactive affective system response We expand kinaesthesia, or motion sensors activity, that recognizes the environment for proprioception, body movement schemes, by adding physiological data from all directions by signal processing, skin temperature, heart rate, cardiac flow, breathing, muscles rhythm. Noé, Action in Perception Ecological perception James. J. Gibson BRIAN MASSUMI Affections Spinoozian Body Living maps Domingues ouroboric perception
  • 75. • New ways of deciphering human behaviors and body/environment influences in microscales allowing in diagnostic and introspective ways, meditation, self-identity and other application . • DIAGNOSTICS - Human actions in enactive affective systems and the processes of knowing, learning and teaching about their affections generate LIVING MAPS and Affective Narratives- • Enhanced in its sensorial properties of synaesthetic biofeedback added to the language of movement in a transphysiological dimension, that is, aspects of motion, electricity, graphic design, in data visualization and data sonification
  • 76. ENACTIONS AND EXPANDED SENSORIUM The whole body in action lives mutual exchanges and emergent properties with the environment resulting in reciprocal changes. For perception: the act of seeing with the entire body
  • 77.  Rates of affective exchanges? Human environment mutual influences
  • 78. Content and Context AFFECTIVE AESTHETICS ENACTIVE SYSTEMS BIOART BIOMEDICAL ENGINEERING LIVING MAPS PHYSIOLOGICAL SENSORS EXPANDED SENSORIUM AMPLIFY KINESTHESIA TO SYNAESTHESIA DATA VISUALIZATION
  • 79. REENGINEERING SENSES EXPANDED SENSORIUM ENGINEERING HEALTH LAB at MIT Camera Culture Media Lab and LART UnB In general aspects and Biomedical Engineering applications, our sensors and technologies are able to monitor vital signs in everyday life, and can constitute personal assistants. They can also be used for social interactions, entertainment, innovative performing, training, safety etc. Concerning the validation and tests, the performance of controlled experiments in order to measure and validate how the studied variables relate to different types of user actions and/or states, includes diabetes, and the methods to specific communities, such as native Brazilian tribes where there are many reported cases of diabetes.
  • 80. Embodiments and affections • In Art and Techno Science embodiments and affective aesthetics , we enhanced the studies on kinesthetics to synasthesya. • Kinemas as the language of movement, • The transphysiological dimension, i.e. aspects of motion, electricity, graphic design, in data visualization and data sonification. • Body movements, gestures, postures, fragmentation, reinstatements, dynamics, internal-external connections and motor schemes, dealing with gestures, rhythms, not only at each stage of the movement, but also considering what affects you, the environment and the coupled interior and affection in the flows of life with affective enactive sensors. Biofeedback with outside environment in enactive affective conditions . • Synaesthemas - the immediate impression of the senses, or by a complicated chain of senses’ impressions, previously experienced, stored in the memory of sensations, affections and emotions and thoughts. Attempts are being made for the system to read the rhythmic patterns of movement
  • 81. “Transphysiology of the Ecstasy” 11th Havana Biennial (2012):artwork Biocybrid Ouroborus: Ecstasys Geographisms. we developed a system that captures and analyzes information about several peoples' movements during rituals, simultaneously. Information was sent wirelessly to a central computer, which generated visualizations and sound patterns associated to the different types of detected movements We used this system to study the energy and synesthesia of bodies during rituals, being similar to Brazilian dances performed by artists from Havana, as we could translate the ritualistic states in terms of different visual patterns, as well as to observe how these patterns acted in the described feedback loop. • “Transphysiology of Ecstasy”, rooted in the concept the trance, proposed by Diana Domingues and Maria Aparecida Donato’s (CNPq PDJ) discussion in her postdoctoral research in LART on body and Bioart, focused on the electrical potential of the body and thel trance states, rising to ecstasies in Brazilian rituals such as carnival and Candomblé . The research results affirm that shamanic trances differ from ecstasy states. Into ecstasy state, sensations, emotions and thoughts come from bodies conscious of their sense of presence, albeit in a condition of transcendence ecstasy here is significantly different.
  • 82. TRANSPHYSIOLOGY : FROM TRANS-E TO ECSTASY We propose the biograms (datavisualization) of corporeal living maps in kinesthesia and synaesthesia as result of perceiving and processing data of human physiology for the understanding of body actions and their cosmic relationships (in daily rituals). Experts in human motion explain that movements and gestures in rituals (candomblé, samba, tai chi chuan) can make us understand every other ones in everyday life Trance is significantly different from ecstasy (Trance is an unconscious state, while during ecstasy we are aware and live rythms and structures of the body autopoiesis.
  • 83. Rudolf Laban 1879 - 1858 Laban's paradigm postulate that human movements in daily life are always composed of the same elements, whether in art, at work, rituals than in everyday life. Consequently, we search for a method with emphasis on the psychological and physiological aspects that lead human beings and electrical biopotential of a body , which in their combination produce states, qualities, actions and parallel motion feature psychic actions present in our actions − recognition in the form of rhythms and structures −
  • 84. Investigation of Brazilian Rituals Pos Doc Prof. Dr. Maria Aparecida Donato Pos doc Junior CNPq LART 2010/2011
  • 85. Biocybrid Ouroborus: Ecstasys Geographisms 11 Habana Bienial 2012 - Gran Teatro de Haban expanded sensorium and datavisualization workshop and installation
  • 86. Imagen catalogo 11ª. Bienal de la Habana, 2012
  • 87. CAVE and CINEMATIC FLOOR - BIOCYBRID SPACE FOR IMMERSIVE SYNAESTHESIA • LART collection artworks are now in the phase of expanding the sensorial apparatus in terms of physiological signals. In the beginning of our research we used trackers for interactive and immersive experiences of proprioceptive devices for movement to map a participant’s displacements or gestures and providing feedback for navigation and positioning. We amplify the previous paradigms of Cinetic Art of the 80s and the experiences are enhanced now with disruptive technologies for perception and sensorial measurement, offering a compelling experience in the real world. The world is visualized with all the senses and not only with haptic and tactile interfaces. It constitutes a disruptive technology for perception and sensorial measurement, in compelling moments mixing effects of real world during immersion with images. Simulators technologically add to displacements the effects of collisions, vibrations, trepidations, unbalance etc., when inhabiting synthetic spaces. Also, the historical intuitive interfaces, such as shutter glasses, data gloves, trackers, emitters, force biofeedback devices, joysticks, among others, are empowered by sensors of biological variables, which capture physiological signals in order to enhance the immersion experience and make it more intense. This body sends and receives data make the data landscapes and virtual reality is reengineered • (The projet was presented at the SPIE conference, 2012, San Francisco. The application is expanded beyond art and entertainment, mainly in games studies, and it is applied to automotive and biomedical engineering. In fact, the kinesthetic sensations replicate the sensation of displacement inside an automobile, as well as the sensations of vibration and vertical movements typical of a vehicle, different speeds, collisions, etc. These various conditions may be created by the system in terms of physical sensations and synthetic data provided by actuators, as well as by the biofeedback using breathing, heat, heart beats and other signals collected by our biosensor circuits. The Cave is also a special place for aero spatial Engineering training.
  • 88. The cinematic floor CAVE and CINEMATIC FLOOR as a BIOCYBRID SPACE FOR IMMERSIVE SYNAESTHESIA (a) (b) Treadmill with different sizes of springs includes the sense of unbalance. Sensations can be experienced in the treadmill, such as : (i) movement or displacement, and (ii) unbalance or oscillation. Thus, some episodes are performed and different scenarios emerges form the immersion with respective physiological rates.
  • 89. The cinematic floor INTERACTIVE DATA VISUALIZATION – CINEMATIC FLOOR AND BIOCYBRID IMMERSIVE SYNAESTHESIA (a) User testing the oscillatory motion and (b), (c) detail of springs of different sizes. (a) (b) (c)
  • 90. Affective immersion LART CAVE, SPIE2012 The Cavern of Trance is an immersive installation conceived by Diana Domingues in 2004 which is restored in the current project and expanded by the enactive affective system adapted to the LART CAVE. The participant uses sound instruments and sensorial microcircuits and the cinematic floor provides enactions a biocybrid space, by coexisting in both in the physical and synthetic landscapes. .
  • 91. The reengineering of the urban and the expanded sensorium Sense of presence and human biology are altered by innovative technologies and the creative use that artists make of technology.
  • 92. DIANA DOMINGUES SUPERVISOR UNB RAMESH RASKAR MIT MEDIA LAB CAMERA CULTURE CNPQ APPLICATIONS: TWO STUDY CASES Diagnostic and treatment of diabetes; Post-doc work by Suélia Fleury Rosa PhD thesis by Tiago Lucena – Cidadepathia UnB CNPq The project takes advantage of the sensorized insole built with latex (Havea brasiliensis) as a mobile (wearable) device and microcircuit of physiological sensors . Figure 1 shows the process of producing the insole for placing the sensors, based on the Brazilian latex. Using physiological sensors we built (s. Figure 2), the insole acquires physiological data (galvanic skin response, foot pressure, temperature) combined with locative tools (GPS), allowing the creation of a kind of affective living map during the enactions with the city. Previous tests have showed the insole is a good personal health assistant, especially for people with diabetes (potentially affected by foot ulcer). Biomaterial and pressure sensors used can predict some of the most affected areas and contribute to healing [35] in experiments led also by Suélia Rodrigues (Reis et al. 2010). The Reenginnering of Urban – Bioart and mHealth Enactive Affective Systems and Affective Narratives
  • 93. The possibility of recording users’ journeys alludes to the mythological figure Hermes and his winged sandals. Hermes could move quickly between places, and created a wearable technology that could be said to have enhanced his relationship with the environment. While this insole does not supplement human ability, it provides an intuitive tool to see where and when the body responds less than optimally. Following the user along his/her daily life our system is as a kind of tool to tell stories about user’s habits and urban activity. The system creates a kind of documentary – a real-life storytelling – in the shape of a dynamic (living) map CITYPATHIA Tiago Franklin Lucena – PhD fellow CNPq at MIT Media Lab Camera Culture SUPERVISOR Diana Domingues LART UnB, Ramesh Raskar / MIT Media Lab.
  • 94. Different environmnents and acts in daily life: Path realized in he MIT campus - Cambridge - United States. About 25 minutes walk offering different situations such as: crossing the street, crossing the corridor with people, up and down stairs, step on grass, open doors, pick up elevator.. etc.. Map: MIT, ESRI. Available: http://whereis.mit.edu/ and Photo (right) by: Mirella Altoé and Tiago Lucena. Trajeto realizado pelo campus MIT – Cambridge – EUA. Cerca de 25 minutos de caminhada oferecendo diferentes situações tais quais: atravessar rua, cruzar com pessoas no corredor, subir e descer escadas, pisar em grama, abrir portas, pegar elevador, etc. Mapa: MIT, ESRI. Disponível: http://whereis.mit.edu/ e Fotos (dir.) por: Mirella Altoé e Tiago Lucena.
  • 95. Visual analytics: mobility, locativity and variables of velocity- accelerometer 8/ 28/ 13 10:47 PM tro_caminhada2_15_agosto_2013- 2 - Google Fusion Tables Page 1 of 1 gle.com/ fusiontables/ data?docid= 1gn3IEBImukHGOSKpvOGzCPijWRrhBJ0k4vwzOuc#chartnew:id= 3 _acelerometro_caminhada2_15_agosto_2013-2 Wed Aug 28 18:19:38 PDT 2013 from tabela_acelerometro_caminhada2_15_agosto_20… more >> on - Edited at 10:21 PM Share Tools Help Chart 1 Rows 1 Cards 1 Chart 2 + No filters applied. Sorted by Time Saved 12,696 rows average(x) average(z) average(y) 100 100 500 500 900 900 1,300 1,300 170.0 177.5 185.0 192.5 200.0 Ricardo Torres – sinal do acelerômetro nos três eixos: x, y e z. (tempo normalizado) Acervo Pessoal e gerado por Ricardo Torres (Unicamp) Pontos consideráveis de alteração na velocidade da caminhada, plotados no mapa. Imagem gerada por Ricardo Torres (Unicamp). Acervo pessoal do pesquisador.
  • 96. Etapa de testes com sensor de GPS - realizado dia 10 de agosto de 2013 em trajeto pela cidade de Boston (EUA). Identification of transport used during experimental path with GPS, accompanied by Prof. Cristiano Miosso. Relating and combining the time path with the speeds and longitudes given by the sensor, we can infer the mode of transportation that has been used for some time (normalized time) Identificação do meio de transporte utilizado durante trajeto experimental com GPS, acompanhado pelo Prof. Cristiano Miosso. Relacionando e combinando o tempo do trajeto com as velocidades e longitudes dadas pelo sensor, pudemos inferir o meio de transporte que foi utilizado durante algum tempo (tempo normalizado). GPS: Time, locativity and Velocity and longitudes : kinds of transportation
  • 97. SENSÓRIO EXPANDIDO COM SISTEMA EMBARCADO DE SENSORES FISIOLÓGICOS: “III ENCONTRO INTERNACIONAL DE ARTE E TECNOCIÊNCIA: SENSÓRIO EXPANDIDO E SAÚDE 19 a 20 de março de 2015, Rio de Janeiro, Rio de Janeiro – Brasil RESUMO: Apresenta-se uma síntese do desenvolvimento do Workshop “III Encontro Internacional de Arte e TecnoCiência: sensório expandido, saúde e Bioarte, realizado nos dias19 e 20 de março de 2015, na cidade do Rio de Janeiro (RJ),nas dependências do Instituto Superior de Educação do Rio de Janeiro (ISERJ) no dia 19 de maio, e nas dependências da E Escola Especial Favo de Mel no dia 20 de maio, a realização do WorkShop faz parte das ações desenvolvidas pelo Laboratório de e Pesquisa Artes e TecnoCiência • • • • • • • • AVALIAÇÃO DE VARIÁVEIS FISIOLÓGICAS em um contexto não habitual, ou seja, não clinico ou laboratorial, utilizando camiseta desenvolvida por alunos da graduação em engenharia eletrônica e do mestrado em Engenharia Biomédica, com sensores capazes de medir a aceleração do corpo e variação da inclinação do corporal. • Esta experiência reuniu uma equipe transdisciplinar ( artes: musica, performance, artes visuais, ciências médicas, engenharia eletrônica, ciência da computação, educação, arquitetura, ciências sociais), durante dois dias na cidade do Rio de Janeiro, coordenados pelos pesquisadores Profa. Dra. Diana Domingues e Prof. Dr. Adson da Rocha e Universidade de Brasília, FGA Gama , LART, CNPq, e ainda na UnB pela Profa. Dra. Suelia Rodrigues Fleury Rosa do Bio Eng. Lab e no RJaneiro pela e pela Profa. Dra Cida Donato da FAETEC, ISERJ. Os Professores contaram com na equipe executora com atividades de : alunos da graduação em engenharia eletrônica, engenharia de software, mestrado em engenharia com biomédica, doutorado em ciências médicas, e Professores Doutores e Mestres do Grupo Arte e TecnoCiência , e ainda de Perfomers Artistas visuais, convidados a participar e a atuar no evento. O grupo formado por graduandas em pedagogia e pedagogas do Rio de Janeiro foi orientado pela Profa. Dra. Cida Donato. • No primeiro momento foi realizada reunião com a equipe executora (figura 1 e 2), sendo que na oportunidade foram discutidas as ações que seriam realizadas, o cronograma, e principalmente, a singularidade de cada um dos grupos – alunos especiais e performers. • O aparato tecnológico previsto para o workshop: • - camiseta com sensores; • - data base sonoro e sons orgânicos; • - projeções gráficas em data visualização interativa das médias fisiológicas auferidas; • foram testados na manhã que antecederam às performances. • Foi decidido que seria inserida a utilização de um sistema de sensores embarcados que oferece uma cinta com sensores de respiração e frequência cardíaca, sensores comercializados, adquiridos pela responsável pelo workshop Profa. Dra. Diana Domingues e trazidos ao país pelo pesquisador Ted Krueger. O aparato serve para aumentar a quantidade de variáveis fisiológicas durante as atividades, bem como, conhecer e discutir a influência dos sons orgânicos e das paisagens gráficas em na frequência cardíaca e respiratória de pessoas com disfunção intelectual e pessoas hígidas. • OBJETIVOS: Testar sensores para aferição de variáveis fisiológicas – frequência respiratória, cardíaca, aceleração e inclinação dos eixos corporais durante dois momentos performances corporais mediadas por sons orgânicos. Promover reflexão e debate sobre a utilização destas tecnologias para assistir ou suplementar funções fisiológicas em contextos não excludentes
  • 99. Tab. 4 - Redes de Sensores Sensores Descrição Localização GSR Galvanic Skin Response – registra a as alterações na condutividade elétrica da pele. Dedos da mão EMG Eletromiografia – registra a atividade elétrica produzida pelos músculos. Atividade muscular. Em fase de seleção FSR (pressão) Force Sensor Resistor - Pressão plantar. Consiste em uma superfície com um polímero que muda a resistência de acordo com a aplicação de força em sua superfície. Pés - Planta - Palmilha Acelerômetro Movimento – aceleração em três eixos Pés GPS Global Positioning System - Movimento - deslocamento pelo espaço Palmilha ou Bolso Temperatura Variação de temperatura em uma dada região Palmilha Umidade Mudam a resistência conforme a umidade relativa Palmilha Respiração Registra o movimento do tórax exercido durante o ato de respirar Tórax Pulso Pulsação arterial - registra o ritmo da pulsação arterial Mão
  • 100. SOCIAL BEHAVIORS AND MHEALTH AND WELL BEING REENGINEERING OF NATURE and biodiversity challenges The challenges of the infirmity of landscapes in the sense of affective geographies and health care, biodiversity, affectivity and the infirmity and preservation of the landscapes and life of the planet 3> REENGINEERING OF CULTURE The role of social and mobile platforms (mhealth) which enhance the awareness of human presence and reinvents urban ecologies amplified by mobile technologies targeting a healthy reengineered future 3.1 > REENGINEERING OF THE URBAN
  • 101. REENGINEERING OF THE NATURE Biodiversity and the preservation of the life and the species
  • 102. Biodiversity and the preservation of the species: “Frogs’ signatures” • Innovative technologies investigates biodiversity and life protection related to the preservation of frog populations in Brazilian biomes. Frogs’ vocalizations are visualize exploring the acquisition of sounds and their properties. The automatic system provides the classification of the species and the number of frogs living in remote biomes, replacing the old analogic way methods.Abstract images, correspond to different levels of physical parameters determined from the sounds: temperature, humidity, and light conditions. The sonic enactive landscape is the PhD thesis of André Gonçalves de Oliveira’s, supervisor Dr. Diana Domingues, in collaborative practices with investigations in signal processing, intelligent systems and data visualization by Prof. Dr. Cristiano Miosso. Different types of physical and behavioral properties, as well as environmental parameters, can be extracted from frogs callings as shown in a recent bioacoustics research. • Regarding scientific visualization techniques to analyze frog vocalizations, we explore e.g. different forms of spectrograms, representing time-frequency distributions using gray levels and colors in bidimensional and tridimensional representations. Furthermore, we develop dynamic spectrograms, showing the evolution of time-frequency distributions as time passes and as the frogs (or other animals) react to environmental changes. Building these spectrograms, we compare different techniques, such as the windowed Fourier transform and filter banks. In enactive soundscapes and data visualization, we use our affective enactive system in Virtual Reality and the simulation of human proximity using our physiological sensors for enactions and the immersion in data landscapes as in the LART Cave. Biofeedback systems and data landscape (large data screen and the compelling experience in the cave), the manipulation of visual and sonic information dialoguing with distant biomes are proposals for the naturalization of aesthetics in the enaction to living organisms, here the frogs, using teleproxemics. Metaphorically, we propose frogs’ signatures and the human behavior dealing with laws and phenomena of the cosmos, by influencing life of nature as a living organism, exchanging electrical potentials, heats, sounds, vibrations and the sense of presence being advanced by the technological apparatus and affective biofeedback for the responsibility of humans and a healthier territory.
  • 103. REENGINEERING OF NATURE AND THE PRESERVATION OF THE SPECIES Life of the planet and BIODIVERSITY Enactive sonic landscapes and the naturalization of the aesthetics ( PhD thesis André Oliveira, Dr. Diana Dominguues Supervisor , Cristiano Miosso- Frogs’signatures and biocybrid ecologies – data visualization
  • 104. Healthy Ecosystem and Fighting Dengue: Biodiversity, Affectivity and Infirmity of Landscapes in Social Software and Data Visualization Mhealth • Researchers Diana M.Gallicchio Domingues*, Sara Diamond**, Ana Paula Machado*** Ricardo da Silva Torres**** Carla Ferreira Rocha*, , Tiago Franklin Lucena*** • * LART, Post Eng. Bio. University of Brasília at Gama, Gama/Brasília, Brazil; CAPES ,CNPq, Brazil • ** OCAD U University, Ontario, Canada • *** University Center of Cesumar, UniCesumar , Maringá, Brazil • **** Institute of Computing, University of Campinas, UNICAMP, CAMPINAS, Brazil
  • 105. Dengue and mhealth Mhealth social softwares
  • 106. METHODOLOGY • Scientific information from technicians and from the communities are gathered in a database, with geographical information. • Participatory Design and Ethnographic Protocols for Visualization Tools and specific technologies (emergent systems, model-based scientific visualizations of complex data sets, data mining for volumetric visualization, cloud computing and architecture) large use of mobile devices and participatory design strategies. • The system is based on networked cyberinfrastructure and physic territory actions. These actions use advanced scientific methods for analysing and evaluating biodiversity research on continental-scale environmental issues • Also, they are based on accelerated research strategies, and on communication strategies for collaborative network on biodiversity, ecological and geographic informatics, social platforms, mobile technologies and health process learning experiences in the physical world and in the digital environment, in collaborations and reciprocity, by using technological common network protocols. • Transdisciplinar/antidisciplinar methods in social software and data visualization in a cyber infrastructure of intelligent systems and visualization technologies enable an affective aesthetics regarding the infirm landscapes and to fight the dengue problem, joining the scientific methods and the social behaviors that aim at a healthier future for the planet.
  • 107. Proposal in mobile apps and affective narratives – MHEALTH • Micronarratives , mobile devices and apps: • Exploring mobile techs : devices iPod?s, iPhone?s, Ipads, Android.. • Hardware, and GPS locativity -, • Google maps, MySpace, Facebook, Skype, Twitter, blogs, Instagrams, What?s app • Youtube and narratives . • REALITY MINING – data mining of people everywhere , social physics, contamination of behaviors, EPIDEMIOLOGY and FICCION and REALITY , biocyber affective ficcion . • Hiperfiçcion, intelligent systems, automatisme, dataming, machime learning, surveillance and GPs, geolocativity. • Visual analytics techniques for healthcare :
  • 108. Final comments : Life is reinvented – life is reengineered • We are facing the transformation in our life , in the “nature itself” and its evident the emergence of “the engineered reality for a healthier future ”.. • The digital magicians every where and their creative technologies may transform life. • We humanize technologies , WE NATURALIZE TECHNOLOGIES • New Leonardos” eScience Institute of Innovation for Living Systems
  • 109. Proposal in mobile apps and affective narratives – BIOART and MHEALTH ]Mobile mobilization Data information and social platforms affective geographies and Bioart and mhealth • Micronarratives , mobile devices and apps: • Exploring mobile techs : Cell phones, devices iPod?s, iPhone?s, Ipads, Android.. • Hardware, and GPS locativity -, • Google maps, Facebook, Skype, Twitter, blogs, Instagrams, What?s app • Youtube and narratives . • REALITY MINING – data mining of people everywhere , social physics, contamination of behaviors, EPIDEMIOLOGY and FICCION and REALITY , biocyber affective narratives . • Hipernarratives, intelligent systems, automatisme, dataming, machime learning, surveillance and GPs, geolocativity. • Visual analytics techniques for health. • Scientific information from technicians and from the communities are gathered in a database, with geographical information. • Participatory Design and Ethnographic Protocols for Visualization Tools and specific technologies (emergent systems, model-based scientific visualizations of complex data sets, data mining for volumetric visualization, cloud computing and architecture) large use of mobile devices and participatory design strategies. • The system is based on networked cyberinfrastructure and physic territory actions. These actions use advanced scientific methods for analysing and evaluating biodiversity research on continental-scale environmental issues • Also, they are based on accelerated research strategies, and on communication strategies for collaborative network on biodiversity, ecological and geographic informatics, social platforms, mobile technologies and health process learning experiences in the physical world and in the digital environment, in collaborations and reciprocity, by using technological common network protocols. • Transdisciplinar/antidisciplinar methods in social software and data visualization in a cyber infrastructure of intelligent systems and visualization technologies enable an affective aesthetics regarding the infirm landscapes and to fight the dengue problem, joining the scientific methods and the social behaviors that aim at a healthier future for the planet
  • 110. Youtube: http://www.youtube.com/channel/UCIRaxl0HRT-Uaclj1Q94rMw Facebook : Tecnodengue O Drama da Dengue: jornalismo e ativismo nos softwares sociais Maringá :case study Ana Paula Machado Velho Pos Doc , PDJ CNPq 2013, Dr.Diana Domingues How to mobilize communities? Product: metodology to activism and social mobilization. Theories: social physics (Alex Pentland), social engagement on online networks (Rheingold, Castells) 2 - Ethnojournalistic narratives (group using smartphones, apps and online social network will generate content about dengue) 3 - Generate content (activation workshops) 4 - Identify requirements for the social software
  • 111. Final comments Life is reengineered • Challenges of the world, increasingly faced by circuits of sensors and transparent technologies are blurring the limits of the natural and physical world and are reengineering reality. We are facing transformation in our life , in the “nature itself” and its evident the emergence of “the engineered reality for a healthier future ” • The digital magicians , every where , with their creative minds transform life. They humanize technologies . They naturalize technologies!
  • 112. Final discussion • Prototypes for the industry, art and culture application. • Biofeedback based on synaesthesya and expanded sensorium generated sounds and images and avoiding patterns that correspond to the (un)desired physiological states during physical activity. • Concerning (re) habilitation of parts of body activities, or simply body behaviors, the identity is revealed in affective zones. • Light and liveness entails new ways of deciphering human behaviors and body embodiments and behaviors in microscales allowing the self-perception in introspective ways, meditation, self-identity, behind externalized traces.
  • 113. Body is reinvented – life is reengineered • Challenges of the world, increasingly faced by biocybrid circuits of sensors, blurring the limits of the natural worlds and the engineered reality and the “nature itself” and the emergence and “the future engineered reality”.. • The digital magicians every where in the world and their creative technologies will transform life. We humanize technologies or “technologies dehumanizes us”.
  • 114. • LART – Laboratory of Research in Art and TechnoScience • Biomedical Engineering Graduate Program - FGA/GAMA • Science Technologies in Health Graduate Program- Ceilândia UnB • University of Brasilia at Gama –– CNPq/CAPES:
  • 115. Discussions and perspective Embodiments and affections • In cognitive science and human embodiments arts domain, we enhance studies on kinesthetics by mixing the Kinemas, as a language of movement, proposed by Rudolf Laban, in a transphysiological dimension, i.e. aspects of motion, electricity, graphic design, in data visualization and data sonification. Body movements, gestures, postures, fragmentation, reinstatements, dynamics, internal-external connections and motor schemes, dealing with gestures, rhythms, not only at each stage of the movement, but also considering what affects you, the environment and the coupled interior and affection in the flows of life with affective enactive sensors. Biofeedback with outside environment in enactive affective conditions can help understanding the internal excitation of nerves or the immediate impression of the senses, or by a complicated chain of senses’ impressions, previously experienced, stored in the memory of sensations, emotions and thoughts. Attempts are being made for the system to read the rhythmic patterns of movement.
  • 116. • Data mining and mobile Technologies (EAGLE e PENTLAND, 2006) waerables (OLGUIN et al., 2009), generating wearable Affective maps based on te physiological data of people design the enactive Affective system afetivo.
  • 117. discussion • - Biomedical Engineeering and prototypes for the medical industry, art and culture application. • Enactive Affective System as personal assistant based on synaesthesya and expanded sensorium generated data and diagnostics avoiding patterns that correspond to the (un)desired physiological states during physical activity. • Concerning (re) habilitation of parts of body activities, or simply body behaviors, the identity is revealed in affective zones. • Light and liveness entails new ways of deciphering human behaviors and body embodiments and behaviors in microscales allowing the self-perception in introspective ways, meditation, self-identity, behind externalized traces.
  • 118. Perspectives Biograms and living maps Perspectiva de Massumi (2002), que ressalta a impossibilidade de textos ou estruturas linguísticas captarem o afeto, desde que não trazem o élan vital do afeto (no setido spinoziano). Ou seja, o método não se resume no metafórico representacional, baseado em dados de experiências vividas que não são traduzidas por um sistema de natureza textual. A afetiva é a intensidade de uma experiência não consciente, “it is a moment of unformed and unstructured potential. Of the three central terms in this essay – feeling, emotion, and affect – affect is the most abstract because affect cannot be fully realised in language, and because affect is always prior to and/or outside of consciousness (Massumi, 2002).” Affect is the body’s way of preparing itself for action in a given circumstance by adding a quantitative dimension of intensity to the quality of an experience. u-health (Ubiquitous health – saúde ubíqua). O termo vem sendo usado em textos específicos no campo médico (Seo, Jin Woo; Park,
  • 119. Final comments Life is reengineered • Challenges of the world, increasingly faced by circuits of sensors and transparent technologies are blurring the limits of the natural and physical world and are reengineering reality. We are facing transformation in life , in the “nature itself” and its evident the emergence of “the engineered reality transformed for a healthier future ” • The digital magicians , every where , with their creative minds transform life. • They humanize technologies . They naturalize technologies!