Bangalore Edition

Due to the complexity of the software and the backend infrastructural requirements, e-Science projects usually involve large teams managed and developed by research laboratories, large universities or governments. e-Science is about global collaboration in key areas of science, and the next generation of infrastructure that will enable it.

Due to the complexity of the software and the backend infrastructural requirements, e-Science projects usually involve large teams managed and developed by research laboratories, large universities or governments.

How do we know when e-Science has succeeded? Not just accelerated but new A. When everyone is using the Grid B. When there are routine scientific advances that would not have happened otherwise

How do we move from heroic scientists doing heroic science with heroic infrastructure to everyday scientists doing science they couldn’t do before? humanists archaeologists geographers musicologists ... researchers! research It’s the democratisation of e-Science! 

scientists Digital Libraries Graduate Students Undergraduate Students experimentation Data, Metadata Provenance Workflows Ontologies The social process of science Local Web Repositories Virtual Learning Environment Technical Reports Reprints Peer-Reviewed Journal & Conference Papers Preprints & Metadata Certified Experimental Results & Analyses

Between 19 th October and 23 rd November 2007 I attended six international meetings related to e-Science Grid 2007 Scientific and Scholarly Workflows e-Social Science 2007 W3C Open Grid Forum Microsoft e-Science This is what I found

Between 19 th October and 23 rd November 2007 I attended six international meetings related to e-Science

Grid 2007 Scientific and Scholarly Workflows e-Social Science 2007 W3C

Open Grid Forum Microsoft e-Science

This is what I found

Not just a specialist few doing heroic science with heroic infrastructure Chemists are blogging the lab Everyone is mashing up Everday hardware – multicore machines and mobile devices Everyday researchers doing everyday research 1

Not just a specialist few doing heroic science with heroic infrastructure

Chemists are blogging the lab

Everyone is mashing up

Everday hardware – multicore machines and mobile devices

Data is large, rich, complex and real-time There is new value in data, through new digital artefacts and through metadata e.g. context, provenance, workflows This isn’t “anti-computation” –design interaction around data A data-centric perspective, like researchers 2

Data is large, rich, complex and real-time

There is new value in data, through new digital artefacts and through metadata e.g. context, provenance, workflows

This isn’t “anti-computation” –design interaction around data

The social process of science revisited in the digital age Collaborative tools – blogs and Wikis e-Science now focuses on publishing as well as consuming Scholarly lifecycle perspective Collaborative and participatory 3

The social process of science revisited in the digital age

Collaborative tools – blogs and Wikis

e-Science now focuses on publishing as well as consuming

Scholarly lifecycle perspective

This is new and powerful! Community intelligence Review Usage informing recommendation e.g. OpenWetWare e.g. myExperiment Benefitting from the scale of digital science activity to support science 4

This is new and powerful!

Community intelligence

Review

Usage informing recommendation

e.g. OpenWetWare

e.g. myExperiment

Preprints servers and institutional repositories Open journals Open access to data Science Commons Object Reuse & Exchange Increasingly open 5

Preprints servers and institutional repositories

Open journals

Open access to data

Science Commons

Object Reuse & Exchange

The technologies people are using are not perfect They are better They are easy to use They are chosen by scientists Better not Perfect 6

The technologies people are using are not perfect

They are better

They are easy to use

They are chosen by scientists

The success stories come from the researchers who have learned to use ICT Domain ICT experts are delivering the solutions Anything that takes away autonomy will be resisted Empowering researchers 7

The success stories come from the researchers who have learned to use ICT

Domain ICT experts are delivering the solutions

Anything that takes away autonomy will be resisted

e-Science is about the intersection of the digital and physical worlds Sensor networks Mobile handheld devices About pervasive computing 8

e-Science is about the intersection of the digital and physical worlds

Sensor networks

Mobile handheld devices

Everyday researchers doing everyday research A data-centric perspective, like researchers Collaborative and participatory Benefitting from the scale of digital science activity to support science Increasingly open Better not Perfect Empowering researchers About pervasive computing Signs of the Times

Everyday researchers doing everyday research

A data-centric perspective, like researchers

Collaborative and participatory

Benefitting from the scale of digital science activity to support science

Increasingly open

Better not Perfect

Empowering researchers

About pervasive computing

e-Science is now enabling researchers to do some completely new stuff! As the individual pieces become easy to use, researchers can bring them together in new ways and ask new questions “ The next level” Onward and Upward “ Standing on the shoulders of giants”

e-Science is now enabling researchers to do some completely new stuff!

As the individual pieces become easy to use, researchers can bring them together in new ways and ask new questions

“ The next level”

Everyday researchers doing everyday research BUT heroic Grid infrastructure not being adopted A data-centric perspective, like researchers BUT Grid gives APIs to computation not data Collaborative and participatory BUT Grid has deeply rooted service provider mindset Better not Perfect BUT Grid aims to provide well-engineered perfect solution Giving autonomy to researchers BUT Grid imposes institutional control (at this time) About pervasive computing BUT Grid is about portals,not the next generation of users The Grid Problem

Everyday researchers doing everyday research

BUT heroic Grid infrastructure not being adopted

A data-centric perspective, like researchers

BUT Grid gives APIs to computation not data

Collaborative and participatory

BUT Grid has deeply rooted service provider mindset

Better not Perfect

BUT Grid aims to provide well-engineered perfect solution

Giving autonomy to researchers

BUT Grid imposes institutional control (at this time)

About pervasive computing

BUT Grid is about portals,not the next generation of users

e-Science Pipeline e-Science Technology Creators & Integrators Applications Research EE Research Socio-economic & Commercial Innovation e-Science bespoke tailoring Mass Use by Researchers 5 years 5 years 5 years CS Research e-Science 10s of integrators 100s of embedded consultants 1000s of research users The Arrow Problem Malcolm Atkinson

Web Services RESTful APIs cmd lines ssh http Web Browser Mobile phone iPod Car Equipment PDA P2P mashups workflows services applications Subject ICT experts Computer Scientists Software Companies Workflow tools Ruby on Rails ecosystem Scientists open source Software Engineers nesc

It’s about empowerment as well as provision People power Hence usability: Simple/familiar interfaces for users Simple/familiar interfaces for developers No need for a summer school! Step into user space and look back Computer Scientists as facilitators and problem solvers(?) For a flourishing ecosystem...

It’s about empowerment as well as provision

People power

Hence usability:

Simple/familiar interfaces for users

Simple/familiar interfaces for developers

No need for a summer school!

Step into user space and look back

Computer Scientists as facilitators and problem solvers(?)

Wikis Mashups REST APIs Google Maps Technologies: AJAX, JSON, Ruby on Rails, ... Social networking Web as a distributed application platform Amazon S3 and EC2 But what about Web 2.0?!

Wikis

Mashups

REST APIs

Google Maps

Technologies:

AJAX, JSON, Ruby on Rails, ...

Social networking

Web as a distributed application platform

Amazon S3 and EC2

Everyday researchers doing everyday research A data-centric perspective, like researchers Collaborative and participatory Benefitting from the scale of digital science activity to support science Increasingly open Better not Perfect Empowering researchers About pervasive computing Signs of the Times The Long Tail Data is the Next “Intel Inside” Users add value Network effects by default Some Rights Reserved The Perpetual Beta Cooperate, don’t Contol Software above the level of the single device Web 2.0 patterns

Everyday researchers doing everyday research

A data-centric perspective, like researchers

Collaborative and participatory

Benefitting from the scale of digital science activity to support science

Increasingly open

Better not Perfect

Empowering researchers

About pervasive computing

use Web 2.0 here? Grid

use Web 2.0 here? Grid

use Web 2.0 here Grid

A utility is a directly and immediately useable service with established functionality, performance and dependability, illustrating the emphasis on user needs and issues such as trust Services are knowledge-assisted (‘semantic’) to facilitate automation and advanced functionality, the knowledge aspect reinforced by the emphasis on delivering high level services to the user Service-Oriented Knowledge Utility The architecture comprises services which may be instantiated and assembled dynamically, hence the structure, behaviour and location of software is changing at run-time

Web 2.0 is not high performance It improves the performance of science and people! Web 2.0 is not a properly engineered solution Scientists want better, not perfect. And agility. Web 2.0 is not secure People do lots of “secure” things on the Web Web 2.0 is a fad that will pass It’s inevitable and it’s already happened! Web 2.0 works for teenagers but it won’t for scientists Let’s find out...! Myths

Web 2.0 is not high performance

It improves the performance of science and people!

Web 2.0 is not a properly engineered solution

Scientists want better, not perfect. And agility.

Web 2.0 is not secure

People do lots of “secure” things on the Web

Web 2.0 is a fad that will pass

It’s inevitable and it’s already happened!

Web 2.0 works for teenagers but it won’t for scientists

Let’s find out...!

myexperiment.org

Workflows are the new rock and roll Machinery for coordinating the execution of (scientific) services and linking together (scientific) resources The era of Service Oriented Applications Repetitive and mundane boring stuff made easier E. Science laboris

Workflows are the new rock and roll

Machinery for coordinating the execution of (scientific) services and linking together (scientific) resources

The era of Service Oriented Applications

Repetitive and mundane boring stuff made easier

Paul writes workflows for identifying biological pathways implicated in resistance to Trypanosomiasis in cattle Paul meets Jo. Jo is investigating Whipworm in mouse. Jo reuses one of Paul’s workflow without change . Jo identifies the biological pathways involved in sex dependence in the mouse model, believed to be involved in the ability of mice to expel the parasite. Previously a manual two year study by Jo had failed to do this. Recycling, Reuse, Repurposing

Paul writes workflows for identifying biological pathways implicated in resistance to Trypanosomiasis in cattle

Paul meets Jo. Jo is investigating Whipworm in mouse.

Jo reuses one of Paul’s workflow without change .

Jo identifies the biological pathways involved in sex dependence in the mouse model, believed to be involved in the ability of mice to expel the parasite.

Previously a manual two year study by Jo had failed to do this.

40 Taverna downloads per day 2007 2006 2005 2004 2003

Independent third party world-wide service providers of applications, tools and data sets. In the Cloud. 850 databases, 166 web servers Nucleic Acids Research Jan 2006 My local applications, tools and datasets. In the Enterprise. In the laboratory. Easily incorporate new service without coding. So even more services from the cloud and enterprise. e-Services in the Cloud

Independent third party world-wide service providers of applications, tools and data sets. In the Cloud.

850 databases, 166 web servers Nucleic Acids Research Jan 2006

My local applications, tools and datasets. In the Enterprise. In the laboratory.

Easily incorporate new service without coding. So even more services from the cloud and enterprise.

Kepler Triana BPEL Ptolemy II

myExperiment.org is… “ Facebook for Scientists” A community social network. A gateway to other publishing environments A federated repository A platform for launching workflows Publishing self-describing Encapsulated myExperiment Objects Mindful publication Started March 2007 Closed beta since July 2007 Open beta November 2007 myExperiment.org is...

“ Facebook for Scientists”

A community social network.

A gateway to other publishing environments

A federated repository

A platform for launching workflows

Publishing self-describing Encapsulated myExperiment Objects

Mindful publication

Started March 2007

Closed beta since July 2007

Open beta November 2007

Google Gadget

Challenge: Policy and Permissions without Tears Ownership and Attribution

24/5/2007 | myExperiment | Slide

` Enactor HTML XML Snapshot map of resources with their relationships and versions users descriptions groups friendships tags blobs workflows

scientists Graduate Students Undergraduate Students experimentation Data, Metadata Provenance Workflows Ontologies Digital Libraries The social process of science 2.0 Local Web Repositories Virtual Learning Environment Technical Reports Reprints Peer-Reviewed Journal & Conference Papers Preprints & Metadata Certified Experimental Results & Analyses

e-Science is about doing new science Grid is just one part of the solution Users are not just consumers of infrastructure. Empower them. Web 2.0 is a set of design patterns Think Web 2.0 on top of Grid and other services Workflows make e-Science easier, and Web 2 makes workflows easier  Take Homes 2.0

e-Science is about doing new science

Grid is just one part of the solution

Users are not just consumers of infrastructure. Empower them.

Web 2.0 is a set of design patterns

Think Web 2.0 on top of Grid and other services

Workflows make e-Science easier, and Web 2 makes workflows easier 

Contact David De Roure dder@ecs.soton.ac.uk Carole Goble [email_address] Thanks Geoffrey Fox, Savas Parastatides, myExperiment team & myGrid team

Contact

David De Roure

dder@ecs.soton.ac.uk

Carole Goble

[email_address]

Thanks

Geoffrey Fox, Savas Parastatides, myExperiment team & myGrid team