E Afgan - Zero to a bioinformatics analysis platform in four minutes

•

2 likes•772 views

Presentation at BOSC2012 by E Afgan - Zero to a bioinformatics analysis platform in four minutes

Zero to a Bioinformatics
Analysis Platform in Four Minutes
Enis Afgan, Brad Chapman, Konstantinos Krampis, James Taylor
BOSC 2012
Long Beach, CA

Australian National Research Cloud

Provide computational infrastructure to support researchers
needs

Compute and Storage
(~25,000 cores + ? PB)

What’s required for genomics?
✔ •  Compute
✔ •  Storage
•  Data resources
o  Ensembl, dbSNP, etc

•  Tools
•  Visualisation
•  Protocols
•  Expertise
•  Community!

Genomics Virtual Lab

Compute + Storage = IaaS

shell vs. IDE

We want it now

What’s required for genomics?
•  Compute
•  Storage
•  Data resources
o  Ensembl, dbSNP, etc

•  Tools
•  Visualisation
•  Protocols
•  Expertise
•  Community!

Galaxy

y
y CloudMan
CloudBioLinux y
y

BioCloudCentral.org

Playing together
•  CloudBioLinux
o  Quickly build-your-own tool suite / ready to roll
o  Graphical & command line access

•  CloudMan
o  Create a scalable and shareable processing platform

•  Galaxy
o  Do exploratory analysis

•  BioCloudCentral.org
o  Get started easily

•  Bundle infrastructure with an analysis tool suite, quickly
o  Validate our approach
o  Easier to maintain and replicate

•  Expose it all via at a variety of interfaces
o  Support meta-analysis workﬂow

•  Move forward
o  Add new features
o  Start using it

And one new thing…

blend
o  A python library for interacting with Galaxy’s API
o  And CloudMan
o  And BioCloudCentral

Request compute infrastructure

Manipulate compute infrastructure

Upload data and run analyses

Docs and examples

Test Automate
repetitive tasks
Distribute

Docs and
examples included
http://blend.readthedocs.org/

Playing together
•  CloudBioLinux
o  Build-your-own tool suite / ready to roll
o  Graphical & command line access

•  CloudMan
o  Create a scalable and shareable processing platform

•  BioCloudCentral.org
o  Get started easily

•  Galaxy
o  Do exploratory analysis

•  Blend library
o  Automate repetitive tasks: analysis AND infrastructure

Questions?
cloudbiolinux.org
usecloudman.org
usegalaxy.org
biocloudcentral.org
blend.readthedocs.org

Visit the poster session (poster #10)

More Related Content

What's hot

Kibana + timelion: time series with the elastic stack

Kibana + timelion: time series with the elastic stack

Kibana + timelion: time series with the elastic stack

Preservation Workflows with Taverna

Preservation Workflows with Taverna

Preservation Workflows with Taverna

IT Press Tour #17 - OpenIO & Technology

IT Press Tour #17 - OpenIO & Technology

IT Press Tour #17 - OpenIO & Technology

OpenIO Object Storage

OpenStack - Pour un Cloud ouvert - Journées FedeRez 2014

OpenStack - Pour un Cloud ouvert - Journées FedeRez 2014

OpenStack - Pour un Cloud ouvert - Journées FedeRez 2014

Presented by Joel Westberg, Findwise AB - See conference video - http://www.lucidimagination.com/devzone/events/conferences/lucene-revolution-2012 This presentation will detail the document-processing framework called Hydra that has been developed by Findwise. It is intended as a description of the framework and the problem it aims to solve. We will first discuss the need for scalable document processing, outlining that there is a missing link between the open source chain to bridge the gap between source system and the search engine, then will move on to describe the design goals of Hydra, as well as how it has been implemented to meet those demands on flexibility, robustness and ease of use. This session will end by discussing some of the possibilities that this new pipeline framework can offer, such as freely seamlessly scaling up the solution during peak loads, metadata enrichment as well as proposed integration with Hadoop for Map/Reduce tasks such as page rank calculations.

Introducing Hydra – An Open Source Document Processing Framework

Introducing Hydra – An Open Source Document Processing Framework

Introducing Hydra – An Open Source Document Processing Framework

lucenerevolution

As machine learning moves from niche to mainstream tech stacks how do DevOps engineers prepare for a very different set of problems. A brief look at the new issues that arise from machine learning, an overview of cutting-edge "old school" solutions and how to drag data science (kicking and screaming) into a world of automation. Video: https://www.youtube.com/watch?v=KHxZCRajRiA Join DevOps Exchange London here: http://meetup.com/DevOps-Exchange-London/ Follow DOXLON on twitter http://www.twitter.com/doxlon

Leonard Austin (Ravelin) - DevOps in a Machine Learning World

Leonard Austin (Ravelin) - DevOps in a Machine Learning World

Leonard Austin (Ravelin) - DevOps in a Machine Learning World

Ci Connect: A service for building multi-institutional cluster environments

Ci Connect: A service for building multi-institutional cluster environments

Ci Connect: A service for building multi-institutional cluster environments

Ansible

As your company accumulates more data, it’s important to leverage all of it to develop new advanced machine learning models. And now, you can scale Spark using Kubernetes. Thanks to the new native integration between Apache Spark’s and Kubernetes, scaling data processing has never been easier. Apache Spark is a well designed high level application that can increase your data processing speed and accuracy. It can handle batch and real-time analytic and data processing workloads. This high level and efficient technology can be used with Java/Spark/Python and R. Joined with Kubernetes, you can get twice the efficiency. Kubernetes is a great engine with the most popular framework for managing compute resources. Unfortunately, running Apache Spark on Kubernetes can be a pain for first-time users. Join CTO of cnvrg.io Leah Kolben as she brings you through a step by step tutorial on how to run Spark on Kubernetes. You’ll have your Spark up and running on Kubernetes in just 30 minutes. Running Spark on Kubernetes will help you: Process larger amounts of data Segment your data into sub groups Watch all our webinars at https://cnvrg.io/webinars-and-workshops/

Webinar kubernetes and-spark

Webinar kubernetes and-spark

Webinar kubernetes and-spark

cnvrg.io AI OS - Hands-on ML Workshops

Amazon Web Services offers a quick and easy way to build a scalable search platform, a flexibility is especially useful when an initial data load is required but the hardware is no longer needed for day-to-day searching and adding new documents. This presentation will cover one such approach capable of enlisting hundreds of worker nodes to ingest data, track their progress, and relinquish them back to the cloud when the job is done. The data set that will be discussed is the collection of published patent grants available through Google Patents. A single Solr instance can easily handle searching the roughly 1 million patents issued between 2010 and 2005, but up to 50 worker nodes were necessary to load that data in a reasonable amount of time. Also, the same basic approach was used to make three sizes of PNG thumbnails of the patent grant TIFF images. In that case 150 worker nodes were used to generate 1.6 Tb of data over the course of three days. In this session, attendees will learn how to leverage EC2 as a scalable indexer and tricks for using XSLT on very large XML documents.

Indexing big data in the cloud

Indexing big data in the cloud

Indexing big data in the cloud

OpenSource Connections

Use cases for cassandra in federal and state government

Use cases for cassandra in federal and state government

Use cases for cassandra in federal and state government

OpenSource Connections

Open Science Grid

Open Science Grid

Open Science Grid

This sessions covers diagnosing and solving common problems encountered in production, using performance profiling tools. We’ll also give a crash course to basic JVM garbage collection tuning. Attendees will leave with a better understanding of what they should look for when they encounter problems with their in-production Cassandra cluster. Video: https://www.youtube.com/watch?v=9XrHoAxd0Is Join DevOps Exchange London here: http://www.meetup.com/DevOps-Exchange-London Follow DOXLON on twitter http://www.twitter.com/doxlon

Joel Jacobson (Datastax) - Diagnosing Cassandra Problems in Production

Joel Jacobson (Datastax) - Diagnosing Cassandra Problems in Production

Joel Jacobson (Datastax) - Diagnosing Cassandra Problems in Production

Building big data applications on AWS by Ran Tessler

Building big data applications on AWS by Ran Tessler

Building big data applications on AWS by Ran Tessler

IronSource Atom - Redshift - Lessons Learned

IronSource Atom - Redshift - Lessons Learned

IronSource Atom - Redshift - Lessons Learned

Circos plot

Akkal Bahadur Bist

Building an open data platform with apache iceberg

Building an open data platform with apache iceberg

Building an open data platform with apache iceberg

Shug meetup Hops Hadoop

Shug meetup Hops Hadoop

Shug meetup Hops Hadoop

Elastic Stack Introduction

Elastic Stack Introduction

Elastic Stack Introduction

Datascience lab 2017 odessa kappa architecture 2.0

Datascience lab 2017 odessa kappa architecture 2.0

Datascience lab 2017 odessa kappa architecture 2.0

Juantomás García Molina

What's hot (20)

Kibana + timelion: time series with the elastic stack

Kibana + timelion: time series with the elastic stack

Kibana + timelion: time series with the elastic stack

Preservation Workflows with Taverna

Preservation Workflows with Taverna

Preservation Workflows with Taverna

IT Press Tour #17 - OpenIO & Technology

IT Press Tour #17 - OpenIO & Technology

IT Press Tour #17 - OpenIO & Technology

OpenStack - Pour un Cloud ouvert - Journées FedeRez 2014

OpenStack - Pour un Cloud ouvert - Journées FedeRez 2014

OpenStack - Pour un Cloud ouvert - Journées FedeRez 2014

Introducing Hydra – An Open Source Document Processing Framework

Introducing Hydra – An Open Source Document Processing Framework

Introducing Hydra – An Open Source Document Processing Framework

Leonard Austin (Ravelin) - DevOps in a Machine Learning World

Leonard Austin (Ravelin) - DevOps in a Machine Learning World

Leonard Austin (Ravelin) - DevOps in a Machine Learning World

Ci Connect: A service for building multi-institutional cluster environments

Ci Connect: A service for building multi-institutional cluster environments

Ci Connect: A service for building multi-institutional cluster environments

Ansible

Webinar kubernetes and-spark

Webinar kubernetes and-spark

Webinar kubernetes and-spark

Indexing big data in the cloud

Indexing big data in the cloud

Indexing big data in the cloud

Use cases for cassandra in federal and state government

Use cases for cassandra in federal and state government

Use cases for cassandra in federal and state government

Open Science Grid

Open Science Grid

Open Science Grid

Joel Jacobson (Datastax) - Diagnosing Cassandra Problems in Production

Joel Jacobson (Datastax) - Diagnosing Cassandra Problems in Production

Joel Jacobson (Datastax) - Diagnosing Cassandra Problems in Production

Building big data applications on AWS by Ran Tessler

Building big data applications on AWS by Ran Tessler

Building big data applications on AWS by Ran Tessler

IronSource Atom - Redshift - Lessons Learned

IronSource Atom - Redshift - Lessons Learned

IronSource Atom - Redshift - Lessons Learned

Circos plot

Building an open data platform with apache iceberg

Building an open data platform with apache iceberg

Building an open data platform with apache iceberg

Shug meetup Hops Hadoop

Shug meetup Hops Hadoop

Shug meetup Hops Hadoop

Elastic Stack Introduction

Elastic Stack Introduction

Elastic Stack Introduction

Datascience lab 2017 odessa kappa architecture 2.0

Datascience lab 2017 odessa kappa architecture 2.0

Datascience lab 2017 odessa kappa architecture 2.0

Similar to E Afgan - Zero to a bioinformatics analysis platform in four minutes

re:Invent 2013-foster-madduri

re:Invent 2013-foster-madduri

re:Invent 2013-foster-madduri

"In this talk, hear about two high-performant research services developed and operated by the Computation Institute at the University of Chicago running on AWS. Globus.org, a high-performance, reliable, robust file transfer service, has over 10,000 registered users who have moved over 25 petabytes of data using the service. The Globus service is operated entirely on AWS, leveraging Amazon EC2, Amazon EBS, Amazon S3, Amazon SES, Amazon SNS, etc. Globus Genomics is an end-to-end next-gen sequencing analysis service with state-of-art research data management capabilities. Globus Genomics uses Amazon EC2 for scaling out analysis, Amazon EBS for persistent storage, and Amazon S3 for archival storage. Attend this session to learn how to move data quickly at any scale as well as how to use genomic analysis tools and pipelines for next generation sequencers using Globus on AWS. "

Globus Genomics: How Science-as-a-Service is Accelerating Discovery (BDT310) ...

Globus Genomics: How Science-as-a-Service is Accelerating Discovery (BDT310) ...

Globus Genomics: How Science-as-a-Service is Accelerating Discovery (BDT310) ...

Amazon Web Services

Intro to Machine Learning with H2O and AWS

Intro to Machine Learning with H2O and AWS

Intro to Machine Learning with H2O and AWS

New Developments in H2O: April 2017 Edition

New Developments in H2O: April 2017 Edition

New Developments in H2O: April 2017 Edition

DevOps environment with OpenStack and NetApp

DevOps environment with OpenStack and NetApp

DevOps environment with OpenStack and NetApp

B1 Systems GmbH

Open Source Visualization of Scientific Data

Open Source Visualization of Scientific Data

Open Source Visualization of Scientific Data

Cloud patterns

Nicolas De Loof

Apache Cassandra training. Overview and Basics

Apache Cassandra training. Overview and Basics

Apache Cassandra training. Overview and Basics

Latest Developments in H2O

Latest Developments in H2O

Latest Developments in H2O

Deep Water is H2O's integration with multiple open source deep learning libraries such as TensorFlow, MXNet and Caffe. On top of the performance gains from GPU backends, Deep Water naturally inherits all H2O properties in scalability. ease of use and deployment. In this talk, I will go through the motivation and benefits of Deep Water. After that, I will demonstrate how to build and deploy deep learning models with or without programming experience using H2O's R/Python/Flow (Web) interfaces. Jo-fai (or Joe) is a data scientist at H2O.ai. Before joining H2O, he was in the business intelligence team at Virgin Media in UK where he developed data products to enable quick and smart business decisions. He also worked remotely for Domino Data Lab in the US as a data science evangelist promoting products via blogging and giving talks at meetups. Joe has a background in water engineering. Before his data science journey, he was an EngD research engineer at STREAM Industrial Doctorate Centre working on machine learning techniques for drainage design optimization. Prior to that, he was an asset management consultant specialized in data mining and constrained optimization for the utilities sector in the UK and abroad. He also holds an MSc in Environmental Management and a BEng in Civil Engineering.

H2O Deep Water - Making Deep Learning Accessible to Everyone

H2O Deep Water - Making Deep Learning Accessible to Everyone

H2O Deep Water - Making Deep Learning Accessible to Everyone

The modern chemist has access to large databases containing both experimental and calculated data. The power of HPC resources continues to increase, with more practitioners having routine access to powerful computational chemistry tools. This places an increasingly high burden on users to assimilate these resources into their workflow in order to effectively utilize resources. The creation of an open, extensible application framework that puts computational tools, data, and domain specific knowledge at the fingertips of chemists is increasingly important. A data-centric approach to chemistry, storing all data in a searchable database, will empower users to efficiently collaborate, innovate, and push the frontiers of research. Providing an open, user-friendly and extensible application will open up new tools to experimental chemists, while providing computational chemists the ability to address greater challenges. Additionally, by distributing experimental and computational data across the research community, incorporating cheminformatics analytics techniques, and providing visual search for chemical structures, the workflow of both groups can be significantly improved. This requires suitable data formats for data exchange, and databases with appropriate APIs for querying, and uploading data in order to effectively share. This talk will discuss recent progress made in developing a suite of open chemistry applications on the desktop. The applications can query online databases, such as the NIH structure resolver service, download and manipulate structures, and prepare input files for standalone computational chemistry codes. Another application developed to submit jobs, monitor and retrieve results from HPC resources will also be shown, and a desktop chemistry database browser. The Quixote project aims to establish standards for data exchange in computational chemistry, along with data repositories for organizations. Establishing these standards is important to promote open, reproducible chemistry, and their integration into user-friendly desktop applications will promote their integration in the standard workflow of researchers.

Chemical Databases and Open Chemistry on the Desktop

Chemical Databases and Open Chemistry on the Desktop

Chemical Databases and Open Chemistry on the Desktop

A typical instance of computational biology software is composed of interpreted code, compiled binaries, shared libraries, and shell scripts, sometimes mixed in with use of web services or databases, running in the context of a complex computer operating system, atop increasingly sophisticiated physical resources. How can we expect computations to be sharable and reproducible, and how can we hope to train people to use such resources? This talk will describe how the Texas Advanced Computing Center enables distribution and use scientific software via various approaches, including Jupyter notebooks, Github repositories, computation-oriented web service APIs, virtual machine images, and container technologies such as Docker, and how these approaches complement one another for training and education.

Packaging computational biology tools for broad distribution and ease-of-reuse

Packaging computational biology tools for broad distribution and ease-of-reuse

Packaging computational biology tools for broad distribution and ease-of-reuse

The PanCancer Analysis of Whole Genomes (PCAWG) project is a large-scale, highly distributed research collaboration designed to identify common patterns of mutations across 2,800 cancer genomes. The use of public and private clouds were instrumental in analyzing this dataset using current best practice containerized pipelines. This session describes the technical infrastructure built for the project, how we leveraged cloud environments to perform the “core” analysis, and the lessons learned along the way.

AWS re:Invent 2016: Large-Scale, Cloud-Based Analysis of Cancer Genomes: Less...

AWS re:Invent 2016: Large-Scale, Cloud-Based Analysis of Cancer Genomes: Less...

AWS re:Invent 2016: Large-Scale, Cloud-Based Analysis of Cancer Genomes: Less...

Amazon Web Services

Architecting Your First Big Data Implementation

Architecting Your First Big Data Implementation

Architecting Your First Big Data Implementation

Adaryl "Bob" Wakefield, MBA

Blue Teaming on a Budget of Zero

Blue Teaming on a Budget of Zero

Blue Teaming on a Budget of Zero

The Power of Azure DevOps

The Power of Azure DevOps

The Power of Azure DevOps

Avoiding cloud lock-in

Avoiding cloud lock-in

Avoiding cloud lock-in

Sebastien Goasguen

OpenStack Documentation in the Open

OpenStack Documentation in the Open

OpenStack Documentation in the Open

The IARPA Machine Intelligence from Cortical Networks (MICrONS) program is a research endeavor created to improve neurally-plausible machine-learning algorithms by understanding data representations and learning rules used by the brain through structurally and functionally interrogating a cubic millimeter of mammalian neocortex. This effort requires efficiently storing, visualizing, and processing petabytes of neuroimaging data. The Johns Hopkins University Applied Physics Laboratory (APL) has developed an open-source, highly available service to manage these data, called the Boss. The Boss uses AWS to provide a cloud-native spatial database with an innovative storage hierarchy and auto-scaling capability to balance cost and performance. This system extensively uses serverless components to meet both scalability and cost requirements. In this session, we provide an overview of the Boss, and we focus on how the APL used Amazon DynamoDB, AWS Lambda, and AWS Step Functions for several high-throughput components of the system. We discuss both the challenges and successes with serverless technologies.

The Boss: A Petascale Database for Large-Scale Neuroscience, Powered by Serve...

The Boss: A Petascale Database for Large-Scale Neuroscience, Powered by Serve...

The Boss: A Petascale Database for Large-Scale Neuroscience, Powered by Serve...

Amazon Web Services

Data visualisation in python tool - a brief

Data visualisation in python tool - a brief

Data visualisation in python tool - a brief

Similar to E Afgan - Zero to a bioinformatics analysis platform in four minutes (20)

re:Invent 2013-foster-madduri

re:Invent 2013-foster-madduri

re:Invent 2013-foster-madduri

Globus Genomics: How Science-as-a-Service is Accelerating Discovery (BDT310) ...

Globus Genomics: How Science-as-a-Service is Accelerating Discovery (BDT310) ...

Globus Genomics: How Science-as-a-Service is Accelerating Discovery (BDT310) ...

Intro to Machine Learning with H2O and AWS

Intro to Machine Learning with H2O and AWS

Intro to Machine Learning with H2O and AWS

New Developments in H2O: April 2017 Edition

New Developments in H2O: April 2017 Edition

New Developments in H2O: April 2017 Edition

DevOps environment with OpenStack and NetApp

DevOps environment with OpenStack and NetApp

DevOps environment with OpenStack and NetApp

Open Source Visualization of Scientific Data

Open Source Visualization of Scientific Data

Open Source Visualization of Scientific Data

Cloud patterns

Apache Cassandra training. Overview and Basics

Apache Cassandra training. Overview and Basics

Apache Cassandra training. Overview and Basics

Latest Developments in H2O

Latest Developments in H2O

Latest Developments in H2O

H2O Deep Water - Making Deep Learning Accessible to Everyone

H2O Deep Water - Making Deep Learning Accessible to Everyone

H2O Deep Water - Making Deep Learning Accessible to Everyone

Chemical Databases and Open Chemistry on the Desktop

Chemical Databases and Open Chemistry on the Desktop

Chemical Databases and Open Chemistry on the Desktop

Packaging computational biology tools for broad distribution and ease-of-reuse

Packaging computational biology tools for broad distribution and ease-of-reuse

Packaging computational biology tools for broad distribution and ease-of-reuse

AWS re:Invent 2016: Large-Scale, Cloud-Based Analysis of Cancer Genomes: Less...

AWS re:Invent 2016: Large-Scale, Cloud-Based Analysis of Cancer Genomes: Less...

AWS re:Invent 2016: Large-Scale, Cloud-Based Analysis of Cancer Genomes: Less...

Architecting Your First Big Data Implementation

Architecting Your First Big Data Implementation

Architecting Your First Big Data Implementation

Blue Teaming on a Budget of Zero

Blue Teaming on a Budget of Zero

Blue Teaming on a Budget of Zero

The Power of Azure DevOps

The Power of Azure DevOps

The Power of Azure DevOps

Avoiding cloud lock-in

Avoiding cloud lock-in

Avoiding cloud lock-in

OpenStack Documentation in the Open

OpenStack Documentation in the Open

OpenStack Documentation in the Open

The Boss: A Petascale Database for Large-Scale Neuroscience, Powered by Serve...

The Boss: A Petascale Database for Large-Scale Neuroscience, Powered by Serve...

The Boss: A Petascale Database for Large-Scale Neuroscience, Powered by Serve...

Data visualisation in python tool - a brief

Data visualisation in python tool - a brief

Data visualisation in python tool - a brief

More from Jan Aerts

VIZBI 2014 - Visualizing Genomic Variation

VIZBI 2014 - Visualizing Genomic Variation

VIZBI 2014 - Visualizing Genomic Variation

Visual Analytics in Omics - why, what, how?

Visual Analytics in Omics - why, what, how?

Visual Analytics in Omics - why, what, how?

Visual Analytics in Omics: why, what, how?

Visual Analytics in Omics: why, what, how?

Visual Analytics in Omics: why, what, how?

Visual Analytics talk at ISMB2013

Visual Analytics talk at ISMB2013

Visual Analytics talk at ISMB2013

Visualizing the Structural Variome (VMLS-Eurovis 2013)

Visualizing the Structural Variome (VMLS-Eurovis 2013)

Visualizing the Structural Variome (VMLS-Eurovis 2013)

Humanizing Data Analysis

Humanizing Data Analysis

Humanizing Data Analysis

Intro to data visualization

Intro to data visualization

Intro to data visualization

L Fu - Dao: a novel programming language for bioinformatics

L Fu - Dao: a novel programming language for bioinformatics

L Fu - Dao: a novel programming language for bioinformatics

J Wang - bioKepler: a comprehensive bioinformatics scientific workflow module...

J Wang - bioKepler: a comprehensive bioinformatics scientific workflow module...

J Wang - bioKepler: a comprehensive bioinformatics scientific workflow module...

S Cain - GMOD in the cloud

S Cain - GMOD in the cloud

S Cain - GMOD in the cloud

B Temperton - The Bioinformatics Testing Consortium

B Temperton - The Bioinformatics Testing Consortium

B Temperton - The Bioinformatics Testing Consortium

J Goecks - The Galaxy Visual Analysis Framework

J Goecks - The Galaxy Visual Analysis Framework

J Goecks - The Galaxy Visual Analysis Framework

S Cain - GMOD in the cloud

S Cain - GMOD in the cloud

S Cain - GMOD in the cloud

B Chapman - Toolkit for variation comparison and analysis

B Chapman - Toolkit for variation comparison and analysis

B Chapman - Toolkit for variation comparison and analysis

P Rocca-Serra - The open source ISA metadata tracking framework: from data cu...

P Rocca-Serra - The open source ISA metadata tracking framework: from data cu...

P Rocca-Serra - The open source ISA metadata tracking framework: from data cu...

J Klein - KUPKB: sharing, connecting and exposing kidney and urinary knowledg...

J Klein - KUPKB: sharing, connecting and exposing kidney and urinary knowledg...

J Klein - KUPKB: sharing, connecting and exposing kidney and urinary knowledg...

S Cheng - eagle-i: development and expansion of a scientific resource discove...

S Cheng - eagle-i: development and expansion of a scientific resource discove...

S Cheng - eagle-i: development and expansion of a scientific resource discove...

A Kanterakis - PyPedia: a python crowdsourcing development environment for bi...

A Kanterakis - PyPedia: a python crowdsourcing development environment for bi...

A Kanterakis - PyPedia: a python crowdsourcing development environment for bi...

A Kalderimis - InterMine: Embeddable datamining components

A Kalderimis - InterMine: Embeddable datamining components

A Kalderimis - InterMine: Embeddable datamining components

B Kinoshita - Creating biology pipelines with BioUno

B Kinoshita - Creating biology pipelines with BioUno

B Kinoshita - Creating biology pipelines with BioUno

More from Jan Aerts (20)

VIZBI 2014 - Visualizing Genomic Variation

VIZBI 2014 - Visualizing Genomic Variation

VIZBI 2014 - Visualizing Genomic Variation

Visual Analytics in Omics - why, what, how?

Visual Analytics in Omics - why, what, how?

Visual Analytics in Omics - why, what, how?

Visual Analytics in Omics: why, what, how?

Visual Analytics in Omics: why, what, how?

Visual Analytics in Omics: why, what, how?

Visual Analytics talk at ISMB2013

Visual Analytics talk at ISMB2013

Visual Analytics talk at ISMB2013

Visualizing the Structural Variome (VMLS-Eurovis 2013)

Visualizing the Structural Variome (VMLS-Eurovis 2013)

Visualizing the Structural Variome (VMLS-Eurovis 2013)

Humanizing Data Analysis

Humanizing Data Analysis

Humanizing Data Analysis

Intro to data visualization

Intro to data visualization

Intro to data visualization

L Fu - Dao: a novel programming language for bioinformatics

L Fu - Dao: a novel programming language for bioinformatics

L Fu - Dao: a novel programming language for bioinformatics

J Wang - bioKepler: a comprehensive bioinformatics scientific workflow module...

J Wang - bioKepler: a comprehensive bioinformatics scientific workflow module...

J Wang - bioKepler: a comprehensive bioinformatics scientific workflow module...

S Cain - GMOD in the cloud

S Cain - GMOD in the cloud

S Cain - GMOD in the cloud

B Temperton - The Bioinformatics Testing Consortium

B Temperton - The Bioinformatics Testing Consortium

B Temperton - The Bioinformatics Testing Consortium

J Goecks - The Galaxy Visual Analysis Framework

J Goecks - The Galaxy Visual Analysis Framework

J Goecks - The Galaxy Visual Analysis Framework

S Cain - GMOD in the cloud

S Cain - GMOD in the cloud

S Cain - GMOD in the cloud

B Chapman - Toolkit for variation comparison and analysis

B Chapman - Toolkit for variation comparison and analysis

B Chapman - Toolkit for variation comparison and analysis

P Rocca-Serra - The open source ISA metadata tracking framework: from data cu...

P Rocca-Serra - The open source ISA metadata tracking framework: from data cu...

P Rocca-Serra - The open source ISA metadata tracking framework: from data cu...

J Klein - KUPKB: sharing, connecting and exposing kidney and urinary knowledg...

J Klein - KUPKB: sharing, connecting and exposing kidney and urinary knowledg...

J Klein - KUPKB: sharing, connecting and exposing kidney and urinary knowledg...

S Cheng - eagle-i: development and expansion of a scientific resource discove...

S Cheng - eagle-i: development and expansion of a scientific resource discove...

S Cheng - eagle-i: development and expansion of a scientific resource discove...

A Kanterakis - PyPedia: a python crowdsourcing development environment for bi...

A Kanterakis - PyPedia: a python crowdsourcing development environment for bi...

A Kanterakis - PyPedia: a python crowdsourcing development environment for bi...

A Kalderimis - InterMine: Embeddable datamining components

A Kalderimis - InterMine: Embeddable datamining components

A Kalderimis - InterMine: Embeddable datamining components

B Kinoshita - Creating biology pipelines with BioUno

B Kinoshita - Creating biology pipelines with BioUno

B Kinoshita - Creating biology pipelines with BioUno

Recently uploaded

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

Keynote 2: APIs in 2030: The Risk of Technological Sleepwalk Paolo Malinverno, Growth Advisor - The Business of Technology Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

The microservices honeymoon is over. When starting a new project or revamping a legacy monolith, teams started looking for alternatives to microservices. The Modular Monolith, or 'Modulith', is an architecture that reaps the benefits of (vertical) functional decoupling without the high costs associated with separate deployments. This talk will delve into the advantages and challenges of this progressive architecture, beginning with exploring the concept of a 'module', its internal structure, public API, and inter-module communication patterns. Supported by spring-modulith, the talk provides practical guidance on addressing the main challenges of a Modultith Architecture: finding and guarding module boundaries, data decoupling, and integration module-testing. You should not miss this talk if you are a software architect or tech lead seeking practical, scalable solutions. About the author With two decades of experience, Victor is a Java Champion working as a trainer for top companies in Europe. Five thousands developers in 120 companies attended his workshops, so he gets to debate every week the challenges that various projects struggle with. In return, Victor summarizes key points from these workshops in conference talks and online meetups for the European Software Crafters, the world’s largest developer community around architecture, refactoring, and testing. Discover how Victor can help you on victorrentea.ro : company training catalog, consultancy and YouTube playlists.

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Manulife - Insurer Transformation Award 2024

Manulife - Insurer Transformation Award 2024

Manulife - Insurer Transformation Award 2024

The Digital Insurer

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

presentation ICT roal in 21st century education

presentation ICT roal in 21st century education

presentation ICT roal in 21st century education

Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Corporate and higher education May webinar.pptx

Corporate and higher education May webinar.pptx

Rustici Software

Tracing the root cause of a performance issue requires a lot of patience, experience, and focus. It’s so hard that we sometimes attempt to guess by trying out tentative fixes, but that usually results in frustration, messy code, and a considerable waste of time and money. This talk explains how to correctly zoom in on a performance bottleneck using three levels of profiling: distributed tracing, metrics, and method profiling. After we learn to read the JVM profiler output as a flame graph, we explore a series of bottlenecks typical for backend systems, like connection/thread pool starvation, invisible aspects, blocking code, hot CPU methods, lock contention, and Virtual Thread pinning, and we learn to trace them even if they occur in library code you are not familiar with. Attend this talk and prepare for the performance issues that will eventually hit any successful system. About authorWith two decades of experience, Victor is a Java Champion working as a trainer for top companies in Europe. Five thousands developers in 120 companies attended his workshops, so he gets to debate every week the challenges that various projects struggle with. In return, Victor summarizes key points from these workshops in conference talks and online meetups for the European Software Crafters, the world’s largest developer community around architecture, refactoring, and testing. Discover how Victor can help you on victorrentea.ro : company training catalog, consultancy and YouTube playlists.

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

DBX First Quarter 2024 Investor Presentation

DBX First Quarter 2024 Investor Presentation

DBX First Quarter 2024 Investor Presentation

Passkeys: Developing APIs to enable passwordless authentication Cody Salas, Sr Developer Advocate | Solutions Architect - Yubico Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

Architecting Cloud Native Applications

Architecting Cloud Native Applications

Architecting Cloud Native Applications

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

The action of the next cyber saga takes place in the mystical lands of the Asia-Pacific region, where the main characters began their digital activities in the middle of 2021 and qualitatively strengthened it in 2022. Corporate espionage, document theft, audio recordings, and data leaks from messaging platforms were all a matter of one day for Dark Pink. Their geographical focus may have started in the Asia-Pacific region, but their ambitions knew no bounds, targeting a European government ministry in a bold move to expand their portfolio. Their victim profile was as diverse as a UN meeting, targeting military organizations, government agencies, and even a religious organization. Because discrimination is not a fashionable agenda. In the world of cybercrime, they serve as a reminder that sometimes the most serious threats come in the most unassuming packages with a pink bow.

Cyberprint. Dark Pink Apt Group [EN].pdf

Cyberprint. Dark Pink Apt Group [EN].pdf

Cyberprint. Dark Pink Apt Group [EN].pdf

Overkill Security

Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar. In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Recently uploaded (20)

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Manulife - Insurer Transformation Award 2024

Manulife - Insurer Transformation Award 2024

Manulife - Insurer Transformation Award 2024

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

presentation ICT roal in 21st century education

presentation ICT roal in 21st century education

presentation ICT roal in 21st century education

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

Corporate and higher education May webinar.pptx

Corporate and higher education May webinar.pptx

Corporate and higher education May webinar.pptx

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

DBX First Quarter 2024 Investor Presentation

DBX First Quarter 2024 Investor Presentation

DBX First Quarter 2024 Investor Presentation

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Architecting Cloud Native Applications

Architecting Cloud Native Applications

Architecting Cloud Native Applications

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Cyberprint. Dark Pink Apt Group [EN].pdf

Cyberprint. Dark Pink Apt Group [EN].pdf

Cyberprint. Dark Pink Apt Group [EN].pdf

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

E Afgan - Zero to a bioinformatics analysis platform in four minutes

1. Zero to a Bioinformatics Analysis Platform in Four Minutes Enis Afgan, Brad Chapman, Konstantinos Krampis, James Taylor BOSC 2012 Long Beach, CA

2. Australian National Research Cloud Provide computational infrastructure to support researchers needs Compute and Storage (~25,000 cores + ? PB)

3. What’s required for genomics? ✔ •  Compute ✔ •  Storage •  Data resources o  Ensembl, dbSNP, etc •  Tools •  Visualisation •  Protocols •  Expertise •  Community!

4. Genomics Virtual Lab

5. Compute + Storage = IaaS

6. shell vs. IDE We want it now

7. What’s required for genomics? •  Compute •  Storage •  Data resources o  Ensembl, dbSNP, etc •  Tools •  Visualisation •  Protocols •  Expertise •  Community!

8. Galaxy y y CloudMan CloudBioLinux y y BioCloudCentral.org

9. Playing together •  CloudBioLinux o  Quickly build-your-own tool suite / ready to roll o  Graphical & command line access •  CloudMan o  Create a scalable and shareable processing platform •  Galaxy o  Do exploratory analysis •  BioCloudCentral.org o  Get started easily

10.

11. •  Bundle infrastructure with an analysis tool suite, quickly o  Validate our approach o  Easier to maintain and replicate •  Expose it all via at a variety of interfaces o  Support meta-analysis workﬂow •  Move forward o  Add new features o  Start using it

12. And one new thing… blend o  A python library for interacting with Galaxy’s API o  And CloudMan o  And BioCloudCentral

13. Request compute infrastructure Manipulate compute infrastructure Upload data and run analyses Docs and examples Test Automate repetitive tasks Distribute

14. Docs and examples included http://blend.readthedocs.org/

15. Playing together •  CloudBioLinux o  Build-your-own tool suite / ready to roll o  Graphical & command line access •  CloudMan o  Create a scalable and shareable processing platform •  BioCloudCentral.org o  Get started easily •  Galaxy o  Do exploratory analysis •  Blend library o  Automate repetitive tasks: analysis AND infrastructure

16. Questions? cloudbiolinux.org usecloudman.org usegalaxy.org biocloudcentral.org blend.readthedocs.org Visit the poster session (poster #10)