eResearch workflows for studying free and open source software development

•Download as PPT, PDF•

6 likes•596 views

1. The document discusses using scientific workflows and tools like Taverna for distributed collaborative research on free and open source software development using large datasets, computational resources, and reproducible analysis. 2. Taverna is presented as an example of a scientific workflow tool that allows modular development of analysis through reusable components with input and output ports, offering advantages over scripts. 3. An example workflow is shown that calculates network centralization in dynamic networks and generates time series and CSV output for further analysis.

Technology Economy & Finance

eResearch workflows for studying free and open source software development James Howison, Andrea Wiggins, & Kevin Crowston Syracuse University School of Information Studies 9 September 2008 ~ IFIP 2.13 - OSS 2008

eResearch ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Current FLOSS Research Practices ,[object Object],[object Object],[object Object],[object Object],[object Object]

FLOSS Research Repositories Java projects plus user contributions Pilot: KDE Partial: Sourceforge, ObjectWeb, Apache, GNOME Sourceforge Sourceforge, Rubyforge, ObjectWeb, Debian, freshmeat Sample collected In Debian Downloads & pageviews Downloads, pageviews, ratings, in Debian, partial: actual use Use & popularity Size & complexity metrics Planned/pilot: size & complexity metrics SVN/CVS full, size, packages, releases & dates SVN/CVS count, packages, releases & dates SVN/CVS count, packages, releases & dates Software venues Planned/pilot: mail lists & trackers Forums & trackers Releases; in progress: mail lists, forums, trackers Communication venues Memberships & roles Memberships & roles Memberships & roles Developer demographics Basic data & confirmed locations Basic data Basic data Project Demographics Source kibitzer Qualoss & SQO-OSS FLOSSmetrics & CVSAnalY SRDA (Notre Dame) FLOSSmole

Scientific Workflow Tools ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Why Workflows Instead of Scripts? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Taverna Workbench ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Workflow Component Types ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Example Workflow ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Example Output ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Benefits of Using Workflows ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Conclusion ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

More ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Similar to eResearch workflows for studying free and open source software development

Collaborative Data Analysis with Taverna Workflows

Andrea Wiggins

Replicating FLOSS Research as eResearch

Andrea Wiggins

Management of Metadata in Linguistic Fieldwork: Experience from the ACLA Pro...

Baden Hughes

Advances in Scientific Workflow Environments

Carole Goble

Lviv Data Science Club (Sergiy Lunyakin)

Lviv Startup Club

sudoers: Benchmarking Hadoop with ALOJA

Nicolas Poggi

Taverna workflows: provenance and reproducibility - STFC/NERC workshop 2013

anpawlik

ODSC East virtual presentation - The best machine learning, and advanced analytics projects are often stopped when it comes time to move into large scale production, preventing them from ever impacting the business in a meaningful way. Hundreds of hours of work may never get put to use. Python is rapidly becoming the language of choice for scientists and researchers of many types to build, test, train and score models. But when data science models need to go into production, challenges of performance and scale can be a huge roadblock. By combining a Python application with an underlying massively parallel (MPP) database, Python users can achieve a simplified path to production. An MPP database also allows you to do data preparation and data analysis at far greater speeds, accelerating development and testing as well as production performance. It also allows greater numbers of concurrent jobs to run, while also continuously loading data for IoT or other streaming use cases. Analyze data in the database where it sits, rather than first moving it to another framework, then analyzing it, then moving the results, taking multiple performance hits from both CPU and IO for every move and transformation. In this talk, you will learn about combination architectures that can get your work into production, shorten development time, and provide the performance and scale advantages of an MPP database with the convenience and power of Python. Use case examples use the open source Vertica-Python project created by Uber with contributions from Twitter, Palantir, Etsy, Vertica, Kayak and Gooddata.

Python + MPP Database = Large Scale AI/ML Projects in Production Faster

Paige_Roberts

Source-to-source transformations: Supporting tools and infrastructure

kaveirious

Versioning for Workflow Evolution

Eran Chinthaka Withana

3rd presentation

Olabode Ajayi

German Conference on Bioinformatics 2021 https://gcb2021.de/ FAIR Computational Workflows Computational workflows capture precise descriptions of the steps and data dependencies needed to carry out computational data pipelines, analysis and simulations in many areas of Science, including the Life Sciences. The use of computational workflows to manage these multi-step computational processes has accelerated in the past few years driven by the need for scalable data processing, the exchange of processing know-how, and the desire for more reproducible (or at least transparent) and quality assured processing methods. The SARS-CoV-2 pandemic has significantly highlighted the value of workflows. This increased interest in workflows has been matched by the number of workflow management systems available to scientists (Galaxy, Snakemake, Nextflow and 270+ more) and the number of workflow services like registries and monitors. There is also recognition that workflows are first class, publishable Research Objects just as data are. They deserve their own FAIR (Findable, Accessible, Interoperable, Reusable) principles and services that cater for their dual roles as explicit method description and software method execution [1]. To promote long-term usability and uptake by the scientific community, workflows (as well as the tools that integrate them) should become FAIR+R(eproducible), and citable so that author’s credit is attributed fairly and accurately. The work on improving the FAIRness of workflows has already started and a whole ecosystem of tools, guidelines and best practices has been under development to reduce the time needed to adapt, reuse and extend existing scientific workflows. An example is the EOSC-Life Cluster of 13 European Biomedical Research Infrastructures which is developing a FAIR Workflow Collaboratory based on the ELIXIR Research Infrastructure for Life Science Data Tools ecosystem. While there are many tools for addressing different aspects of FAIR workflows, many challenges remain for describing, annotating, and exposing scientific workflows so that they can be found, understood and reused by other scientists. This keynote will explore the FAIR principles for computational workflows in the Life Science using the EOSC-Life Workflow Collaboratory as an example. [1] Carole Goble, Sarah Cohen-Boulakia, Stian Soiland-Reyes,Daniel Garijo, Yolanda Gil, Michael R. Crusoe, Kristian Peters, and Daniel Schober FAIR Computational Workflows Data Intelligence 2020 2:1-2, 108-121 https://doi.org/10.1162/dint_a_00033.

FAIR Computational Workflows

Carole Goble

In this session I'd share the design, architecture and implementation of some of the most common elements of any social platform - Open API, profiles, searches, lists and activity streams. These "pillers" of a social platform bear most of the weight behind a jazzy UI, and scaling them has its own challenges. I will also talk about how we built the Social Platform at IGN from ground up, including not-so-unique challenges like integration with legacy systems.

Silicon Valley Code Camp 2010: Social Platforms : What goes on under the hood

Manish Pandit

Sparkflows.io

sparkflows

Development Practices & The Microsoft Approach

Steve Lange

Apache phoenix

University of Moratuwa

The Taverna Software Suite

myGrid team

The Chemtools LaBLog

Cameron Neylon

Many of the Big Data and IoT use cases are based on combining data from multiple data sources and to make them available on a Big Data platform for analysis. The data sources are often very heterogeneous, from simple files, databases to high-volume event streams from sensors (IoT devices). It’s important to retrieve this data in a secure and reliable manner and integrate it with the Big Data platform so that it is available for analysis in real-time (stream processing) as well as in batch (typical big data processing). In past some new tools have emerged, which are especially capable of handling the process of integrating data from outside, often called Data Ingestion. From an outside perspective, they are very similar to a traditional Enterprise Service Bus infrastructures, which in larger organization are often in use to handle message-driven and service-oriented systems. But there are also important differences, they are typically easier to scale in a horizontal fashion, offer a more distributed setup, are capable of handling high-volumes of data/messages, provide a very detailed monitoring on message level and integrate very well with the Hadoop ecosystem. This session will present and compare Apache Flume, Apache NiFi, StreamSets and the Kafka Ecosystem and show how they handle the data ingestion in a Big Data solution architecture.

Self-Service Data Ingestion Using NiFi, StreamSets & Kafka

Guido Schmutz

DataFinder: A Python Application for Scientific Data Management

Andreas Schreiber

Similar to eResearch workflows for studying free and open source software development (20)

Collaborative Data Analysis with Taverna Workflows

Replicating FLOSS Research as eResearch

Management of Metadata in Linguistic Fieldwork: Experience from the ACLA Pro...

Advances in Scientific Workflow Environments

Lviv Data Science Club (Sergiy Lunyakin)

sudoers: Benchmarking Hadoop with ALOJA

Taverna workflows: provenance and reproducibility - STFC/NERC workshop 2013

Python + MPP Database = Large Scale AI/ML Projects in Production Faster

Source-to-source transformations: Supporting tools and infrastructure

Versioning for Workflow Evolution

3rd presentation

FAIR Computational Workflows

Silicon Valley Code Camp 2010: Social Platforms : What goes on under the hood

Sparkflows.io

Development Practices & The Microsoft Approach

Apache phoenix

The Taverna Software Suite

The Chemtools LaBLog

Self-Service Data Ingestion Using NiFi, StreamSets & Kafka

DataFinder: A Python Application for Scientific Data Management

Recently uploaded

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

Scaling API-first – The story of a global engineering organization

Radu Cotescu

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Data Cloud, More than a CDP by Matt Robison

Anna Loughnan Colquhoun

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Drew Madelung

With more memory available, system performance of three Dell devices increased, which can translate to a better user experience Conclusion When your system has plenty of RAM to meet your needs, you can efficiently access the applications and data you need to finish projects and to-do lists without sacrificing time and focus. Our test results show that with more memory available, three Dell PCs delivered better performance and took less time to complete the Procyon Office Productivity benchmark. These advantages translate to users being able to complete workflows more quickly and multitask more easily. Whether you need the mobility of the Latitude 5440, the creative capabilities of the Precision 3470, or the high performance of the OptiPlex Tower Plus 7010, configuring your system with more RAM can help keep processes running smoothly, enabling you to do more without compromising performance.

Boost PC performance: How more available memory can improve productivity

Principled Technologies

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

MINDCTI Revenue Release Quarter One 2024

MIND CTI

💉💊+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHABI}}+971581248768 +971581248768 Mtp-Kit (500MG) Prices » Dubai [(+971581248768**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Maya Whatsapp +971581248768 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971581248768''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971581248768' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Cl

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@

A Domino Admins Adventures (Engage 2024)

Gabriella Davis

Automating Google Workspace (GWS) & more with Apps Script

wesley chun

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

wesley chun

Discord is a free app offering voice, video, and text chat functionalities, primarily catering to the gaming community. It serves as a hub for users to create and join servers tailored to their interests. Discord’s ecosystem comprises servers, each functioning as a distinct online community with its own channels dedicated to specific topics or activities. Users can engage in text-based discussions, voice calls, or video chats within these channels. Understanding Discord Servers Discord servers are virtual spaces where users congregate to interact, share content, and build communities. Servers may revolve around gaming, hobbies, interests, or fandoms, providing a platform for like-minded individuals to connect. Communication Features Discord offers a range of communication tools, including text channels for messaging, voice channels for real-time audio conversations, and video channels for face-to-face interactions. These features facilitate seamless communication and collaboration. What Does NSFW Mean? The acronym NSFW stands for “Not Safe For Work,” indicating content that may be inappropriate for professional or public settings. NSFW Content NSFW content encompasses material that is sexually explicit, violent, or otherwise graphic in nature. It often includes nudity, profanity, or depictions of sensitive topics.

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

UK Journal

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

A Principled Technologies deployment guide Conclusion Deploying VMware Cloud Foundation 5.1 on next gen Dell PowerEdge servers brings together critical virtualization capabilities and high-performing hardware infrastructure. Relying on our hands-on experience, this deployment guide offers a comprehensive roadmap that can guide your organization through the seamless integration of advanced VMware cloud solutions with the performance and reliability of Dell PowerEdge servers. In addition to the deployment efficiency, the Cloud Foundation 5.1 and PowerEdge solution delivered strong performance while running a MySQL database workload. By leveraging VMware Cloud Foundation 5.1 and PowerEdge servers, you could help your organization embrace cloud computing with confidence, potentially unlocking a new level of agility, scalability, and efficiency in your data center operations.

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Principled Technologies

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Martijn de Jong

Recently uploaded (20)

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Scaling API-first – The story of a global engineering organization

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Data Cloud, More than a CDP by Matt Robison

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Boost PC performance: How more available memory can improve productivity

Boost Fertility New Invention Ups Success Rates.pdf

MINDCTI Revenue Release Quarter One 2024

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

A Domino Admins Adventures (Engage 2024)

Automating Google Workspace (GWS) & more with Apps Script

presentation ICT roal in 21st century education

Powerful Google developer tools for immediate impact! (2023-24 C)

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Artificial Intelligence Chap.5 : Uncertainty

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Strategies for Landing an Oracle DBA Job as a Fresher

2024: Domino Containers - The Next Step. News from the Domino Container commu...

eResearch workflows for studying free and open source software development

1. eResearch workflows for studying free and open source software development James Howison, Andrea Wiggins, & Kevin Crowston Syracuse University School of Information Studies 9 September 2008 ~ IFIP 2.13 - OSS 2008

4. FLOSS Research Repositories Java projects plus user contributions Pilot: KDE Partial: Sourceforge, ObjectWeb, Apache, GNOME Sourceforge Sourceforge, Rubyforge, ObjectWeb, Debian, freshmeat Sample collected In Debian Downloads & pageviews Downloads, pageviews, ratings, in Debian, partial: actual use Use & popularity Size & complexity metrics Planned/pilot: size & complexity metrics SVN/CVS full, size, packages, releases & dates SVN/CVS count, packages, releases & dates SVN/CVS count, packages, releases & dates Software venues Planned/pilot: mail lists & trackers Forums & trackers Releases; in progress: mail lists, forums, trackers Communication venues Memberships & roles Memberships & roles Memberships & roles Developer demographics Basic data & confirmed locations Basic data Basic data Project Demographics Source kibitzer Qualoss & SQO-OSS FLOSSmetrics & CVSAnalY SRDA (Notre Dame) FLOSSmole

5. FLOSS Research Today

6. FLOSS Research Tomorrow?

10. Taverna Design Mode

11. Taverna Execution Mode

12.

13.

14.

15.

16.

17.