Open Science Grid
•
1 like•458 views
This document summarizes the Open Science Grid (OSG), a distributed high throughput computing resource that aggregates computing clusters totaling over 100,000 cores. It provides statistics on OSG usage and describes how OSG can be used by individual researchers and campus clusters to access additional computing and storage resources beyond what is locally available. OSG supports a variety of science domains and thousands of users through login services, job scheduling, software stacks, and large-scale data transfers.
Report
Share
Report
Share
Download to read offline
Recommended
Scalable Clusters On Demand
At Opendoor, we do a lot of big data processing, and use Spark and Dask clusters for the computations. Our machine learning platform is written in Dask and we are actively moving data ingestion pipelines and geo computations to PySpark. The biggest challenge is that jobs vary in memory, cpu needs, and the load in not evenly distributed over time, which causes our workers and clusters to be over-provisioned. In addition to this, we need to enable data scientists and engineers run their code without having to upgrade the cluster for every request and deal with the dependency hell.
To solve all of these problems, we introduce a lightweight integration across some popular tools like Kubernetes, Docker, Airflow and Spark. Using a combination of these tools, we are able to spin up on-demand Spark and Dask clusters for our computing jobs, bring down the cost using autoscaling and spot pricing, unify DAGs across many teams with different stacks on the single Airflow instance, and all of it at minimal cost.
Introducing MagnetoDB, a key-value storage sevice for OpenStack
MagnetoDB is an open source implementation of the Amazon DynamoDB API for OpenStack. It provides a key-value database service for storing unlimited data with scalability and predictable performance. MagnetoDB's API is compatible with existing DynamoDB clients, allowing applications using DynamoDB storage to run on OpenStack. The pilot implementation provides basic CRUD operations for items and tables and is available on GitHub under an Apache 2 license.
Netflix Data Benchmark @ HPTS 2017
Cloud database vendors tend to report performance numbers for the sweet spot or running in highly optimized hardware with specific workload parameters.
Moreover, many of these systems are not tested under different failure scenarios that may appear in the public cloud.
At Netflix, as a cloud-native enterprise, our focus is on high availability. We achieve high availability by deploying at multiple regions.
Hence, our data store system performance is highly affected by our global deployment model, instance types and workload patterns.
Hence, we were interested in a Cloud database benchmark tool that could be deployed in a loosely-coupled fashion, as a microservice, and with the ability to dynamically change the configurations parameters at run time. In this paper, we present Netflix Data Benchmark (NDBench). NDBench offers pluggable patterns and loads and support for different client APIs. It offers the ability to deploy, manage and monitor multiple instances from a single point. NDBench was designed to run for infinite time. This nature offered us with the ability to test long-running database maintenance jobs, test database systems under conditions that affect the performance, such as compactions, repairs etc., and also gives us a view on client side issues like memory leaks and heap pressure. We have been running NDBench for almost 3 years having validated multiple database versions, tested numerous NoSQL systems running on the Cloud, and tested new functionalities. NDBench is major component of our testing and validation pipelines.
Kubernetes best practices.odf
This document outlines several Kubernetes best practices including:
- Using small, secure container images to improve performance and security
- Running containers as non-root users for an extra layer of security
- Organizing workloads into namespaces for isolation, resource utilization, and security
- Implementing liveness and readiness probes to ensure instances are ready to receive traffic
- Setting resource requests and limits to control node resource allocation
- Ensuring applications terminate gracefully through termination grace periods and pre-stop hooks
- Implementing administrative boundaries through namespaces, RBAC, quotas, and policies
CodiLime Tech Talk - Maciej Sawicki: Streamline application deployments with ...
Tech Talk CodiLime 31.01.2018 DevOps by Example
CodiLime Tech Talk - Maciej Sawicki: Streamline application deployments with Kubernetes and Helm
You can find the recording here: https://youtu.be/6hazvmPOWHY
SANSA ISWC 2017 Talk
The document discusses combining big data processing frameworks like Spark and Flink with semantic technologies. It presents SANSA, a system that loads RDF data into Spark and enables distributed semantic processing including querying, reasoning, and analytics. SANSA allows expressing ontologies and rules as RDDs to leverage Spark's scalability while supporting W3C standards like RDF and OWL. The document provides examples of using SANSA to load and partition RDF graphs, perform reasoning using rules, and write inferred data back to disk.
Ryan Betts [InfluxData] | InfluxDB Platform Performance | InfluxDays Virtual ...
The document discusses updates and new features for InfluxDB Platform in year 1, including new AWS regions for InfluxDB Cloud, pricing and signup improvements, expanded Telegraf plugin and SDK support, InfluxDB templates for sharing configurations, performance improvements for querying and visualizing data, alerting capabilities, and open sourcing InfluxDB 2.0 with a single binary. It also advertises upcoming talks on integrating OSS at the edge and Cloud at the core, and seamlessly migrating from InfluxDB 1.x to 2.0.
Building an open data platform with apache iceberg
Alluxio Day VIII
December 14, 2021
https://www.alluxio.io/alluxio-day/
Speaker:
Ryan Blue, Apache Iceberg
Recommended
Scalable Clusters On Demand
At Opendoor, we do a lot of big data processing, and use Spark and Dask clusters for the computations. Our machine learning platform is written in Dask and we are actively moving data ingestion pipelines and geo computations to PySpark. The biggest challenge is that jobs vary in memory, cpu needs, and the load in not evenly distributed over time, which causes our workers and clusters to be over-provisioned. In addition to this, we need to enable data scientists and engineers run their code without having to upgrade the cluster for every request and deal with the dependency hell.
To solve all of these problems, we introduce a lightweight integration across some popular tools like Kubernetes, Docker, Airflow and Spark. Using a combination of these tools, we are able to spin up on-demand Spark and Dask clusters for our computing jobs, bring down the cost using autoscaling and spot pricing, unify DAGs across many teams with different stacks on the single Airflow instance, and all of it at minimal cost.
Introducing MagnetoDB, a key-value storage sevice for OpenStack
MagnetoDB is an open source implementation of the Amazon DynamoDB API for OpenStack. It provides a key-value database service for storing unlimited data with scalability and predictable performance. MagnetoDB's API is compatible with existing DynamoDB clients, allowing applications using DynamoDB storage to run on OpenStack. The pilot implementation provides basic CRUD operations for items and tables and is available on GitHub under an Apache 2 license.
Netflix Data Benchmark @ HPTS 2017
Cloud database vendors tend to report performance numbers for the sweet spot or running in highly optimized hardware with specific workload parameters.
Moreover, many of these systems are not tested under different failure scenarios that may appear in the public cloud.
At Netflix, as a cloud-native enterprise, our focus is on high availability. We achieve high availability by deploying at multiple regions.
Hence, our data store system performance is highly affected by our global deployment model, instance types and workload patterns.
Hence, we were interested in a Cloud database benchmark tool that could be deployed in a loosely-coupled fashion, as a microservice, and with the ability to dynamically change the configurations parameters at run time. In this paper, we present Netflix Data Benchmark (NDBench). NDBench offers pluggable patterns and loads and support for different client APIs. It offers the ability to deploy, manage and monitor multiple instances from a single point. NDBench was designed to run for infinite time. This nature offered us with the ability to test long-running database maintenance jobs, test database systems under conditions that affect the performance, such as compactions, repairs etc., and also gives us a view on client side issues like memory leaks and heap pressure. We have been running NDBench for almost 3 years having validated multiple database versions, tested numerous NoSQL systems running on the Cloud, and tested new functionalities. NDBench is major component of our testing and validation pipelines.
Kubernetes best practices.odf
This document outlines several Kubernetes best practices including:
- Using small, secure container images to improve performance and security
- Running containers as non-root users for an extra layer of security
- Organizing workloads into namespaces for isolation, resource utilization, and security
- Implementing liveness and readiness probes to ensure instances are ready to receive traffic
- Setting resource requests and limits to control node resource allocation
- Ensuring applications terminate gracefully through termination grace periods and pre-stop hooks
- Implementing administrative boundaries through namespaces, RBAC, quotas, and policies
CodiLime Tech Talk - Maciej Sawicki: Streamline application deployments with ...
Tech Talk CodiLime 31.01.2018 DevOps by Example
CodiLime Tech Talk - Maciej Sawicki: Streamline application deployments with Kubernetes and Helm
You can find the recording here: https://youtu.be/6hazvmPOWHY
SANSA ISWC 2017 Talk
The document discusses combining big data processing frameworks like Spark and Flink with semantic technologies. It presents SANSA, a system that loads RDF data into Spark and enables distributed semantic processing including querying, reasoning, and analytics. SANSA allows expressing ontologies and rules as RDDs to leverage Spark's scalability while supporting W3C standards like RDF and OWL. The document provides examples of using SANSA to load and partition RDF graphs, perform reasoning using rules, and write inferred data back to disk.
Ryan Betts [InfluxData] | InfluxDB Platform Performance | InfluxDays Virtual ...
The document discusses updates and new features for InfluxDB Platform in year 1, including new AWS regions for InfluxDB Cloud, pricing and signup improvements, expanded Telegraf plugin and SDK support, InfluxDB templates for sharing configurations, performance improvements for querying and visualizing data, alerting capabilities, and open sourcing InfluxDB 2.0 with a single binary. It also advertises upcoming talks on integrating OSS at the edge and Cloud at the core, and seamlessly migrating from InfluxDB 1.x to 2.0.
Building an open data platform with apache iceberg
Alluxio Day VIII
December 14, 2021
https://www.alluxio.io/alluxio-day/
Speaker:
Ryan Blue, Apache Iceberg
[WSO2Con Asia 2018] Architecting for Container-native Environments
Cloud native applications take advantage of cloud characteristics by using microservices architectures and containers. Microservices allow each service to have a single focus, be loosely coupled, lightweight, and highly scalable. Containers enable fast, immutable deployments and optimize resource usage. Orchestration tools like Kubernetes manage containers and provide additional capabilities like networking and scaling. Observability tools provide monitoring, logging, and distributed tracing to gain insights into application performance and issues.
Google cloud infrastructure workshop
This document outlines an agenda for a Google Cloud Infrastructure workshop. The workshop will provide an overview of Google Cloud Platform, including its core computing and storage services. It will also cover hands-on labs and quests using Qwiklabs to practice deploying and developing applications on Google Cloud. The instructor, Akash Agrawal, will discuss his background and provide resources for learning more about Google Cloud Platform.
Cloud computing course introduction
Cloud computing allows applications and services to be accessed from anywhere via the internet. Windows Azure is Microsoft's cloud computing platform, running on data centers around the world. It provides infrastructure as a service (IaaS), platform as a service (PaaS), and software as a service (SaaS). Windows Azure uses compute and storage nodes, as well as app fabrics and Azure Connect to host and connect applications in a scalable and available manner. Courses are available to learn about Windows Azure's compute and storage nodes, as well as app fabrics and mobile application development capabilities.
[WSO2Con USA 2018] Microservices, Containers, and Beyond
This slide deck discusses what's next in this highly agile, massively distributed environment. It will focus on fine-tuned DevOps processes, governance, and observability in a massively distributed container native microservices platform.
OpenStack MagnetoDB. Atlanta Summit 2014
MagnetoDB presentation at Atlanta OpenStack Summit.
Agenda
========
MagnetoDB overview
Live demo
MagnetoDB Juno Roadmap
Q&A
MagnetoDB - the key-value database service with OpenStack native RESTful and Amazon DynamoDB API, predictable performance and seamless scalability
MagnetoDB key features
==================
REST API
Schemaless, non-relational table-based model
Put/get/query/scan item operations
Eventual and strong consistency
Local Secondary indexes
Batch read/write operations
DynamoDB API support
Seamless throughput and storage scaling
Fault tolerance
MagnetoDB use cases
=================
High request traffic level applications
Time series data
Queries are distributed across the data
Any other applications
Migration of workloads between AWS and OpenStack
Architecture highlights
================
Layered architecture
Horizontally scalable
Pluggable database backend
Leverage of existing OpenStack services
OpenStack HEAT
OpenStack Neutron LoadBalancer
OpenStack Trove
Current status
============
MagnetoDB 2.0.x released
Stackforge project, openstack community processes
OpenStack native API
Keystone v3 support
Multi-tenancy enforcement
Tempest tests (149 passed)
Devstack integration
Deployable to Vanilla OpenStack
Compatible with existing DynamoDB clients
Juno roadmap
===========
Incubation
Community
Enlarge core team
Features
python-magnetodb client
Tunable consistency
Atomic counters
Ceilometer monitoring integration
Other features
Quota management
more https://etherpad.openstack.org/p/magnetodb-juno-roadmap
Netflix Titus WASP October 2017
This document discusses Netflix's use of containers and the Titus container management platform. It provides the following key points:
1. Titus provides container scheduling, resource management, and execution capabilities. It helps Netflix achieve consistent developer experiences, faster innovation, and simpler deployments.
2. Titus has scaled to support over 1,000,000 daily container launches across multiple AWS regions. It integrates containers into Netflix's infrastructure and provides features like VPC networking and AWS integration.
3. Looking ahead, Netflix aims to further improve Titus' performance, operations, reliability, and scheduling capabilities to support even larger container workloads. Deeper security isolation and integration with services like ALB are also goals.
MicroService architecture_&_Kubernetes
This document discusses using microservice architecture with Kubernetes. It begins with an overview of microservice architecture compared to traditional monolithic architecture and its benefits. It then covers Kubernetes and containers, the Kubernetes architecture and components, and managed Kubernetes services like Google Kubernetes Engine. It proposes combining microservices, containers, Kubernetes, and services like Istio and GKE to build microservices applications at scale. The presenter is introduced as an expert with experience implementing such architectures for clients.
Apache Cassandra Lunch #52: Airflow and Cassandra for Cluster Management
In Apache Cassandra Lunch #52: Airflow and Cassandra for Cluster Management, we discussed using Airflow to schedule tasks on a Cassandra cluster beyond what could be accomplished with the Cassandra provider package.
Webinar: Building a multi-cloud Kubernetes storage on GitLab
In this webinar, we talk about how to set up redundant and highly available storage for your repos to make your key repositories easier to deploy, more reliable, and easier to back up or move to a different cloud. We reviewed the current practices for highly-available CI/CD and showcased how there’s a better way to do it with OpenEBS.
MongoDB IoT City Tour LONDON: Managing the Database Complexity, by Arthur Vie...
Arthur Viegers, Senior Solutions Architect, MongoDB.
The value of the fast growing class of NoSQL databases is the ability to handle high velocity and volumes of data while enabling greater agility with dynamic schemas. MongoDB gives you those benefits while also providing a rich querying capability and a document model for developer productivity. Arthur Viegers outlines the reasons for MongoDB's popularity in IoT applications and how you can leverage the core concepts of NoSQL to build robust and highly scalable IoT applications.
Proteon - DevOps Live 2019 - OpenShift Pitfalls
In these slides Alwyn explains various pitfalls to look out for in OpenShift, and our recommended approach.
[WSO2Con EU 2018] Deploying Applications in K8S and Docker
Within the last four years container technologies have become very popular. A lot of companies and developers are now using containers to ship their applications. Docker provides an easy-to-use packaging model to bundle the application. However in many cases, a single container is not enough to run an application. It requires multiple containers, scaled into multiple host machines to become a production grade deployment. Kubernetes is an open source system for automating deployment, scaling, and management of containerized applications. It groups containers that make up an application into logical units for easy management and discovery. This presentation discusses best practices of deploying application in Docker and Kubernetes while discussing Docker and Kubernetes concepts.
FIWARE Global Summit - DRACO: Managing the Stream of Context Information Hist...
Presentation by Joaquin Salvachúa (Professor, UPM) & Andres Muñoz (Professor, UPM)
FIWARE Global Summit
21-22 May 2019 - Genoa, Italy
Intro to creating kubernetes operators
This document provides an introduction to Kubernetes operators and the Java Operator SDK framework. It begins with an overview of operators and how they extend the Kubernetes API using custom resource definitions (CRDs). A simple web server example is demonstrated. The document then discusses how the Java Operator SDK addresses common problems like concurrency handling and retries. It also covers features like finalizers, event sources, and integration with Java frameworks. In comparison to Terraform, operators are meant to manage resources, while Terraform provisions resources managed by cloud providers. The status of custom resources in operators is analogous to state in Terraform.
BigData in IoT #iotconfua
The document discusses using Lambda architecture for big data analytics in IoT applications. It describes the traditional challenges of device, server, and orchestration architecture and proposes using DeviceHive as an open source framework. DeviceHive uses a Lambda architecture approach with Kafka for streaming data to Cassandra and a batch layer. It also discusses deploying such a system using containers and services like Juju, Mesos, and Docker. Visualization tools like Freeboard, ELK, Spark Streaming, and Zeppelin are proposed for analysis and visualization of the IoT data.
Google Kubernetes Engine (GKE) deep dive
This document provides an overview of Google Kubernetes Engine (GKE) including its architecture and request flow. It discusses GKE features like node pools, cluster scoping, auto repair, and integration with other Google Cloud services. The presenter then covers getting started with GKE, best practices for production usage, and the broader GKE ecosystem which includes GKE, GKE On-Prem, Anthos, and Cloud Run.
Introducing TiDB Operator [Cologne, Germany]
This slide was delivered at the Kubernetes/Docker meetup in Cologne, Germany, hosted by Giant Swarms on how TiDB, an open source NewSQL distributed database, is deployed and managed on any Kubernetes-enabled cloud environment by applying the Operator pattern.
Sharing our best secrets: Design a distributed system from scratch
The document summarizes a system design workshop for designing a note-taking application called TechyNotes. The workshop covers defining system requirements and interfaces, discussing database and storage options, designing initial and revised system architectures, and addressing scalability bottlenecks. Attendees learn a repeatable process for system design and discuss technologies like databases, load balancing, caching, and queues.
Netflix Container Scheduling and Execution - QCon New York 2016
Scheduling a Fuller House: Container Management At Netflix
Customers from over all over the world streamed Forty Two Billion hours of Netflix content last year. Various Netflix batch jobs and an increasing number of service applications use containers for their processing. In this talk Netflix will present a deep dive on the motivations and the technology powering container deployment on top of the AWS EC2 service. The talk will cover our approach to cloud resource management and scheduling with the open source Fenzo library, along with details on docker execution engine as a part of project Titus. As well, the talk will share some of the results so far, lessons learned, and end with a brief look at the developer experience for containers.
Initial presentation of openstack (for montreal user group)
Introduction to Openstack: basic concepts, latest Havana project release, cloud terminology (including IaaS, PaaS and SaaS). This presentation was shown in the first Openstack Montreal user group in November 19 2013 (http://montrealopenstack.org/)
The Open Science Grid
Presented at the New Mexico Technology in Education Conference, University of New Mexico, November18, 2015
FutureGrid Computing Testbed as a Service
Describes FutureGrid and its role as a Computing Testbed as a Service. FutureGrid is user-customizable, accessed interactively and supports Grid, Cloud and HPC software with and without VM’s. Lessons learnt and example use cases are described
More Related Content
What's hot
[WSO2Con Asia 2018] Architecting for Container-native Environments
Cloud native applications take advantage of cloud characteristics by using microservices architectures and containers. Microservices allow each service to have a single focus, be loosely coupled, lightweight, and highly scalable. Containers enable fast, immutable deployments and optimize resource usage. Orchestration tools like Kubernetes manage containers and provide additional capabilities like networking and scaling. Observability tools provide monitoring, logging, and distributed tracing to gain insights into application performance and issues.
Google cloud infrastructure workshop
This document outlines an agenda for a Google Cloud Infrastructure workshop. The workshop will provide an overview of Google Cloud Platform, including its core computing and storage services. It will also cover hands-on labs and quests using Qwiklabs to practice deploying and developing applications on Google Cloud. The instructor, Akash Agrawal, will discuss his background and provide resources for learning more about Google Cloud Platform.
Cloud computing course introduction
Cloud computing allows applications and services to be accessed from anywhere via the internet. Windows Azure is Microsoft's cloud computing platform, running on data centers around the world. It provides infrastructure as a service (IaaS), platform as a service (PaaS), and software as a service (SaaS). Windows Azure uses compute and storage nodes, as well as app fabrics and Azure Connect to host and connect applications in a scalable and available manner. Courses are available to learn about Windows Azure's compute and storage nodes, as well as app fabrics and mobile application development capabilities.
[WSO2Con USA 2018] Microservices, Containers, and Beyond
This slide deck discusses what's next in this highly agile, massively distributed environment. It will focus on fine-tuned DevOps processes, governance, and observability in a massively distributed container native microservices platform.
OpenStack MagnetoDB. Atlanta Summit 2014
MagnetoDB presentation at Atlanta OpenStack Summit.
Agenda
========
MagnetoDB overview
Live demo
MagnetoDB Juno Roadmap
Q&A
MagnetoDB - the key-value database service with OpenStack native RESTful and Amazon DynamoDB API, predictable performance and seamless scalability
MagnetoDB key features
==================
REST API
Schemaless, non-relational table-based model
Put/get/query/scan item operations
Eventual and strong consistency
Local Secondary indexes
Batch read/write operations
DynamoDB API support
Seamless throughput and storage scaling
Fault tolerance
MagnetoDB use cases
=================
High request traffic level applications
Time series data
Queries are distributed across the data
Any other applications
Migration of workloads between AWS and OpenStack
Architecture highlights
================
Layered architecture
Horizontally scalable
Pluggable database backend
Leverage of existing OpenStack services
OpenStack HEAT
OpenStack Neutron LoadBalancer
OpenStack Trove
Current status
============
MagnetoDB 2.0.x released
Stackforge project, openstack community processes
OpenStack native API
Keystone v3 support
Multi-tenancy enforcement
Tempest tests (149 passed)
Devstack integration
Deployable to Vanilla OpenStack
Compatible with existing DynamoDB clients
Juno roadmap
===========
Incubation
Community
Enlarge core team
Features
python-magnetodb client
Tunable consistency
Atomic counters
Ceilometer monitoring integration
Other features
Quota management
more https://etherpad.openstack.org/p/magnetodb-juno-roadmap
Netflix Titus WASP October 2017
This document discusses Netflix's use of containers and the Titus container management platform. It provides the following key points:
1. Titus provides container scheduling, resource management, and execution capabilities. It helps Netflix achieve consistent developer experiences, faster innovation, and simpler deployments.
2. Titus has scaled to support over 1,000,000 daily container launches across multiple AWS regions. It integrates containers into Netflix's infrastructure and provides features like VPC networking and AWS integration.
3. Looking ahead, Netflix aims to further improve Titus' performance, operations, reliability, and scheduling capabilities to support even larger container workloads. Deeper security isolation and integration with services like ALB are also goals.
MicroService architecture_&_Kubernetes
This document discusses using microservice architecture with Kubernetes. It begins with an overview of microservice architecture compared to traditional monolithic architecture and its benefits. It then covers Kubernetes and containers, the Kubernetes architecture and components, and managed Kubernetes services like Google Kubernetes Engine. It proposes combining microservices, containers, Kubernetes, and services like Istio and GKE to build microservices applications at scale. The presenter is introduced as an expert with experience implementing such architectures for clients.
Apache Cassandra Lunch #52: Airflow and Cassandra for Cluster Management
In Apache Cassandra Lunch #52: Airflow and Cassandra for Cluster Management, we discussed using Airflow to schedule tasks on a Cassandra cluster beyond what could be accomplished with the Cassandra provider package.
Webinar: Building a multi-cloud Kubernetes storage on GitLab
In this webinar, we talk about how to set up redundant and highly available storage for your repos to make your key repositories easier to deploy, more reliable, and easier to back up or move to a different cloud. We reviewed the current practices for highly-available CI/CD and showcased how there’s a better way to do it with OpenEBS.
MongoDB IoT City Tour LONDON: Managing the Database Complexity, by Arthur Vie...
Arthur Viegers, Senior Solutions Architect, MongoDB.
The value of the fast growing class of NoSQL databases is the ability to handle high velocity and volumes of data while enabling greater agility with dynamic schemas. MongoDB gives you those benefits while also providing a rich querying capability and a document model for developer productivity. Arthur Viegers outlines the reasons for MongoDB's popularity in IoT applications and how you can leverage the core concepts of NoSQL to build robust and highly scalable IoT applications.
Proteon - DevOps Live 2019 - OpenShift Pitfalls
In these slides Alwyn explains various pitfalls to look out for in OpenShift, and our recommended approach.
[WSO2Con EU 2018] Deploying Applications in K8S and Docker
Within the last four years container technologies have become very popular. A lot of companies and developers are now using containers to ship their applications. Docker provides an easy-to-use packaging model to bundle the application. However in many cases, a single container is not enough to run an application. It requires multiple containers, scaled into multiple host machines to become a production grade deployment. Kubernetes is an open source system for automating deployment, scaling, and management of containerized applications. It groups containers that make up an application into logical units for easy management and discovery. This presentation discusses best practices of deploying application in Docker and Kubernetes while discussing Docker and Kubernetes concepts.
FIWARE Global Summit - DRACO: Managing the Stream of Context Information Hist...
Presentation by Joaquin Salvachúa (Professor, UPM) & Andres Muñoz (Professor, UPM)
FIWARE Global Summit
21-22 May 2019 - Genoa, Italy
Intro to creating kubernetes operators
This document provides an introduction to Kubernetes operators and the Java Operator SDK framework. It begins with an overview of operators and how they extend the Kubernetes API using custom resource definitions (CRDs). A simple web server example is demonstrated. The document then discusses how the Java Operator SDK addresses common problems like concurrency handling and retries. It also covers features like finalizers, event sources, and integration with Java frameworks. In comparison to Terraform, operators are meant to manage resources, while Terraform provisions resources managed by cloud providers. The status of custom resources in operators is analogous to state in Terraform.
BigData in IoT #iotconfua
The document discusses using Lambda architecture for big data analytics in IoT applications. It describes the traditional challenges of device, server, and orchestration architecture and proposes using DeviceHive as an open source framework. DeviceHive uses a Lambda architecture approach with Kafka for streaming data to Cassandra and a batch layer. It also discusses deploying such a system using containers and services like Juju, Mesos, and Docker. Visualization tools like Freeboard, ELK, Spark Streaming, and Zeppelin are proposed for analysis and visualization of the IoT data.
Google Kubernetes Engine (GKE) deep dive
This document provides an overview of Google Kubernetes Engine (GKE) including its architecture and request flow. It discusses GKE features like node pools, cluster scoping, auto repair, and integration with other Google Cloud services. The presenter then covers getting started with GKE, best practices for production usage, and the broader GKE ecosystem which includes GKE, GKE On-Prem, Anthos, and Cloud Run.
Introducing TiDB Operator [Cologne, Germany]
This slide was delivered at the Kubernetes/Docker meetup in Cologne, Germany, hosted by Giant Swarms on how TiDB, an open source NewSQL distributed database, is deployed and managed on any Kubernetes-enabled cloud environment by applying the Operator pattern.
Sharing our best secrets: Design a distributed system from scratch
The document summarizes a system design workshop for designing a note-taking application called TechyNotes. The workshop covers defining system requirements and interfaces, discussing database and storage options, designing initial and revised system architectures, and addressing scalability bottlenecks. Attendees learn a repeatable process for system design and discuss technologies like databases, load balancing, caching, and queues.
Netflix Container Scheduling and Execution - QCon New York 2016
Scheduling a Fuller House: Container Management At Netflix
Customers from over all over the world streamed Forty Two Billion hours of Netflix content last year. Various Netflix batch jobs and an increasing number of service applications use containers for their processing. In this talk Netflix will present a deep dive on the motivations and the technology powering container deployment on top of the AWS EC2 service. The talk will cover our approach to cloud resource management and scheduling with the open source Fenzo library, along with details on docker execution engine as a part of project Titus. As well, the talk will share some of the results so far, lessons learned, and end with a brief look at the developer experience for containers.
Initial presentation of openstack (for montreal user group)
Introduction to Openstack: basic concepts, latest Havana project release, cloud terminology (including IaaS, PaaS and SaaS). This presentation was shown in the first Openstack Montreal user group in November 19 2013 (http://montrealopenstack.org/)
What's hot (20)
[WSO2Con Asia 2018] Architecting for Container-native Environments
[WSO2Con Asia 2018] Architecting for Container-native Environments
[WSO2Con USA 2018] Microservices, Containers, and Beyond
[WSO2Con USA 2018] Microservices, Containers, and Beyond
Apache Cassandra Lunch #52: Airflow and Cassandra for Cluster Management
Apache Cassandra Lunch #52: Airflow and Cassandra for Cluster Management
Webinar: Building a multi-cloud Kubernetes storage on GitLab
Webinar: Building a multi-cloud Kubernetes storage on GitLab
MongoDB IoT City Tour LONDON: Managing the Database Complexity, by Arthur Vie...
MongoDB IoT City Tour LONDON: Managing the Database Complexity, by Arthur Vie...
[WSO2Con EU 2018] Deploying Applications in K8S and Docker
[WSO2Con EU 2018] Deploying Applications in K8S and Docker
FIWARE Global Summit - DRACO: Managing the Stream of Context Information Hist...
FIWARE Global Summit - DRACO: Managing the Stream of Context Information Hist...
Sharing our best secrets: Design a distributed system from scratch
Sharing our best secrets: Design a distributed system from scratch
Netflix Container Scheduling and Execution - QCon New York 2016
Netflix Container Scheduling and Execution - QCon New York 2016
Initial presentation of openstack (for montreal user group)
Initial presentation of openstack (for montreal user group)
Similar to Open Science Grid
The Open Science Grid
Presented at the New Mexico Technology in Education Conference, University of New Mexico, November18, 2015
FutureGrid Computing Testbed as a Service
Describes FutureGrid and its role as a Computing Testbed as a Service. FutureGrid is user-customizable, accessed interactively and supports Grid, Cloud and HPC software with and without VM’s. Lessons learnt and example use cases are described
Public Cloud Workshop
The document discusses public cloud computing concepts including cloud infrastructure, services, and architectures. Some key points:
- Cloud provides on-demand access to computing resources like servers and storage over the internet. Major cloud providers include AWS, Azure, and Google Cloud.
- Cloud services include Infrastructure as a Service (IaaS), Platform as a Service (PaaS), Software as a Service (SaaS), and Function as a Service (FaaS).
- Microservices architecture breaks applications into small, independent services that communicate over the network. This allows independent scaling and improves resilience.
- Auto scaling helps automatically scale cloud resources like servers up and down based on demand to optimize costs and performance.
A performance analysis of OpenStack Cloud vs Real System on Hadoop Clusters
It introduces the performance analysis of OpenStack Cloud with the commodity computers in the big data environments. It concludes that the data storage and analysis in hadoop cluster in cloud is more flexible and easily scalable than the real system cluster. It also concludes the cluster in commodities computers are faster than the cloud clusters.
Get Your Head in the Cloud - Lessons in GPU Computing with Schlumberger
In this presentation from the GPU Technology Conference, Wyatt Gorman from Google and Abhishek Gupta from Schlumberger present: Get Your Head in the Cloud - Lessons in GPU Computing with Schlumberger.
"Demand for GPUs in High Performance Computing is only growing, and it is costly and difficult to keep pace in an entirely on-premise environment. We will hear from Schlumberger on why and how they are utilizing cloud-based GPU-enabled computing resources from Google Cloud to supply their users with the computing power they need, from exploration and modeling to visualization."
Watch the video: https://wp.me/p3RLHQ-kcl
Learn more: https://www.blog.google/products/google-cloud/schlumberger-chooses-gcp-to-deliver-new-oil-and-gas-technology-platform/
and
https://www.nvidia.com/en-us/gtc/
Migrate to Microservices Judiciously!
This presentation covers some aspects of migrating of a monolithic application to Microservices architectural style.
BigData Hadoop
This document summarizes a summer training seminar on BigData Hadoop that was attended. The training was provided by LinuxWorld Informatics Pvt Ltd, which offers open source and commercial training programs. The attendee learned about Hadoop, MapReduce, single and multi-node clusters, Docker, and Ansible. Big data challenges related to volume, variety, velocity, and veracity of data were also covered. Hadoop and its core components HDFS and MapReduce were explained as solutions for storing and processing large datasets in a distributed manner across commodity hardware. Docker containers were introduced as a lightweight alternative to virtual machines.
Easy Microservices with JHipster - Devoxx BE 2017
10,000 microservices are generated each month using JHipster!
During this in-depth session by the two JHipster lead developers, we’ll detail:
How to develop and deploy microservices easily
Scalability and failover of microservices
The JHipster Registry for scaling, configuring and monitoring microservices
Common architecture patterns and pitfalls
Devoxx Belgium 2017 - easy microservices with JHipster
Slides from the "easy microservices with JHipster" session by Julien Dubois and Deepu K Sasidharan at Devoxx Belgium 2017
DOC ROI Presentation 2pm NZ3 - Duane Wilkins
This document discusses the Department of Conservation's (DOC) use of GIS technology. It outlines DOC's vision for GIS, including moving towards centralized, integrated, enterprise-level applications. Examples are provided of successful GIS applications created for DOC, including Discover the Outdoors, DOCgis, and tools for operational activities. Benefits realized from these applications are highlighted, such as improved access to data and reduced costs. Future goals are mentioned, such as expanding self-service access to data and applications.
Hungarian ClusterGrid and its applications
This document summarizes the Hungarian ClusterGrid and its applications. ClusterGrid integrates individual clusters and supercomputers with grid middleware. It currently includes 1000 nodes across 32 cluster sites providing 22 TB of distributed storage. A new generation middleware called Grid Underground has been developed which uses a pure web services approach. Core services include security, job management, and storage. One application involved virtual screening of 8 million molecules to identify potential new medicines.
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
TubeMogul grew from few servers to over two thousands servers and handling over one trillion http requests a month, processed in less than 50ms each. To keep up with the fast growth, the SRE team had to implement an efficient Continuous Delivery infrastructure that allowed to do over 10,000 puppet deployment and 8,500 application deployment in 2014. In this presentation, we will cover the nuts and bolts of the TubeMogul operations engineering team and how they overcome challenges.
DDDP 2019 - Brown to Green
Brown to Green
An Open Platform for Evolutionary Architecture - Connecting a Secure Edge to Intelligent Apps
Amruth_Kumar_Juturu_Resume
Amruth Kumar Juturu is a computer science graduate with a Master's degree from Texas A&M University and a Bachelor's degree from Indian Institute of Information Technology. He has work experience as an intern at Nvidia and as a senior software developer at Citrix R&D India. Currently he is a graduate assistant at the Supercomputing Facility at TAMU where he provides technical support to users. He has strong skills in programming languages like C/C++, Java, Python and tools like MPI, OpenMP, CUDA. His academic and work projects include developing a virtual machine manager, transport drivers, proxy servers and device overlays.
Red Hat Java Update and Quarkus Introduction
Presentation for the Houston Java Users Group to celebrate 22 years of HJUG. Introduction to Quarkus.io for Java containers and serverless.
Lecture_IIITD.pptx
The document discusses IoT, edge computing, and machine learning. It provides an overview of edge computing and how it differs from cloud computing by processing data near its source to improve response times. It also discusses edge intelligence, which combines AI and edge computing by enabling machine learning algorithms to run on edge devices. The document outlines some challenges in edge computing like real-time scheduling on reconfigurable platforms. It summarizes some of the speaker's research on techniques like voltage scaling partitions to enable low-power edge inference on FPGAs.
Ci Connect: A service for building multi-institutional cluster environments
Rob Gardner presented CI Connect, a service that builds multi-institutional cluster environments using existing technologies like Globus, HTCondor, and Xrootd. It allows small research groups to access distributed high throughput computing resources through virtual clusters. The service also extends the capacity of ATLAS Tier3 clusters. Upcoming work includes automating provisioning to easily configure sharing among campuses with minimal operational effort at resource sites.
Hpc lunch and learn
This document discusses ideas and technologies for building scalable software systems and processing big data. It covers:
1. Bi-modal distribution of developers shapes architecture/design and the need for loosely/tightly coupled code.
2. Internet companies like Google and Facebook innovate at large scale using open source tools and REST architectures.
3. A REST architecture allows scalability, extensible development, and integration of tools/ideas from the internet for non-internet applications.
Globus toolkit in grid
For more information visit http://www.presentationat.blogspot.in/
Paper Presentation on:Globus toolkit in grid
Spark Driven Big Data Analytics
This document provides an overview of Spark driven big data analytics. It begins by defining big data and its characteristics. It then discusses the challenges of traditional analytics on big data and how Apache Spark addresses these challenges. Spark improves on MapReduce by allowing distributed datasets to be kept in memory across clusters. This enables faster iterative and interactive processing. The document outlines Spark's architecture including its core components like RDDs, transformations, actions and DAG execution model. It provides examples of writing Spark applications in Java and Java 8 to perform common analytics tasks like word count.
Similar to Open Science Grid (20)
A performance analysis of OpenStack Cloud vs Real System on Hadoop Clusters
A performance analysis of OpenStack Cloud vs Real System on Hadoop Clusters
Get Your Head in the Cloud - Lessons in GPU Computing with Schlumberger
Get Your Head in the Cloud - Lessons in GPU Computing with Schlumberger
Devoxx Belgium 2017 - easy microservices with JHipster
Devoxx Belgium 2017 - easy microservices with JHipster
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
Ci Connect: A service for building multi-institutional cluster environments
Ci Connect: A service for building multi-institutional cluster environments
Recently uploaded
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
原版纸张【微信：741003700 】【(uvic毕业证书)维多利亚大学毕业证】【微信：741003700 】学位证，留信认证（真实可查，永久存档）offer、雅思、外壳等材料/诚信可靠,可直接看成品样本，帮您解决无法毕业带来的各种难题！外壳，原版制作，诚信可靠，可直接看成品样本。行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备。十五年致力于帮助留学生解决难题，包您满意。
本公司拥有海外各大学样板无数，能完美还原海外各大学 Bachelor Diploma degree, Master Degree Diploma
1:1完美还原海外各大学毕业材料上的工艺：水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠。文字图案浮雕、激光镭射、紫外荧光、温感、复印防伪等防伪工艺。材料咨询办理、认证咨询办理请加学历顾问Q/微741003700
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
8.Isolation of pure cultures and preservation of cultures.pdf
Isolation of pure culture, its various method.
Cytokines and their role in immune regulation.pptx
This presentation covers the content and information on "Cytokines " and their role in immune regulation .
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...University of Maribor
Slides from talk:
Aleš Zamuda: Remote Sensing and Computational, Evolutionary, Supercomputing, and Intelligent Systems.
11th International Conference on Electrical, Electronics and Computer Engineering (IcETRAN), Niš, 3-6 June 2024
Inter-Society Networking Panel GRSS/MTT-S/CIS Panel Session: Promoting Connection and Cooperation
https://www.etran.rs/2024/en/home-english/Deep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless ReproducibilityUniversity of Rennes, INSA Rennes, Inria/IRISA, CNRS
The ability to recreate computational results with minimal effort and actionable metrics provides a solid foundation for scientific research and software development. When people can replicate an analysis at the touch of a button using open-source software, open data, and methods to assess and compare proposals, it significantly eases verification of results, engagement with a diverse range of contributors, and progress. However, we have yet to fully achieve this; there are still many sociotechnical frictions.
Inspired by David Donoho's vision, this talk aims to revisit the three crucial pillars of frictionless reproducibility (data sharing, code sharing, and competitive challenges) with the perspective of deep software variability.
Our observation is that multiple layers — hardware, operating systems, third-party libraries, software versions, input data, compile-time options, and parameters — are subject to variability that exacerbates frictions but is also essential for achieving robust, generalizable results and fostering innovation. I will first review the literature, providing evidence of how the complex variability interactions across these layers affect qualitative and quantitative software properties, thereby complicating the reproduction and replication of scientific studies in various fields.
I will then present some software engineering and AI techniques that can support the strategic exploration of variability spaces. These include the use of abstractions and models (e.g., feature models), sampling strategies (e.g., uniform, random), cost-effective measurements (e.g., incremental build of software configurations), and dimensionality reduction methods (e.g., transfer learning, feature selection, software debloating).
I will finally argue that deep variability is both the problem and solution of frictionless reproducibility, calling the software science community to develop new methods and tools to manage variability and foster reproducibility in software systems.
Exposé invité Journées Nationales du GDR GPL 2024
Phenomics assisted breeding in crop improvement
As the population is increasing and will reach about 9 billion upto 2050. Also due to climate change, it is difficult to meet the food requirement of such a large population. Facing the challenges presented by resource shortages, climate
change, and increasing global population, crop yield and quality need to be improved in a sustainable way over the coming decades. Genetic improvement by breeding is the best way to increase crop productivity. With the rapid progression of functional
genomics, an increasing number of crop genomes have been sequenced and dozens of genes influencing key agronomic traits have been identified. However, current genome sequence information has not been adequately exploited for understanding
the complex characteristics of multiple gene, owing to a lack of crop phenotypic data. Efficient, automatic, and accurate technologies and platforms that can capture phenotypic data that can
be linked to genomics information for crop improvement at all growth stages have become as important as genotyping. Thus,
high-throughput phenotyping has become the major bottleneck restricting crop breeding. Plant phenomics has been defined as the high-throughput, accurate acquisition and analysis of multi-dimensional phenotypes
during crop growing stages at the organism level, including the cell, tissue, organ, individual plant, plot, and field levels. With the rapid development of novel sensors, imaging technology,
and analysis methods, numerous infrastructure platforms have been developed for phenotyping.
Immersive Learning That Works: Research Grounding and Paths Forward
We will metaverse into the essence of immersive learning, into its three dimensions and conceptual models. This approach encompasses elements from teaching methodologies to social involvement, through organizational concerns and technologies. Challenging the perception of learning as knowledge transfer, we introduce a 'Uses, Practices & Strategies' model operationalized by the 'Immersive Learning Brain' and ‘Immersion Cube’ frameworks. This approach offers a comprehensive guide through the intricacies of immersive educational experiences and spotlighting research frontiers, along the immersion dimensions of system, narrative, and agency. Our discourse extends to stakeholders beyond the academic sphere, addressing the interests of technologists, instructional designers, and policymakers. We span various contexts, from formal education to organizational transformation to the new horizon of an AI-pervasive society. This keynote aims to unite the iLRN community in a collaborative journey towards a future where immersive learning research and practice coalesce, paving the way for innovative educational research and practice landscapes.
Bob Reedy - Nitrate in Texas Groundwater.pdf
Presented at June 6-7 Texas Alliance of Groundwater Districts Business Meeting
Authoring a personal GPT for your research and practice: How we created the Q...
Thematic analysis in qualitative research is a time-consuming and systematic task, typically done using teams. Team members must ground their activities on common understandings of the major concepts underlying the thematic analysis, and define criteria for its development. However, conceptual misunderstandings, equivocations, and lack of adherence to criteria are challenges to the quality and speed of this process. Given the distributed and uncertain nature of this process, we wondered if the tasks in thematic analysis could be supported by readily available artificial intelligence chatbots. Our early efforts point to potential benefits: not just saving time in the coding process but better adherence to criteria and grounding, by increasing triangulation between humans and artificial intelligence. This tutorial will provide a description and demonstration of the process we followed, as two academic researchers, to develop a custom ChatGPT to assist with qualitative coding in the thematic data analysis process of immersive learning accounts in a survey of the academic literature: QUAL-E Immersive Learning Thematic Analysis Helper. In the hands-on time, participants will try out QUAL-E and develop their ideas for their own qualitative coding ChatGPT. Participants that have the paid ChatGPT Plus subscription can create a draft of their assistants. The organizers will provide course materials and slide deck that participants will be able to utilize to continue development of their custom GPT. The paid subscription to ChatGPT Plus is not required to participate in this workshop, just for trying out personal GPTs during it.
Randomised Optimisation Algorithms in DAPHNE
Slides from talk:
Aleš Zamuda: Randomised Optimisation Algorithms in DAPHNE .
Austrian-Slovenian HPC Meeting 2024 – ASHPC24, Seeblickhotel Grundlsee in Austria, 10–13 June 2024
https://ashpc.eu/
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills of Minnesota developed a method to convert waste into high-value dry fertilizer, significantly enriching soil quality. By providing farmers with a valuable resource derived from waste, Travis Hills helps enhance farm profitability while promoting environmental stewardship. Travis Hills' sustainable practices lead to cost savings and increased revenue for farmers by improving resource efficiency and reducing waste.
Equivariant neural networks and representation theory
Or: Beyond linear.
Abstract: Equivariant neural networks are neural networks that incorporate symmetries. The nonlinear activation functions in these networks result in interesting nonlinear equivariant maps between simple representations, and motivate the key player of this talk: piecewise linear representation theory.
Disclaimer: No one is perfect, so please mind that there might be mistakes and typos.
dtubbenhauer@gmail.com
Corrected slides: dtubbenhauer.com/talks.html
bordetella pertussis.................................ppt
Bordettela is a gram negative cocobacilli spread by air born drop let
ESR spectroscopy in liquid food and beverages.pptx
With increasing population, people need to rely on packaged food stuffs. Packaging of food materials requires the preservation of food. There are various methods for the treatment of food to preserve them and irradiation treatment of food is one of them. It is the most common and the most harmless method for the food preservation as it does not alter the necessary micronutrients of food materials. Although irradiated food doesn’t cause any harm to the human health but still the quality assessment of food is required to provide consumers with necessary information about the food. ESR spectroscopy is the most sophisticated way to investigate the quality of the food and the free radicals induced during the processing of the food. ESR spin trapping technique is useful for the detection of highly unstable radicals in the food. The antioxidant capability of liquid food and beverages in mainly performed by spin trapping technique.
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...Abdul Wali Khan University Mardan,kP,Pakistan
hematic appreciation test is a psychological assessment tool used to measure an individual's appreciation and understanding of specific themes or topics. This test helps to evaluate an individual's ability to connect different ideas and concepts within a given theme, as well as their overall comprehension and interpretation skills. The results of the test can provide valuable insights into an individual's cognitive abilities, creativity, and critical thinking skillsThe use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptx
Although Artemia has been known to man for centuries, its use as a food for the culture of larval organisms apparently began only in the 1930s, when several investigators found that it made an excellent food for newly hatched fish larvae (Litvinenko et al., 2023). As aquaculture developed in the 1960s and ‘70s, the use of Artemia also became more widespread, due both to its convenience and to its nutritional value for larval organisms (Arenas-Pardo et al., 2024). The fact that Artemia dormant cysts can be stored for long periods in cans, and then used as an off-the-shelf food requiring only 24 h of incubation makes them the most convenient, least labor-intensive, live food available for aquaculture (Sorgeloos & Roubach, 2021). The nutritional value of Artemia, especially for marine organisms, is not constant, but varies both geographically and temporally. During the last decade, however, both the causes of Artemia nutritional variability and methods to improve poorquality Artemia have been identified (Loufi et al., 2024).
Brine shrimp (Artemia spp.) are used in marine aquaculture worldwide. Annually, more than 2,000 metric tons of dry cysts are used for cultivation of fish, crustacean, and shellfish larva. Brine shrimp are important to aquaculture because newly hatched brine shrimp nauplii (larvae) provide a food source for many fish fry (Mozanzadeh et al., 2021). Culture and harvesting of brine shrimp eggs represents another aspect of the aquaculture industry. Nauplii and metanauplii of Artemia, commonly known as brine shrimp, play a crucial role in aquaculture due to their nutritional value and suitability as live feed for many aquatic species, particularly in larval stages (Sorgeloos & Roubach, 2021).
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
The pygmy halfbeak Dermogenys colletei, is known for its viviparous nature, this presents an intriguing case of relatively low fecundity, raising questions about potential compensatory reproductive strategies employed by this species. Our study delves into the examination of fecundity and the Gonadosomatic Index (GSI) in the Pygmy Halfbeak, D. colletei (Meisner, 2001), an intriguing viviparous fish indigenous to Sarawak, Borneo. We hypothesize that the Pygmy halfbeak, D. colletei, may exhibit unique reproductive adaptations to offset its low fecundity, thus enhancing its survival and fitness. To address this, we conducted a comprehensive study utilizing 28 mature female specimens of D. colletei, carefully measuring fecundity and GSI to shed light on the reproductive adaptations of this species. Our findings reveal that D. colletei indeed exhibits low fecundity, with a mean of 16.76 ± 2.01, and a mean GSI of 12.83 ± 1.27, providing crucial insights into the reproductive mechanisms at play in this species. These results underscore the existence of unique reproductive strategies in D. colletei, enabling its adaptation and persistence in Borneo's diverse aquatic ecosystems, and call for further ecological research to elucidate these mechanisms. This study lends to a better understanding of viviparous fish in Borneo and contributes to the broader field of aquatic ecology, enhancing our knowledge of species adaptations to unique ecological challenges.
Recently uploaded (20)
8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf
Cytokines and their role in immune regulation.pptx
Cytokines and their role in immune regulation.pptx
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Deep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless Reproducibility
Immersive Learning That Works: Research Grounding and Paths Forward
Immersive Learning That Works: Research Grounding and Paths Forward
Authoring a personal GPT for your research and practice: How we created the Q...
Authoring a personal GPT for your research and practice: How we created the Q...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Equivariant neural networks and representation theory
Equivariant neural networks and representation theory
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
bordetella pertussis.................................ppt
bordetella pertussis.................................ppt
ESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptx
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
The use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptx
The use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptx
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Open Science Grid
- 1. Rob Gardner • University of Chicago Open Science Grid Rocky Mountain HPC Symposium University of Colorado, August 12, 2015 OSG User Support and Campus Grids area coordinator rwg@uchicago.edu
- 2. OSG: distributed high throughput (HTC) aggregate of individual clusters > 100k cores
- 3. ● 2014 stats ○ 67% size of XD, 35% BlueWaters ○ 2.5 Million CPU hours/day ○ 800M hours/year ○ 125M/y provided opportunistic ● >1 petabyte of data/day xfered ● 50+ research groups ● thousands of users ● XD service provider for XSEDE Rudi Eigenmann Program Director Division of Advanced Cyberinfrastructure (ACI) NSF CISE CASC Meeting, April 1, 2015 OSG: distributed high throughput (HTC)
- 4. OSG for users - HTC profile (vs HPC) ● Does your science workflow involve computations that can be split into many independent jobs? ● Can individual jobs be run on a single processor (as opposed to a single large- scale MPI job simultaneously utilizing many processors)? ● Can your applications be interrupted and restarted at a later time or on another processor or computing site? ● Is your application software “portable”? ● How does computing fit into your science workflow? Are results needed immediately after submission? ● Do your computations require access to or produce huge amounts of data?
- 5. Login Service: connect users to national ACI
- 6. OSG Connect Service OSG as a campus cluster ★ Login host ★ Job scheduler ★ Software ★ Storage
- 7. Submit jobs to OSG with HTCondor ● Simple HTCondor submission ● Complexity hidden from the user ● No grid (X509) certificates required ● Uses HTCondor ClassAd and glidein technology ● DAGMan and other workflow tools
- 8. Software & tools on the OSG ● Distributed software file system ● Special module command ○ identical software on all clusters ● Common tools & libs ● Curate on demand continuously ● HTC apps in XSEDE campus bridging yum repo $ switchmodules oasis $ module avail $ module load R $ module load namd $ module purge $ switchmodules local https://goo.gl/A7kNkf
- 9. Storage service: “Stash” ● Storage service for job input/output data ● Globus Server for managed transfers between campus and the OSG ● POSIX access provided to the login host ● 500 TB capacity ● Personalized http endpoint ● Connected to 100 Gbps SciDMZ (I2, ESnet)
- 10. campus to OSG stash
- 11. Connecting campus to national ACI
- 12. OSG for resource providers ● Connect your campus users to the OSG ○ connect-client - job submit client for the local cluster ○ provide “burst” like capability for HTC jobs to shared opportunistic resources ● Connect campus cluster to OSG ○ Lightweight connect : OSG sends “glidein” jobs to your cluster, using a simple user account ■ No local software or services needed! ○ Large scale: deploy the OSG software stack ■ Support more science communities at larger scale