Opening Keynote Lecture
15th Annual ON*VECTOR International Photonics Workshop
Calit2’s Qualcomm Institute
University of California, San Diego
February 29, 2016
Toward a Global Interactive Earth Observing CyberinfrastructureLarry Smarr
05.01.12
Invited Talk to the 21st International Conference on Interactive Information Processing Systems (IIPS) for Meteorology, Oceanography, and Hydrology Held at the 85th AMS Annual Meeting
Title: Toward a Global Interactive Earth Observing Cyberinfrastructure
San Diego, CA
Opening Keynote Lecture
15th Annual ON*VECTOR International Photonics Workshop
Calit2’s Qualcomm Institute
University of California, San Diego
February 29, 2016
Toward a Global Interactive Earth Observing CyberinfrastructureLarry Smarr
05.01.12
Invited Talk to the 21st International Conference on Interactive Information Processing Systems (IIPS) for Meteorology, Oceanography, and Hydrology Held at the 85th AMS Annual Meeting
Title: Toward a Global Interactive Earth Observing Cyberinfrastructure
San Diego, CA
Distributed Cyberinfrastructure to Support Big Data Machine LearningLarry Smarr
Panel on the Future of Machine Learning
California Institute for Telecommunications and Information Technology
University of California, Irvine
May 24, 2018
Distributed Cyberinfrastructure to Support Big Data Machine LearningLarry Smarr
Panel on the Future of Machine Learning
California Institute for Telecommunications and Information Technology
University of California, Irvine
May 24, 2018
Using the Pacific Research Platform for Earth Sciences Big DataLarry Smarr
Grand Challenge Lecture
Big Data and the Earth Sciences: Grand Challenges Workshop
Calit2’s Qualcomm Institute
University of California, San Diego
May 31, 2017
High Performance Cyberinfrastructure Enabling Data-Driven Science Supporting ...Larry Smarr
11.05.13
Invited Presentation
Sanford Consortium for Regenerative Medicine
Salk Institute, La Jolla
Larry Smarr, Calit2 & Phil Papadopoulos, SDSC/Calit2
Title: High Performance Cyberinfrastructure Enabling Data-Driven Science Supporting Stem Cell Research
Similar to Berkeley cloud computing meetup may 2020 (20)
Professional air quality monitoring systems provide immediate, on-site data for analysis, compliance, and decision-making.
Monitor common gases, weather parameters, particulates.
The ability to recreate computational results with minimal effort and actionable metrics provides a solid foundation for scientific research and software development. When people can replicate an analysis at the touch of a button using open-source software, open data, and methods to assess and compare proposals, it significantly eases verification of results, engagement with a diverse range of contributors, and progress. However, we have yet to fully achieve this; there are still many sociotechnical frictions.
Inspired by David Donoho's vision, this talk aims to revisit the three crucial pillars of frictionless reproducibility (data sharing, code sharing, and competitive challenges) with the perspective of deep software variability.
Our observation is that multiple layers — hardware, operating systems, third-party libraries, software versions, input data, compile-time options, and parameters — are subject to variability that exacerbates frictions but is also essential for achieving robust, generalizable results and fostering innovation. I will first review the literature, providing evidence of how the complex variability interactions across these layers affect qualitative and quantitative software properties, thereby complicating the reproduction and replication of scientific studies in various fields.
I will then present some software engineering and AI techniques that can support the strategic exploration of variability spaces. These include the use of abstractions and models (e.g., feature models), sampling strategies (e.g., uniform, random), cost-effective measurements (e.g., incremental build of software configurations), and dimensionality reduction methods (e.g., transfer learning, feature selection, software debloating).
I will finally argue that deep variability is both the problem and solution of frictionless reproducibility, calling the software science community to develop new methods and tools to manage variability and foster reproducibility in software systems.
Exposé invité Journées Nationales du GDR GPL 2024
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...Travis Hills MN
Travis Hills of Minnesota developed a method to convert waste into high-value dry fertilizer, significantly enriching soil quality. By providing farmers with a valuable resource derived from waste, Travis Hills helps enhance farm profitability while promoting environmental stewardship. Travis Hills' sustainable practices lead to cost savings and increased revenue for farmers by improving resource efficiency and reducing waste.
Phenomics assisted breeding in crop improvementIshaGoswami9
As the population is increasing and will reach about 9 billion upto 2050. Also due to climate change, it is difficult to meet the food requirement of such a large population. Facing the challenges presented by resource shortages, climate
change, and increasing global population, crop yield and quality need to be improved in a sustainable way over the coming decades. Genetic improvement by breeding is the best way to increase crop productivity. With the rapid progression of functional
genomics, an increasing number of crop genomes have been sequenced and dozens of genes influencing key agronomic traits have been identified. However, current genome sequence information has not been adequately exploited for understanding
the complex characteristics of multiple gene, owing to a lack of crop phenotypic data. Efficient, automatic, and accurate technologies and platforms that can capture phenotypic data that can
be linked to genomics information for crop improvement at all growth stages have become as important as genotyping. Thus,
high-throughput phenotyping has become the major bottleneck restricting crop breeding. Plant phenomics has been defined as the high-throughput, accurate acquisition and analysis of multi-dimensional phenotypes
during crop growing stages at the organism level, including the cell, tissue, organ, individual plant, plot, and field levels. With the rapid development of novel sensors, imaging technology,
and analysis methods, numerous infrastructure platforms have been developed for phenotyping.
ISI 2024: Application Form (Extended), Exam Date (Out), EligibilitySciAstra
The Indian Statistical Institute (ISI) has extended its application deadline for 2024 admissions to April 2. Known for its excellence in statistics and related fields, ISI offers a range of programs from Bachelor's to Junior Research Fellowships. The admission test is scheduled for May 12, 2024. Eligibility varies by program, generally requiring a background in Mathematics and English for undergraduate courses and specific degrees for postgraduate and research positions. Application fees are ₹1500 for male general category applicants and ₹1000 for females. Applications are open to Indian and OCI candidates.
The use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptxMAGOTI ERNEST
Although Artemia has been known to man for centuries, its use as a food for the culture of larval organisms apparently began only in the 1930s, when several investigators found that it made an excellent food for newly hatched fish larvae (Litvinenko et al., 2023). As aquaculture developed in the 1960s and ‘70s, the use of Artemia also became more widespread, due both to its convenience and to its nutritional value for larval organisms (Arenas-Pardo et al., 2024). The fact that Artemia dormant cysts can be stored for long periods in cans, and then used as an off-the-shelf food requiring only 24 h of incubation makes them the most convenient, least labor-intensive, live food available for aquaculture (Sorgeloos & Roubach, 2021). The nutritional value of Artemia, especially for marine organisms, is not constant, but varies both geographically and temporally. During the last decade, however, both the causes of Artemia nutritional variability and methods to improve poorquality Artemia have been identified (Loufi et al., 2024).
Brine shrimp (Artemia spp.) are used in marine aquaculture worldwide. Annually, more than 2,000 metric tons of dry cysts are used for cultivation of fish, crustacean, and shellfish larva. Brine shrimp are important to aquaculture because newly hatched brine shrimp nauplii (larvae) provide a food source for many fish fry (Mozanzadeh et al., 2021). Culture and harvesting of brine shrimp eggs represents another aspect of the aquaculture industry. Nauplii and metanauplii of Artemia, commonly known as brine shrimp, play a crucial role in aquaculture due to their nutritional value and suitability as live feed for many aquatic species, particularly in larval stages (Sorgeloos & Roubach, 2021).
hematic appreciation test is a psychological assessment tool used to measure an individual's appreciation and understanding of specific themes or topics. This test helps to evaluate an individual's ability to connect different ideas and concepts within a given theme, as well as their overall comprehension and interpretation skills. The results of the test can provide valuable insights into an individual's cognitive abilities, creativity, and critical thinking skills
Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...Studia Poinsotiana
I Introduction
II Subalternation and Theology
III Theology and Dogmatic Declarations
IV The Mixed Principles of Theology
V Virtual Revelation: The Unity of Theology
VI Theology as a Natural Science
VII Theology’s Certitude
VIII Conclusion
Notes
Bibliography
All the contents are fully attributable to the author, Doctor Victor Salas. Should you wish to get this text republished, get in touch with the author or the editorial committee of the Studia Poinsotiana. Insofar as possible, we will be happy to broker your contact.
ESR spectroscopy in liquid food and beverages.pptxPRIYANKA PATEL
With increasing population, people need to rely on packaged food stuffs. Packaging of food materials requires the preservation of food. There are various methods for the treatment of food to preserve them and irradiation treatment of food is one of them. It is the most common and the most harmless method for the food preservation as it does not alter the necessary micronutrients of food materials. Although irradiated food doesn’t cause any harm to the human health but still the quality assessment of food is required to provide consumers with necessary information about the food. ESR spectroscopy is the most sophisticated way to investigate the quality of the food and the free radicals induced during the processing of the food. ESR spin trapping technique is useful for the detection of highly unstable radicals in the food. The antioxidant capability of liquid food and beverages in mainly performed by spin trapping technique.
This presentation explores a brief idea about the structural and functional attributes of nucleotides, the structure and function of genetic materials along with the impact of UV rays and pH upon them.
Nucleic Acid-its structural and functional complexity.
Berkeley cloud computing meetup may 2020
1. “The Pacific Research Platform-
a High-Bandwidth Global-Scale Private ‘Cloud’
Connected to Commercial Clouds”
Presentation to the UC Berkeley Cloud Computing MeetUp
May 26, 2020
Dr. Larry Smarr
Director, California Institute for Telecommunications and Information Technology
Harry E. Gruber Professor,
Dept. of Computer Science and Engineering
Jacobs School of Engineering, UCSD
http://lsmarr.calit2.net
1
2. Before the PRP: ESnet’s ScienceDMZ Accelerates Science Research:
DOE & NSF Partnering on Science Engagement and Technology Adoption
Science
DMZ
Data Transfer
Nodes
(DTN/FIONA)
Network
Architecture
(zero friction)
Performance
Monitoring
(perfSONAR)
ScienceDMZ Coined in 2010 by ESnet
Basis of PRP Architecture and Design
http://fasterdata.es.net/science-dmz/
Slide Adapted From Inder Monga, ESnet
DOE
NSF
NSF Campus Cyberinfrastructure Program
Has Made Over 250 Awards
2012 2013 2014 2015 2016 2017 2018
3. (GDC)
2015 Vision: The Pacific Research Platform Will Connect Science DMZs
Creating a Regional End-to-End Science-Driven Community Cyberinfrastructure
NSF CC*DNI Grant
$6.3M 10/2015-10/2020
In Year 5 Now
PI: Larry Smarr, UC San Diego Calit2
Co-PIs:
• Camille Crittenden, UC Berkeley CITRIS,
• Philip Papadopoulos, UCI
• Tom DeFanti, UC San Diego Calit2/QI,
• Frank Wuerthwein, UCSD Physics and SDSC
Source: John Hess, CENIC
Letters of Commitment from:
• 50 Researchers from 15 Campuses
• 32 IT/Network Organization Leaders
Supercomputer
Centers
4. PRP Links At-Risk Cultural Heritage and Archaeology Datasets
at UCB, UCLA, UCM and UCSD with CAVEkiosks
48 Megapixel CAVEkiosk
UCSD Library
48 Megapixel CAVEkiosk
UCB CITRIS Tech Museum
24 Megapixel CAVEkiosk
UCM Library
UC President Napolitano's Research Catalyst Award to
UC San Diego (Tom Levy), UC Berkeley (Benjamin Porter), UC Merced (Nicola Lercari) and UCLA (Willeke Wendrich)
5. Terminating the Fiber Optics - Data Transfer Nodes (DTNs):
Flash I/O Network Appliances (FIONAs)
UCSD-Designed FIONAs Solved the Disk-to-Disk Data Transfer Problem
at Near Full Speed on Best-Effort 10G, 40G and 100G Networks
FIONAs Designed by UCSD’s Phil Papadopoulos, John Graham,
Joe Keefe, and Tom DeFanti
Two FIONA DTNs at UC Santa Cruz: 40G & 100G
Up to 192 TB Rotating Storage
Add Up to 8 Nvidia GPUs Per 2U FIONA
To Add Machine Learning Capability
6. 2017-2020: NSF CHASE-CI Grant Adds a Machine Learning Layer
Built on Top of the Pacific Research Platform
Caltech
UCB
UCI UCR
UCSD
UCSC
Stanford
MSU
UCM
SDSU
NSF Grant for High Speed “Cloud” of 256 GPUs
For 30 ML Faculty & Their Students at 10 Campuses
for Training AI Algorithms on Big Data
7. Original PRP
CENIC/PW Link
2018-2021: Toward the National Research Platform (NRP) -
Using CENIC & Internet2 to Connect Quilt Regional R&E Networks
“Towards
The NRP”
3-Year Grant
Funded
by NSF
$2.5M
October 2018
PI Smarr
Co-PIs Altintas
Papadopoulos
Wuerthwein
Rosing
DeFanti
NSF CENIC Link
8. 2018/2019: PRP Game Changer!
Using Kubernetes to Orchestrate Containers Across the PRP
“Kubernetes is a way of stitching together
a collection of machines into,
basically, a big computer,”
--Craig Mcluckie, Google
and now CEO and Founder of Heptio
"Everything at Google runs in a container."
--Joe Beda,Google
9. PRP’s Nautilus Hypercluster Adopted Kubernetes to Orchestrate Software Containers
and Rook, Which Runs Inside of Kubernetes, to Manage Distributed Storage
https://rook.io/
“Kubernetes with Rook/Ceph Allows Us to Manage Petabytes of Distributed Storage
and GPUs for Data Science,
While We Measure and Monitor Network Use.”
--John Graham, Calit2/QI UC San Diego
11. CENIC/PW Link
40G 3TB
U Hawaii
40G 160TB
NCAR-WY
40G 192TB
UWashington
10G FIONA1
40G FIONA
UIC
40G 3TB
StarLight
PRP/TNRP’s United States Nautilus Hypercluster FIONAs
Now Connects 4 More Regionals and 3 Internet2 Storage Sites
100G FIONA
I2 Chicago
100G FIONA
I2 Kansas City
100G FIONA
I2 NYC
12. PRP Global Nautilus Hypercluster Is Rapidly Adding International Partners
Beyond Our Original Partner in Amsterdam
Netherlands
10G 35TB
UvA
PRP
Transoceanic Nodes Show Distance is Not a Barrier
to Above 5Gb/s Disk-to-Disk Performance
PRP’s Current
International
Partners
Guam
Australia
Korea
Singapore
40G FIONA6
40G 28TB
KISTI
10G 96TB
U of Guam
100G 35TB
U of Queensland
GRP Workshop 9/17-18/2019
at Calit2@UCSD
13. PRP’s Nautilus Forms a Multi-Application
Powerful Distributed “Big Data” Storage and Machine-Learning Computer
Source: grafana.nautilus.optiputer.net on 1/27/2020
14. Calit2’s FIONA
SDSC’s COMET
Calit2’s FIONA
Pacific Research Platform (10-100 Gb/s)
GPUsGPUs
Complete workflow time:
19.2 days52 Minutes!
532 Times Faster!UC, Irvine UC, San Diego
Collaboration on Distributed Machine Learning for Atmospheric Water in the West
Between UC San Diego and UC Irvine
Source: Scott Sellers, CW3E
15. UCB Science Engagement Workshop:
Applying Advanced Astronomy AI to Microscopy Workflows
Organized and
Coordinated by
UCB’s PRP
Science Engagement
Team
16. Co-Existence of Interactive and
Non-Interactive Computing on PRP
GPU Simulations Needed to Improve Ice Model.
Results in Significant Improvement
in Pointing Resolution for Multi-Messenger Astrophysics
But IceCube Did Not Have Access to GPUs
NSF Large-Scale Observatories
Asked to Utilize PRP Compute Resources
17. IceCube
Number of Requested PRP Nautilus GPUs For All Projects Has Gone Up 4X in 2019
Largely Driven By the Unplanned Access by NSF’s IceCube
4X
https://grafana.nautilus.optiputer.net/d/fHSeM5Lmk/k8s-compute-resources-cluster-
gpus?orgId=1&fullscreen&panelId=2&from=1546329600000&to=1577865599000
18. Multi-Messenger Astrophysics
with IceCube Across All Available GPUs in the Cloud
• Integrate All GPUs Available for Sale Worldwide
into a Single HTCondor Pool
– Use 28 Regions Across AWS, Azure, and Google Cloud
for a Burst of a Couple Hours, or so
– Launch From PRP FIONAs
• IceCube Submits Their Photon Propagation Workflow
to this HTCondor Pool.
– The Input, Jobs on the GPUs, and Output are All Part of
a Single Globally Distributed System
– This Demo Used Just the Standard HTCondor Tools
Run a GPU Burst Relevant in-Scale
for Future Exascale HPC Systems
19. Science with 51,000 GPUs
Achieved as Peak Performance
19
Time in Minutes
Each Color is a Different
Cloud Region in US, EU, or Asia.
Total of 28 Regions in Use
Peaked at 51,500 GPUs
~380 Petaflops of FP32
Summary of Stats at Peak - 8 Generations of NVIDIA GPUs Used