Cyberinfrastructure And Astronomical Research

•

1 like•252 views

Chris Pritchett Professor, Physics and Astronomy, University of Victoria Presented at the Cybera/CANARIE National Summit 2009, as part of the session "Research Transformed by Cyberinfrastructure." This panel featured researchers who have seen their work transformed through cyberinfrastructure – ie. collaborations made possible, mountains of data rendered intelligible, remote instrumentation accessed.

Technology

Telescope vs. CCD
total area in 3m+ telescopes [m2]

total CCD area [Megapix]

Cyberinfrastructure
Transforms Research:

Supernovae and Cosmology

9

Expansion of the Universe
Feb 9th, 1948

Hubble 1929

10

Fate of the Universe
past future
low
density

?
size of
Universe

high
density
big
bang now

time

11

MegaCam at the Canada-
France-Hawaii Telescope

~ 0.5 Gigapixels

14

The Universe - a

dark energy 70%
dark
matter
25%

normal
matter
5%

15

Supernova Survey
!! Images taken at CFHT in Hawaii

!! Find supernovae within ~12 hr
!! software in Victoria
!! database in Toronto

!! Obtain spectra on 8m class telescopes in Hawaii
and Chile
!! within 1-2 nights of imaging data

16

Cyberinfrastructure
Transforms Research:

Archiving and Data Mining

20

Changing Sociology of Astronomy
1600's

1970's

21

2001

Changing Sociology of Astronomy
!! Science Teams 25 years ago:
!! Individuals or groups of 2-3 people
!! Allocations of a few nights of telescope
time/year
!! Small data collections for each project
!! Science Teams Today:
!! groups of dozens of people all over the
world
!! Allocations of 10%-30% of ALL
telescope time is not uncommon
!! Large data collections for each project
!! Why the change?
!! Better, more comprehensive science
from large surveys

22

Canadian Astronomy
Data Centre
HST
!! Delivers 2 Terabytes
FUSE per week to users
!! 2500 distinct users
MOST !! 87 countries
CFHT
!! Serve all Canadian
astronomy research
Gemini universities
!! Largest astronomy data
BLAST centre in the world (by
data volume)
JCMT

CGPS

MACHO

GB CADC archive stats per year

CADC: a week in the life

24

Changing Role of CADC
!! CADC 25 years ago:
!! Archived data
!! Made data accessible
!! Today
!! Design data management processes and systems in collaboration with
observatories and Science Teams
!! Implement and Operate these data management systems
!! Why the change?
!! Individual Science Teams cannot handle the processing and storage
requirements for very large survey projects

25

SDSS Archive
!! 10,000 sq deg (1/4 sky)
!! 3D map of "local" Universe
(volume about 1030 cubic
light yrs)
!! ~100 TB (FermiLab)

26

Cyberinfrastructure
Transforms Research:

Access to Publications

28

Cyberinfrastructure
Transforms Research:

Canarie NEP39 - CANFAR

34

Cyberinfrastructure
Transforms Research:

The Future

37

Cyberinfrastructure
Transforms Research:

The Future
"Our task is not to forsee the future, but to enable it."
Antoine de Saint-Expuréy

38

International Liquid Mirror
Telescope (ILMT)

!! >200 GB/night presents
challenges from India

41

Come back to
!! my notes from Fri meeting

!! my "CyberPanel ideas" !! reorganize ADS stuff
msg Oct 9 2:31pm - lots of !! reorganize NY times thing
good things at end
•! cosmic zoom?
!! summary/questions for
future
!! reorganize ADS stuff
!! definition of
cyberinfrastrucure -
Baru .ppt from
SACNAS2005

45

The document discusses the challenges of big data in astronomy. It describes several upcoming and current astronomical surveys that will produce enormous amounts of data, such as Euclid which will collect 15 terabytes per day starting in 2022. Dealing with such large datasets requires new techniques for storage, processing, analyzing, classifying, compressing and visualizing the data. Machine learning and citizen science are helping to process the data more efficiently. Future surveys like the Square Kilometer Array telescope will pose even greater challenges by producing data at terabytes per second.

Wolfram Data Summit: New Frontiers in Astronomy

Alberto Conti

National Academy of Sciences

Alberto Conti

Science Gateways and Their Tremendous Potential for Science and Engineering

Cybera Inc.

This document discusses the potential of science gateways and their role in connecting scientists to shared computing resources. It notes that gateways provide intuitive interfaces to access advanced capabilities, allowing scientists to focus on their research without deep technical knowledge. However, gateways must be developed by experts and sustained over the long term to gain the trust of scientists and truly enable new forms of collaborative, data-driven research.

Engineering Operations

Cybera Inc.

Open Government

Cybera Inc.

UNIT .01

Mark Ryder

This document introduces several foundational concepts in geometry and coordinate systems, including the Cartesian coordinate plane, absolute value, distance formulas, midpoint formulas, and equations of circles. It provides definitions, examples, and step-by-step solutions for calculating distances between points, midpoints of line segments, and standard form equations of circles. The key topics covered lay the groundwork for further material in the textbook.

Koordinates

Cybera Inc.

The document discusses Koordinates, a New Zealand-based startup that launched in 2007 to provide a platform for storing, discovering, and distributing geodata online. Koordinates allows over 1,000 public layers and 8,000 users across 100 countries to access over 200 GB of geospatial data monthly. It also manages the New Zealand Land Information data service, making government geospatial data available to the public. Koordinates offers free and commercial tools for organizations and developers to host, share, and access mapped information and datasets.

The document discusses how astronomy is changing in the 21st century due to new technologies and large datasets. In the next decade, astronomers will observe the first sources of light in the universe with the James Webb Space Telescope and build extremely large ground-based telescopes. Surveys will collect terabytes to petabytes of data per night, far more than currently exists on the internet. While data storage is cheap, analyzing and discovering knowledge from the data presents new challenges. Citizen science initiatives are helping astronomers analyze data and make new discoveries.

How Personal Lightwaves Enable Telepresence: Collapsing the Flat World to a “...

Larry Smarr

How Personal Lightwaves Enable Telepresence: Collapsing the Flat World to a “...

Larry Smarr

The Strongly Coupled LambdaCloud

Larry Smarr

The document describes the Strongly Coupled LambdaCloud project at Calit2. It discusses two new buildings at Calit2 that house over 1000 researchers working on nanotech, biotech, chips, VR and other areas. It also describes the OptIPuter network that connects these researchers via 10Gbps lightpaths, enabling collaborative data-intensive research worldwide. The network includes 50 OptIPortals connected to resources like supercomputers and satellite imagery.

AstroCV: A computer vision library for Astronomy

Roberto Muñoz

How Personal Lightwaves Enable Telepresence: Collapsing the Flat World to a “...

Larry Smarr

Building a Global Collaboration System for Data-Intensive Discovery

Larry Smarr

Remote Telepresence for Exploring Virtual Worlds

Larry Smarr

Remote Telepresence for Exploring Virtual Worlds

Larry Smarr

The document describes the history and development of remote telepresence and virtual reality technologies over several decades. It outlines key projects and innovations including the NSFnet which connected supercomputers in the 1980s, the development of the CAVE virtual reality system in the early 1990s, and more advanced optical network projects like OptIPuter in the 2000s which enabled high-resolution telepresence and collaboration across global research centers.

El futuro-de-la-tecnologia-y-la-tecnologia-del-futuro-jose-luis-cordeiro

orlando tipismana

Quantum nature poli_mi_ddm_200115

domenico di mola

This document discusses quantum computing technologies including quantum supremacy, quantum sensors, and the quantum internet. It provides information on Google's quantum computer Sycamore and its processing of 53 qubits in 200 seconds, which would take thousands of years for a classical computer. It also discusses the development of quantum hardware companies, investments in quantum computing, and potential applications in encryption, imaging, and materials modeling. Barriers to progress mentioned include the short coherence times of quantum systems and challenges in scaling to larger numbers of high-quality qubits. The document aims to provide an overview of the current state of quantum technologies for internal business use at Juniper.

Education in a Globally Connected World

Larry Smarr

The document discusses how advances in technology are enabling more globally connected education and research collaboration. It provides examples of optical networks and dedicated fiber links allowing universities to share high-definition media and remotely access scientific instruments and environments. Global partnerships are being formed to leverage these technologies and better prepare students for an increasingly interconnected world.

Astronomy - State of the Art - Telescopes

Chris Impey

Telescopes help us learn about the universe by collecting more light than the human eye and seeing more detail. Larger telescopes collect more light and see sharper images, but the atmosphere limits ground-based telescope resolution. Telescope size has grown exponentially over time. Adaptive optics and interferometry allow telescopes to approach the theoretical resolution limit. While space telescopes avoid many atmospheric limitations, they are much more expensive to build and operate. The Hubble Space Telescope has revolutionized astronomy through high-quality images across the electromagnetic spectrum.

Grasp Your Goal Before Your Feet Hit the Ground! By Jim Bensen

Ann Treacy

The document discusses broadband internet and the GigaZone fiber network being built by Paul Bunyan Communications. It can provide download and upload speeds of 1000 Mbps. The network is described as the future of broadband internet and will bring high-speed connectivity to communities. Short quotes and statistics are provided about technological changes, the growth of information and computing power, and new innovations in areas like solar power and nanotechnology.

000 cordeirosingularidad2011

alain.dongo

Burst data retrieval after 50k GPU Cloud run

Igor Sfiligoi

Running a GPU burst for Multi-Messenger Astrophysics with IceCube across all ...

Frank Wuerthwein

- The document describes running a GPU burst simulation for IceCube astrophysics research across 50,000 NVIDIA GPUs in multiple cloud platforms globally, achieving 350 petaflops for 2 hours. - IceCube detects high-energy neutrinos to study violent astrophysical events by observing the interactions of neutrinos within a cubic kilometer of Antarctic ice instrumented with sensors. - The GPU burst simulation campaign helped improve IceCube's ability to reconstruct neutrino direction and energy and identify astrophysical sources through multi-messenger astrophysics.

2008—The Year of Global Telepresence

Larry Smarr

From the Shared Internet to Personal Lightwaves: How the OptIPuter is Transfo...

Larry Smarr

The document summarizes how the OptIPuter project is transforming scientific research through user-controlled high-speed optical network connections. It provides examples of how 1-10Gbps connections through projects like National LambdaRail are enabling new forms of collaborative work and access to scientific instruments and global data repositories. The OptIPuter creates an environment where researchers can access remote resources through local "OptIPortals" connected to these high-speed optical networks.

Cyber Summit 2016: Technology, Education, and Democracy

Cybera Inc.

What are the opportunities and the challenges offered by emerging modes of technologically-inflected communication and decision-making? What is our role and responsibility as educators and as developers of research and teaching digital infrastructures? What do students need in the 21st century? As education institutions and providers struggle to respond to the first two questions, are we abrogating our responsibility to the last? In this talk, Matt Ratto will describe some of the opportunities and the challenges we currently face, laying out a model of action for how to potentially address the questions raised above. Core to his thinking are two related points; first that we must help students develop a greater sense of how the informational world and its attendant infrastructures helps shape how and what we think, and second, that a good way to do this is to give students the space to engage in reflexive acts of technological production – what Matt has termed ‘critical making.’ He will provide concrete examples from both his research and his teaching that demonstrate the value and importance of reflexive, hands-on work with digital technologies in helping students develop the critical digital literacy skills they need to function in today’s society. Matt Ratto is an Associate Professor in the Faculty of Information at the University of Toronto and directs the Semaphore Research cluster on Inclusive Design, Mobile and Pervasive Computing and, as part of Semaphore, the Critical Making lab.

Cyber Summit 2016: Understanding Users' (In)Secure Behaviour

Cybera Inc.

1) The document summarizes a user study on phishing detection that found users still struggle to accurately identify phishing sites, being successful only 53% of the time on phishing sites and 78% on legitimate sites. 2) The study also found that users have only a shallow understanding of security indicators and place more attention on page content than security cues. Nearly half did not recognize a phishing version of their own bank site. 3) The presentation argues that common password policies may do more harm than good by placing unreasonable demands on human memory and behavior. It suggests rethinking such policies and advice to consider human capabilities and provide more practical and beneficial guidance.

Similar to Cyberinfrastructure And Astronomical Research

Efficient data reduction and analysis of DECam images using multicore archite...

Roberto Muñoz

The Changing Face(s) of Astronomy

skendrew

How Personal Lightwaves Enable Telepresence: Collapsing the Flat World to a “...

Larry Smarr

How Personal Lightwaves Enable Telepresence: Collapsing the Flat World to a “...

Larry Smarr

The Strongly Coupled LambdaCloud

Larry Smarr

AstroCV: A computer vision library for Astronomy

Roberto Muñoz

How Personal Lightwaves Enable Telepresence: Collapsing the Flat World to a “...

Larry Smarr

Building a Global Collaboration System for Data-Intensive Discovery

Larry Smarr

Remote Telepresence for Exploring Virtual Worlds

Larry Smarr

Remote Telepresence for Exploring Virtual Worlds

Larry Smarr

El futuro-de-la-tecnologia-y-la-tecnologia-del-futuro-jose-luis-cordeiro

orlando tipismana

Quantum nature poli_mi_ddm_200115

domenico di mola

Education in a Globally Connected World

Larry Smarr

Astronomy - State of the Art - Telescopes

Chris Impey

Grasp Your Goal Before Your Feet Hit the Ground! By Jim Bensen

Ann Treacy

000 cordeirosingularidad2011

alain.dongo

Burst data retrieval after 50k GPU Cloud run

Igor Sfiligoi

Running a GPU burst for Multi-Messenger Astrophysics with IceCube across all ...

Frank Wuerthwein

2008—The Year of Global Telepresence

Larry Smarr

From the Shared Internet to Personal Lightwaves: How the OptIPuter is Transfo...

Larry Smarr

Similar to Cyberinfrastructure And Astronomical Research (20)

Efficient data reduction and analysis of DECam images using multicore archite...

The Changing Face(s) of Astronomy

How Personal Lightwaves Enable Telepresence: Collapsing the Flat World to a “...

The Strongly Coupled LambdaCloud

AstroCV: A computer vision library for Astronomy

How Personal Lightwaves Enable Telepresence: Collapsing the Flat World to a “...

Building a Global Collaboration System for Data-Intensive Discovery

Remote Telepresence for Exploring Virtual Worlds

El futuro-de-la-tecnologia-y-la-tecnologia-del-futuro-jose-luis-cordeiro

Quantum nature poli_mi_ddm_200115

Education in a Globally Connected World

Astronomy - State of the Art - Telescopes

Grasp Your Goal Before Your Feet Hit the Ground! By Jim Bensen

000 cordeirosingularidad2011

Burst data retrieval after 50k GPU Cloud run

Running a GPU burst for Multi-Messenger Astrophysics with IceCube across all ...

2008—The Year of Global Telepresence

From the Shared Internet to Personal Lightwaves: How the OptIPuter is Transfo...

More from Cybera Inc.

Cyber Summit 2016: Technology, Education, and Democracy

Cybera Inc.

Cyber Summit 2016: Understanding Users' (In)Secure Behaviour

Cybera Inc.

Cyber Summit 2016: Insider Threat Indicators: Human Behaviour

Cybera Inc.

Serious threats to private and governmental organizations do not only come from the outside world, but also come from within. Some employees and contractors with legitimate access to buildings, networks, assets and information deliberately misuse their priviledged access to cause harm to their organization. What are the reasons behind their actions? Is it debts, greed, ideology, disgruntlement, or divided loyalty? Regardless of their motivations or vulnerabilities, traitors have very similar types of personality and display a certain pattern of behaviours before committing an insider incident. As a prevention measure, it is vital that organizations and employees understand, recognize and detect the common indicators of insider threat. Would you recognize the signs? Mario Vachon is an Insider Threat Security Specialist with the RCMP Departmental Security Branch.

Cyber Summit 2016: Research Data and the Canadian Innovation Challenge

Cybera Inc.

Canada allocates a substantial amount of public funding to research, which is a critical factor in ensuring we remain innovative and competitive. Increasingly this funding is geared to the support and development of digital research infrastructure (DRI), including the underlying networks and the associated data acquisition, storage, analysis and visualization. In order to maximize the benefits of increasingly complex DRI and the research it facilitates, it is important to make sure data is properly stewarded, accessible and reusable. By adopting appropriate approaches to research data management we are better positioned to respond to challenges, such as effectively measuring research impacts, and ensuring the reproducibility, privacy, and security of research outputs. Research Data Canada (RDC) is a member-driven organization committed to developing a sustainable approach to research data management, one based on interoperability and best practices. This session will provide an update on the efforts of RDC and partner organizations, including: CANARIE, Compute Canada, CARL Portage Network, CASRAI, the TriAgencies, and the Leadership Council for Digital Infrastructure. Intersections with international activities and projects will also be highlighted. These efforts are ultimately designed to faciliate a cohesive national approach to research data management, and one based on a clearly articulated vision for supporting innovation and discovery in Canada. Mark Leggott is the Executive Director of Research Data Canada.

Cyber Summit 2016: Knowing More and Understanding Less in the Age of Big Data

Cybera Inc.

The Internet has revolutionized how — and how much — each of us can know. Our digital tools put the knowledge of the world at our fingertips — and soon, maybe, right into our heads. But what kinds of of knowledge do our devices give us, and how are they reshaping and challenging the role that education and libraries should play in our lives? This talk was delivered by Michael Patrick Lynch, professor of philosophy at the University of Connecticut, where he directs the university’s Humanities Institute.

Cyber Summit 2016: Privacy Issues in Big Data Sharing and Reuse

Cybera Inc.

This document summarizes a presentation on big data and data reuse given by Bart Custers. It discusses: 1) The Eudeco project which examines big data and data reuse from legal, societal, economic, and technological perspectives across multiple European countries. 2) Issues with data sharing and reuse, including potential privacy violations, discrimination, lack of transparency, and unintended consequences from new uses of data or placing it in new contexts. 3) Potential solutions discussed, including privacy impact assessments, privacy by design, and new approaches focusing more on transparency and responsibility than restricting data access and use.

Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...

Cybera Inc.

This document summarizes a presentation about establishing an ethics framework for predictive analytics using student data in higher education. It discusses how technology has enabled more data collection and predictive modeling of student behavior. However, few guidelines exist for these practices. The presentation advocates developing an ethics framework that safeguards student privacy, promotes transparency, considers unintended consequences, and involves consultation. It also examines existing principles and discusses challenges like opaque predictive models that work against students' interests. The presenter argues universities should internalize norms of respecting trust and serving students, not just avoiding legal issues.

Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...

Cybera Inc.

Canada’s National Research and Education Network, like other ultra-speed research networks, has evolved to transfer massive amounts of data at 100Gbps and beyond. But with the volume of data traffic growing at more than 50% per year, the ability to move increasing volumes of data is challenging. What are the kinds of applications in research and education that are driving this growth? What are the implications of the coming data tsunami on our communication networks? And what happens to network economics to keep up with the demand? CANARIE’s Chief Technology Officer, Mark Wolff, explores these topics and offer insights into how the NREN will evolve to continue to meet the unique needs of Canada’s research and education community.

Cyber Summit 2016: Issues and Challenges Facing Municipalities In Securing Data

Cybera Inc.

The City of Calgary is responsible for providing municipal services to 1.1 million people and 16,000 employees with more than 700 sites and critical infrastructure units. The municipal services represent a $60B asset base including water and wastewater treatment plants, light rapid transit, emergency services, roads and recreation facilities, and has revenue and procurement streams of $4.0B annually. During his tenure, Owen Key, Chief Security Officer and the Chief Information Officer for the City, has implemented enterprise systems for CCTV, access and ID control, physical security information management systems, and has responsibility for information security.

Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...

Cybera Inc.

This document summarizes issues at the intersection of law and technology in Canada over the next five years. It discusses debates around lawful access to data, encryption, data retention, and network interception capabilities. Other issues addressed include internet taxes, linking and payments between platforms, VPN use, global orders for content removal, localization requirements, and website blocking. The document argues that as these issues are addressed through law and policy, responsibilities must be met to use law responsibly and consider matters like privacy, oversight, safeguards, and technological implications.

Privacy, Security & Access to Data

Cybera Inc.

This document summarizes a presentation given by Brian Hamilton on privacy, security, and access to data. It discusses the role of the Office of the Information and Privacy Commissioner of Alberta in overseeing privacy laws and reviewing research proposals. It outlines how the office analyzes information sharing and big data initiatives to ensure privacy is protected. Tips are provided for developing privacy controls and gaining approval, including conducting a privacy impact assessment and developing expertise in privacy principles.

Do Universities Dream of Big Data

Cybera Inc.

Historically, the University of Alberta lacked a centrally managed repository for reporting data, resulting in inconsistency and disparity in access for units across campus. Meaningful and actionable reports were limited, and only focused on the interests and goals of the few units with data analysts who could synthesize the information. Over the last couple of years, the University of Alberta has undertaken major changes in how information is managed and utilized. At the forefront of this change has been an increased interest in supporting the development of analytics and supporting tools. Beginning with the implementation of a centrally managed data warehouse with self-service capabilities, and the introduction of cloud services with business process analysis tools, the University is just starting down the road of big data. This presentation explores opportunities and challenges for the University of Alberta in utilizing big data.

Predicting the Future With Microsoft Bing

Cybera Inc.

The next generation of data scientists will be asked to build predictive models that can extract inferences from very large datasets which are unobservable at the surface, even to the best domain experts. Microsoft has access to some truly large data sets, web and search data from the Bing search engine and social data through collaborations with Twitter. In this talk, we show you how a small team of data scientists used this data to build the Bing Predicts engine — a collection of machine learnt predictive models that is beating industry experts at predicting the outcome of events like the Super Bowl, the Oscars, elections and referendums and even breakthroughs in health sciences. The talk will also give a preview of how organizations can adopt a big data mindset to generate and experiment with large data sets and to make amazing predictions using their own data.

Analytics 101: How to not fail at analytics

Cybera Inc.

Are MOOC's past their peak?

Cybera Inc.

Opening the doors of the laboratory

Cybera Inc.

While the use of online instructional technologies allows the presentation of theoretical science materials, how do we deal with the fact that such courses often include hands-on labs? Laboratory simulations can only provide a solution for online students in a limited and often artificial way. Nearly 20 years ago, Athabasca University developed a solution to the problem of students having to travel to complete their lab work. Emerging technologies at the time allowed for quantitative physics labs to be sent to students as a small kit. The physics initiative was so successful, with over 5,000 students served, that it was picked up in other fields at Athabasca University. Over the years, such material has become cheaper, easier to use, and more integrated with modern computers. Athabasca is now pioneering ways to put real labs directly onto the internet. In this session, the methods used to make real lab experiences available to online students will be discussed, and some of them demonstrated.

Open City - Edmonton

Cybera Inc.

Unlocking the power of healthcare data

Cybera Inc.

Data science and the use of big data in healthcare delivery could revolutionize the field by decreasing costs and vastly improving efficiency and outcomes. There is an abundance of healthcare data in Canada, but it is mostly siloed and difficult to access due to privacy and security challenges. This session will offer insights into best practices for healthcare analytics programs, as well as use cases that demonstrate the potential benefits that can be realized through this work.

Checking in on Healthcare Data Analytics

Cybera Inc.

Open access and open data: international trends and strategic context

Cybera Inc.

Governments around the world fund billions of dollars in research every year. Ensuring that the results of research are available to the public, other researchers and industry has become an important underlying value in order to maximize the impact of our publicly funded research. This session will discuss what’s driving the trend towards greater openness and provide an overview of international developments that will help put Canada’s activities into context.

More from Cybera Inc. (20)