This document provides an overview and agenda for an upcoming webinar on Jupyter tools for scientific collaboration and education. It begins with introductions and then covers Jupyter Notebook for interactive and reproducible computing, JupyterHub for hosting and scaling notebooks, JupyterLab as the next evolution of the notebook interface, and next steps for the Jupyter community. Examples are given throughout of different uses of Jupyter in education, research, and industry. The document concludes by inviting participants to get involved in Jupyter through various means and announcing an upcoming Jupyter conference.
Amazing Things: Third-Party Python Package EcosystemsAudrey Roy
My presentation from PyCodeConf 2011.
I talk about:
- how the Python open-source community is a meritocracy
- how the best way to grow your ecosystem within the Python community is to make it easy to create third-party packages
- community building, mentorship, and diversity of ideas
PLOTCON NYC: The Architecture of Jupyter: Protocols for Interactive Data Expl...Plotly
Project Jupyter, evolved from the IPython environment, provides a platform for interactive computing that is widely used today in research, education, journalism and industry. The core premise of the Jupyter architecture is to design tools around the experience of interactive computing, building an environment, protocol, file format and libraries optimized for the computational process when there is a human in the loop, in a live iteration with ideas and data assisted by the computer.
In this talk, I will discuss what are the basic ideas that underpin Jupyter, and how they provide "lego blocks" that enable the project team, and the broader community, to develop a variety of tools and approaches to problems in interactive computing, data science, visualization and more.
Django Package Thunderdome by Audrey Roy & Daniel GreenfeldAudrey Roy
What makes a package useful? What is it about certain packages that makes them must-haves for any project?
We’ll go over topics like: purpose, structure, docs, tests, availability on PyPI and Github/Bitbucket, activity, and more.
We will visit some of the most useful grid categories on djangopackages.com and highlight our top package picks, showing examples of what makes the top packages so great and what could use improvement.
Open Educational Resources and the School Librarian: Collaborating with Teach...Heather Braum
Learn about open education & open web resources and how school librarians can leverage them to assist classroom teachers. Presented at the KASL District I Workshop, April 2013
Vance Stevens live-streams workshop on Hangout on Air at GloCALL AhmedabadVance Stevens
The following information on the workshop is here: http://glocall.org/course/view.php?id=81&topic=0#section-8
Connecting Live Online with our Personal Learning Networks
by Vance Stevens
This 2-hour workshop will introduce the concept and importance of Personal Learning Networks and suggest ways that educators can engage in almost unlimited opportunities for professional development online. One such possibility is participation in weekly Learning2gether events (L2g) coordinated by the presenter. This workshop introduces two tools used frequently in L2g and shows participants how they can use them in their professional development. The first of these is Blackboard Collaborate (available on grant to L2g participants) and the second is Google+ Hangouts. The workshop will walk participants through the process of setting up and conducting events using each tool. Topics include using social media to advertise your events, how to moderate sessions using each tool, and how to archive them. Participants will learn how to stream Hangouts so that they can be attended by many more than the ten allowed in the Hangout itself at any one time.
This model lesson will demonstrate how students can collect and share data and produce a digital report. Bring your own device to participate as a student or come observe all the action.
Amazing Things: Third-Party Python Package EcosystemsAudrey Roy
My presentation from PyCodeConf 2011.
I talk about:
- how the Python open-source community is a meritocracy
- how the best way to grow your ecosystem within the Python community is to make it easy to create third-party packages
- community building, mentorship, and diversity of ideas
PLOTCON NYC: The Architecture of Jupyter: Protocols for Interactive Data Expl...Plotly
Project Jupyter, evolved from the IPython environment, provides a platform for interactive computing that is widely used today in research, education, journalism and industry. The core premise of the Jupyter architecture is to design tools around the experience of interactive computing, building an environment, protocol, file format and libraries optimized for the computational process when there is a human in the loop, in a live iteration with ideas and data assisted by the computer.
In this talk, I will discuss what are the basic ideas that underpin Jupyter, and how they provide "lego blocks" that enable the project team, and the broader community, to develop a variety of tools and approaches to problems in interactive computing, data science, visualization and more.
Django Package Thunderdome by Audrey Roy & Daniel GreenfeldAudrey Roy
What makes a package useful? What is it about certain packages that makes them must-haves for any project?
We’ll go over topics like: purpose, structure, docs, tests, availability on PyPI and Github/Bitbucket, activity, and more.
We will visit some of the most useful grid categories on djangopackages.com and highlight our top package picks, showing examples of what makes the top packages so great and what could use improvement.
Open Educational Resources and the School Librarian: Collaborating with Teach...Heather Braum
Learn about open education & open web resources and how school librarians can leverage them to assist classroom teachers. Presented at the KASL District I Workshop, April 2013
Vance Stevens live-streams workshop on Hangout on Air at GloCALL AhmedabadVance Stevens
The following information on the workshop is here: http://glocall.org/course/view.php?id=81&topic=0#section-8
Connecting Live Online with our Personal Learning Networks
by Vance Stevens
This 2-hour workshop will introduce the concept and importance of Personal Learning Networks and suggest ways that educators can engage in almost unlimited opportunities for professional development online. One such possibility is participation in weekly Learning2gether events (L2g) coordinated by the presenter. This workshop introduces two tools used frequently in L2g and shows participants how they can use them in their professional development. The first of these is Blackboard Collaborate (available on grant to L2g participants) and the second is Google+ Hangouts. The workshop will walk participants through the process of setting up and conducting events using each tool. Topics include using social media to advertise your events, how to moderate sessions using each tool, and how to archive them. Participants will learn how to stream Hangouts so that they can be attended by many more than the ten allowed in the Hangout itself at any one time.
This model lesson will demonstrate how students can collect and share data and produce a digital report. Bring your own device to participate as a student or come observe all the action.
Creating a developer pipeline by teaching gateway technologiesMarlon Pierce
Do you have trouble recruiting and retaining good gateway developers? Common challenges include the allure of the cutting-edge commercial sector, academic pay scales, and the specialized knowledge necessary for development. The Indiana University Science Gateways Research Center is attempting to turn this challenge into an opportunity by teaching Web-based cyberinfrastructure systems using concepts and technologies that will benefit students in their non-academic careers. Such distributed systems require knowledge of both classic and cutting-edge topics, such as microservices and “DevOps” practices. Meanwhile, the instructors can identify and connect with promising students while keeping themselves aware of important trends and technologies. This webinar will provide an overview of the material and concepts that we cover in the class, describe the student project assignments and class organization, and present outcomes and student feedback that we have gotten over the last two semesters. We will also discuss possibilities of making the course material and instruction available to other interested universities. Course information and material is available from http://courses.airavata.org/.
Presented at CYTO 2014 in Ft. Lauderdale, FL, USA May 19, 2014. Focused on methods used to enhance exposure of shared resource laboratories (or core facilities) by means of increased participation in social media activities.
Tech programs post pandemic tech to go and lending programsBrian Pichman
We learned a lot in the first few months of 2020 as the world shifted to provide more digital and online services and provide cleaner and safer in-person interactions. Through all these lessons learned, join Brian Pichman as he highlights some of the fun interactive virtual services in this new era of providing services to the public. We will cover some of the best tech tips for technology lending programs and things that patrons and users can do while away from your library. At the end of this workshop, pandemic or not, you’ll be able to provide greater services and resources to your patrons, regardless of their physical location and being as safe as possible to deliver these services.
An introduction to open science, why it's important and how to do it. This presentation was given at the European Medical Students Association (EMSA) event, 'Open Access in Action' in Berlin on 14th-15th September 2015
A Virtual Infrastructure for Data intensive Analysis (VIDIA)Alexandra M. Pickett
The presentation will overview a the establishment of a collaborative virtual community, focusing initially on data-intensive computing education in the social sciences.
Humanities Crowdsourcing on the Zooniverse PlatformUCLDH
Zooniverse (https://www.zooniverse.org/) is a world-leading academic crowdsourcing organization based at the University of Oxford, the Adler Planetarium and the University of Minnesota. This talk will provide an overview of the types of metadata extraction and full text transcription projects and tools that are currently available on the platform. It will give an overview of the design and lessons learned from projects such as Operation War Diary, Science Gossip, Shakespeare’s World and Measuring the ANZACs, and suggest ways in which crowdsourced data can be used in the humanities. The talk will also provide an overview of the free Project Builder (https://www.zooniverse.org/lab), where anyone with an internet connection can create their own project and obtain their own data.
Similar to Jupyter: A Gateway for Scientific Collaboration and Education (20)
Python - The People's Programming LanguageCarol Willing
Keynote for PyCon Philippines 2016 in Cebu. This talk explores how Python and people partner to address complex real world issues. Project Jupyter and its notebooks are also shared.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Jupyter: A Gateway for Scientific Collaboration and Education
1. Welcome to the SGCI Webinar!
• We will be starting shortly.
• Your audio has been muted, and you are encouraged
to turn off your video during the presentation.
• Controls for these are near the bottom of
the right-side control panel for BlueJeans.
• You may submit questions at any time using Chat,
and the moderator will share them with the
presenter when appropriate.
• This presentation will be recorded and slides will be posted.
1
SGCI’s week-long Science Gateways Bootcamp in October teaches
strategies for successful gateway development & sustainability.
Apply by Friday 7/28: https://sciencegateways.org/bootcamp
2. A few brief words about the
Science Gateways Community Institute (SGCI)
Our goal: To facilitate community sharing of experiences, technologies, and
practices at little or no cost to community members through NSF-funded, online
and in-person resources and services
2
Incubator: Learn best practices from our consultants or Bootcamp.
Extended Developer Support: Get direct, custom development
help.
Scientific Software Collaborative: Find gateways or software
components (or promote your own).
Community Engagement & Exchange: Engage with and learn
from the gateways community.
Workforce Development: Build your professional career as a
student or young professional.
3. A quick favor at the end of this webinar…
3
NSF gives money to SGCI.
SGCI gives you a free webinar.
Could you give SGCI
30 seconds of feedback?
4.
A Gateway for
Scientific Collaboration
and Education
July 20, 2017
The Project Jupyter Team
Carol Willing, Cal Poly
Brian Granger, Cal Poly
Fernando Perez, LBNL/Berkeley
Min Ragan-Kelley, Simula
The Larger Jupyter Team
@ProjectJupyter on Twitter
6. Proud
member
of the
Jupyter
community
• Steering Council, Project Jupyter
• Core Developer, Project Jupyter
• Software Engineer, Cal Poly SLO
• Director, Python Software Foundation
• Core Developer, CPython
• Geek in Residence, Fab Lab San Diego
Carol Willing
@willingcarol
9. • Start with a proven curriculum
http://pyvideo.org/pycon-us-2013/a-hands-on-
introduction-to-python-for-beginning-p.html
• Hands on to engage students
• Takeaway notebooks reduce
student stress
https://github.com/pythonsd/intro-to-
python
2014 - Break down barriers to entry
Intro to Python
San Diego Python
10. 2014 - Build a community
Credits: http://zonca.org/ https://words.sdsc.edu/team https://software-carpentry.org
11. Serve users and foster collaboration
Credit: http://sciencegateways.org/
2017 and
beyond
12.
13. “Project Jupyter serves not only the
academic and scientific communities
but also a much broader constituency
of data scientists in research,
education, industry and journalism…
- Fernando Pérez
UC Berkeley
14. “…we see uses of our tools that range
from high school education in
programming to the nation’s
supercomputing facilities and the
leaders of the tech industry.
- Fernando Pérez
UC Berkeley
15. “More than a million people are
currently using Jupyter for everything
from…
-Prof. Brian Granger
Cal Poly
18. “…analyzing massive gene sequencing
datasets to processing images from
the Hubble Space Telescope and
developing models of financial
markets.
-Prof. Brian Granger
Cal Poly
20. “We are excited by the potential of
Project Jupyter to reach even wider
audiences and to contribute to
increased cross-disciplinary
collaboration in the sciences.
-Betsy Fader
Helmsley Charitable Trust
21. “Jupyter Notebook… will enable data
exploration, visualization, and analysis
in a way that encourages sound
science and speeds progress.
-Chris Mentzel
The Gordon and Betty Moore Foundation
31. • Exploration and experimentation
http://pyvideo.org/scipy-2016/labs-in-the-wild-teaching-
signal-processing-using-wearables-jupyter-notebooks-
scipy-2016.html
• Physical media with wearables and
electronics
• Real world, self-directed projects
Exploration and prototyping
Teaching Signal Processing using Wearables
and Jupyter Notebooks
Dr. Demba Ba
32. • Feedback and communication with
students using nbgrader
http://kristenthyng.com/blog/2016/09/07/
jupyterhub+nbgrader/
• Progression to complex examples
and tasks
https://github.com/kthyng/
python4geosciences
Visualize and communicate
Python for Geosciences
Dr. Kristen Thyng
33. Scale learning with research tools
Berkeley Data Science
Data8
UC Berkeley
http://denero.org/data-8-in-spring-2017.html
https://github.com/data-8/jupyterhub-k8s
http://data8.org/
http://data.berkeley.edu/
http://data.berkeley.edu/about/videos
•Campus wide curriculum
•Cross-discipline
• Zero to JupyterHub with Kubernetes
https://zero-to-jupyterhub.readthedocs.io
36. JupyterHub
Where we
are
0.7 - 12/2016
•introduce Services
•Anything that can talk to the Hub's API that's not a
User
•Managed Service: A process started by the Hub
•External Service: Anything not started by the Hub
(may or may not be a process)
37. Where
we are
0.7 Services can...
•run a web service at /services/:service-name
•authenticate requests with the Hub via HubAuth
•talk to the Hub API with their API token(s)
38. Where
we are
0.7 Services are for...
•interacting with the Hub
•nbgrader formgrader
•culling idle servers
•sharing files
•shared notebook server(s)
•nbviewer
40. Where
we are
going
0.8
•abstract Proxy API
•define spec and Python API for Hub's proxy
needs
•Better support nginx, kubernetes proxies
•Requires moving activity tracking to single-user
servers (done in notebook 5.0)
41. Where
we are
going
0.8
•multiple servers per user
•useful when single Hub exposes a variety of
computational resources (clusters)
•servers can have different configurations
(different Spawners?)
•need to keep common single server-per-user
case well supported, to avoid overcomplicating
things
•contributions started by Christian Barra
42. Where
we are
going
OAuth
•JupyterHub as OAuth provider
•removes need for complicated cookie
management by the Hub
•Will be needed as number of endpoints for
which users are authorized grows (shared servers
for collaboration)
43. Where
we are
going
HubShare
•Service for sharing
•unit of sharing: directory
•push/pull model
•simple REST spec (possibly WebDAV)
•share with individuals, groups
•target use case: nbgrader assignments
https://github.com/jupyterhub/hubshare
46. Introducing JupyterLab:
The Evolution of the Jupyter Notebook
(almost beta)
The JupyterLab Team
Chris Colbert, Continuum
Steven Silvester, Continuum
Afshin Darian, Continuum
Jason Grout, Bloomberg
Brian Granger, Cal Poly
Grant Nestor, Cal Poly
Cameron Oelsen, Cal Poly
Fernando Perez, LBNL/Berkeley
Ian Rose, Berkeley
Cal Poly Interns
The Larger Jupyter Team
@jupyterlab on GitHub
@ProjectJupyter on Twitter
56. Becomes a notebook extension
With the same code, the Fasta viewer becomes an extension usable in the notebook.
57. Datasets, grids, and scale
1.2M rows 200Mb csv file. Excel can’t open.
A few seconds to load and then“smooth as butter”when scrolling.
Rumor has it that Chris Colbert has a trillion row by column demo too.
59. Call to
action
• Join Jupyter mailing lists
• Participate in a sprint
• Give a talk or write a post
• Offer a workshop
• Contribute to a favorite project
• Share your trials and successes
63. • Kristen Thyng
• San Diego Python
• Demba Ba
• Jeremy Freeman, Binder
• Michael Cuthbert, music21
• LIGO
• Andrea Zonca, SDSC, Ilkay Altinas, Software Carpentry
• Photo credits on individual slides
Attributions and recognition
A huge thank you to the Project Jupyter team and community.
Your hard work and passion makes this all possible.
66. Thank you for participating!
• Please share your feedback through our 30-second evaluation:
http://sciencegateways.org/webinareval
• Join us next month (August 9)
Interactive Best Practices:
Job Management & Scheduling
Presented by Miron Livny and Todd Tannenbaum (Condor
Project), Mark Miller (CIPRES),Sudhakar Pamidighantam
(SEAgrid), and others
• Upcoming opportunities for students/educators: http://
sciencegateways.org/engage/student-focused
66