Jason Huggins' (founder/CTO Sauce Labs), presentation to the JavaScript Chicago Meetup on January 28, 2010. Node.js: "The first non-browser version of JavaScript you'll want to use for every-day scripting and creating servers"
GitHub is a Web-based Git repository hosting service. It offers all of the distributed revision control and source code management (SCM) functionality of Git as well as adding its own features. Unlike Git, which is strictly a command-line tool, GitHub provides a Web-based graphical interface and desktop as well as mobile integration. It also provides access control and several collaboration features such as bug tracking, feature requests, task management, and wikis for every project.
The document discusses development environments using Docker containers. It notes that Docker can simplify collaboration by eliminating dependency issues and allowing for reusable, distributable images. Docker provides fast builds through caching and composability through linking and sharing data between containers. An example dev environment is provided that builds an API image with different branches. Challenges are posed around breaking projects into containerized pieces and sharing code between containers and hosts to enable live reloading as code changes.
Writing your own browser reload functionalityAnže Žnidaršič
1) The document discusses building browser reload functionality from scratch for a geographic information systems company. It outlines using Gulp to detect code changes, process files, and reload browsers.
2) A Node.js server is used to establish secure web socket connections between browsers and the Laravel application to trigger reloads on code changes.
3) While existing solutions like Livereload and Browsersync were considered, they did not meet the goals of supporting any browser and HTTP/2. The presented solution proxies web sockets through Nginx to work behind firewalls.
Deploy in scale with Docker, CoreOS, Kubernetes and Apache StratosLakmal Warusawithana
Kubernetes is an open-source platform developed by Google for hosting and managing Docker containers across clustered infrastructure, providing features like container grouping, load balancing, automatic healing and manual scaling. Started by Google, it is now supported and contributed to by many major tech companies including Google, Microsoft, Redhat and VMWare.
This document discusses DevOps tools and technologies. DevOps combines development and operations to shorten the systems development life cycle and provide continuous delivery. Key tools mentioned include Jenkins for continuous integration; Puppet, Docker, Ansible, and Chef for infrastructure automation and configuration management; Git for version control; Docker and other tools for containers; Terraform, Pulumi, Ansible, and Salt for infrastructure as code; Kubernetes and others for container orchestration; and Jenkins, TeamCity, and Azure DevOps for continuous integration, with ArgoCD and others enabling continuous deployment.
This document introduces version control systems and Git. It discusses the history and features of Git, how it differs from centralized and local version control systems in using a distributed and non-linear model. The document then provides a tutorial on basic Git commands and workflows for initializing and cloning repositories, tracking and committing changes, viewing history and undoing changes, working with remote repositories, tagging, and using branches.
This document discusses using Docker and microservices to build applications. It introduces Docker and how containers work at the process level in an isolated and lightweight way. It demonstrates how to build Dockerfiles for Node.js and Python applications, use Docker Hub for images, and run multi-container apps with Docker Compose. Some challenges of Docker like learning curve, build time, and file refresh are also outlined.
Jason Huggins' (founder/CTO Sauce Labs), presentation to the JavaScript Chicago Meetup on January 28, 2010. Node.js: "The first non-browser version of JavaScript you'll want to use for every-day scripting and creating servers"
GitHub is a Web-based Git repository hosting service. It offers all of the distributed revision control and source code management (SCM) functionality of Git as well as adding its own features. Unlike Git, which is strictly a command-line tool, GitHub provides a Web-based graphical interface and desktop as well as mobile integration. It also provides access control and several collaboration features such as bug tracking, feature requests, task management, and wikis for every project.
The document discusses development environments using Docker containers. It notes that Docker can simplify collaboration by eliminating dependency issues and allowing for reusable, distributable images. Docker provides fast builds through caching and composability through linking and sharing data between containers. An example dev environment is provided that builds an API image with different branches. Challenges are posed around breaking projects into containerized pieces and sharing code between containers and hosts to enable live reloading as code changes.
Writing your own browser reload functionalityAnže Žnidaršič
1) The document discusses building browser reload functionality from scratch for a geographic information systems company. It outlines using Gulp to detect code changes, process files, and reload browsers.
2) A Node.js server is used to establish secure web socket connections between browsers and the Laravel application to trigger reloads on code changes.
3) While existing solutions like Livereload and Browsersync were considered, they did not meet the goals of supporting any browser and HTTP/2. The presented solution proxies web sockets through Nginx to work behind firewalls.
Deploy in scale with Docker, CoreOS, Kubernetes and Apache StratosLakmal Warusawithana
Kubernetes is an open-source platform developed by Google for hosting and managing Docker containers across clustered infrastructure, providing features like container grouping, load balancing, automatic healing and manual scaling. Started by Google, it is now supported and contributed to by many major tech companies including Google, Microsoft, Redhat and VMWare.
This document discusses DevOps tools and technologies. DevOps combines development and operations to shorten the systems development life cycle and provide continuous delivery. Key tools mentioned include Jenkins for continuous integration; Puppet, Docker, Ansible, and Chef for infrastructure automation and configuration management; Git for version control; Docker and other tools for containers; Terraform, Pulumi, Ansible, and Salt for infrastructure as code; Kubernetes and others for container orchestration; and Jenkins, TeamCity, and Azure DevOps for continuous integration, with ArgoCD and others enabling continuous deployment.
This document introduces version control systems and Git. It discusses the history and features of Git, how it differs from centralized and local version control systems in using a distributed and non-linear model. The document then provides a tutorial on basic Git commands and workflows for initializing and cloning repositories, tracking and committing changes, viewing history and undoing changes, working with remote repositories, tagging, and using branches.
This document discusses using Docker and microservices to build applications. It introduces Docker and how containers work at the process level in an isolated and lightweight way. It demonstrates how to build Dockerfiles for Node.js and Python applications, use Docker Hub for images, and run multi-container apps with Docker Compose. Some challenges of Docker like learning curve, build time, and file refresh are also outlined.
Emmabuntüs is a Linux distribution based on Debian and Ubuntu that is designed for refurbished computers used by humanitarian organizations. It contains multiple applications like browsers, office suites, media players, and utilities to extend hardware lifespan and reduce electronics waste. The latest version 3.1 updates many core applications like Firefox, Chromium, GIMP, and VLC to their newest versions while keeping the overall goal of being accessible to beginners and children using older computers.
Singularity: The Inner Workings of Securely Running User Containers on HPC Sy...inside-BigData.com
“Singularity is an open source container solution being developed specifically for HPC environments. With Singularity, HPC users can safely bring their own execution environments to the cluster. Unlike other container solutions,Singularity does not require root level permissions to run containers, which allows users to freely control what software stack they wish to use.Provisioning of a container image can be done locally on the user’s machine or on Singularity Hub. The resulting image can then be securely executed on any machine with Singularity installed. Reproduction of results has never been easier: a user can now share a single Singularity image file that will ensure a consistent execution environment wherever it is run.
This presentation will provide an in-depth look at how Singularity is able to securely run user containers on HPC systems. After a brief introduction to Singularity and its relationship to other container solutions, the details of Singularity’s runtime will be explored. The way that Singularity leverages Linux features such as namespaces, bind mounts, and SUID binaries will be discussed in further detail as well.”
This document discusses ways to improve the developer experience (DX) for the GNOME desktop environment to help attract more contributors. It suggests adding a "Developer Mode" switch to make GNOME development tools easily accessible. It also proposes creating "GNOME Ambassadors" to help new developers get started, improving documentation, and making platform libraries and APIs easier to use. The document advocates for the xdg-app framework to allow developers to more easily package and distribute applications independently of Linux distributions. Overall it argues that enhancing the GNOME developer experience through better tools, documentation, and support can help grow the community of contributors.
La startup Yuzu, accompagnée de la société Vixns, a opté pour le choix d'une infrastructure Docker tournant sur Mesos/Marathon/Consul. De l'environnement de développement jusqu'au monitoring au quotidien, nous vous ferons part de nos erreurs, réussites, workflows et outils utilisés.
A brief introduction on Kubernetes's main concepts. Kubernetes is a container orchestrator developed by Google in 2014 and donate for the CNCF in 2015.
Docker in production, for real!
The Yuzu startup, helped by Vixns, chose to have a docker infrastructure with Mesos/Marathon/Consul. From the development environment to our prod monitoring, we share our mistakes, successes, workflows and tools.
Kotti is a high-level, Pythonic web application framework built on top of Pyramid, SQLAlchemy, and Twitter Bootstrap. It provides a minimalistic framework for building content-centric web applications and includes features like content editing, user accounts, and i18n support out of the box. Kotti is open source, released under the BSD license, and supports Python 3.
06/03/19 Docker, Docker Compose y Heroku - Granada Developer Group - SalesforceAlba Azcona Rivas
Trasladar un container de Docker a Heroku ha sido una característica bastante esperada hasta ahora. En este seminario cubrimos los conocimientos básicos de docker y docker-compose así como reciente integración con Heroku (Julio 2018), vemos qué posibilidades y beneficios nos aporta tanto el uso de docker como la integración de este con Heroku y finalmente cómo aplicarlo de una manera óptima y rápida en nuestro entorno de desarrollo desde cero.
Ubuntu is a popular Linux-based operating system that is free, open-source and user-friendly. It has many advantages over other operating systems like Windows including being less resource intensive, more secure, and providing regular free updates. Ubuntu is widely used both for personal computers and servers around the world.
[JDV_TechTalk] Make a Heroku-like Server in Digital OceanYanuar W
TechTalk about how to make auto deploy on push server like Heroku but at our own server in Digital Ocean.
Arranged by Qiscus, supported by Jogja Digital Valley
This document provides an overview of Linux and open source software. It discusses that Linux is the kernel of an operating system and was created by Linus Torvalds. It also explains that open source software allows users to view and modify source code. Finally, it outlines some popular Linux distributions and common Linux commands.
This document discusses the history of free and open-source software from the 1960s to the present. It describes how early hackers believed all information should be free and computers should be accessible to all. It outlines Richard Stallman's four freedoms of free software in the 1970s. It also mentions the development of Unix, Linux, and criticisms of sharing software without payment. The document concludes with an overview of the xPUD small Linux distribution focused on experimentation.
20160929 android taipei Sonatype nexus on amazon ec2 TSE-JU LIN(Louis)
Sonatype Nexus can be installed on an Amazon EC2 Ubuntu server to host software libraries for Android development projects. Nexus is downloaded and extracted, the nexus user is created, and configuration files are edited to set the home directory and user. Archives can then be uploaded to Nexus and projects can define Nexus as a repository in their build.gradle files to access dependencies from Nexus. Exoplayer is provided as an example library.
Open Source applications provide alternatives to commercial software that fill needs not met by paid options. Some key open source applications include GNU/Linux, which was completed by Linus Torvalds' kernel in 1992; SourceForge, a portal for developing and distributing open source software; and Firefox, one of the first successful open source browsers and current market leader. These and other open source tools like FreeNAS, Gparted, Clonezilla, and VLC Media Player offer free and customizable alternatives to proprietary software.
This document discusses Jupyter, an open-source tool for interactive data science and scientific computing. Jupyter allows for interactive exploration, development, and communication through code, equations, visualizations and narrative text. It supports over 50 programming languages and has found widespread adoption in academia and industry for individual and collaborative work across the entire workflow of a scientific idea from data collection to publication. The document outlines Jupyter's history and architecture, ecosystem of related projects, and future development plans to enhance collaboration and software engineering capabilities.
A Jupyter kernel for Scala and Apache Spark.pdfLuciano Resende
Many data scientists are already making heavy usage of the Jupyter ecosystem for analyzing data using interactive notebooks. Apache Toree (incubating) is a Jupyter kernel designed that enables data scientists and data engineers to easily connect and leverage Apache Spark and its powerful APIs from a standard Jupyter notebook to execute their analytics workloads. In this talk, we will go over what's new with the most recent Apache Toree release. We will cover available magics and visualizations extensions that can be integrated with Toree to enable better data exploration and data visualizations. We will also describe some high-level designs of Toree and how users can extend the functionality of Apache Toree powerful plugin system. And all of these with multiple live demos that demonstrate how Toree can help with your analytics workloads in an Apache Spark environment.
This document provides an overview of version control systems and Git/GitHub. It begins by defining version control as a system to track changes to files over time. It then discusses Git as a version control system and GitHub as a hosting service for Git repositories. Key concepts for GitHub users like repositories, forking, and upstream are defined. The document demonstrates the GitHub workflow and shows how to create repositories using the GitHub Desktop GUI.
The Five Stages of Enterprise Jupyter DeploymentFrederick Reiss
Meetup talk from May 30, 2018.
Jupyter notebooks are an important tool for data science. For a single user on a laptop, these notebooks are a simple, straightforward tool. But Jupyter in the enterprise is a much more complex affair. Enterprises have large teams of data scientists who need to run their notebooks atop scalable compute infrastructure with secure, audited access to massive, proprietary data sets; all while keeping hardware costs down.
Here at IBM’s Center for Open-Source Data and AI Technologies, we’ve seen multiple enterprise rollouts of Jupyter notebooks, both first-hand, in IBM products and services; and second-hand, in our discussions with other members of the Jupyter community.
In this talk, we merge together the stories of these projects and walk through the process of deploying high-performance, secure, mulitentant Jupyter notebooks in an enterprise setting. Our goal is here is inform others who may be at the beginning of this journey of what is coming and how to navigate the challenges ahead.
Along the way, we answer five important questions: What are Jupyter notebooks? What makes Jupyter so attractive to data scientists? Why is deploying Jupyter in the enterprise difficult? What are your deployment options today? And, what are the tradeoffs of those approaches?
We’ll finish with a description of how how IBM and other members of the Jupyter community are working towards reducing those tradeoffs with the Jupyter Enterprise Gateway project. Finally, we’ll give a demonstration of multitenant Jupyter notebooks in action.
This talk is aimed at enterprise architects who need to support growing data science teams with multi-user deployments of Jupyter. No knowledge of data science is required.
The document discusses the concept of "Docs Like Code", which treats documentation like code by storing docs in version control systems, using plain text formats, and integrating doc writing and publishing into the same workflow as software development. It provides the case study of Apache Pulsar, which uses GitHub and other tools to collaborate effectively on docs between developers, writers and users. Benefits include better doc quality and syncing with code through continuous integration/deployment of docs.
JupyterHub - A "Thing Explainer" OverviewCarol Willing
JupyterHub allows each user in a group to have their own Jupyter notebook server. It has three main parts: the hub, which manages authentication and spawns single-user notebook servers; a user database to store user information; and an authenticator to verify users' identities. When a user logs in, the hub's spawner creates a dedicated notebook server for that user. JupyterHub is useful for shared computing resources like classrooms, workshops, or research groups.
What's new in Kubernetes 1.3?
New things like:
Petsets, init-containers, ubernetes, federated clusters, improved kubernetes UI, minikube, support for rkt, etc.
Also find out sources to learn Kubernetes, how to participate with k8s community.
Open Source Dev Containers with DevPod - Rich Burroughs.pdfRich Burroughs
Many developers are excited about dev containers, but until now, people needed to use a managed service like Codespaces or Gitpod to feel that dev container magic. DevPod is a new open source tool that allows users to launch dev containers with any infrastructure that they have available.
DevPod uses a provider model like Terraform's, and there are currently providers for many different infrastructures, like local Docker daemons, Kubernetes, AWS, and several other cloud providers. It's also possible to develop providers if you don't find one that fits your needs.
While you can choose the infra you want to use with DevPod, you don't have to manage it. DevPod handles the lifecycle of the infrastructure it runs on, and it can even suspend cloud resources automatically to save on costs. DevPod uses the open devcontainer.json standard, so it's compatible with VS Code and many other IDEs, as well as tools like Codespaces.
We'll look at how DevPod works and get into a quick demo that showcases how it can help developers and teams standardize their dev environments.
Emmabuntüs is a Linux distribution based on Debian and Ubuntu that is designed for refurbished computers used by humanitarian organizations. It contains multiple applications like browsers, office suites, media players, and utilities to extend hardware lifespan and reduce electronics waste. The latest version 3.1 updates many core applications like Firefox, Chromium, GIMP, and VLC to their newest versions while keeping the overall goal of being accessible to beginners and children using older computers.
Singularity: The Inner Workings of Securely Running User Containers on HPC Sy...inside-BigData.com
“Singularity is an open source container solution being developed specifically for HPC environments. With Singularity, HPC users can safely bring their own execution environments to the cluster. Unlike other container solutions,Singularity does not require root level permissions to run containers, which allows users to freely control what software stack they wish to use.Provisioning of a container image can be done locally on the user’s machine or on Singularity Hub. The resulting image can then be securely executed on any machine with Singularity installed. Reproduction of results has never been easier: a user can now share a single Singularity image file that will ensure a consistent execution environment wherever it is run.
This presentation will provide an in-depth look at how Singularity is able to securely run user containers on HPC systems. After a brief introduction to Singularity and its relationship to other container solutions, the details of Singularity’s runtime will be explored. The way that Singularity leverages Linux features such as namespaces, bind mounts, and SUID binaries will be discussed in further detail as well.”
This document discusses ways to improve the developer experience (DX) for the GNOME desktop environment to help attract more contributors. It suggests adding a "Developer Mode" switch to make GNOME development tools easily accessible. It also proposes creating "GNOME Ambassadors" to help new developers get started, improving documentation, and making platform libraries and APIs easier to use. The document advocates for the xdg-app framework to allow developers to more easily package and distribute applications independently of Linux distributions. Overall it argues that enhancing the GNOME developer experience through better tools, documentation, and support can help grow the community of contributors.
La startup Yuzu, accompagnée de la société Vixns, a opté pour le choix d'une infrastructure Docker tournant sur Mesos/Marathon/Consul. De l'environnement de développement jusqu'au monitoring au quotidien, nous vous ferons part de nos erreurs, réussites, workflows et outils utilisés.
A brief introduction on Kubernetes's main concepts. Kubernetes is a container orchestrator developed by Google in 2014 and donate for the CNCF in 2015.
Docker in production, for real!
The Yuzu startup, helped by Vixns, chose to have a docker infrastructure with Mesos/Marathon/Consul. From the development environment to our prod monitoring, we share our mistakes, successes, workflows and tools.
Kotti is a high-level, Pythonic web application framework built on top of Pyramid, SQLAlchemy, and Twitter Bootstrap. It provides a minimalistic framework for building content-centric web applications and includes features like content editing, user accounts, and i18n support out of the box. Kotti is open source, released under the BSD license, and supports Python 3.
06/03/19 Docker, Docker Compose y Heroku - Granada Developer Group - SalesforceAlba Azcona Rivas
Trasladar un container de Docker a Heroku ha sido una característica bastante esperada hasta ahora. En este seminario cubrimos los conocimientos básicos de docker y docker-compose así como reciente integración con Heroku (Julio 2018), vemos qué posibilidades y beneficios nos aporta tanto el uso de docker como la integración de este con Heroku y finalmente cómo aplicarlo de una manera óptima y rápida en nuestro entorno de desarrollo desde cero.
Ubuntu is a popular Linux-based operating system that is free, open-source and user-friendly. It has many advantages over other operating systems like Windows including being less resource intensive, more secure, and providing regular free updates. Ubuntu is widely used both for personal computers and servers around the world.
[JDV_TechTalk] Make a Heroku-like Server in Digital OceanYanuar W
TechTalk about how to make auto deploy on push server like Heroku but at our own server in Digital Ocean.
Arranged by Qiscus, supported by Jogja Digital Valley
This document provides an overview of Linux and open source software. It discusses that Linux is the kernel of an operating system and was created by Linus Torvalds. It also explains that open source software allows users to view and modify source code. Finally, it outlines some popular Linux distributions and common Linux commands.
This document discusses the history of free and open-source software from the 1960s to the present. It describes how early hackers believed all information should be free and computers should be accessible to all. It outlines Richard Stallman's four freedoms of free software in the 1970s. It also mentions the development of Unix, Linux, and criticisms of sharing software without payment. The document concludes with an overview of the xPUD small Linux distribution focused on experimentation.
20160929 android taipei Sonatype nexus on amazon ec2 TSE-JU LIN(Louis)
Sonatype Nexus can be installed on an Amazon EC2 Ubuntu server to host software libraries for Android development projects. Nexus is downloaded and extracted, the nexus user is created, and configuration files are edited to set the home directory and user. Archives can then be uploaded to Nexus and projects can define Nexus as a repository in their build.gradle files to access dependencies from Nexus. Exoplayer is provided as an example library.
Open Source applications provide alternatives to commercial software that fill needs not met by paid options. Some key open source applications include GNU/Linux, which was completed by Linus Torvalds' kernel in 1992; SourceForge, a portal for developing and distributing open source software; and Firefox, one of the first successful open source browsers and current market leader. These and other open source tools like FreeNAS, Gparted, Clonezilla, and VLC Media Player offer free and customizable alternatives to proprietary software.
This document discusses Jupyter, an open-source tool for interactive data science and scientific computing. Jupyter allows for interactive exploration, development, and communication through code, equations, visualizations and narrative text. It supports over 50 programming languages and has found widespread adoption in academia and industry for individual and collaborative work across the entire workflow of a scientific idea from data collection to publication. The document outlines Jupyter's history and architecture, ecosystem of related projects, and future development plans to enhance collaboration and software engineering capabilities.
A Jupyter kernel for Scala and Apache Spark.pdfLuciano Resende
Many data scientists are already making heavy usage of the Jupyter ecosystem for analyzing data using interactive notebooks. Apache Toree (incubating) is a Jupyter kernel designed that enables data scientists and data engineers to easily connect and leverage Apache Spark and its powerful APIs from a standard Jupyter notebook to execute their analytics workloads. In this talk, we will go over what's new with the most recent Apache Toree release. We will cover available magics and visualizations extensions that can be integrated with Toree to enable better data exploration and data visualizations. We will also describe some high-level designs of Toree and how users can extend the functionality of Apache Toree powerful plugin system. And all of these with multiple live demos that demonstrate how Toree can help with your analytics workloads in an Apache Spark environment.
This document provides an overview of version control systems and Git/GitHub. It begins by defining version control as a system to track changes to files over time. It then discusses Git as a version control system and GitHub as a hosting service for Git repositories. Key concepts for GitHub users like repositories, forking, and upstream are defined. The document demonstrates the GitHub workflow and shows how to create repositories using the GitHub Desktop GUI.
The Five Stages of Enterprise Jupyter DeploymentFrederick Reiss
Meetup talk from May 30, 2018.
Jupyter notebooks are an important tool for data science. For a single user on a laptop, these notebooks are a simple, straightforward tool. But Jupyter in the enterprise is a much more complex affair. Enterprises have large teams of data scientists who need to run their notebooks atop scalable compute infrastructure with secure, audited access to massive, proprietary data sets; all while keeping hardware costs down.
Here at IBM’s Center for Open-Source Data and AI Technologies, we’ve seen multiple enterprise rollouts of Jupyter notebooks, both first-hand, in IBM products and services; and second-hand, in our discussions with other members of the Jupyter community.
In this talk, we merge together the stories of these projects and walk through the process of deploying high-performance, secure, mulitentant Jupyter notebooks in an enterprise setting. Our goal is here is inform others who may be at the beginning of this journey of what is coming and how to navigate the challenges ahead.
Along the way, we answer five important questions: What are Jupyter notebooks? What makes Jupyter so attractive to data scientists? Why is deploying Jupyter in the enterprise difficult? What are your deployment options today? And, what are the tradeoffs of those approaches?
We’ll finish with a description of how how IBM and other members of the Jupyter community are working towards reducing those tradeoffs with the Jupyter Enterprise Gateway project. Finally, we’ll give a demonstration of multitenant Jupyter notebooks in action.
This talk is aimed at enterprise architects who need to support growing data science teams with multi-user deployments of Jupyter. No knowledge of data science is required.
The document discusses the concept of "Docs Like Code", which treats documentation like code by storing docs in version control systems, using plain text formats, and integrating doc writing and publishing into the same workflow as software development. It provides the case study of Apache Pulsar, which uses GitHub and other tools to collaborate effectively on docs between developers, writers and users. Benefits include better doc quality and syncing with code through continuous integration/deployment of docs.
JupyterHub - A "Thing Explainer" OverviewCarol Willing
JupyterHub allows each user in a group to have their own Jupyter notebook server. It has three main parts: the hub, which manages authentication and spawns single-user notebook servers; a user database to store user information; and an authenticator to verify users' identities. When a user logs in, the hub's spawner creates a dedicated notebook server for that user. JupyterHub is useful for shared computing resources like classrooms, workshops, or research groups.
What's new in Kubernetes 1.3?
New things like:
Petsets, init-containers, ubernetes, federated clusters, improved kubernetes UI, minikube, support for rkt, etc.
Also find out sources to learn Kubernetes, how to participate with k8s community.
Open Source Dev Containers with DevPod - Rich Burroughs.pdfRich Burroughs
Many developers are excited about dev containers, but until now, people needed to use a managed service like Codespaces or Gitpod to feel that dev container magic. DevPod is a new open source tool that allows users to launch dev containers with any infrastructure that they have available.
DevPod uses a provider model like Terraform's, and there are currently providers for many different infrastructures, like local Docker daemons, Kubernetes, AWS, and several other cloud providers. It's also possible to develop providers if you don't find one that fits your needs.
While you can choose the infra you want to use with DevPod, you don't have to manage it. DevPod handles the lifecycle of the infrastructure it runs on, and it can even suspend cloud resources automatically to save on costs. DevPod uses the open devcontainer.json standard, so it's compatible with VS Code and many other IDEs, as well as tools like Codespaces.
We'll look at how DevPod works and get into a quick demo that showcases how it can help developers and teams standardize their dev environments.
Jupyter notebooks have arrived to stay as a means to document the scientific analysis protocol, as well as to provide executable recipes shared seamlessly among the community. This has triggered the rise of a plethora of complementary tools and services associated to them. This talk will cover different possibilities to use Jupyter notebooks and JupyterLab interface. We will start with the description of their basic functionalities, as well as functionality extensions not widely known by the community. We will describe how to take advantage of their cross-language capabilities to enhance collaborative work, and also use them as complementary assets in the paper publication process to provide reproducibility of the results. Other aspects on how to deal with modularity and scalability of long complex notebooks will be covered, and we will see several platforms for rendering and execution others then the browser and the local desktop. We will finish on how they are actually being used together with Docker and Binder as part of the versioned executable documentation of a project like Gammapy.
Bootstrap4XPages is an OSGi plugin that provides the Twitter Bootstrap framework for developing responsive, mobile-first XPages applications. It includes the Bootstrap CSS, JS, and jQuery libraries. Developers can enable the Bootstrap theme in their XPages applications without changing any code by simply selecting the Bootstrap theme in the Xsp Properties. The plugin is available on OpenNTF and makes it very easy to use the popular Bootstrap framework with XPages.
Stop making, start composing - Using Composer for Drupal developmentkaspergarnaes
The document discusses using Composer for Drupal development as an alternative to Drush Make. It provides a 5 minute crash course on Composer, explaining what it is and what it does. It then outlines how modules, themes, libraries and patches can be managed with Composer and provides examples from a demo project. It concludes by discussing next steps such as a Drupal Composer repository and the future of Drush.
This document provides an introduction to Jupyter Notebook and Azure Machine Learning Studio. It discusses popular programming languages like Python, R, and Julia that can be used with these tools. It also summarizes key features of Jupyter Notebook like code cells, kernels, and cloud deployment. Demo code examples are shown for integrating Python and R with Azure ML to fetch and transform data.
This document provides an introduction to Jupyter Notebook and Azure Machine Learning Studio. It discusses popular programming languages like Python, R, and Julia that can be used with these tools. It also summarizes key features of Jupyter Notebook like code cells, kernels, and cloud deployment. Examples are given of using Python and R with Azure ML to fetch and transform data in Jupyter notebooks.
Data visualisation in python tool - a briefameermalik11
This document provides an overview of data visualization tools in Python and R. It discusses popular Python libraries like Matplotlib, NumPy, Pandas, and Seaborn for creating visualizations. For R, it covers the R programming language, RStudio IDE, and key visualization packages like ggplot2. Examples demonstrate creating bar charts and other visualizations in both Python and R. The document recommends resources for learning data visualization and encourages participation in the library's GIS working group.
Data Engineer's Lunch #52: JupyterHub/JupyterLab on Kubernetes Anant Corporation
In Data Engineer's Lunch #52 we will deploy JupyterHub/JupyterLab on Kubernetes
Accompanying Blog: Coming Soon!
Accompanying YouTube: https://youtu.be/QaXHuqHr8bQ
Sign Up For Our Newsletter: http://eepurl.com/grdMkn
Join Cassandra Lunch Weekly at 12 PM EST Every Wednesday: https://www.meetup.com/Cassandra-DataStax-DC/events/
Cassandra.Link:
https://cassandra.link/
Follow Us and Reach Us At:
Anant:
https://www.anant.us/
Awesome Cassandra:
https://github.com/Anant/awesome-cassandra
Cassandra.Lunch:
https://github.com/Anant/Cassandra.Lunch
Email:
solutions@anant.us
LinkedIn:
https://www.linkedin.com/company/anant/
Twitter:
https://twitter.com/anantcorp
Eventbrite:
https://www.eventbrite.com/o/anant-1072927283
Facebook:
https://www.facebook.com/AnantCorp/
Join The Anant Team:
https://www.careers.anant.us
>>WATCH THE WEBINAR HERE: https://codefresh.io/docker-based-pipelines-with-codefresh/
Most people think that Docker adoption means deploying Docker images. In this webinar, we will see the alternative way of adopting Docker in a Continuous Integration Pipeline, by packaging all build tools inside Docker containers. This makes it very easy to use different tool versions on the same build and puts an end to version conflicts in build machines. We will use Codefresh as a CI/CD solution as it fully supports pipelines where each build step is running on its own container image.
Sign up for FREE Codefresh account (120 builds/month) at Codefresh.io/codefresh-signup
Jetpack SDK: The new possibility of the extensions on browserlittlebtc
The document discusses the new Jetpack SDK which provides a new way to develop extensions for the Mozilla platform like Firefox. It allows writing extensions using HTML5, CSS3 and JavaScript in a modular way. The Jetpack SDK uses Python and provides tools for testing and packaging extensions. It also has APIs for creating widgets, working with tabs, making HTTP requests, storing data and using timers. Examples shown include extensions for sharing pages to Plurk, displaying apologies, and tracking unread messages on Plurk. The future of Jetpack SDK includes more APIs and improvements to the add-on installation and update process.
Managing JavaScript projects in a MonoRepo
(Zacky Pickholz)
Managing a large front end project with multiple npm packages can be overwhelming sometimes. During this session we cover popular tools that help us maintain this project much more easily.
Using NuGet the way you should
Consuming NuGet packages, that’s what everyone does. Open source projects create NuGet packages and post them on NuGet.org. Meanwhile, all of us are still working with shared projects and fighting relative paths, versioning and so on. In this talk, we’ll use Visual Studio, NuGet and TeamCity to work with NuGet the way you should. Project references must die! Add Package Reference and good continuous integration is everything you will ever need.
The second part of a talk about hg and version control I gave to my colleagues in a group of bioinformaticians. First part here: http://www.slideshare.net/giovanni/hg-version-control-bioinformaticians
Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...Aggregage
This webinar will explore cutting-edge, less familiar but powerful experimentation methodologies which address well-known limitations of standard A/B Testing. Designed for data and product leaders, this session aims to inspire the embrace of innovative approaches and provide insights into the frontiers of experimentation!
Learn SQL from basic queries to Advance queriesmanishkhaire30
Dive into the world of data analysis with our comprehensive guide on mastering SQL! This presentation offers a practical approach to learning SQL, focusing on real-world applications and hands-on practice. Whether you're a beginner or looking to sharpen your skills, this guide provides the tools you need to extract, analyze, and interpret data effectively.
Key Highlights:
Foundations of SQL: Understand the basics of SQL, including data retrieval, filtering, and aggregation.
Advanced Queries: Learn to craft complex queries to uncover deep insights from your data.
Data Trends and Patterns: Discover how to identify and interpret trends and patterns in your datasets.
Practical Examples: Follow step-by-step examples to apply SQL techniques in real-world scenarios.
Actionable Insights: Gain the skills to derive actionable insights that drive informed decision-making.
Join us on this journey to enhance your data analysis capabilities and unlock the full potential of SQL. Perfect for data enthusiasts, analysts, and anyone eager to harness the power of data!
#DataAnalysis #SQL #LearningSQL #DataInsights #DataScience #Analytics
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...sameer shah
"Join us for STATATHON, a dynamic 2-day event dedicated to exploring statistical knowledge and its real-world applications. From theory to practice, participants engage in intensive learning sessions, workshops, and challenges, fostering a deeper understanding of statistical methodologies and their significance in various fields."
Open Source Contributions to Postgres: The Basics POSETTE 2024ElizabethGarrettChri
Postgres is the most advanced open-source database in the world and it's supported by a community, not a single company. So how does this work? How does code actually get into Postgres? I recently had a patch submitted and committed and I want to share what I learned in that process. I’ll give you an overview of Postgres versions and how the underlying project codebase functions. I’ll also show you the process for submitting a patch and getting that tested and committed.
The Ipsos - AI - Monitor 2024 Report.pdfSocial Samosa
According to Ipsos AI Monitor's 2024 report, 65% Indians said that products and services using AI have profoundly changed their daily life in the past 3-5 years.
Global Situational Awareness of A.I. and where its headedvikram sood
You can see the future first in San Francisco.
Over the past year, the talk of the town has shifted from $10 billion compute clusters to $100 billion clusters to trillion-dollar clusters. Every six months another zero is added to the boardroom plans. Behind the scenes, there’s a fierce scramble to secure every power contract still available for the rest of the decade, every voltage transformer that can possibly be procured. American big business is gearing up to pour trillions of dollars into a long-unseen mobilization of American industrial might. By the end of the decade, American electricity production will have grown tens of percent; from the shale fields of Pennsylvania to the solar farms of Nevada, hundreds of millions of GPUs will hum.
The AGI race has begun. We are building machines that can think and reason. By 2025/26, these machines will outpace college graduates. By the end of the decade, they will be smarter than you or I; we will have superintelligence, in the true sense of the word. Along the way, national security forces not seen in half a century will be un-leashed, and before long, The Project will be on. If we’re lucky, we’ll be in an all-out race with the CCP; if we’re unlucky, an all-out war.
Everyone is now talking about AI, but few have the faintest glimmer of what is about to hit them. Nvidia analysts still think 2024 might be close to the peak. Mainstream pundits are stuck on the wilful blindness of “it’s just predicting the next word”. They see only hype and business-as-usual; at most they entertain another internet-scale technological change.
Before long, the world will wake up. But right now, there are perhaps a few hundred people, most of them in San Francisco and the AI labs, that have situational awareness. Through whatever peculiar forces of fate, I have found myself amongst them. A few years ago, these people were derided as crazy—but they trusted the trendlines, which allowed them to correctly predict the AI advances of the past few years. Whether these people are also right about the next few years remains to be seen. But these are very smart people—the smartest people I have ever met—and they are the ones building this technology. Perhaps they will be an odd footnote in history, or perhaps they will go down in history like Szilard and Oppenheimer and Teller. If they are seeing the future even close to correctly, we are in for a wild ride.
Let me tell you what we see.
Build applications with generative AI on Google CloudMárton Kodok
We will explore Vertex AI - Model Garden powered experiences, we are going to learn more about the integration of these generative AI APIs. We are going to see in action what the Gemini family of generative models are for developers to build and deploy AI-driven applications. Vertex AI includes a suite of foundation models, these are referred to as the PaLM and Gemini family of generative ai models, and they come in different versions. We are going to cover how to use via API to: - execute prompts in text and chat - cover multimodal use cases with image prompts. - finetune and distill to improve knowledge domains - run function calls with foundation models to optimize them for specific tasks. At the end of the session, developers will understand how to innovate with generative AI and develop apps using the generative ai industry trends.
Predictably Improve Your B2B Tech Company's Performance by Leveraging DataKiwi Creative
Harness the power of AI-backed reports, benchmarking and data analysis to predict trends and detect anomalies in your marketing efforts.
Peter Caputa, CEO at Databox, reveals how you can discover the strategies and tools to increase your growth rate (and margins!).
From metrics to track to data habits to pick up, enhance your reporting for powerful insights to improve your B2B tech company's marketing.
- - -
This is the webinar recording from the June 2024 HubSpot User Group (HUG) for B2B Technology USA.
Watch the video recording at https://youtu.be/5vjwGfPN9lw
Sign up for future HUG events at https://events.hubspot.com/b2b-technology-usa/
Codeless Generative AI Pipelines
(GenAI with Milvus)
https://ml.dssconf.pl/user.html#!/lecture/DSSML24-041a/rate
Discover the potential of real-time streaming in the context of GenAI as we delve into the intricacies of Apache NiFi and its capabilities. Learn how this tool can significantly simplify the data engineering workflow for GenAI applications, allowing you to focus on the creative aspects rather than the technical complexities. I will guide you through practical examples and use cases, showing the impact of automation on prompt building. From data ingestion to transformation and delivery, witness how Apache NiFi streamlines the entire pipeline, ensuring a smooth and hassle-free experience.
Timothy Spann
https://www.youtube.com/@FLaNK-Stack
https://medium.com/@tspann
https://www.datainmotion.dev/
milvus, unstructured data, vector database, zilliz, cloud, vectors, python, deep learning, generative ai, genai, nifi, kafka, flink, streaming, iot, edge
2. JupyterHub
• Multi-user server with independent notebook server per user
• I.e. to solve the deployment problem
• NOTE: Not for multiple users collaborating on the same notebook
Carol Willing
3. JupyterHub
• Works via NodeJS proxy
• Uses Docker, load balancing with Docker Swarm
• Hub is Python & Tornado
• Works with both Python 2 and 3
• https://jupyterhub.readthedocs.io/en/latest/
• https://github.com/jupyterhub/jupyterhub
5. JupyterLab is alpha
• IDE with panels inside a browser tab
• Improved UI, esp. file browser and console
• Extensible environment based around plugins
• Emphasis as much on script/console as notebook / narrative
Steven Silvester
7. JupyterLab
• Based on Continuum's open source PhosphorJS framework:
– http://phosphorjs.github.io
• Integration with git/GitHub is coming (inc. nbdime for diff/merge)
• Live-rendered tabs alongside source
• Graphical interaction widgets have been switched off until a sprint
due in Sept/Oct:
– matplotlib 2.0.0 will assist in making widgets work properly
– (it will use jupyter's own version of ipywidgets)