The document outlines the steps to contribute to the Apache Airflow project:
1. Fork the Apache Airflow repository and configure your development environment.
2. Connect with the Apache Airflow community by joining communication channels like Slack and mailing lists.
3. Prepare a pull request with your code changes by following the pull request guidelines and rebasing regularly.
4. Engage in peer review by pinging reviewers on Slack and addressing any comments to get your pull request merged.
* What is different GitHub Flow and Git Flow?
* What is GitHub Actions?
* How to write the simple workflow?
* What's problem in GitHub Actions UI?
* What's problem with Secrets in GitHub Actions?
* How to write your first GitHub Actions and upload to the marketplace?
* What's a problem with environment variables in GitHub Actions?
Gitea is a painless self-hosted Git service. It is similar to GitHub, Bitbucket or Gitlab. The initial development have been done on Gogs but we have forked it and named it Gitea. If you want to read more about the reasons why we have done that please read this blog post.
https://docs.gitea.io/en-us/
In this tutorial, we will explore version control features of RStudio. The version control system used is GitHub which is based on Git but offers additional features as it is a cloud based version control system.
* What is different GitHub Flow and Git Flow?
* What is GitHub Actions?
* How to write the simple workflow?
* What's problem in GitHub Actions UI?
* What's problem with Secrets in GitHub Actions?
* How to write your first GitHub Actions and upload to the marketplace?
* What's a problem with environment variables in GitHub Actions?
Gitea is a painless self-hosted Git service. It is similar to GitHub, Bitbucket or Gitlab. The initial development have been done on Gogs but we have forked it and named it Gitea. If you want to read more about the reasons why we have done that please read this blog post.
https://docs.gitea.io/en-us/
In this tutorial, we will explore version control features of RStudio. The version control system used is GitHub which is based on Git but offers additional features as it is a cloud based version control system.
The following is my Agenda
* Why I don’t choose Jenkins or GitLab CI?
* What is Drone CI?
* Drone Infrastructure
* How to install Drone in five minutes?
* Integrate your project
* Create your Drone plugin
* Try drone CLI without drone server
more detail information you can find that in Udemy: https://www.udemy.com/devops-oneday/?couponCode=DRONE-DEVOPS
Creating mobile apps the web developer wayLorna Timbah
Get the latest slide from: https://docs.google.com/presentation/d/1BfMfE973DN6UumK6Aqlyg-iKWClA0fLyiigwzsAvrTw/edit?usp=sharing
Think transitioning from web development to mobile app development ain't easy? That's what I thought. Here's my step-by-step guide on how to transition my web dev skills so that I can build mobile apps without the steep learning curve.
TYPO3 8 is here - how we keep EXT:solr uptodate with the TYPO3 coretimohund
This presentation shows, how we use travis-ci.org and scrutinizer-ci.com to keep our extension uptodate with the TYPO3 core. Beside that we show what could be next for EXT:solr in the next year.
How we write microservices in Go and deploy them to Kubernetes using Helm and Charts. Automation is everywhere!
This talk was made for Golang Novosibirsk Meetup: https://youtu.be/WwCWUEO7tqI
Efficient development workflows with composernuppla
Composer is a great tool for managing a project's dependencies - however, as with many tools there are various ways to use it. That's why this session will provide you an overview of possible workflows and shows practical solutions for building and deploying composer-managed projects. It covers experiences with handling Drupal projects and focus on approaches that can be shared across projects and team members.
Topics:
- Introduction: What is composer and how to use it with Drupal
- Build & deployment workflows for composer-managed projects
- Composer & Drupal: Challenges & solutions
- Creating re-usable packages
Describe how to contribute to open source projects.
Provide example process using two hot open source project, linux and AOSP(Android Open Source Project)
Understanding Pseudo-Versions Moving to Go 1.13 What is in Go 1.14+ for ModulesMitali Bisht
Explaining pseudo-version, how restrictions have been enforced for pseudo-version in Go 1.13 along with go sumdb, resolving them , features in Go 1.14+ related to modules
The following is my Agenda
* Why I don’t choose Jenkins or GitLab CI?
* What is Drone CI?
* Drone Infrastructure
* How to install Drone in five minutes?
* Integrate your project
* Create your Drone plugin
* Try drone CLI without drone server
more detail information you can find that in Udemy: https://www.udemy.com/devops-oneday/?couponCode=DRONE-DEVOPS
Creating mobile apps the web developer wayLorna Timbah
Get the latest slide from: https://docs.google.com/presentation/d/1BfMfE973DN6UumK6Aqlyg-iKWClA0fLyiigwzsAvrTw/edit?usp=sharing
Think transitioning from web development to mobile app development ain't easy? That's what I thought. Here's my step-by-step guide on how to transition my web dev skills so that I can build mobile apps without the steep learning curve.
TYPO3 8 is here - how we keep EXT:solr uptodate with the TYPO3 coretimohund
This presentation shows, how we use travis-ci.org and scrutinizer-ci.com to keep our extension uptodate with the TYPO3 core. Beside that we show what could be next for EXT:solr in the next year.
How we write microservices in Go and deploy them to Kubernetes using Helm and Charts. Automation is everywhere!
This talk was made for Golang Novosibirsk Meetup: https://youtu.be/WwCWUEO7tqI
Efficient development workflows with composernuppla
Composer is a great tool for managing a project's dependencies - however, as with many tools there are various ways to use it. That's why this session will provide you an overview of possible workflows and shows practical solutions for building and deploying composer-managed projects. It covers experiences with handling Drupal projects and focus on approaches that can be shared across projects and team members.
Topics:
- Introduction: What is composer and how to use it with Drupal
- Build & deployment workflows for composer-managed projects
- Composer & Drupal: Challenges & solutions
- Creating re-usable packages
Describe how to contribute to open source projects.
Provide example process using two hot open source project, linux and AOSP(Android Open Source Project)
Understanding Pseudo-Versions Moving to Go 1.13 What is in Go 1.14+ for ModulesMitali Bisht
Explaining pseudo-version, how restrictions have been enforced for pseudo-version in Go 1.13 along with go sumdb, resolving them , features in Go 1.14+ related to modules
Contributing to Apache Airflow | Journey to becoming Airflow's leading contri...Kaxil Naik
From not knowing Python (let alone Airflow), and from submitting the first PR that fixes typo to becoming Airflow Committer, PMC Member, Release Manager, and #1 Committer this year, this talk walks through Kaxil’s journey in the Airflow World.
The second part of this talk explains:
how you can also start your OSS journey by contributing to Airflow
Expanding familiarity with a different part of the Airflow codebase
Continue committing regularly & steadily to become Airflow Committer. (including talking about current Guidelines of becoming a Committer)
Different mediums of communication (Dev list, users list, Slack channel, Github Discussions etc)
Plugin Development for Beginners v.2019Joe Cartonia
WordPress plugins are not as complicated as you may think. They can be created with basic knowledge of PHP. This session will demonstrate how a beginner can start developing a plugin, and some common tools used by developers.
WordPress plugins can appear to be magical, but they can be created with basic knowledge of PHP. This session will demonstrate how a beginner may develop a simple plugin or a more complex plugin using a boilerplate template.
Python/Flask is one of the most popular choices for Developers when it comes to creating a Web Application. Learn how you can get started with making your Web Application using Python and Flask in this presentation.
Here are Github links for Sample Application that we Demonstrated -
https://github.com/mohanrohit/reading-list-api
https://github.com/mohanrohit/reading-list-web
(Powered by www.DeepDiveEducation.com)
It's a Breeze to develop Apache Airflow (London Apache Airflow meetup)Jarek Potiuk
This talk is about tools and mechanism we developed and used to improve productivity and teamwork in our team (of 6 currently) while developing 70+ operators for Airflow over more than 6 months.
We developed an "Airflow Breeze" simplified development environment which cuts down the time to become productive Apache Airflow developer from days to minutes.
It is part of Airflow Improvement Proposals:
AIP-10 Multi-layered and multi-stage official Airflow image
AIP-7 Simplified development workflow
Setting up Notifications, Alerts & Webhooks with Flux v2 by Alison DowdneyWeaveworks
Watch the recording here: https://youtu.be/cakxixc-yQk
❗️ Notifications & Alerts ⚠️
When operating a cluster, different teams may wish to receive notifications about the status of their GitOps pipelines. For example, the on-call team would receive alerts about reconciliation failures in the cluster, while the dev team may wish to be alerted when a new version of an app was deployed and if the deployment is healthy.
Webhook Receivers
The GitOps toolkit controllers are by design pull-based. In order to notify the controllers about changes in Git or Helm repositories, you can setup webhooks and trigger a cluster reconciliation every time a source changes. Using webhook receivers, you can build push-based GitOps pipelines that react to external events.
Alison Dowdney, Developer Experience Engineer at Weaveworks and CNCF Ambassador, walks through how to define a provider, an alert, git commit status, exposing the webhook receiver and defining a git repository and receiver.
Resources
Flux2 Documentation: https://fluxcd.io/docs/
Flux Guide: Setup Notifications: https://fluxcd.io/docs/guides/notifications/
Flux Guide: Setup Webhook receivers: https://fluxcd.io/docs/guides/webhook-receivers/
Flux Roadmap: https://fluxcd.io/docs/roadmap/
Alison's Demo Repo: https://github.com/alisondy/flux-demos
Come learn about Vagrant - a tool to create and configure lightweight, reproducible, and portable development environments plus provisioning options to automate the environment configuration. Vagrant lowers development environment setup time, increases development/production parity, and makes the "works on my machine" excuse a relic of the past.
It's a Breeze to develop Airflow (Cloud Native Warsaw)Jarek Potiuk
Jareks talk is about tools and mechanism we developed and used to improve productivity and teamwork in our team (of 6 currently) while developing 70+ operators for Airflow over more than 6 months.
We developed an "Airflow Breeze" simplified development environment which cuts down the time to become productive Apache Airflow developer from days to minutes.
It is part of Airflow Improvement Proposals:
AIP-10 Multi-layered and multi-stage official Airflow image
AIP-7 Simplified development workflow
Terminus, the Pantheon command-line interfaceJon Peck
Terminus is a command-line tool for performing Pantheon dashboard operations. Free, open-source & MIT-licensed, Terminus is a great daily-use tool for both developers and DevOps engineers. From updating your Drush aliases to automating site creation and deployment, Terminus has features for everyone.
Join the maintainers, Jon Peck and Josh Koenig of Pantheon for an in-depth demonstration, training and discussion of how Terminus can supercharge your site management and development!
For more information on Terminus, see https://www.getpantheon.com/blog/terminus-pantheon-cli
Similar to Berlin Apache Con EU Airflow Workshops (20)
Caching in Docker - the hardest thing in computer scienceJarek Potiuk
Presentation about problems encountered while building Breeze - Development Environment for Apache Airflow. Docker is great for containerisation but when you are trying to make full use of it for caching and development, there are a number of problems you have to overcome.
Manageable Data Pipelines With Airflow (and kubernetes) - GDG DevFestJarek Potiuk
Apache Airflow is a platform to programmatically author, schedule and monitor workflows. Airflow is not a data streaming solution. Tasks do not move data from one to the other (though tasks can exchange metadata!). Airflow is not in the Spark Streaming or Storm space, it is more comparable to Oozie or Azkaban. It's primary goal is to solve problem nicely described in this XKCD comic (https://xkcd.com/2054/) What's unique about Airflow is that it brings "infrastructure as a code" concept to building scalable, manageable and elegant workflows. Workflows are defined as Python code - thus making dynamic workflow possible. It provides hundreds of out-of-the-box Operators that allow your pipeline to tap into pretty much any resource possible - starting from resources from multiple cloud providers as well as on-the-premises systems of yours. It's super-easy to write your own operators and leverage the power of data pipeline infrastructure provided by Airflow. This talk will be about general concepts behind Airflow - how you can author your workflow, write your own operators and run and monitor your pipelines. It will also explain how you can leverage Kubernetes (in recent release of Airflow) to make use of your on-premises or in-the-cloud infrastructure efficiently. You leave the talk armed with enough knowledge to evaluate if Airflow is good for you to solve your data pipeline problems and get some insight from Airflow contributors in case you are already an Airflow user.
Off time - how to use social media to be more out of social mediaJarek Potiuk
An Application we developed at Facebook Mobile Hackathon in Warsaw that encourages you to be more offline by tracking your offline status and (yes!) posting your ranks in social media.
Manageable data pipelines with airflow (and kubernetes) november 27, 11 45 ...Jarek Potiuk
Apache Airflow is a platform to programmatically author, schedule and monitor workflows. Airflow is not a data streaming solution. Tasks do not move data from one to the other (though tasks can exchange metadata!). Airflow is not in the Spark Streaming or Storm space, it is more comparable to Oozie or Azkaban. It's primary goal is to solve problem nicely described in this XKCD comic (https://xkcd.com/2054/) What's unique about Airflow is that it brings "infrastructure as a code" concept to building scalable, manageable and elegant workflows. Workflows are defined as Python code - thus making dynamic workflow possible. It provides hundreds of out-of-the-box Operators that allow your pipeline to tap into pretty much any resource possible - starting from resources from multiple cloud providers as well as on-the-premises systems of yours. It's super-easy to write your own operators and leverage the power of data pipeline infrastructure provided by Airflow. This talk will be about general concepts behind Airflow - how you can author your workflow, write your own operators and run and monitor your pipelines. It will also explain how you can leverage Kubernetes (in recent release of Airflow) to make use of your on-premises or in-the-cloud infrastructure efficiently. You leave the talk armed with enough knowledge to evaluate if Airflow is good for you to solve your data pipeline problems and get some insight from Airflow contributors in case you are already an Airflow user.
This is a story about how we developed a fully-fledged automated CI development environment for Android OS development. That was one of the first approaches where we managed to have every single PR go through full build process for Android OS ( almost 500-repositories). We manged to get down from almost 2 hrs build time to 20 minutes.
It's a Breeze to develop Apache Airflow (Apache Con Berlin)Jarek Potiuk
his talk is about tools and mechanism we developed and used to improve productivity and teamwork in our team (of 6 currently) while developing 70+ operators for Airflow over more than 6 months.
We developed an "Airflow Breeze" simplified development environment which cuts down the time to become productive Apache Airflow developer from days to minutes.
It is part of Airflow Improvement Proposals:
AIP-10 Multi-layered and multi-stage official Airflow image
AIP-7 Simplified development workflow
Introduction to React Native from Mobile Warsaw
This is a short presentation of concepts of React Native mobile application Framework.
It's an introductory talk for Application developers.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
3. Polidea
How to contribute
1
Fork airflow/master
Make your own fork of Apache
Airflow main repo
Configure environment
Create virtualenv
Initialize Breeze
Install pre-commit
Setup your own Travis CI
2
Connect with people
Join devlist
Setup slack account
3
Prepare PR
PR from your fork
Follow PR guidelines in
CONTRIBUTING.rst
4
PR review
Ping @ #development slack
Comment @people
Be annoying
Be considerate
5
4. Polidea
Fork apache/airflow
● Apache Airflow repository
○ https://github.com/apache/airflow
● How to fork
○ https://help.github.com/en/github/getting-started-with-github/fork-a-repo
6. Polidea
Configure environment
● Dev environments:
○ https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#development-environments
● Local virtualenv:
○ https://github.com/apache/airflow/blob/master/LOCAL_VIRTUALENV.rst
● Breeze
○ https://github.com/apache/airflow/blob/master/BREEZE.rst
● Travis CI
○ https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#travis-ci-testing-framework
● Pre-commit hooks
○ https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pre-commit-hooks
7. Polidea
Connect with people
● Slack: ad-hoc discussions/ask questions/is anyone working on it?
● DevList: important topics
● https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#resources-links
● Mailing lists:
○ Developer’s mailing list mailto:dev-subscribe@airflow.apache.org
○ All commits mailing list: mailto:commits-subscribe@airflow.apache.org
○ Airflow users mailing list: mailto:users-subscribe@airflow.apache.org
● Issues on Apache’s Jira
● Slack (chat)
● More resources and links to Airflow related content on the Wiki
8. Polidea
Prepare PR
● Pull Request Guidelines
○ https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#id11
● Rebase your fork, squash commits, and resolve all conflicts.
● Preface your commit's subject & PR title with [AIRFLOW-YYYY]
COMMIT_MSG where YYYY is the JIRA number.
9. Polidea
Check for PR
reviews and
comments
Apply fixes
and extend
tests
Submit
fixup
commit
Ping on
#developme
nt
PR Review
● Be empathic
● Be annoying
● Be cooperative
● Be persistent
● Rebase often to master
● Rinse & repeat
