Apache Beam: Lote portátil y procesamiento de transmisión
•
0 likes•50 views
Speaker: Albert Ramírez Cerquera Video: https://youtu.be/18Tbr1LZmtM En esta charla, vemos cómo utilizar el modelo de programación Apache Beam para procesar datos por batch y en streaming. Además, se enseñará cómo se puede ejecutar Beam en ejecutores como Flink y Google Cloud Dataflow. --------------------------------------------------------------------------------------------------------------------------------------------------------------- Hay trabajos y hay carreras. Las oportunidades vienen a golpear la puerta cuando menos lo esperas. La decisión es tuya. Desde tener la oportunidad de hacer algo significativo día tras día, hasta estar rodeado de gente supremamente inteligente y motivada. ¿Estás listo? Descúbre todas nuestras oportunidades acá: https://bit.ly/2PWKky9 --------------------------------------------------------------------------------------------------------------------------------------------------------------- Síguenos en: Facebook: https://www.facebook.com/Globant/ Twitter: https://twitter.com/Globant Instagram: https://www.instagram.com/globantpics/ Linkedin: https://www.linkedin.com/company/globant Visita nuestra página web: https://bit.ly/2XLVYQD
Report
Share
Report
Share
Download to read offline
Recommended
Flink Forward San Francisco 2019: Managing Flink on Kubernetes - FlinkK8sOper...
Managing Flink on Kubernetes - FlinkK8sOperator
The goal of Lyft is to “Improve people’s lives with the world’s best transportation”. Our product is fundamentally real-time and building a reliable platform that consumes and processes massive amounts of streaming data empowers us to achieve our mission. The advent of containers and Kubernetes has completely changed how we deploy and manage stateless services. At Lyft we have doubled down on Docker containers and Kubernetes for all the services in production. To achieve a homogenous infrastructure we decided to extend Kubernetes to manage stateful streaming services like Flink. We developed the FlinkK8sOperator which leverages Kubernetes CustomResourceDefinition to enable native management of Flink applications on Kubernetes. FlinkK8sOperator employs a state machine that transitions the application through a series of states, until a stable state is attained. Each Flink application on Kubernetes spins up a separate Flink Cluster, with its own UI, providing clear isolation for monitoring and debugging. This talk provides an overview of running Flink applications on Kubernetes using FlinkK8sOperator, showcasing the entire lifecycle of the application from creation to execution, with focus of transitions during deployments and stateful updates, concluding with a demo.
Porting Projects to .NET 5
Want to move to .NET 5? In this session you'll see how to approach porting projects from .NET Framework, .NET Core, and .NET Standard to .NET 5 and the tools you can use to get there.
Interoperate - Product Presentation
The document discusses semantics-based techniques for rapidly translating legacy software systems to modern versions. It focuses on Interoperate's product for automatically translating test scripts written in the obsolete WinRunner TestScript Language (TSL) to the modern QuickTest Pro (QTP) framework. The translation is done through Interoperate's translator, which can automatically convert over 95% of TSL code to an equivalent QTP test script. The document provides information on Interoperate's translation process and offers organizations an opportunity for a free proof-of-concept translation.
P.I.Z.Z.A.: Status Update
The P.IZ.Z.A Team presented their project to accelerate the Umap algorithm through FPGA implementation. They introduced themselves and their goal to speed up the already fast Umap algorithm. Their project aims to accelerate the central core of the NN_Descent algorithm through an FPGA implementation plus optimized Python layer. Their current work includes a fully functioning FPGA implementation of the nn_descent algorithm using custom data types and optimized conditional jumps. They also have an automated build process to generate C code from the original Python implementation to run on the FPGA.
201801 CSE240 Lecture 04
This document outlines a lecture on program processing methods, including interpretation, compilation, and two-step translation using intermediate code. Interpretation involves translating and executing each statement at runtime, allowing for quicker development but slower execution. Compilation translates the entire code to assembly code beforehand in two separate phases, allowing for faster execution but losing some debugging information. Languages like Java use a two-step process involving intermediate bytecode that makes the compiler independent of hardware while still allowing for optimization.
So you want to write a cloud function
With Cloud Functions you write simple, functions that doing one unit of execution.
Cloud Functions can be written using JavaScript, Python 3, or Go
and you simply deploy a function bound to the event you want and you are all done.
In our case we will leavrage from Cloud Function to manage our K8s clusters based on work times in order to save budget.
Spring Boot & Spring Cloud on k8s and PCF
This document discusses Spring Boot and Spring Cloud applications running on Kubernetes and Pivotal Cloud Foundry. It introduces the speaker and covers topics like different platforms, choosing between Kubernetes and PCF, and developer experience differences. PCF is highlighted as providing lower development complexity while Kubernetes offers more flexibility and control. The benefits of both platforms for running Spring applications are discussed.
C og c++-jens lund jensen
The document summarizes a company's conversion of its embedded controller software from C to C++ over a two month period. It involved converting 8 projects with 30% shared code across 18 developers. Challenges included converting callbacks and dealing with scripting errors. Opportunities included improving code quality, team building, and evaluating new static analysis tools. The conversion was successful with minimal performance impacts and many bugs were found and fixed during the process. Future plans include C++ training and refactoring code to fully utilize C++ features.
Recommended
Flink Forward San Francisco 2019: Managing Flink on Kubernetes - FlinkK8sOper...
Managing Flink on Kubernetes - FlinkK8sOperator
The goal of Lyft is to “Improve people’s lives with the world’s best transportation”. Our product is fundamentally real-time and building a reliable platform that consumes and processes massive amounts of streaming data empowers us to achieve our mission. The advent of containers and Kubernetes has completely changed how we deploy and manage stateless services. At Lyft we have doubled down on Docker containers and Kubernetes for all the services in production. To achieve a homogenous infrastructure we decided to extend Kubernetes to manage stateful streaming services like Flink. We developed the FlinkK8sOperator which leverages Kubernetes CustomResourceDefinition to enable native management of Flink applications on Kubernetes. FlinkK8sOperator employs a state machine that transitions the application through a series of states, until a stable state is attained. Each Flink application on Kubernetes spins up a separate Flink Cluster, with its own UI, providing clear isolation for monitoring and debugging. This talk provides an overview of running Flink applications on Kubernetes using FlinkK8sOperator, showcasing the entire lifecycle of the application from creation to execution, with focus of transitions during deployments and stateful updates, concluding with a demo.
Porting Projects to .NET 5
Want to move to .NET 5? In this session you'll see how to approach porting projects from .NET Framework, .NET Core, and .NET Standard to .NET 5 and the tools you can use to get there.
Interoperate - Product Presentation
The document discusses semantics-based techniques for rapidly translating legacy software systems to modern versions. It focuses on Interoperate's product for automatically translating test scripts written in the obsolete WinRunner TestScript Language (TSL) to the modern QuickTest Pro (QTP) framework. The translation is done through Interoperate's translator, which can automatically convert over 95% of TSL code to an equivalent QTP test script. The document provides information on Interoperate's translation process and offers organizations an opportunity for a free proof-of-concept translation.
P.I.Z.Z.A.: Status Update
The P.IZ.Z.A Team presented their project to accelerate the Umap algorithm through FPGA implementation. They introduced themselves and their goal to speed up the already fast Umap algorithm. Their project aims to accelerate the central core of the NN_Descent algorithm through an FPGA implementation plus optimized Python layer. Their current work includes a fully functioning FPGA implementation of the nn_descent algorithm using custom data types and optimized conditional jumps. They also have an automated build process to generate C code from the original Python implementation to run on the FPGA.
201801 CSE240 Lecture 04
This document outlines a lecture on program processing methods, including interpretation, compilation, and two-step translation using intermediate code. Interpretation involves translating and executing each statement at runtime, allowing for quicker development but slower execution. Compilation translates the entire code to assembly code beforehand in two separate phases, allowing for faster execution but losing some debugging information. Languages like Java use a two-step process involving intermediate bytecode that makes the compiler independent of hardware while still allowing for optimization.
So you want to write a cloud function
With Cloud Functions you write simple, functions that doing one unit of execution.
Cloud Functions can be written using JavaScript, Python 3, or Go
and you simply deploy a function bound to the event you want and you are all done.
In our case we will leavrage from Cloud Function to manage our K8s clusters based on work times in order to save budget.
Spring Boot & Spring Cloud on k8s and PCF
This document discusses Spring Boot and Spring Cloud applications running on Kubernetes and Pivotal Cloud Foundry. It introduces the speaker and covers topics like different platforms, choosing between Kubernetes and PCF, and developer experience differences. PCF is highlighted as providing lower development complexity while Kubernetes offers more flexibility and control. The benefits of both platforms for running Spring applications are discussed.
C og c++-jens lund jensen
The document summarizes a company's conversion of its embedded controller software from C to C++ over a two month period. It involved converting 8 projects with 30% shared code across 18 developers. Challenges included converting callbacks and dealing with scripting errors. Opportunities included improving code quality, team building, and evaluating new static analysis tools. The conversion was successful with minimal performance impacts and many bugs were found and fixed during the process. Future plans include C++ training and refactoring code to fully utilize C++ features.
Cloud Native CI/CD with Spring Cloud Pipelines
Spring, Spring Boot and Spring Cloud are tools that allow developers to speed up the creation of new business features. But a new feature is only useful if it's in production. Companies spend a lot of time and resources on building their own deployment pipelines using a plethora of technologies. Spring Cloud Pipelines provides an opinionated way for getting your features to production in a fast, reliable, reproducible and fully automated way.
Go programming language
Go programming language is an open source static type language designed by Google engineers Robert Griesemer, Rob Pike and Ken Thompson.
A Functional Approach to Architecture - Kafka & Kafka Streams - Kevin Mas Rui...
This document discusses the use of Kafka and Kafka Streams to build a functional architecture for exporting car listings data from AutoScout24 to other marketplaces. It describes the business requirements, including allowing dealers to enable/disable exports and ensuring listings are updated. It then provides an overview of Kafka and Kafka Streams and how they enable a scalable, fault-tolerant streaming data pipeline modeled with stateless functions. Key learnings are that functions should transform domains and consistency is on a per-partition basis.
Five Real-World Strategies for Perforce Streams
Before you deploy Perforce Streams in your organization, you should have a plan in place. Get advice and hear the five strategies for using Streams and how to handle integration exceptions gracefully.
Building your first aplication using Apache Apex
This document provides an overview of building an Apache Apex application, including key concepts like DAGs, operators, and ports. It also includes an example "word count" application and demonstrates how to define the application and operators, and build Apache Apex from source code. The document outlines the sample application workflow and includes information on resources for learning more about Apache Apex.
Bodywork - GitOps for Machine Learning
The document discusses continuous deployment for machine learning projects using Bodywork. Bodywork enables CI/CD for ML projects by allowing teams to define workflows in a Git repository that can deploy models, pipelines, and services to Kubernetes. It tackles common deployment challenges for ML like managing container images and infrastructure, and allows teams to focus on their code. The talk includes demos of sample ML projects deployed with Bodywork, like serving a model with a REST API and a train-and-serve pipeline.
Go lambda-presentation
Steven White gave a presentation on using Go (golang) to build serverless applications targeting AWS Lambda. He defined serverless computing and Function as a Service (FaaS). The presentation included setting up a Go project to target Lambda, integrating with AWS API Gateway, and using DynamoDB as a backend database for a simple REST API, with live coding demonstrations. Resources for further learning about serverless architectures using Go and AWS Lambda were also provided.
Php Inspections (EA Extended): realtime static code analysis
Php Inspections (EA Extended) provides real-time static code analysis for PHP with over 300 rules across 12 groups. It runs analysis on-the-fly and supports automated issue fixing. Static code analysis can reduce change and ownership costs by slowing software aging through early defect detection. The tool is particularly useful for its control flow, performance, and probable bugs rule groups which are important for legacy codebases.
Multitenant SaaS Apps In Rails By Iqbal Hasnan
This document discusses multi-tenant SaaS applications in Ruby on Rails. It describes multi-tenancy as an architecture where a single application serves multiple customers (tenants). It provides examples like GitHub and Basecamp. It also defines Software as a Service (SaaS) and discusses two common multi-tenancy options in Rails: using PostgreSQL schemas with the Apartment gem or column scoping. It then covers implementing subdomains, charging customers via subscriptions or rake tasks/cron jobs, and using the Apartment gem for schema scoping in a Rails app.
Open source tools for logic synthesis and soc design an overview
This document provides an overview of open source tools for logic synthesis and system on chip design. It discusses the following topics:
1. Functional verification using iverilog for simulation and verification of digital designs.
2. Logic synthesis which translates RTL to gates using techniques like translation, optimizations, and mapping to a standard cell library.
3. Gate level simulation using iverilog to check correctness after synthesis.
4. The Litex framework for creating FPGA cores and systems on chips with support for CPUs like microwatt and integration of Verilog, VHDL, and SystemVerilog code.
5. A demo of simulating a microwatt-based system on chip using
Config management for kubernetes: GitOps + Helm
This document discusses using GitOps and Helm for configuration management of Kubernetes. It begins with an overview of configuration management and why GitOps is useful. It then demonstrates Flux for continuous delivery to synchronize a Git repo and Kubernetes cluster. Helm is demonstrated as a package manager for Kubernetes that helps manage complex applications and sharing of charts. Finally, it shows how the Flux Helm Operator can automate Helm chart releases defined as Kubernetes custom resources.
Trailblazer Rails Architecture
The document introduces Trailblazer, a Ruby on Rails architecture that introduces new abstraction layers to help with code organization. It aims to gently enforce encapsulation and intuitive structure by providing clear guidelines for where different types of code belong. This helps address the complexity issue that can arise in applications larger than a simple blog. Trailblazer moves processing logic out of controllers and into separate operations, keeps models logic-less for persistence, and uses cells/decorators to organize views.
RxSwift
RxSwift is a library for reactive programming in Swift that allows asynchronous data streams to be represented as Observables. It provides components like Observables, Observers, and Schedulers that allow asynchronous and event-based programs to be written in a functional, non-blocking manner. RxSwift uses operators to filter, transform, and combine Observable data streams and includes extensions for UI bindings and almost any other type of object.
Sebastian Spaink [InfluxData] | Layer by Layer: Printing Your Own External In...
An external plugin allows Telegraf to collect metrics from external programs. This presentation demonstrates how to create an external plugin by printing 3D data from an Octoprint server. It discusses the basics of external plugins, provides a simple example using Bash, and walks through building a plugin for Octoprint using Go. The presentation concludes by discussing how to create plugins in other languages like Rust and ideas for other external plugins.
Designing a complete ci cd pipeline using argo events, workflow and cd products
https://www.youtube.com/watch?v=YmIAatr3Who
Presented at Cloud and AI DevFest GDG Montreal on September 27, 2019.
Are you looking to get more flexibility out of your CICD platform? Interested how GitOps fits into the mix? Learn how Argo CD, Workflows, and Events can be combined to craft custom CICD flows. All while staying Kubernetes native, enabling you to leverage existing observability tooling.
Berlin AWS meetup: here.com on AWS
Here.com implemented their website on AWS over time, starting with a single region and EC2 instances. They expanded to use CloudFront for caching, ElastiCache, and additional regions for latency. Performance issues prompted optimizations like refactoring stacks, right-sizing instances, and frontend improvements. Next steps include further performance fixes and using HTTP/2 when available. Lessons included starting small and iterating, being data-driven, automating pain points, and embracing limitations for workarounds.
helm, the real world
Related to meetup: https://www.meetup.com/Kubernetes-Tel-Aviv/events/248536747/
Codefresh - using Helm to provision ad-hoc environments
Oleg from Codefresh will share how they have used Helm to spin up an complete working version of their product (including all services and dependencies) on each commit, allowing developers and other stakeholders to test, experiment, and communicate on work in progress.
Oleg is working as Backend engineer at Codefresh, a Kubernetes native CI/CD platform.
For the past year focusing on #helm and #K8S in research and implementation of Codefresh roadmap.
In his spare time Oleg is maintaining his own projects, traveling and reading.
The demo application: https://github.com/olegsu/kubernetes-tlv
44CON 2014 - Binary Protocol Analysis with CANAPE, James Forshaw
44CON 2014 - Binary Protocol Analysis with CANAPE, James Forshaw
CANAPE is an open source network proxy written in .NET. It has been developed to aid in the analysis and exploitation of unknown application network protocols using a similar use case to common HTTP proxies such as Burp or CAT.
This workshop will go through the basics of analysing an unknown application protocol with hands on training examples. By the end of the workshop candidates should be able to better understand CANAPE’s functionality and be able to apply that to other protocols they come across.
THE STATE OF OPENTELEMETRY, DOTAN HOROVITS, Logz.io
Everyone wants observability into their system, but find themselves with too many vendors and tools, each with its own API, SDK, agent and collectors.
In this talk I will present OpenTelemetry, an ambitious open source project with the promise of a unified framework for collecting observability data. With OpenTelemetry you could instrument your application in a vendor-agnostic way, and then analyze the telemetry data in your backend tool of choice, whether Prometheus, Jaeger, Zipkin, or others.
I will cover the current state of the various projects of OpenTelemetry (across programming languages, exporters, receivers, protocols), some of which not even GA yet, and provide useful guidance on how to get started with it.
.Net Introduction
The document discusses the .NET Framework. It is a software platform that is language-neutral and allows programs written in any compliant language to be executed. The framework includes the Common Language Runtime (CLR) which acts like a virtual machine, Windows Forms for building rich clients, ASP.NET for web applications and web services, and Visual Studio.NET as an integrated development environment. All .NET languages compile to intermediate language code that is just-in-time compiled and executed by the CLR.
Introduction to Apache Beam
Apache Beam is an open source unified programming model to define and execute data processing pipelines, including ETL, batch and stream processing.
Present and future of unified, portable, and efficient data processing with A...
The world of big data involves an ever-changing field of players. Much as SQL stands as a lingua franca for declarative data analysis, Apache Beam aims to provide a portable standard for expressing robust, out-of-order data processing pipelines in a variety of languages across a variety of platforms. In a way, Apache Beam is a glue that can connect the big data ecosystem together; it enables users to "run any data processing pipeline anywhere."
This talk will briefly cover the capabilities of the Beam model for data processing and discuss its architecture, including the portability model. We’ll focus on the present state of the community and the current status of the Beam ecosystem. We’ll cover the state of the art in data processing and discuss where Beam is going next, including completion of the portability framework and the Streaming SQL. Finally, we’ll discuss areas of improvement and how anybody can join us on the path of creating the glue that interconnects the big data ecosystem.
Speaker
Davor Bonaci, Apache Software Foundation; Simbly, V.P. of Apache Beam; Founder/CEO at Operiant
More Related Content
What's hot
Cloud Native CI/CD with Spring Cloud Pipelines
Spring, Spring Boot and Spring Cloud are tools that allow developers to speed up the creation of new business features. But a new feature is only useful if it's in production. Companies spend a lot of time and resources on building their own deployment pipelines using a plethora of technologies. Spring Cloud Pipelines provides an opinionated way for getting your features to production in a fast, reliable, reproducible and fully automated way.
Go programming language
Go programming language is an open source static type language designed by Google engineers Robert Griesemer, Rob Pike and Ken Thompson.
A Functional Approach to Architecture - Kafka & Kafka Streams - Kevin Mas Rui...
This document discusses the use of Kafka and Kafka Streams to build a functional architecture for exporting car listings data from AutoScout24 to other marketplaces. It describes the business requirements, including allowing dealers to enable/disable exports and ensuring listings are updated. It then provides an overview of Kafka and Kafka Streams and how they enable a scalable, fault-tolerant streaming data pipeline modeled with stateless functions. Key learnings are that functions should transform domains and consistency is on a per-partition basis.
Five Real-World Strategies for Perforce Streams
Before you deploy Perforce Streams in your organization, you should have a plan in place. Get advice and hear the five strategies for using Streams and how to handle integration exceptions gracefully.
Building your first aplication using Apache Apex
This document provides an overview of building an Apache Apex application, including key concepts like DAGs, operators, and ports. It also includes an example "word count" application and demonstrates how to define the application and operators, and build Apache Apex from source code. The document outlines the sample application workflow and includes information on resources for learning more about Apache Apex.
Bodywork - GitOps for Machine Learning
The document discusses continuous deployment for machine learning projects using Bodywork. Bodywork enables CI/CD for ML projects by allowing teams to define workflows in a Git repository that can deploy models, pipelines, and services to Kubernetes. It tackles common deployment challenges for ML like managing container images and infrastructure, and allows teams to focus on their code. The talk includes demos of sample ML projects deployed with Bodywork, like serving a model with a REST API and a train-and-serve pipeline.
Go lambda-presentation
Steven White gave a presentation on using Go (golang) to build serverless applications targeting AWS Lambda. He defined serverless computing and Function as a Service (FaaS). The presentation included setting up a Go project to target Lambda, integrating with AWS API Gateway, and using DynamoDB as a backend database for a simple REST API, with live coding demonstrations. Resources for further learning about serverless architectures using Go and AWS Lambda were also provided.
Php Inspections (EA Extended): realtime static code analysis
Php Inspections (EA Extended) provides real-time static code analysis for PHP with over 300 rules across 12 groups. It runs analysis on-the-fly and supports automated issue fixing. Static code analysis can reduce change and ownership costs by slowing software aging through early defect detection. The tool is particularly useful for its control flow, performance, and probable bugs rule groups which are important for legacy codebases.
Multitenant SaaS Apps In Rails By Iqbal Hasnan
This document discusses multi-tenant SaaS applications in Ruby on Rails. It describes multi-tenancy as an architecture where a single application serves multiple customers (tenants). It provides examples like GitHub and Basecamp. It also defines Software as a Service (SaaS) and discusses two common multi-tenancy options in Rails: using PostgreSQL schemas with the Apartment gem or column scoping. It then covers implementing subdomains, charging customers via subscriptions or rake tasks/cron jobs, and using the Apartment gem for schema scoping in a Rails app.
Open source tools for logic synthesis and soc design an overview
This document provides an overview of open source tools for logic synthesis and system on chip design. It discusses the following topics:
1. Functional verification using iverilog for simulation and verification of digital designs.
2. Logic synthesis which translates RTL to gates using techniques like translation, optimizations, and mapping to a standard cell library.
3. Gate level simulation using iverilog to check correctness after synthesis.
4. The Litex framework for creating FPGA cores and systems on chips with support for CPUs like microwatt and integration of Verilog, VHDL, and SystemVerilog code.
5. A demo of simulating a microwatt-based system on chip using
Config management for kubernetes: GitOps + Helm
This document discusses using GitOps and Helm for configuration management of Kubernetes. It begins with an overview of configuration management and why GitOps is useful. It then demonstrates Flux for continuous delivery to synchronize a Git repo and Kubernetes cluster. Helm is demonstrated as a package manager for Kubernetes that helps manage complex applications and sharing of charts. Finally, it shows how the Flux Helm Operator can automate Helm chart releases defined as Kubernetes custom resources.
Trailblazer Rails Architecture
The document introduces Trailblazer, a Ruby on Rails architecture that introduces new abstraction layers to help with code organization. It aims to gently enforce encapsulation and intuitive structure by providing clear guidelines for where different types of code belong. This helps address the complexity issue that can arise in applications larger than a simple blog. Trailblazer moves processing logic out of controllers and into separate operations, keeps models logic-less for persistence, and uses cells/decorators to organize views.
RxSwift
RxSwift is a library for reactive programming in Swift that allows asynchronous data streams to be represented as Observables. It provides components like Observables, Observers, and Schedulers that allow asynchronous and event-based programs to be written in a functional, non-blocking manner. RxSwift uses operators to filter, transform, and combine Observable data streams and includes extensions for UI bindings and almost any other type of object.
Sebastian Spaink [InfluxData] | Layer by Layer: Printing Your Own External In...
An external plugin allows Telegraf to collect metrics from external programs. This presentation demonstrates how to create an external plugin by printing 3D data from an Octoprint server. It discusses the basics of external plugins, provides a simple example using Bash, and walks through building a plugin for Octoprint using Go. The presentation concludes by discussing how to create plugins in other languages like Rust and ideas for other external plugins.
Designing a complete ci cd pipeline using argo events, workflow and cd products
https://www.youtube.com/watch?v=YmIAatr3Who
Presented at Cloud and AI DevFest GDG Montreal on September 27, 2019.
Are you looking to get more flexibility out of your CICD platform? Interested how GitOps fits into the mix? Learn how Argo CD, Workflows, and Events can be combined to craft custom CICD flows. All while staying Kubernetes native, enabling you to leverage existing observability tooling.
Berlin AWS meetup: here.com on AWS
Here.com implemented their website on AWS over time, starting with a single region and EC2 instances. They expanded to use CloudFront for caching, ElastiCache, and additional regions for latency. Performance issues prompted optimizations like refactoring stacks, right-sizing instances, and frontend improvements. Next steps include further performance fixes and using HTTP/2 when available. Lessons included starting small and iterating, being data-driven, automating pain points, and embracing limitations for workarounds.
helm, the real world
Related to meetup: https://www.meetup.com/Kubernetes-Tel-Aviv/events/248536747/
Codefresh - using Helm to provision ad-hoc environments
Oleg from Codefresh will share how they have used Helm to spin up an complete working version of their product (including all services and dependencies) on each commit, allowing developers and other stakeholders to test, experiment, and communicate on work in progress.
Oleg is working as Backend engineer at Codefresh, a Kubernetes native CI/CD platform.
For the past year focusing on #helm and #K8S in research and implementation of Codefresh roadmap.
In his spare time Oleg is maintaining his own projects, traveling and reading.
The demo application: https://github.com/olegsu/kubernetes-tlv
44CON 2014 - Binary Protocol Analysis with CANAPE, James Forshaw
44CON 2014 - Binary Protocol Analysis with CANAPE, James Forshaw
CANAPE is an open source network proxy written in .NET. It has been developed to aid in the analysis and exploitation of unknown application network protocols using a similar use case to common HTTP proxies such as Burp or CAT.
This workshop will go through the basics of analysing an unknown application protocol with hands on training examples. By the end of the workshop candidates should be able to better understand CANAPE’s functionality and be able to apply that to other protocols they come across.
THE STATE OF OPENTELEMETRY, DOTAN HOROVITS, Logz.io
Everyone wants observability into their system, but find themselves with too many vendors and tools, each with its own API, SDK, agent and collectors.
In this talk I will present OpenTelemetry, an ambitious open source project with the promise of a unified framework for collecting observability data. With OpenTelemetry you could instrument your application in a vendor-agnostic way, and then analyze the telemetry data in your backend tool of choice, whether Prometheus, Jaeger, Zipkin, or others.
I will cover the current state of the various projects of OpenTelemetry (across programming languages, exporters, receivers, protocols), some of which not even GA yet, and provide useful guidance on how to get started with it.
.Net Introduction
The document discusses the .NET Framework. It is a software platform that is language-neutral and allows programs written in any compliant language to be executed. The framework includes the Common Language Runtime (CLR) which acts like a virtual machine, Windows Forms for building rich clients, ASP.NET for web applications and web services, and Visual Studio.NET as an integrated development environment. All .NET languages compile to intermediate language code that is just-in-time compiled and executed by the CLR.
What's hot (20)
A Functional Approach to Architecture - Kafka & Kafka Streams - Kevin Mas Rui...
A Functional Approach to Architecture - Kafka & Kafka Streams - Kevin Mas Rui...
Php Inspections (EA Extended): realtime static code analysis
Php Inspections (EA Extended): realtime static code analysis
Open source tools for logic synthesis and soc design an overview
Open source tools for logic synthesis and soc design an overview
Sebastian Spaink [InfluxData] | Layer by Layer: Printing Your Own External In...
Sebastian Spaink [InfluxData] | Layer by Layer: Printing Your Own External In...
Designing a complete ci cd pipeline using argo events, workflow and cd products
Designing a complete ci cd pipeline using argo events, workflow and cd products
44CON 2014 - Binary Protocol Analysis with CANAPE, James Forshaw
44CON 2014 - Binary Protocol Analysis with CANAPE, James Forshaw
THE STATE OF OPENTELEMETRY, DOTAN HOROVITS, Logz.io
THE STATE OF OPENTELEMETRY, DOTAN HOROVITS, Logz.io
Similar to Apache Beam: Lote portátil y procesamiento de transmisión
Introduction to Apache Beam
Apache Beam is an open source unified programming model to define and execute data processing pipelines, including ETL, batch and stream processing.
Present and future of unified, portable, and efficient data processing with A...
The world of big data involves an ever-changing field of players. Much as SQL stands as a lingua franca for declarative data analysis, Apache Beam aims to provide a portable standard for expressing robust, out-of-order data processing pipelines in a variety of languages across a variety of platforms. In a way, Apache Beam is a glue that can connect the big data ecosystem together; it enables users to "run any data processing pipeline anywhere."
This talk will briefly cover the capabilities of the Beam model for data processing and discuss its architecture, including the portability model. We’ll focus on the present state of the community and the current status of the Beam ecosystem. We’ll cover the state of the art in data processing and discuss where Beam is going next, including completion of the portability framework and the Streaming SQL. Finally, we’ll discuss areas of improvement and how anybody can join us on the path of creating the glue that interconnects the big data ecosystem.
Speaker
Davor Bonaci, Apache Software Foundation; Simbly, V.P. of Apache Beam; Founder/CEO at Operiant
Brisbane MuleSoft Meetup 2023-03-22 - Anypoint Code Builder and Splunk Loggin...
In this presentation we'll explore the latest developments in MuleSoft's Anypoint Code Builder IDE and how it can help streamline your integration projects. We'll also dive into the exciting world of Splunk and demonstrate how to efficiently push your application logs to Splunk for real-time analysis and troubleshooting.
Introduction to DevOps and the Practical Use Cases at Credit OK
The document provides an introduction to DevOps and practical use cases. It discusses what DevOps is, why it is popular, the skills required of DevOps engineers, and common DevOps technologies like version control, CI/CD pipelines, containers, and monitoring. It also summarizes Credit OK's use of DevOps practices like Docker, Kubernetes, and GitLab CI/CD pipelines for their credit scoring platform. Finally, it outlines some modern obstacles in software development and concludes that DevOps can help ensure quality, improve productivity, and automate infrastructure through practices like continuous integration, containerization, and logging/monitoring.
Flink Forward San Francisco 2019: Apache Beam portability in the times of rea...
Apache Beam was open sourced by the big data team at Google in 2016, and has become an active community with participants from all over. Beam is a framework to define data processing workflows and run them on various runners (Flink included). In this talk, I will talk about some cool things you can do with Beam + Flink such as running pipelines written in Go and Python; then I’ll mention some cool tools in the Beam ecosystem. Finally, we’ll wrap up with some cool things we expect to be able to do soon - and how you can get involved.
Portable batch and streaming pipelines with Apache Beam (Big Data Application...
Apache Beam is a top-level Apache project which aims at providing a unified API for efficient and portable data processing pipeline. Beam handles both batch and streaming use cases and neatly separates properties of the data from runtime characteristics, allowing pipelines to be portable across multiple runtimes, both open-source (e.g., Apache Flink, Apache Spark, Apache Apex, ...) and proprietary (e.g., Google Cloud Dataflow). This talk will cover the basics of Apache Beam, describe the main concepts of the programming model and talk about the current state of the project (new python support, first stable version). We'll illustrate the concepts with a use case running on several runners.
Apache Airflow in the Cloud: Programmatically orchestrating workloads with Py...
Apache Airflow allows users to programmatically author, schedule, and monitor workflows or directed acyclic graphs (DAGs) using Python. It is an open-source workflow management platform developed by Airbnb that is used to orchestrate data pipelines. The document provides an overview of Airflow including what it is, its architecture, and concepts like DAGs, tasks, and operators. It also includes instructions on setting up Airflow and running tutorials on basic and dynamic workflows.
LCU14 310- Cisco ODP v2
LCU14 310- Cisco ODP
---------------------------------------------------
Speaker: Robbie King
Date: September 17, 2014
---------------------------------------------------
★ Session Summary ★
Cisco to present their experience using ODP to provide portable accelerated access to crypto functions on various SoCs.
---------------------------------------------------
★ Resources ★
Zerista: http://lcu14.zerista.com/event/member/137757
Google Event: https://plus.google.com/u/0/events/ckmld1hll5jjijq11frbqmptet8
Video: https://www.youtube.com/watch?v=eFlTmslVK-Y&list=UUIVqQKxCyQLJS6xvSmfndLA
Etherpad: http://pad.linaro.org/p/lcu14-310
---------------------------------------------------
★ Event Details ★
Linaro Connect USA - #LCU14
September 15-19th, 2014
Hyatt Regency San Francisco Airport
---------------------------------------------------
http://www.linaro.org
http://connect.linaro.org
Prefect Paris Airflow Meetup Jeff Hale April 2023.pdf
Prefect: tools for interacting with complex system. Prefect is the flexible and scalable
Python data orchestrator. And introducing Marvin, the
batteries-included library for building AI-powered software.
Apache Beam @ GCPUG.TW Flink.TW 20161006
Introduce to Apache Beam
Dive in to Beam's architecture and live demo running data pipeline on different runners such as Google Dataflow, Flink and Spark
SpringOne 2016 in a nutshell
If you missed the SpringOne Conference this year, don't fret! In this session you'll get the opportunity to get the highlights of the trip Jeroen and Tim made to Las Vegas and they'll show you the coolest stuff from Spring and CloudFoundry!
Unified, Efficient, and Portable Data Processing with Apache Beam
Unbounded, unordered, global scale datasets are increasingly common in day-to-day business, and consumers of these datasets have detailed requirements for latency, cost, and completeness. Apache Beam defines a new data processing programming model that evolved from more than a decade of experience building Big Data infrastructure within Google, including MapReduce, FlumeJava, Millwheel, and Cloud Dataflow.
Apache Beam handles both batch and streaming use cases, offering a powerful, unified model. It neatly separates properties of the data from run-time characteristics, allowing pipelines to be portable across multiple run-time environments, both open source, including Apache Apex, Apache Flink, Apache Gearpump, Apache Spark, and proprietary. Finally, Beam's model enables newer optimizations, like dynamic work rebalancing and autoscaling, resulting in an efficient execution.
This talk will cover the basics of Apache Beam, touch on its evolution, and describe main concepts in its powerful programming model. We'll show how Beam unifies batch and streaming use cases, and show efficient execution in real-world scenarios. Finally, we'll demonstrate pipeline portability across Apache Apex, Apache Flink, Apache Spark and Google Cloud Dataflow in a live setting.
Portable Streaming Pipelines with Apache Beam
1) Apache Beam is an open source unified model for defining both batch and streaming data processing pipelines. It allows writing pipelines once that can run on multiple distributed processing backends.
2) The Beam model separates the data processing logic from runtime requirements. It defines concepts like processing time vs event time to allow portability across batch and streaming runners.
3) Beam supports extensible IO connectors and aims to allow pipelines written in one language to run on different runtimes through language-specific SDKs. Currently, Java and Python SDKs can run on backends like Apache Spark, Flink, and Google Cloud Dataflow.
Structured Streaming in Spark
Apache Spark has been gaining steam, with rapidity, both in the headlines and in real-world adoption. Spark was developed in 2009, and open sourced in 2010. Since then, it has grown to become one of the largest open source communities in big data with over 200 contributors from more than 50 organizations. This open source analytics engine stands out for its ability to process large volumes of data significantly faster than contemporaries such as MapReduce, primarily owing to in-memory storage of data on its own processing framework. That being said, one of the top real-world industry use cases for Apache Spark is its ability to process ‘streaming data‘.
Apache Beam and Google Cloud Dataflow - IDG - final
Google Cloud Dataflow is a next generation managed big data service based on the Apache Beam programming model. It provides a unified model for batch and streaming data processing, with an optimized execution engine that automatically scales based on workload. Customers report being able to build complex data pipelines more quickly using Cloud Dataflow compared to other technologies like Spark, and with improved performance and reduced operational overhead.
OpenLineage for Stream Processing | Kafka Summit London
"OpenLineage is an open platform for the collection and analysis of data lineage, which includes an open standard for lineage data collection, integration libraries for the most common tools, and a metadata repository/reference implementation (Marquez).
In recent months, stream processing, which is an important use case for Apache Kafka, has gained the particular focus of the OpenLineage community with many useful features completed or begun, including:
* A seamless OpenLineage & Apache Flink integration,
* Support for streaming jobs in Marquez,
* Progress on a built-in lineage API within the Flink codebase.
Cross-platform lineage allows for a holistic overview of data flow and its dependencies within organizations, including stream processing.
This talk will provide an overview of the most recent developments in the OpenLineage Flink integration and share what’s in store for this important collaboration.
This talk is a must-attend for those wishing to stay up-to-date on lineage developments in the stream processing world."
DevOpsDays Tel Aviv DEC 2022 | Building A Cloud-Native Platform Brick by Bric...
DevOpsDays Tel Aviv DEC 2022 | Building A Cloud-Native Platform Brick by Bric...Haggai Philip Zagury
The overwhelming growth of technologies in the Cloud Native foundation overtook our toolbox and completely changed (well, really enhanced) the Developer Experience.
In this talk, I will try to provide my personal journey from the "Operator to Developer's chair" and the practices which helped me along my journey as a Cloud-Native Dev ;)Google Cloud Dataflow
Cloud Dataflow is a fully managed service and SDK from Google that allows users to define and run data processing pipelines. The Dataflow SDK defines the programming model used to build streaming and batch processing pipelines. Google Cloud Dataflow is the managed service that will run and optimize pipelines defined using the SDK. The SDK provides primitives like PCollections, ParDo, GroupByKey, and windows that allow users to build unified streaming and batch pipelines.
CCT (Check and Calculate Transfer)
CCT is a Web App developed for an IT Project Management exam. This Web App hasbeen developed using various tools including Python, MySQL, Flask, Anaconda, and VisualStudio Code. An app aimed at companies able to manage the transfers of a worker withinthe company, taking into account all the costs that he faces and allowing him to updatethem through this webApp. Finally, to make understanding easier, there was a graphicalinterface dedicated to understanding costs, transfers through plots.
Presentation CCT
CCT is a project for the IT Project and Management exam's. It's an help for the employee to plan and organize the transfer and receive a refound in a short term. The principal operations are : Add transfer, Share on Telegram, View Details, Import Costs in way to semplify the PM's work. For develop this web app, I use Anaconda, Flask, Visual Studio and MySql.
Similar to Apache Beam: Lote portátil y procesamiento de transmisión (20)
Present and future of unified, portable, and efficient data processing with A...
Present and future of unified, portable, and efficient data processing with A...
Brisbane MuleSoft Meetup 2023-03-22 - Anypoint Code Builder and Splunk Loggin...
Brisbane MuleSoft Meetup 2023-03-22 - Anypoint Code Builder and Splunk Loggin...
Introduction to DevOps and the Practical Use Cases at Credit OK
Introduction to DevOps and the Practical Use Cases at Credit OK
Flink Forward San Francisco 2019: Apache Beam portability in the times of rea...
Flink Forward San Francisco 2019: Apache Beam portability in the times of rea...
Portable batch and streaming pipelines with Apache Beam (Big Data Application...
Portable batch and streaming pipelines with Apache Beam (Big Data Application...
Apache Airflow in the Cloud: Programmatically orchestrating workloads with Py...
Apache Airflow in the Cloud: Programmatically orchestrating workloads with Py...
Prefect Paris Airflow Meetup Jeff Hale April 2023.pdf
Prefect Paris Airflow Meetup Jeff Hale April 2023.pdf
Unified, Efficient, and Portable Data Processing with Apache Beam
Unified, Efficient, and Portable Data Processing with Apache Beam
Apache Beam and Google Cloud Dataflow - IDG - final
Apache Beam and Google Cloud Dataflow - IDG - final
OpenLineage for Stream Processing | Kafka Summit London
OpenLineage for Stream Processing | Kafka Summit London
DevOpsDays Tel Aviv DEC 2022 | Building A Cloud-Native Platform Brick by Bric...
DevOpsDays Tel Aviv DEC 2022 | Building A Cloud-Native Platform Brick by Bric...
More from Globant
Webinar MLOps: When AA gets serious.
This document discusses operations for commercial flights. It covers personalized offers, holidays, ancillary services, mail offers, customer segmentation, flying tendencies, upgrades, agency relationships, fraud prevention, demand forecasting, overbooking, and pricing. It also discusses hiring data scientists, engineers, and machine learning specialists to build models and ensure proper monitoring, testing, and reproducibility of models in production. MLOps principles are discussed around consuming models through on-demand batch processing, native libraries, lookup tables, and experiment tracking.
Google Cloud Spanner y NewSQL
Video: https://youtu.be/LuVT0jsIrZk
------------------------------------------------------------------------------------------------------------------------------------
Hay trabajos y hay carreras. Las oportunidades vienen a golpear la puerta cuando menos lo esperas. La decisión es tuya. Desde tener la oportunidad de hacer algo significativo día tras día, hasta estar rodeado de gente supremamente inteligente y motivada.
¿Estás listo?
Descúbre todas nuestras oportunidades acá:https://mycareer.globant.com/
------------------------------------------------------------------------------------------------------------------------------------
Siguenos en:
Facebook: https://www.facebook.com/Globant/
Twitter: https://twitter.com/Globant
Instagram: https://www.instagram.com/globantpics/
Linkedin: https://www.linkedin.com/company/globant/
Eventos Asíncronos como estrategia virtual
Video:https://youtu.be/TOGOBc81hjc
Speakers: Andres Gonzalez - Project Manager en Globant & Jeid Vásquez - Agile Coach en IBM
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Hay trabajos y hay carreras. Las oportunidades vienen a golpear la puerta cuando menos lo esperas. La decisión es tuya. Desde tener la oportunidad de hacer algo significativo día tras día, hasta estar rodeado de gente supremamente inteligente y motivada.
¿Estás listo?
Descúbre todas nuestras oportunidades acá:https://mycareer.globant.com/
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Siguenos en:
Facebook: https://www.facebook.com/Globant/
Twitter: https://twitter.com/Globant
Instagram: https://www.instagram.com/globantpics/
Linkedin: https://www.linkedin.com/company/globant
Cultura y valores 4.0 para líderes 4.0
Video: https://youtu.be/HO1WqzHqRJU
Speaker: Rose Mery Restrepo - Agile LeaderShip Coach en EPM
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Hay trabajos y hay carreras. Las oportunidades vienen a golpear la puerta cuando menos lo esperas. La decisión es tuya. Desde tener la oportunidad de hacer algo significativo día tras día, hasta estar rodeado de gente supremamente inteligente y motivada.
¿Estás listo?
Descúbre todas nuestras oportunidades acá:https://mycareer.globant.com/
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Siguenos en:
Facebook: https://www.facebook.com/Globant/
Twitter: https://twitter.com/Globant
Instagram: https://www.instagram.com/globantpics/
Linkedin: https://www.linkedin.com/company/globant
Tech Insiders Salesforce: SFDX e Integración Continua
En este webinar hablaremos de cómo las nuevas herramientas que nos entrega salesforce a nivel de desarrollo, nos pueden llevar a tener mejores procesos de desarrollo en los cuáles tengamos elementos de integración y entrega continua. Compartiremos experiencias y beneficios obtenidos a lo largo de los proyectos utilizando herramientas como salesforce DX y las Scratch Org.
Como impulsar tu carrera Salesforce
Este documento proporciona información sobre Globant, una empresa de servicios de tecnología. Globant tiene más de 12,500 empleados en 16 países y 51 oficinas en todo el mundo. La empresa se especializa en transformación digital y cognitiva para sus clientes. El documento también describe la trayectoria profesional de un ejecutivo de ventas de Globant y las oportunidades de carrera disponibles en Salesforce.
3D Programming Basics: WebGL
This document provides an overview of key concepts for developing a 3D graphics application using Three.js, including:
- Setting up the initial scene, renderer, and render loop
- Adding a camera to define the view of the scene
- Loading 3D models using glTF and a loader like GLTFLoader
- Applying materials to define the visual properties of objects
- Adding different types of lights like ambient and directional lights
- Enabling shadows using Three.js' built-in shadow mapping implementation
The document walks through these concepts by providing code examples for a simple Three.js app that visualizes 3D models.
Converge augmented report
The virtual Converge event hosted by Globant welcomed over 10,000 attendees and featured Steve Wozniak as a keynote speaker. Speakers discussed how AI is helping create "Augmented Organizations" and changing how software is developed through "Augmented Coding". Tan Le of EMOTIV spoke about brain-computer interfaces and how environments may one day adapt to human brain activity. Wozniak and Globant's CEO discussed the importance of passion and ethics in building companies. Overall the conference explored how AI is accelerating and enhancing people's work.
Sistema de recomendación entiempo real usando Delta Lake
Speaker: Valentina Grajales
Video: https://youtu.be/-R5qFhnyZU0
Presentamos cómo construir un sistema de recomendación en tiempo real con entrenamiento dinámico usando operaciones de ventana en una arquitectura Kappa de Spark Delta Lake.
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Hay trabajos y hay carreras. Las oportunidades vienen a golpear la puerta cuando menos lo esperas. La decisión es tuya. Desde tener la oportunidad de hacer algo significativo día tras día, hasta estar rodeado de gente supremamente inteligente y motivada.
¿Estás listo?
Descúbre todas nuestras oportunidades acá: https://bit.ly/2PWKky9
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Síguenos en:
Facebook: https://www.facebook.com/Globant/
Twitter: https://twitter.com/Globant
Instagram: https://www.instagram.com/globantpics/
Linkedin: https://www.linkedin.com/company/globant
Visita nuestra página web: https://bit.ly/2XLVYQD
Kubeflow: Machine Learning en Cloud para todos
Speaker: Juan Camilo Díaz
Video: https://youtu.be/jfH93vdRmTk
Kubeflow hace que implementar workflows de Machine Learning en Kubernetes sean simples, portátiles y escalables. Kubeflow es el kit de herramientas que permite implementar procesos de Machine Learning, ampliando la capacidad de Kubernetes para ejecutar pasos independientes y configurables, con bibliotecas y frameworks específicos.
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Hay trabajos y hay carreras. Las oportunidades vienen a golpear la puerta cuando menos lo esperas. La decisión es tuya. Desde tener la oportunidad de hacer algo significativo día tras día, hasta estar rodeado de gente supremamente inteligente y motivada.
¿Estás listo?
Descúbre todas nuestras oportunidades acá: https://bit.ly/2PWKky9
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Síguenos en:
Facebook: https://www.facebook.com/Globant/
Twitter: https://twitter.com/Globant
Instagram: https://www.instagram.com/globantpics/
Linkedin: https://www.linkedin.com/company/globant
Orquestando Pipelines de Datosen AWS con Step Function y AWS Glue
Speaker: Sebastián Suárez
Video: https://youtu.be/gWr_htOg-iY
Describir a la audiencia como puede orquestar flujos de datos complejos usando AWS Glue y AWS Step Functions. Con estas herramientas se puede orquestar pasos que incluyen scripts SQL, scripts python usando Pandas o Numpy, jobs spark.
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Hay trabajos y hay carreras. Las oportunidades vienen a golpear la puerta cuando menos lo esperas. La decisión es tuya. Desde tener la oportunidad de hacer algo significativo día tras día, hasta estar rodeado de gente supremamente inteligente y motivada.
¿Estás listo?
Descúbre todas nuestras oportunidades acá: https://bit.ly/2PWKky9
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Síguenos en:
Facebook: https://www.facebook.com/Globant/
Twitter: https://twitter.com/Globant
Instagram: https://www.instagram.com/globantpics/
Linkedin: https://www.linkedin.com/company/globant
Visita nuestra página web: https://bit.ly/2XLVYQD
Navegando el desafío de transformación digital de los servicios financieros
Cómo las empresas de servicios financieros de Latam pueden utilizar las tecnologías digitales para acelerar su evolución y éxito en la "nueva normalidad"
Ante una época de cambios constantes, expectativas crecientes de los clientes, y del surgimiento disruptivo de nuevas tecnologías y nuevos competidores, los límites de las industrias se desdibujan y los modelos de negocios actuales comienzan a ser insuficientes para la generación sostenible de valor.
La industria de Servicios Financieros está viviendo una época de profunda transformación. Aquellas compañías con modelos de negocio y de servicio tradicionales, están viendo cada vez más afectadas su capacidad de sumar nuevos clientes, crecer y generar nuevos negocios, como así también su capacidad de atraer talento y desarrollar capacidades competitivas diferenciales.
Las respuestas tradicionales a estos desafíos, aunque pueden ayudar muchas veces a reducir las brechas, no logran solucionar los desafíos más profundos relativos a la agilidad organizacional y cultural, la flexibilidad y escalabilidad tecnológica, y la evolución de paradigmas pasados que deben actualizarse a los tiempos presentes.
El contexto actual generado por la Pandemia ha acelerado nuestras vidas digitales y de las empresas de manera drástica, dejando en claro la urgencia y criticidad de la transformación y evolución necesaria en cada aspecto de nuestras Organizaciones y la manera en que creamos y entregamos valor a los usuarios.
Frente a un futuro incierto, cada vez más volátil y dinámico, la “Nueva Normalidad” obliga a los Bancos a repensar sus modelos de negocio, cartera de servicios, procesos internos, modelos de relacionamiento con sus clientes, su visión del ecosistema y de cómo ser relevantes en la vida de sus clientes.
En un mundo en donde la agilidad y capacidad de adaptación es una de las ventajas competitivas más necesarias, la Industria de Servicios Financieros se encuentra ante el mayor desafío de transformación de las últimas décadas.
Converge 2020
This document discusses the concept of augmented collaboration and how organizations have adapted to remote work during the COVID-19 pandemic. It provides examples of how Globant has implemented augmented collaboration through technologies like augmented coding, knowledge sharing, and analytics of team dynamics. Speakers at a Converge conference presented on topics like the future of education, digital transformation, and creating successful remote work teams. The discussion emphasizes that remote work requires a focus on communication, empowerment, and aligning teams to be as effective as in-person work.
Converge 2020
El documento habla sobre los desafíos que trajo la pandemia de COVID-19 para las organizaciones y la necesidad de reinventar las dinámicas de trabajo adoptando tecnología para promover entornos laborales digitales. Globant propone la "Colaboración Aumentada" mediante el uso de inteligencia artificial para que los equipos distribuidos sean tan efectivos como cuando trabajaban de forma presencial. En el evento Converge 2020 se presentaron ejemplos de cómo lograr una verdadera colaboración entre equipos, industrias y sectores público-
Tendencias de tecnología para el recién egresado
Video acá: https://youtu.be/awL0c7qUyu8
En esta charla, Edgar Pérez -Tech Manager en Globant, nos brinda un análisis general a las últimas tendencias y desafíos en la industria TI para la nueva fuerza laboral.
¿Qué temáticas se abordarán?
- Lo que la industria está solicitando hoy en el mercado laboral internacional.
- Herramientas para enfocar intereses profesionales, conectando lo que se aprende en la academia con el mundo real en el trabajo.
___________________________________________________
Hay trabajos y hay carreras. Las oportunidades vienen a golpear la puerta cuando menos lo esperas. La decisión es tuya. Desde tener la oportunidad de hacer algo significativo día tras día, hasta estar rodeado de gente supremamente inteligente y motivada.
¿Estás listo?
Descubre todas nuestras oportunidades acá: https://mycareer.globant.com/
-------------------------------------------------------------------------------------
Síguenos en:
Facebook: https://www.facebook.com/Globant/
Twitter: https://twitter.com/Globant
Instagram: https://www.instagram.com/globantpics/
Linkedin: https://www.linkedin.com/company/globant
SRE: ¿Qué es y cómo gestionar el Toil?
Video: https://youtu.be/_ENsu84pH2U
Hay trabajos y hay carreras. Las oportunidades vienen a golpear la puerta cuando menos lo esperas. La decisión es tuya. Desde tener la oportunidad de hacer algo significativo día tras día, hasta estar rodeado de gente supremamente inteligente y motivada.
¿Estás listo?
Descúbre todas nuestras oportunidades acá:https://mycareer.globant.com/
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Siguenos en:
Facebook: https://www.facebook.com/Globant/
Twitter: https://twitter.com/Globant
Instagram: https://www.instagram.com/globantpics/
Linkedin: https://www.linkedin.com/company/globant
Monitoreo en tiempo real para la mejora continua de una aplicación
Video: https://youtu.be/bCmzvLqVdY0
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Hay trabajos y hay carreras. Las oportunidades vienen a golpear la puerta cuando menos lo esperas. La decisión es tuya. Desde tener la oportunidad de hacer algo significativo día tras día, hasta estar rodeado de gente supremamente inteligente y motivada.
¿Estás listo?
Descúbre todas nuestras oportunidades acá:https://mycareer.globant.com/
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Siguenos en:
Facebook: https://www.facebook.com/Globant/
Twitter: https://twitter.com/Globant
Instagram: https://www.instagram.com/globantpics/
Linkedin: https://www.linkedin.com/company/globant
¿Cómo automatizar pruebas de infraestructura y no morir en el intento?
Video : https://youtu.be/pU5bt1M27X4
Hay trabajos y hay carreras. Las oportunidades vienen a golpear la puerta cuando menos lo esperas. La decisión es tuya. Desde tener la oportunidad de hacer algo significativo día tras día, hasta estar rodeado de gente supremamente inteligente y motivada.
¿Estás listo?
Descúbre todas nuestras oportunidades acá:https://mycareer.globant.com/
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Siguenos en:
Facebook: https://www.facebook.com/Globant/
Twitter: https://twitter.com/Globant
Instagram: https://www.instagram.com/globantpics/
Linkedin: https://www.linkedin.com/company/globant
Automatización en AWS con Chatbot Serverless (Amazon Lex)
Video: https://youtu.be/64DUg97We84
Hay trabajos y hay carreras. Las oportunidades vienen a golpear la puerta cuando menos lo esperas. La decisión es tuya. Desde tener la oportunidad de hacer algo significativo día tras día, hasta estar rodeado de gente supremamente inteligente y motivada.
¿Estás listo?
Descúbre todas nuestras oportunidades acá:https://mycareer.globant.com/
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Siguenos en:
Facebook: https://www.facebook.com/Globant/
Twitter: https://twitter.com/Globant
Instagram: https://www.instagram.com/globantpics/
Linkedin: https://www.linkedin.com/company/globant
¿Cómo importar funcionalidades de C++ a NodeJS?
This document discusses creating Node.js addons using C++. It begins by explaining what a Node.js addon is, which is a piece of software written in C++ that can be imported and used as a regular module in Node.js. It then outlines the main options for creating addons, including using the ABI, NAN, and N-API. N-API is considered the most stable and compatible option as it is maintained by the Node.js core team. The document provides prerequisites and demonstrates creating a basic music addon in C++ and using it in Node.js. It also briefly discusses some other capabilities and points to references for further learning.
More from Globant (20)
Tech Insiders Salesforce: SFDX e Integración Continua
Tech Insiders Salesforce: SFDX e Integración Continua
Sistema de recomendación entiempo real usando Delta Lake
Sistema de recomendación entiempo real usando Delta Lake
Orquestando Pipelines de Datosen AWS con Step Function y AWS Glue
Orquestando Pipelines de Datosen AWS con Step Function y AWS Glue
Navegando el desafío de transformación digital de los servicios financieros
Navegando el desafío de transformación digital de los servicios financieros
Monitoreo en tiempo real para la mejora continua de una aplicación
Monitoreo en tiempo real para la mejora continua de una aplicación
¿Cómo automatizar pruebas de infraestructura y no morir en el intento?
¿Cómo automatizar pruebas de infraestructura y no morir en el intento?
Automatización en AWS con Chatbot Serverless (Amazon Lex)
Automatización en AWS con Chatbot Serverless (Amazon Lex)
Recently uploaded
MySQL InnoDB Storage Engine: Deep Dive - Mydbops
This presentation, titled "MySQL - InnoDB" and delivered by Mayank Prasad at the Mydbops Open Source Database Meetup 16 on June 8th, 2024, covers dynamic configuration of REDO logs and instant ADD/DROP columns in InnoDB.
This presentation dives deep into the world of InnoDB, exploring two ground-breaking features introduced in MySQL 8.0:
• Dynamic Configuration of REDO Logs: Enhance your database's performance and flexibility with on-the-fly adjustments to REDO log capacity. Unleash the power of the snake metaphor to visualize how InnoDB manages REDO log files.
• Instant ADD/DROP Columns: Say goodbye to costly table rebuilds! This presentation unveils how InnoDB now enables seamless addition and removal of columns without compromising data integrity or incurring downtime.
Key Learnings:
• Grasp the concept of REDO logs and their significance in InnoDB's transaction management.
• Discover the advantages of dynamic REDO log configuration and how to leverage it for optimal performance.
• Understand the inner workings of instant ADD/DROP columns and their impact on database operations.
• Gain valuable insights into the row versioning mechanism that empowers instant column modifications.
Lee Barnes - Path to Becoming an Effective Test Automation Engineer.pdf
So… you want to become a Test Automation Engineer (or hire and develop one)? While there’s quite a bit of information available about important technical and tool skills to master, there’s not enough discussion around the path to becoming an effective Test Automation Engineer that knows how to add VALUE. In my experience this had led to a proliferation of engineers who are proficient with tools and building frameworks but have skill and knowledge gaps, especially in software testing, that reduce the value they deliver with test automation.
In this talk, Lee will share his lessons learned from over 30 years of working with, and mentoring, hundreds of Test Automation Engineers. Whether you’re looking to get started in test automation or just want to improve your trade, this talk will give you a solid foundation and roadmap for ensuring your test automation efforts continuously add value. This talk is equally valuable for both aspiring Test Automation Engineers and those managing them! All attendees will take away a set of key foundational knowledge and a high-level learning path for leveling up test automation skills and ensuring they add value to their organizations.
What is an RPA CoE? Session 2 – CoE Roles
In this session, we will review the players involved in the CoE and how each role impacts opportunities.
Topics covered:
• What roles are essential?
• What place in the automation journey does each role play?
Speaker:
Chris Bolin, Senior Intelligent Automation Architect Anika Systems
Getting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
ScyllaDB monitoring provides a lot of useful information. But sometimes it’s not easy to find the root of the problem if something is wrong or even estimate the remaining capacity by the load on the cluster. This talk shares our team's practical tips on: 1) How to find the root of the problem by metrics if ScyllaDB is slow 2) How to interpret the load and plan capacity for the future 3) Compaction strategies and how to choose the right one 4) Important metrics which aren’t available in the default monitoring setup.
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
HERE IS YOUR WEBINAR CONTENT! 'Mastering Customer Journey Management with Dr. Graham Hill'. We hope you find the webinar recording both insightful and enjoyable.
In this webinar, we explored essential aspects of Customer Journey Management and personalization. Here’s a summary of the key insights and topics discussed:
Key Takeaways:
Understanding the Customer Journey: Dr. Hill emphasized the importance of mapping and understanding the complete customer journey to identify touchpoints and opportunities for improvement.
Personalization Strategies: We discussed how to leverage data and insights to create personalized experiences that resonate with customers.
Technology Integration: Insights were shared on how inQuba’s advanced technology can streamline customer interactions and drive operational efficiency.
A Deep Dive into ScyllaDB's Architecture
This talk will cover ScyllaDB Architecture from the cluster-level view and zoom in on data distribution and internal node architecture. In the process, we will learn the secret sauce used to get ScyllaDB's high availability and superior performance. We will also touch on the upcoming changes to ScyllaDB architecture, moving to strongly consistent metadata and tablets.
Dandelion Hashtable: beyond billion requests per second on a commodity server
This slide deck presents DLHT, a concurrent in-memory hashtable. Despite efforts to optimize hashtables, that go as far as sacrificing core functionality, state-of-the-art designs still incur multiple memory accesses per request and block request processing in three cases. First, most hashtables block while waiting for data to be retrieved from memory. Second, open-addressing designs, which represent the current state-of-the-art, either cannot free index slots on deletes or must block all requests to do so. Third, index resizes block every request until all objects are copied to the new index. Defying folklore wisdom, DLHT forgoes open-addressing and adopts a fully-featured and memory-aware closed-addressing design based on bounded cache-line-chaining. This design offers lock-free index operations and deletes that free slots instantly, (2) completes most requests with a single memory access, (3) utilizes software prefetching to hide memory latencies, and (4) employs a novel non-blocking and parallel resizing. In a commodity server and a memory-resident workload, DLHT surpasses 1.6B requests per second and provides 3.5x (12x) the throughput of the state-of-the-art closed-addressing (open-addressing) resizable hashtable on Gets (Deletes).
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Join us to learn how UiPath Apps can directly and easily interact with prebuilt connectors via Integration Service--including Salesforce, ServiceNow, Open GenAI, and more.
The best part is you can achieve this without building a custom workflow! Say goodbye to the hassle of using separate automations to call APIs. By seamlessly integrating within App Studio, you can now easily streamline your workflow, while gaining direct access to our Connector Catalog of popular applications.
We’ll discuss and demo the benefits of UiPath Apps and connectors including:
Creating a compelling user experience for any software, without the limitations of APIs.
Accelerating the app creation process, saving time and effort
Enjoying high-performance CRUD (create, read, update, delete) operations, for
seamless data management.
Speakers:
Russell Alfeche, Technology Leader, RPA at qBotic and UiPath MVP
Charlie Greenberg, host
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
Tomaz Bratanic
Graph ML and GenAI Expert - Neo4j
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
The typical problem in product engineering is not bad strategy, so much as “no strategy”. This leads to confusion, lack of motivation, and incoherent action. The next time you look for a strategy and find an empty space, instead of waiting for it to be filled, I will show you how to fill it in yourself. If you’re wrong, it forces a correction. If you’re right, it helps create focus. I’ll share how I’ve approached this in the past, both what works and lessons for what didn’t work so well.
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
This LF Energy webinar took place June 20, 2024. It featured:
-Alex Thornton, LF Energy
-Hallie Cramer, Google
-Daniel Roesler, UtilityAPI
-Henry Richardson, WattTime
In response to the urgency and scale required to effectively address climate change, open source solutions offer significant potential for driving innovation and progress. Currently, there is a growing demand for standardization and interoperability in energy data and modeling. Open source standards and specifications within the energy sector can also alleviate challenges associated with data fragmentation, transparency, and accessibility. At the same time, it is crucial to consider privacy and security concerns throughout the development of open source platforms.
This webinar will delve into the motivations behind establishing LF Energy’s Carbon Data Specification Consortium. It will provide an overview of the draft specifications and the ongoing progress made by the respective working groups.
Three primary specifications will be discussed:
-Discovery and client registration, emphasizing transparent processes and secure and private access
-Customer data, centering around customer tariffs, bills, energy usage, and full consumption disclosure
-Power systems data, focusing on grid data, inclusive of transmission and distribution networks, generation, intergrid power flows, and market settlement data
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
What began over 115 years ago as a supplier of precision gauges to the automotive industry has evolved into being an industry leader in the manufacture of product branding, automotive cockpit trim and decorative appliance trim. Value-added services include in-house Design, Engineering, Program Management, Test Lab and Tool Shops.
AI in the Workplace Reskilling, Upskilling, and Future Work.pptx
Discover how AI is transforming the workplace and learn strategies for reskilling and upskilling employees to stay ahead. This comprehensive guide covers the impact of AI on jobs, essential skills for the future, and successful case studies from industry leaders. Embrace AI-driven changes, foster continuous learning, and build a future-ready workforce.
Read More - https://bit.ly/3VKly70
Apps Break Data
How information systems are built or acquired puts information, which is what they should be about, in a secondary place. Our language adapted accordingly, and we no longer talk about information systems but applications. Applications evolved in a way to break data into diverse fragments, tightly coupled with applications and expensive to integrate. The result is technical debt, which is re-paid by taking even bigger "loans", resulting in an ever-increasing technical debt. Software engineering and procurement practices work in sync with market forces to maintain this trend. This talk demonstrates how natural this situation is. The question is: can something be done to reverse the trend?
Northern Engraving | Nameplate Manufacturing Process - 2024
Manufacturing custom quality metal nameplates and badges involves several standard operations. Processes include sheet prep, lithography, screening, coating, punch press and inspection. All decoration is completed in the flat sheet with adhesive and tooling operations following. The possibilities for creating unique durable nameplates are endless. How will you create your brand identity? We can help!
AWS Certified Solutions Architect Associate (SAA-C03)
AWS Certified Solutions Architect Associate (SAA-C03)
"NATO Hackathon Winner: AI-Powered Drug Search", Taras Kloba
This is a session that details how PostgreSQL's features and Azure AI Services can be effectively used to significantly enhance the search functionality in any application.
In this session, we'll share insights on how we used PostgreSQL to facilitate precise searches across multiple fields in our mobile application. The techniques include using LIKE and ILIKE operators and integrating a trigram-based search to handle potential misspellings, thereby increasing the search accuracy.
We'll also discuss how the azure_ai extension on PostgreSQL databases in Azure and Azure AI Services were utilized to create vectors from user input, a feature beneficial when users wish to find specific items based on text prompts. While our application's case study involves a drug search, the techniques and principles shared in this session can be adapted to improve search functionality in a wide range of applications. Join us to learn how PostgreSQL and Azure AI can be harnessed to enhance your application's search capability.
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
These are the slides for the presentation, "Component Testing: Bridging the gap between frontend applications" that was presented at QA or the Highway 2024 in Columbus, OH by Zachary Hamm.
Recently uploaded (20)
Lee Barnes - Path to Becoming an Effective Test Automation Engineer.pdf
Lee Barnes - Path to Becoming an Effective Test Automation Engineer.pdf
Getting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
Getting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
AI in the Workplace Reskilling, Upskilling, and Future Work.pptx
AI in the Workplace Reskilling, Upskilling, and Future Work.pptx
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024
AWS Certified Solutions Architect Associate (SAA-C03)
AWS Certified Solutions Architect Associate (SAA-C03)
"NATO Hackathon Winner: AI-Powered Drug Search", Taras Kloba
"NATO Hackathon Winner: AI-Powered Drug Search", Taras Kloba
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
Apache Beam: Lote portátil y procesamiento de transmisión
- 1. Portable Batch and Streaming Processing APACHE BEAM
- 2. ABOUT ME ● Data Architect at Globant ● Certified Google Data Engineer ● Applying software engineering practices to Big Data development
- 3. AGENDA 1. Introduction 2. What is Apache Beam? 3. Why Apache Beam? 4. Crash course 5. Beam on Flink 6. Beam on DataFlow 7. Summary
- 4. INTRODUCTION Computation Result Computation Computation Computation Computation Result
- 5. INTRODUCTION Computation Computation Computation Computation Result Computation Computation Computation Computation Result Batch Streaming
- 6. WHAT IS APACHE BEAM? ● Original code from Google (Cloud Dataflow SDK). ● Apache open-source project since 2016. ● Parallel/distributed data processing. ● Unified programming model for batch and streaming. ● Portable, execution engine and programming language of your choice.
- 7. WHY APACHE BEAM? Write Translate
- 9. CRASH COURSE Input Transform PCollection Transform PCollection Sink Pipeline Output
- 10. PIPELINE A Pipeline encapsulates your entire data processing task, from start to finish. This includes reading input data, transforming that data, and writing output data.
- 12. PCollection The PCollection abstraction represents a potentially distributed, multi-element data set. You can think of a PCollection as “pipeline” data; Beam transforms use PCollection objects as inputs and outputs. As such, if you want to work with data in your pipeline, it must be in the form of a PCollection.
- 13. PCollection
- 14. PCollection ● The elements of a PCollection may be of any type, but must all be of the same type. ● A PCollection is immutable. ● A PCollection can be either bounded or unbounded in size. ● Each element in a PCollection has an associated intrinsic timestamp.
- 16. Transforms
- 17. Transforms
- 18. Transforms
- 19. Transforms ● Read - parallel connectors to external systems ● ParDo - per element processing ● GroupByKey - aggregating elements per key and window ● Flatten - union of PCollections ● Window - set the windowing strategy for a PCollection
- 20. Transforms Transform PCollection Transform PCollection Sink Pipeline
- 21. Pipeline I/O
- 22. Pipeline I/O
- 23. Pipeline I/O Input Transform PCollection Transform PCollection Sink Pipeline Output
- 24. Beam on Flink
- 25. Beam on Google Cloud DataFlow
- 26. BE AWARE OF Write Translate
- 27. BE AWARE OF Portable protocol JAVA Objects
- 28. What is being computed?
- 29. Where in event time?
- 30. Summary ● Apache Beam is not an execution engine, is a programming model. ● Apache Flink and Google Cloud Dataflow are the execution engines that supports all the features of Beam. ● The JAVA SDK is the the most up to date. ● PCollections are the main Data Structure in Beam. ● Transformations receive PCollections as inputs and produces the same as outputs. ● Check the compatibility table before jump into the development.
- 31. Q&A
- 32. Thank you for listening!