Greenfield data platform implementation
•
1 like•311 views
Building a Data and Analytics Platform from scratch is always difficult yet exciting and rewarding. There are many keys to success and getting this off the ground running before you get lost in the myriad of offerings, tools, and technologies ranging from Data Orchestration Tools, ETL / ELT, Cloud Data Warehouses, and BI tools. During this talk, Peter Choe discusses some of the key areas to consider, tools and important concepts to ensure success in the delivery of a data platform. Peter walks you through a recent customer success story, using Airflow, Stitch, Databricks, Snowflake, and Looker. Peter explains some of the key factors in making these decisions, and we finally discuss some great KPIs and ROIs that were realized very early on.
Report
Share
Report
Share
Download to read offline
Recommended
Kubernetes Native Infrastructure and CoreOS Operator Framework for 5G Edge Cl...
This session will discuss K8s solutions and Telco Intelligent-edge possibilities by integrate with CoreOS Operator Framework that can manage CNFs, state-full and other complex stateless container applications.
The Event Mesh: real-time, event-driven, responsive APIs and beyond
Phil Scanlon, Head of Technology in Asia Pacific & Japan for Solace, describes "The Event Mesh" at API Days Melbourne in September 2018. Scanlon explains the complexities of the Event Mesh using the evolution to event-driven, the anatomy of an event, and real world examples.
Tech Modernization: A Cloud Migration
SpringOne Platform 2017
John Berry, Schwab; Henri van den Bulk, Schwab
Corporate organizations have traditionally built enterprise systems to support their business. These systems were built on classical shared system models which are not conducive to continuous deployments. With a core focus on our client’s experience and needs, we’ve been on a journey to deliver solutions faster and more efficiently. This endeavor has encompasses building agile practices and cloud ready applications. Our transformation leverages the 12-factor methodology, thereby allowing us to build cloud ready applications with modern patterns. Join us as we share lessons learned and guidance on building scalable software-as-service applications.
Slides: Success Stories for Data-to-Cloud
Companies are finding accessing data from a variety of sources can be labor-intensive and costly. Oftentimes these companies are looking to cloud solutions, but are then finding the traditional architecture brittle when trying to move data to the cloud, which can drain organizations of time and resources.
Join this webinar to hear several company success stories, the data-to-cloud issues they were encountering, and the steps these companies took to bring their cloud architecture to a successful, real-time analytic solution unlocking massive amounts of fresh enterprise-wide on a continuous basis.
In addition, you will learn how to:
• Modernize the ETL process to one that’s fast, flexible, and scalable
• Supply users with up-to-date, accurate, trusted data
• Increase your time to value with data in the cloud
• Best practices on how to minimize resource overhead
Scaling up Hyperautomation with Process Intelligence
The document discusses using process intelligence to fast-track hyperautomation. Process intelligence can automatically discover and map all relevant processes, including variations, without requiring integrations. It analyzes massive amounts of user activity data to provide insights. These insights support use cases like automation, operational excellence, and compliance. Process intelligence is extending beyond traditional finance uses to other business functions and industries. It can accelerate automation by automatically finding opportunities, mapping cross-functional processes, and providing granular process details without disrupting workers. For media companies, process intelligence helped document over 2,200 processes, quantify tasks, and generate recommendations to speed improvements.
Emerging Trends in Hybrid-Cloud & Multi-Cloud Strategies
As Cloud Computing rapidly evolves, newer deployment strategies such as Hybrid-Cloud, Multi-Cloud and On-Prem Cloud are emerging. More and more enterprise solution providers are offering support for a combination of these deployment targets. It is imperative that the larger organizations have a clear Hybrid-Cloud and Multi-Cloud strategy to avoid cloud lock-in and to de-risk business decisions.
What do each of these terminologies mean? What is the scope of each and overlap if any? We will discuss the emerging best-practices across these interdisciplinary trends, especially in the context of Modern Data and Analytics Platforms and Enterprise Self-Service.
Elastic-Engineering
To Build Cloud-Native Apps
Using Composable Enterprise Architecture
Create Elastic Engineering (Pods) Teams
To Manage
SpecOps: From Specs to Ops
Big Data Architectural Patterns and Best Practices on AWS
This document discusses big data architectural patterns and best practices on AWS. It covers the evolution of big data approaches from batch processing to stream processing to machine learning. The key principles discussed are building decoupled systems, using the right tools for the job, leveraging managed AWS services, using log-centric design patterns, and being cost-conscious. An overview of major AWS services for data ingestion, storage, processing, analysis and consumption is also provided.
Recommended
Kubernetes Native Infrastructure and CoreOS Operator Framework for 5G Edge Cl...
This session will discuss K8s solutions and Telco Intelligent-edge possibilities by integrate with CoreOS Operator Framework that can manage CNFs, state-full and other complex stateless container applications.
The Event Mesh: real-time, event-driven, responsive APIs and beyond
Phil Scanlon, Head of Technology in Asia Pacific & Japan for Solace, describes "The Event Mesh" at API Days Melbourne in September 2018. Scanlon explains the complexities of the Event Mesh using the evolution to event-driven, the anatomy of an event, and real world examples.
Tech Modernization: A Cloud Migration
SpringOne Platform 2017
John Berry, Schwab; Henri van den Bulk, Schwab
Corporate organizations have traditionally built enterprise systems to support their business. These systems were built on classical shared system models which are not conducive to continuous deployments. With a core focus on our client’s experience and needs, we’ve been on a journey to deliver solutions faster and more efficiently. This endeavor has encompasses building agile practices and cloud ready applications. Our transformation leverages the 12-factor methodology, thereby allowing us to build cloud ready applications with modern patterns. Join us as we share lessons learned and guidance on building scalable software-as-service applications.
Slides: Success Stories for Data-to-Cloud
Companies are finding accessing data from a variety of sources can be labor-intensive and costly. Oftentimes these companies are looking to cloud solutions, but are then finding the traditional architecture brittle when trying to move data to the cloud, which can drain organizations of time and resources.
Join this webinar to hear several company success stories, the data-to-cloud issues they were encountering, and the steps these companies took to bring their cloud architecture to a successful, real-time analytic solution unlocking massive amounts of fresh enterprise-wide on a continuous basis.
In addition, you will learn how to:
• Modernize the ETL process to one that’s fast, flexible, and scalable
• Supply users with up-to-date, accurate, trusted data
• Increase your time to value with data in the cloud
• Best practices on how to minimize resource overhead
Scaling up Hyperautomation with Process Intelligence
The document discusses using process intelligence to fast-track hyperautomation. Process intelligence can automatically discover and map all relevant processes, including variations, without requiring integrations. It analyzes massive amounts of user activity data to provide insights. These insights support use cases like automation, operational excellence, and compliance. Process intelligence is extending beyond traditional finance uses to other business functions and industries. It can accelerate automation by automatically finding opportunities, mapping cross-functional processes, and providing granular process details without disrupting workers. For media companies, process intelligence helped document over 2,200 processes, quantify tasks, and generate recommendations to speed improvements.
Emerging Trends in Hybrid-Cloud & Multi-Cloud Strategies
As Cloud Computing rapidly evolves, newer deployment strategies such as Hybrid-Cloud, Multi-Cloud and On-Prem Cloud are emerging. More and more enterprise solution providers are offering support for a combination of these deployment targets. It is imperative that the larger organizations have a clear Hybrid-Cloud and Multi-Cloud strategy to avoid cloud lock-in and to de-risk business decisions.
What do each of these terminologies mean? What is the scope of each and overlap if any? We will discuss the emerging best-practices across these interdisciplinary trends, especially in the context of Modern Data and Analytics Platforms and Enterprise Self-Service.
Elastic-Engineering
To Build Cloud-Native Apps
Using Composable Enterprise Architecture
Create Elastic Engineering (Pods) Teams
To Manage
SpecOps: From Specs to Ops
Big Data Architectural Patterns and Best Practices on AWS
This document discusses big data architectural patterns and best practices on AWS. It covers the evolution of big data approaches from batch processing to stream processing to machine learning. The key principles discussed are building decoupled systems, using the right tools for the job, leveraging managed AWS services, using log-centric design patterns, and being cost-conscious. An overview of major AWS services for data ingestion, storage, processing, analysis and consumption is also provided.
AWS re:Invent 2016: Governance Strategies for Cloud Transformation (WWPS302)
This document provides an overview of cloud governance strategies for cloud transformation. It defines cloud governance and discusses the benefits of governance. It also discusses the role of a Cloud Center of Excellence and describes common stages of cloud governance maturity. The presentation provides examples from Monash University and University of Maryland on their cloud governance approaches and lessons learned. It concludes with a question and answer section.
클라우드 컴퓨팅 기본 사항 (Fundamentals)
클라우드 컴퓨팅, 기본부터 정복해보자!
클라우드 컴퓨팅, 줄여서 클라우드라고 이야기하죠.
클라우드 서비스가 등장한지 어느덧 약 15년이 지났지만 여전히 사용하기 쉽지 않다고 합니다.
본 교육에서는 클라우드 컴퓨팅 기본 사항부터 접근해보고자 합니다.
개요 및 아키텍처, 주요 서비스 이해를 통해 클라우드를 보다 효율적으로 사용하기 위한 기본기를 확보하고,
이를 기반으로 클라우드를 안정적으로 활용하는 지식을 함양하고자 합니다.
본 내용은 Microsoft Learn에 무료로 공개된 다음 주요 모듈 내용을 기반으로 설명을 위해 강의/발표 형태로 재구성하였습니다:
- Microsoft Azure 기본 사항: 클라우드 개념 설명: https://learn.microsoft.com/ko-kr/training/paths/microsoft-azure-fundamentals-describe-cloud-concepts/
- 개발자를 위한 클라우드 컴퓨팅 기본 사항: https://learn.microsoft.com/ko-kr/training/paths/cmu-cloud-developer-basics/
Cloud Migration Strategy and Best Practices
Analyze key aspects to be considered before embarking on your cloud journey. The presentation outlines the strategies, approach, and choices that need to be made, to ensure a smooth transition to the cloud.
Data Mesh
Presentation on Data Mesh: The paradigm shift is a new type of eco-system architecture, which is a shift left towards a modern distributed architecture in which it allows domain-specific data and views “data-as-a-product,” enabling each domain to handle its own data pipelines.
The Top 5 Apache Kafka Use Cases and Architectures in 2022
This document discusses the top 5 use cases and architectures for data in motion in 2022. It describes:
1) The Kappa architecture as an alternative to the Lambda architecture that uses a single stream to handle both real-time and batch data.
2) Hyper-personalized omnichannel experiences that integrate customer data from multiple sources in real-time to provide personalized experiences across channels.
3) Multi-cloud deployments using Apache Kafka and data mesh architectures to share data across different cloud platforms.
4) Edge analytics that deploy stream processing and Kafka brokers at the edge to enable low-latency use cases and offline functionality.
5) Real-time cybersecurity applications that use streaming data
Free Training: How to Build a Lakehouse
Doug Bateman, a principal data engineering instructor at Databricks, presented on how to build a Lakehouse architecture. He began by introducing himself and his background. He then discussed the goals of describing key Lakehouse features, explaining how Delta Lake enables it, and developing a sample Lakehouse using Databricks. The key aspects of a Lakehouse are that it supports diverse data types and workloads while enabling using BI tools directly on source data. Delta Lake provides reliability, consistency, and performance through its ACID transactions, automatic file consolidation, and integration with Spark. Bateman concluded with a demo of creating a Lakehouse.
Introduction to Oracle Cloud Infrastructure Services
Knoldus is a technology consulting firm that delivers solutions using Reactive Products, IoT, Microservices, API, Data Science, Data Engineering and DevOps. Oracle Cloud Infrastructure (OCI) provides compute, storage and networking capabilities in a highly available hosted environment. OCI's Free Tier offers $300 in cloud credits valid for 30 days to spend on eligible services. OCI accounts have Always Free resources like VMs and databases that can be used for small applications without charges. OCI provides regions, availability domains and fault domains for high availability and scalability across isolated data centers.
AWS상에서 블록체인 서비스 구축 및 활용가이드 대방출! - 박천구 솔루션즈 아키텍트, AWS / 오재훈 이사, 두나무 :: AWS Sum...
AWS상에서 블록체인 서비스 구축 및 활용가이드 대방출! - 박천구 솔루션즈 아키텍트, AWS / 오재훈 이사, 두나무 :: AWS Sum...Amazon Web Services Korea
AWS상에서 블록체인 서비스 구축 및 활용가이드 대방출!
박천구 솔루션즈 아키텍트, AWS
오재훈 이사, 두나무
블록체인 기반의 서비스를 오픈하기까지는 기술의 한계점, 개발 및 운영의 어려움 등으로 많은 시간과 비용이 소요됩니다. AWS를 활용하여 어떻게 블록체인 비즈니스를 차별화하고 최적화된 성능과 비용으로 성공적인 서비스를 구축하는지를, 두나무 Lambda256의 Luniverse 플랫폼 사례 및 AWS 활용 팁을 통해 상세히 살펴봅니다.Serverless Architecture Patterns
As serverless architectures become more popular, AWS customers need a framework of patterns to help them deploy their workloads without managing servers or operating systems.
StreamSet ETL tool
This presentation is to understand StreamSets ETL tool.
StreamSets is modern ETL tool designed to process streaming data.
StreamSets has 2 engines, 1 is Data Controller and Data Transformer(Based on Apache Spark).
Navigating the YANGscape of network automation
Network automation as a discipline has evolved rapidly over the last few years. Not that long ago we were pushing configuration lines templated with Jinja over SSH and thought of it as Network Automation state of the art. Nowadays, we use programming languages and machine generate pre-validated configuration structures that are pushed out over sophisticated gRPC interfaces.
One of the key enablers for this leapfrog was the YANG data modelling language that powers leading Network Operating Systems. In this talk we will explore how exactly YANG enables Model-Driven Interfaces and what open-source tools are available to engineers to navigate the vast sea of YANG models.
Cisco prime-nms-overview-hi-techdays deep dive
This document discusses Cisco Prime Network Management and its benefits over traditional point-product network management solutions. It provides an overview of Cisco Prime's integrated workflows, common user experience, consolidated management capabilities, and support for the full device lifecycle. Key features highlighted include comprehensive device manageability, assurance of application experience and visibility, simplified deployment of Cisco devices, and support for network lifecycle management.
Apache Kafka® Use Cases for Financial Services
Traditional systems were designed in an era that predates large-scale distributed systems. These systems often lack the ability to scale to meet the needs of the modern data-driven organisation. Adding to this is the accumulation of technologies and the explosion of data which can result in complex point-to-point integrations where data becomes siloed or separated across the enterprise.
The demand for fast results and decision making, have generated the need for real-time event streaming and processing of data adoption in financial institutions to be on the competitive edge. Apache Kafka and the Confluent Platform are designed to solve the problems associated with traditional systems and provide a modern, distributed architecture and Real-time Data streaming capability. In addition these technologies open up a range of use cases for Financial Services organisations, many of which will be explored in this talk. .
Multi Cloud Architecture Approach
The document discusses the challenges of transitioning to a multi-cloud environment and proposes solutions across six architecture domains: 1) provisioning infrastructure as code while enforcing policies, 2) implementing a zero-trust security model with secrets management and encryption, 3) using a service registry and service mesh for networking, 4) delivering both modern and legacy applications via flexible orchestration, 5) addressing issues of databases across cloud platforms, and 6) establishing multi-cloud governance and policy management. The goal is to simplify management of resources distributed across multiple cloud providers while maintaining visibility, consistency, and cost optimization.
Kakao Cloud Native Platform, 9rum
공용준(Andrew.kong) / kakao corp.(cloud part)
---
오프소스 기반의 클라우드 플랫폼인 9rum을 소개합니다. 확장성 있는 클라우드와 컨테이너 기반 서비스를 위한 클라우드를 만들기 위해 어떤 기술들을 만들어 적용했고 어떤 과정을 거쳐 갔는지에 대해서 이야기합니다. 그리고 9rum 서비스가 카카오의 개발 문화에 어떻게 기여하는지 설명합니다.
REST vs gRPC: Battle of API's
This document compares REST and gRPC for microservices communication. It discusses how gRPC addresses limitations of REST like inefficient binary encoding and lack of bidirectional streaming. gRPC uses protocol buffers for interface definition and code generation. It supports multiple languages and platforms and uses HTTP/2 for performance. Companies like Google and Netflix use gRPC for its performance advantages. The document provides examples of unary, server streaming, client streaming and bidirectional streaming RPC calls in gRPC. It recommends using gRPC for microservices and client-server applications where performance is important.
Micro services Architecture
The document provides an overview of microservices architecture. It discusses key characteristics of microservices such as each service focusing on a specific business capability, decentralized governance and data management, and infrastructure automation. It also compares microservices to monolithic and SOA architectures. Some design styles enabled by microservices like domain-driven design, event sourcing, and functional reactive programming are also covered at a high level. The document aims to introduce attendees to microservices concepts and architectures.
Ambari Views - Overview
Ambari Views provide a common user experience framework for Hadoop ecosystem components. Views can be contributed as plugins to embed interfaces in Ambari for operators, data workers, and others. The goals of Views are to provide a single point of entry through a common URL, a pluggable UI framework where Views can be shared, and centralized authorization. Example Views include queue managers, resource utilization dashboards, and query editors.
SDN 101
The document discusses Software-Defined Networking (SDN), defining it as an emerging architecture that is dynamic, manageable, cost-effective and adaptable. It describes SDN protocols like OpenFlow that give access to network switches. It outlines the key aspects of the SDN architecture including being directly programmable, centrally managed, programmatically configured, and open standards-based. It also lists several related open-source SDN projects and protocols involved in SDN like Open vSwitch, ONAP, DPDK, OpenDaylight, ONOS, and PNDA.
A Journey to a Serverless Business Intelligence, Machine Learning and Big Dat...
In this talk we will describe the journey we made with one of our customers, Volotea, to deploy a serverless Business Intelligence (BI), Machine Learning (ML) and Big Data (BD) platform on the Cloud. The new platform leverages Platform-as-a-Service (PaaS) Cloud services, and it is the result of the reengineering and extension of an existing platform based on Cloud Infrastructure-as-a-Service (IaaS) services and bare-metal systems. Managing and maintaining BI, ML and BD platforms based on bare-metal or IaaS deployments is not a straightforward task, and as size and complexity grow, we often find ourselves spending more and more time in tasks that are rather administrative, more than of a development or analytics nature. That is exactly what Volotea realized, and together we envisioned and executed a plan to lift and reengineer their platform into a new solution that leverages Microsoft Azure PaaS services. We have delivered a solution that manages to greatly reduce the administrative burden as well as the technical complexity when implementing new use cases. The new platform is based on the Microsoft Azure stack and it includes Azure Data Lake, Azure Data Lake Analytics, Azure Data Factory, Azure Machine Learning and Azure SQL Database. Join us in this talk where we will share our lessons learned and we will discuss how to plan and execute such an endeavor.
NextStep Boston 2018 - Speeding in the Right Direction: Modernizing Legacy Ap...
How do you overcome a decade of neglecting IT? Find out with the CIO/CTO of the City of Oakland. He’ll explain how he modernized the City of Oakland’s IT organization, landscape, and capabilities with OutSystems and a low-code digital factory.
More Related Content
What's hot
AWS re:Invent 2016: Governance Strategies for Cloud Transformation (WWPS302)
This document provides an overview of cloud governance strategies for cloud transformation. It defines cloud governance and discusses the benefits of governance. It also discusses the role of a Cloud Center of Excellence and describes common stages of cloud governance maturity. The presentation provides examples from Monash University and University of Maryland on their cloud governance approaches and lessons learned. It concludes with a question and answer section.
클라우드 컴퓨팅 기본 사항 (Fundamentals)
클라우드 컴퓨팅, 기본부터 정복해보자!
클라우드 컴퓨팅, 줄여서 클라우드라고 이야기하죠.
클라우드 서비스가 등장한지 어느덧 약 15년이 지났지만 여전히 사용하기 쉽지 않다고 합니다.
본 교육에서는 클라우드 컴퓨팅 기본 사항부터 접근해보고자 합니다.
개요 및 아키텍처, 주요 서비스 이해를 통해 클라우드를 보다 효율적으로 사용하기 위한 기본기를 확보하고,
이를 기반으로 클라우드를 안정적으로 활용하는 지식을 함양하고자 합니다.
본 내용은 Microsoft Learn에 무료로 공개된 다음 주요 모듈 내용을 기반으로 설명을 위해 강의/발표 형태로 재구성하였습니다:
- Microsoft Azure 기본 사항: 클라우드 개념 설명: https://learn.microsoft.com/ko-kr/training/paths/microsoft-azure-fundamentals-describe-cloud-concepts/
- 개발자를 위한 클라우드 컴퓨팅 기본 사항: https://learn.microsoft.com/ko-kr/training/paths/cmu-cloud-developer-basics/
Cloud Migration Strategy and Best Practices
Analyze key aspects to be considered before embarking on your cloud journey. The presentation outlines the strategies, approach, and choices that need to be made, to ensure a smooth transition to the cloud.
Data Mesh
Presentation on Data Mesh: The paradigm shift is a new type of eco-system architecture, which is a shift left towards a modern distributed architecture in which it allows domain-specific data and views “data-as-a-product,” enabling each domain to handle its own data pipelines.
The Top 5 Apache Kafka Use Cases and Architectures in 2022
This document discusses the top 5 use cases and architectures for data in motion in 2022. It describes:
1) The Kappa architecture as an alternative to the Lambda architecture that uses a single stream to handle both real-time and batch data.
2) Hyper-personalized omnichannel experiences that integrate customer data from multiple sources in real-time to provide personalized experiences across channels.
3) Multi-cloud deployments using Apache Kafka and data mesh architectures to share data across different cloud platforms.
4) Edge analytics that deploy stream processing and Kafka brokers at the edge to enable low-latency use cases and offline functionality.
5) Real-time cybersecurity applications that use streaming data
Free Training: How to Build a Lakehouse
Doug Bateman, a principal data engineering instructor at Databricks, presented on how to build a Lakehouse architecture. He began by introducing himself and his background. He then discussed the goals of describing key Lakehouse features, explaining how Delta Lake enables it, and developing a sample Lakehouse using Databricks. The key aspects of a Lakehouse are that it supports diverse data types and workloads while enabling using BI tools directly on source data. Delta Lake provides reliability, consistency, and performance through its ACID transactions, automatic file consolidation, and integration with Spark. Bateman concluded with a demo of creating a Lakehouse.
Introduction to Oracle Cloud Infrastructure Services
Knoldus is a technology consulting firm that delivers solutions using Reactive Products, IoT, Microservices, API, Data Science, Data Engineering and DevOps. Oracle Cloud Infrastructure (OCI) provides compute, storage and networking capabilities in a highly available hosted environment. OCI's Free Tier offers $300 in cloud credits valid for 30 days to spend on eligible services. OCI accounts have Always Free resources like VMs and databases that can be used for small applications without charges. OCI provides regions, availability domains and fault domains for high availability and scalability across isolated data centers.
AWS상에서 블록체인 서비스 구축 및 활용가이드 대방출! - 박천구 솔루션즈 아키텍트, AWS / 오재훈 이사, 두나무 :: AWS Sum...
AWS상에서 블록체인 서비스 구축 및 활용가이드 대방출! - 박천구 솔루션즈 아키텍트, AWS / 오재훈 이사, 두나무 :: AWS Sum...Amazon Web Services Korea
AWS상에서 블록체인 서비스 구축 및 활용가이드 대방출!
박천구 솔루션즈 아키텍트, AWS
오재훈 이사, 두나무
블록체인 기반의 서비스를 오픈하기까지는 기술의 한계점, 개발 및 운영의 어려움 등으로 많은 시간과 비용이 소요됩니다. AWS를 활용하여 어떻게 블록체인 비즈니스를 차별화하고 최적화된 성능과 비용으로 성공적인 서비스를 구축하는지를, 두나무 Lambda256의 Luniverse 플랫폼 사례 및 AWS 활용 팁을 통해 상세히 살펴봅니다.Serverless Architecture Patterns
As serverless architectures become more popular, AWS customers need a framework of patterns to help them deploy their workloads without managing servers or operating systems.
StreamSet ETL tool
This presentation is to understand StreamSets ETL tool.
StreamSets is modern ETL tool designed to process streaming data.
StreamSets has 2 engines, 1 is Data Controller and Data Transformer(Based on Apache Spark).
Navigating the YANGscape of network automation
Network automation as a discipline has evolved rapidly over the last few years. Not that long ago we were pushing configuration lines templated with Jinja over SSH and thought of it as Network Automation state of the art. Nowadays, we use programming languages and machine generate pre-validated configuration structures that are pushed out over sophisticated gRPC interfaces.
One of the key enablers for this leapfrog was the YANG data modelling language that powers leading Network Operating Systems. In this talk we will explore how exactly YANG enables Model-Driven Interfaces and what open-source tools are available to engineers to navigate the vast sea of YANG models.
Cisco prime-nms-overview-hi-techdays deep dive
This document discusses Cisco Prime Network Management and its benefits over traditional point-product network management solutions. It provides an overview of Cisco Prime's integrated workflows, common user experience, consolidated management capabilities, and support for the full device lifecycle. Key features highlighted include comprehensive device manageability, assurance of application experience and visibility, simplified deployment of Cisco devices, and support for network lifecycle management.
Apache Kafka® Use Cases for Financial Services
Traditional systems were designed in an era that predates large-scale distributed systems. These systems often lack the ability to scale to meet the needs of the modern data-driven organisation. Adding to this is the accumulation of technologies and the explosion of data which can result in complex point-to-point integrations where data becomes siloed or separated across the enterprise.
The demand for fast results and decision making, have generated the need for real-time event streaming and processing of data adoption in financial institutions to be on the competitive edge. Apache Kafka and the Confluent Platform are designed to solve the problems associated with traditional systems and provide a modern, distributed architecture and Real-time Data streaming capability. In addition these technologies open up a range of use cases for Financial Services organisations, many of which will be explored in this talk. .
Multi Cloud Architecture Approach
The document discusses the challenges of transitioning to a multi-cloud environment and proposes solutions across six architecture domains: 1) provisioning infrastructure as code while enforcing policies, 2) implementing a zero-trust security model with secrets management and encryption, 3) using a service registry and service mesh for networking, 4) delivering both modern and legacy applications via flexible orchestration, 5) addressing issues of databases across cloud platforms, and 6) establishing multi-cloud governance and policy management. The goal is to simplify management of resources distributed across multiple cloud providers while maintaining visibility, consistency, and cost optimization.
Kakao Cloud Native Platform, 9rum
공용준(Andrew.kong) / kakao corp.(cloud part)
---
오프소스 기반의 클라우드 플랫폼인 9rum을 소개합니다. 확장성 있는 클라우드와 컨테이너 기반 서비스를 위한 클라우드를 만들기 위해 어떤 기술들을 만들어 적용했고 어떤 과정을 거쳐 갔는지에 대해서 이야기합니다. 그리고 9rum 서비스가 카카오의 개발 문화에 어떻게 기여하는지 설명합니다.
REST vs gRPC: Battle of API's
This document compares REST and gRPC for microservices communication. It discusses how gRPC addresses limitations of REST like inefficient binary encoding and lack of bidirectional streaming. gRPC uses protocol buffers for interface definition and code generation. It supports multiple languages and platforms and uses HTTP/2 for performance. Companies like Google and Netflix use gRPC for its performance advantages. The document provides examples of unary, server streaming, client streaming and bidirectional streaming RPC calls in gRPC. It recommends using gRPC for microservices and client-server applications where performance is important.
Micro services Architecture
The document provides an overview of microservices architecture. It discusses key characteristics of microservices such as each service focusing on a specific business capability, decentralized governance and data management, and infrastructure automation. It also compares microservices to monolithic and SOA architectures. Some design styles enabled by microservices like domain-driven design, event sourcing, and functional reactive programming are also covered at a high level. The document aims to introduce attendees to microservices concepts and architectures.
Ambari Views - Overview
Ambari Views provide a common user experience framework for Hadoop ecosystem components. Views can be contributed as plugins to embed interfaces in Ambari for operators, data workers, and others. The goals of Views are to provide a single point of entry through a common URL, a pluggable UI framework where Views can be shared, and centralized authorization. Example Views include queue managers, resource utilization dashboards, and query editors.
SDN 101
The document discusses Software-Defined Networking (SDN), defining it as an emerging architecture that is dynamic, manageable, cost-effective and adaptable. It describes SDN protocols like OpenFlow that give access to network switches. It outlines the key aspects of the SDN architecture including being directly programmable, centrally managed, programmatically configured, and open standards-based. It also lists several related open-source SDN projects and protocols involved in SDN like Open vSwitch, ONAP, DPDK, OpenDaylight, ONOS, and PNDA.
What's hot (20)
AWS re:Invent 2016: Governance Strategies for Cloud Transformation (WWPS302)
AWS re:Invent 2016: Governance Strategies for Cloud Transformation (WWPS302)
The Top 5 Apache Kafka Use Cases and Architectures in 2022
The Top 5 Apache Kafka Use Cases and Architectures in 2022
Introduction to Oracle Cloud Infrastructure Services
Introduction to Oracle Cloud Infrastructure Services
AWS상에서 블록체인 서비스 구축 및 활용가이드 대방출! - 박천구 솔루션즈 아키텍트, AWS / 오재훈 이사, 두나무 :: AWS Sum...
AWS상에서 블록체인 서비스 구축 및 활용가이드 대방출! - 박천구 솔루션즈 아키텍트, AWS / 오재훈 이사, 두나무 :: AWS Sum...
Similar to Greenfield data platform implementation
A Journey to a Serverless Business Intelligence, Machine Learning and Big Dat...
In this talk we will describe the journey we made with one of our customers, Volotea, to deploy a serverless Business Intelligence (BI), Machine Learning (ML) and Big Data (BD) platform on the Cloud. The new platform leverages Platform-as-a-Service (PaaS) Cloud services, and it is the result of the reengineering and extension of an existing platform based on Cloud Infrastructure-as-a-Service (IaaS) services and bare-metal systems. Managing and maintaining BI, ML and BD platforms based on bare-metal or IaaS deployments is not a straightforward task, and as size and complexity grow, we often find ourselves spending more and more time in tasks that are rather administrative, more than of a development or analytics nature. That is exactly what Volotea realized, and together we envisioned and executed a plan to lift and reengineer their platform into a new solution that leverages Microsoft Azure PaaS services. We have delivered a solution that manages to greatly reduce the administrative burden as well as the technical complexity when implementing new use cases. The new platform is based on the Microsoft Azure stack and it includes Azure Data Lake, Azure Data Lake Analytics, Azure Data Factory, Azure Machine Learning and Azure SQL Database. Join us in this talk where we will share our lessons learned and we will discuss how to plan and execute such an endeavor.
NextStep Boston 2018 - Speeding in the Right Direction: Modernizing Legacy Ap...
How do you overcome a decade of neglecting IT? Find out with the CIO/CTO of the City of Oakland. He’ll explain how he modernized the City of Oakland’s IT organization, landscape, and capabilities with OutSystems and a low-code digital factory.
Customer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTX
This document provides instructions for using a presentation deck on Cloud Pak for Data. It instructs the user to:
1. Delete the first slide before using the deck.
2. Customize the presentation for the intended audience as the deck covers various topics and using all slides may not fit a single meeting.
3. The deck contains 6 embedded video records for a demo that takes 15-25 minutes to present. Guidance on pitching the demo is available.
The appendix contains slides on Cloud Pak for Data licensing and IBM's overall strategy.
CMAA_KSORENSEN
1) He discussed several mobile applications for tasks like daily reporting, punchlisting, inspections, photo management, and design collaboration. 2) He explained how these applications can streamline workflows by making information accessible remotely and eliminating paper-based processes. 3) His presentation provided an overview of how construction companies can evaluate technology needs, test applications, and incorporate useful tools to improve project management.
Rise with SAP
1. Yesterday's ERP systems are unable to keep pace with today's rapidly changing business environment, even before the COVID-19 pandemic. 50% of human tasks will be automated by 2025 and 90% of data and analytics innovation will be driven by public cloud services by 2022.
2. SAP offers RISE with SAP, a unified and simplified offering that brings together cloud services, advisory support and managed services to help customers transform their businesses. It provides standardized best practices, flexibility and scalability, and continuous innovation through its intelligent suite and cloud platform.
3. Customers are choosing RISE with SAP because it allows them to standardize and automate processes, gain flexibility and scal
Splunk: How Vodafone established Operational Analytics in a Hybrid Environmen...
Learn how Vodafone has provided end-to-end visibility across services by building an Operational Analytics Platform. In this session, you will hear how Stefan and his team manage legacy, on premise, hybrid and public cloud services, and how they are providing a platform for complex triage and debugging to tackle use cases across Vodafone’s extensive ecosystem.
CloudExpo Cloud Computing IaaS Growth Details 2015 - Why 2014 Was A Turning P...
Cloud Computing and IaaS are growing rapidly and now we are entering the age of the Early Majority. We've reached Peak Data Center, Peak Colocation and Peak Enterprise software - IT teams are embracing public cloud infrastructure from companies like ProfitBricks, Amazon AWS, Microsoft Azure and IBM SoftLayer. 2014 was a turning point where cloud computing infrastructure services transitioned from being the playground of developers and startups to the primary deployment option of IT teams that are tasked with upgrading and scaling on-premise applications and workloads. In this standing room only talk at CloudExpo, I shared insight into why 2015 and beyond is a turning point for IaaS..
Cortana Analytics Workshop: Milliman Integrate for Cortana Analytics
Paul Maher. Milliman Integrate is a SaaS offering from Milliman for the life insurance market to democratize actuarial modeling and financial reporting. Actuaries use mathematics, statistics, financial models, and simulations on a customer's profile to evaluate short- and long-term risks. The goal of Milliman Integrate is to allow actuaries to focus on business processes and analysis rather than complex infrastructure details. Come join this session to learn how Milliman is using Cortana Analytics and Azure to power Milliman Integrate, which reimagines the relationships between people, process, and technology to manage risk and maximize efficiencies. Go to https://channel9.msdn.com/ to find the recording of this session.
Driving Network and Marketing Investments at O2 by Focusing on Improving the ...
The idea was to predict the customer experience, and their perception of the O2 network at both the user and area levels to drive the network and marketing investments. Here is why and how we got there.
In order to measure and predict customer network experience, O2 needed a streaming big data solution which would consume billions of events coming in from the network, in real-time, to measure the performance of the network as experienced by the customer. It was important to build a platform to gather all the relevant data; to co-relate that with the customer satisfaction index (CSI) surveys to understand the relationship of metrics to score. We applied machine learning methods to predict the CSI for all users on the network. Customer insights from the network helped us to build customer segmentations which are shaping various marketing and digital propositions at O2.
- The overall solution was based on a hybrid architecture, where Open Source technologies were brought together with Tableau visualization which enabled O2 to keep the maintenance cost down to a minimum.
- In order to have quick ROI, the solution was built as the prototype which continued to evolve and now currently handles 30 billion transactions a day, continuously streaming into the platform, and predicting customer experience for 35m+ users.
The O2 solution continued to expand every year to accommodate multi-fold growth in traffic, and to accommodate additional features. The decision to move from a community edition Hadoop to the Hortonworks-based platform enabled us to have a supported, faster, and more reliable service. The migration to Hortonworks was completed in October 2018 which has given us the reliable platform to expand the analytics use cases across the wider O2 businesses.
Platform Strategy to Deliver Digital Experiences on Azure
This slide deck introduces Choreo, a cloud native internal developer platform by Microsoft independent software vendor (ISV) Partner, WSO2. It enables your developers to create, deploy, and run new digital components like APIs, microservices, and integrations in serverless mode on any Kubernetes cluster with built-in DevSecOps.
Recording: https://wso2.com/choreo/resources/webinar/platform-strategy-to-deliver-digital-experiences-on-azure/
NextStep Boston - Its 2025 How are You Managing Your Team of Citizen Develope...
The future is now. Supported by an active community, OutSystems, and superb onboarding, citizen developers are hard at work at Dupont Pioneer. Learn how it happened and about the offline apps these research scientists built.
Digital Reinvention by NRB
How to reinvent your organization in an iterative and pragmatic way? This is the result of using our digital toolbox. It allows you to transform your business model, expand your ecosystem by setting up your digital platform. This reinvention is also supported by the adaptation of your governance allowing you to innovate while guaranteeing the performance of your organization. For any information / suggestion / collaboration - william.poos@nrb.be
Comment réinventer votre organisation de manière itérative et pragmatique ? C'est le résultat de l'utilisation de notre boîte à outils digitale. Elle vous permet de transformer votre modèle métier, d'étendre votre écosystème en mettant en place votre plateforme digitale. Cette réinvention est également supportée par l'adaptation de votre gouvernance vous permettant d'innover tout en garantissant la performance de votre organisation. Pour toute information / suggestion / collaboration - william.poos@nrb.be
18th Athens Big Data Meetup - 1st Talk - Timeseries Forecasting as a Service
Title: Timeseries Forecasting as a Service
Speaker: Thanassis Spyrou (https://linkedin.com/in/thanassis-spyrou-92911959/)
Date: Thursday, November 14, 2019
Event: https://meetup.com/Athens-Big-Data/events/265957761/
Platform Requirements for CI/CD Success—and the Enterprises Leading the Way
All enterprises want to increase the speed of software delivery to get new products to market faster. The means for achieving this is often through the practice of continuous integration/continuous delivery. But speed alone isn’t enough—teams also require the ability to pivot when conditions change. They must ensure their software is stable and reliable, and be able to roll out patches and other security measures quickly and at scale.
A cloud-native platform coupled with test-driven development and CI/CD practices can help make this a reality. In this webinar, 451 Research’s Jay Lyman presents the results of his research into cloud-native platform requirements for enterprise CI/CD and DevOps success. Pivotal’s James Ma joins Lyman to discuss best practices from DevOps teams charged with running and managing cloud-native platforms, including applying CI/CD to the platform itself.
Speakers: James Ma, Pivotal and Jay Lyman, 451 Research
30 March 2017 - Vuzion Ireland Love Cloud
Kieran McDonnell from Vuzion Ireland gave a presentation on digital transformation and how Vuzion can help businesses future proof themselves. Vuzion is a cloud aggregator that has been delivering and selling cloud services for 20 years. They have a rich portfolio of cloud services and work with a smart ecosystem of partners. Vuzion's GTM model involves pre-sales engagement, operational delivery, capability development, and bespoke solutions. Julian Dyer from Vuzion then provided direction on Microsoft including updates on products like Skype for Business and Security as a Service. Elaine Pakes from DocuSign discussed how DocuSign can be used to sign documents anytime, anywhere on any device to ensure secure and compliant
Dynniq & GoDataDriven - Shaping the future of traffic with IoT and AI
Dynniq is a high-tech, innovative company offering smart mobility solutions and services internationally. We will present advanced IoT use cases Dynniq is working on, and share how GoDataDriven helps set up an AI capability. We will share our learnings, and show what makes data science in the mobility domain unique.
La Digital Transformation ha un nuovo alleato: Value Stream Management
La Digital Transformation ha un nuovo alleato: Value Stream ManagementEmerasoft, solutions to collaborate
Il modo di fare software è cambiato, Digital.ai approda in Italia con Emerasoft.
Digital.ai è la nuova realtà sul panorama mondiale in grado di rispondere alle nuove esigenze di Aziende di tipo Enterprise che necessitano di monitorare e valorizzare ogni step del processo produttivo delle applicazioni.
Digital.ai raccoglie tecnologie leader di mercato, come:
Xebialabs - Arxan - Collabnet - Experitest - Numerify
Perché partecipare
Per conoscere l’innovativo approccio al Value Stream Management
Per scoprire da vicino le soluzioni leader di mercato che oggi fanno parte della compagine delle tecnologie della piattaforma
Infine per conoscere perché abbiamo deciso di portare Digital.ai sul mercato italiano
Scrivi a sales@emerasoft.com per saperne di piùBecoming a data driven organization
The document discusses Pivotal's platform and strategy. It notes that Pivotal's platform allows for agile application development, access to big data solutions, and infrastructure flexibility. Examples are given of how companies like GE have used Pivotal's technologies to innovate faster using data and applications. The document promotes Pivotal's platform as uniquely positioned to help enterprises modernize their use of applications, data, and analytics.
BIG Data & Hadoop Applications in Logistics
Explore the applications of BIG Data & Hadoop in Logistics via Skillspeed.
BIG Data & Hadoop in Logistics is a key differentiator, especially in terms of optimizing back-end operations. They are used by companies for delivery optimization, demand & inventory forecasting and simplifying distribution networks.
To get more details regarding BIG Data & Hadoop, please visit - www.SkillSpeed.com
Orange Data Centre and Cloud
The Data Center infrastructure now includes Private Cloud, Public Cloud and Hybrid Cloud, paving the way for Hybrid IT. Find out the role they play in Digital Transformation.
Similar to Greenfield data platform implementation (20)
A Journey to a Serverless Business Intelligence, Machine Learning and Big Dat...
A Journey to a Serverless Business Intelligence, Machine Learning and Big Dat...
NextStep Boston 2018 - Speeding in the Right Direction: Modernizing Legacy Ap...
NextStep Boston 2018 - Speeding in the Right Direction: Modernizing Legacy Ap...
Customer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTX
Customer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTX
Splunk: How Vodafone established Operational Analytics in a Hybrid Environmen...
Splunk: How Vodafone established Operational Analytics in a Hybrid Environmen...
CloudExpo Cloud Computing IaaS Growth Details 2015 - Why 2014 Was A Turning P...
CloudExpo Cloud Computing IaaS Growth Details 2015 - Why 2014 Was A Turning P...
Cortana Analytics Workshop: Milliman Integrate for Cortana Analytics
Cortana Analytics Workshop: Milliman Integrate for Cortana Analytics
Driving Network and Marketing Investments at O2 by Focusing on Improving the ...
Driving Network and Marketing Investments at O2 by Focusing on Improving the ...
Platform Strategy to Deliver Digital Experiences on Azure
Platform Strategy to Deliver Digital Experiences on Azure
NextStep Boston - Its 2025 How are You Managing Your Team of Citizen Develope...
NextStep Boston - Its 2025 How are You Managing Your Team of Citizen Develope...
18th Athens Big Data Meetup - 1st Talk - Timeseries Forecasting as a Service
18th Athens Big Data Meetup - 1st Talk - Timeseries Forecasting as a Service
Platform Requirements for CI/CD Success—and the Enterprises Leading the Way
Platform Requirements for CI/CD Success—and the Enterprises Leading the Way
Dynniq & GoDataDriven - Shaping the future of traffic with IoT and AI
Dynniq & GoDataDriven - Shaping the future of traffic with IoT and AI
La Digital Transformation ha un nuovo alleato: Value Stream Management
La Digital Transformation ha un nuovo alleato: Value Stream Management
Recently uploaded
一比一原版(牛布毕业证书)牛津布鲁克斯大学毕业证如何办理
毕业原版【微信:41543339】【(牛布毕业证书)牛津布鲁克斯大学毕业证】【微信:41543339】成绩单、外壳、offer、留信学历认证（永久存档真实可查）采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。
【我们承诺采用的是学校原版纸张（纸质、底色、纹路），我们拥有全套进口原装设备，特殊工艺都是采用不同机器制作，仿真度基本可以达到100%，所有工艺效果都可提前给客户展示，不满意可以根据客户要求进行调整，直到满意为止！】
【业务选择办理准则】
一、工作未确定，回国需先给父母、亲戚朋友看下文凭的情况，办理一份就读学校的毕业证【微信41543339】文凭即可
二、回国进私企、外企、自己做生意的情况，这些单位是不查询毕业证真伪的，而且国内没有渠道去查询国外文凭的真假，也不需要提供真实教育部认证。鉴于此，办理一份毕业证【微信41543339】即可
三、进国企，银行，事业单位，考公务员等等，这些单位是必需要提供真实教育部认证的，办理教育部认证所需资料众多且烦琐，所有材料您都必须提供原件，我们凭借丰富的经验，快捷的绿色通道帮您快速整合材料，让您少走弯路。
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
留信网服务项目：
1、留学生专业人才库服务（留信分析）
2、国（境）学习人员提供就业推荐信服务
3、留学人员区块链存储服务
→ 【关于价格问题（保证一手价格）】
我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子 我给客户的都是第一手的代理价格，因为我想坦诚对待大家 不想跟大家在价格方面浪费时间
对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。
选择实体注册公司办理，更放心，更安全！我们的承诺：客户在留信官方认证查询网站查询到认证通过结果后付款，不成功不收费！
一比一原版(UO毕业证)渥太华大学毕业证如何办理
UO毕业证录取书【微信95270640】购买（渥太华大学毕业证成绩单硕士学历）Q微信95270640代办UO学历认证留信网伪造渥太华大学学位证书精仿渥太华大学本科/硕士文凭证书补办渥太华大学 diplomaoffer,Transcript购买渥太华大学毕业证成绩单购买UO假毕业证学位证书购买伪造渥太华大学文凭证书学位证书,专业办理雅思、托福成绩单，学生ID卡，在读证明，海外各大学offer录取通知书，毕业证书，成绩单，文凭等材料:1:1完美还原毕业证、offer录取通知书、学生卡等各种在读或毕业材料的防伪工艺（包括 烫金、烫银、钢印、底纹、凹凸版、水印、防伪光标、热敏防伪、文字图案浮雕，激光镭射，紫外荧光，温感光标）学校原版上有的工艺我们一样不会少，不论是老版本还是最新版本，都能保证最高程度还原，力争完美以求让所有同学都能享受到完美的品质服务。
文凭办理流程：
1客户提供办理信息：姓名生日专业学位毕业时间等（如信息不确定可以咨询顾问：微信95270640我们有专业老师帮你查询）；
2开始安排制作毕业证成绩单电子图；
3毕业证成绩单电子版做好以后发送给您确认；
4毕业证成绩单电子版您确认信息无误之后安排制作成品；
5成品做好拍照或者视频给您确认；
6快递给客户（国内顺丰国外DHLUPS等快读邮寄）。
7完成交易删除客户资料
高精端提供以下服务：
一：渥太华大学渥太华大学毕业证文凭证书全套材料从防伪到印刷水印底纹到钢印烫金
二：真实使馆认证（留学人员回国证明）使馆存档
三：真实教育部认证教育部存档教育部留服网站可查
四：留信认证留学生信息网站可查
五：与学校颁发的相关证件1:1纸质尺寸制定（定期向各大院校毕业生购买最新版本毕,业证成绩单保证您拿到的是鲁昂大学内部最新版本毕业证成绩单微信95270640）
A.为什么留学生需要操作留信认证?
留信认证全称全国留学生信息服务网认证,隶属于北京中科院。①留信认证门槛条件更低,费用更美丽,并且包过,完单周期短,效率高②留信认证虽然不能去国企,但是一般的公司都没有问题,因为国内很多公司连基本的留学生学历认证都不了解。这对于留学生来说,这就比自己光拿一个证书更有说服力,因为留学学历可以在留信网站上进行查询!
B.为什么我们提供的毕业证成绩单具有使用价值？
查询留服认证是国内鉴别留学生海外学历的唯一途径但认证只是个体行为不是所有留学生都操作所以没有办理认证的留学生的学历在国内也是查询不到的他们也仅仅只有一张文凭。所以这时候我们提供的和学校颁发的一模一样的毕业证成绩单就有了使用价值。只硕大的蛇皮袋手里拎着长铁钩正站在门口朝黑色的屋内张望不好坏人小偷山娃一怔却也灵机一动立马仰起头双手拢在嘴边朝楼上大喊：“爸爸爸——有人找——那人一听朝山娃尴尬地笑笑悻悻地走了山娃立马“嘭的一声将铁门锁死心却咚咚地乱跳当山娃跟父亲说起这事时父亲很吃惊抚摸着山娃的头说还好醒得及时要不家早被人掏空了到时连电视也没得看啰不过父亲还是夸山娃能临危不乱随机应变有胆有谋山娃笑笑说那都是书上学的看童话和小说时多
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
Dynamic policy enforcement is becoming an increasingly important topic in today’s world where data privacy and compliance is a top priority for companies, individuals, and regulators alike. In these slides, we discuss how LinkedIn implements a powerful dynamic policy enforcement engine, called ViewShift, and integrates it within its data lake. We show the query engine architecture and how catalog implementations can automatically route table resolutions to compliance-enforcing SQL views. Such views have a set of very interesting properties: (1) They are auto-generated from declarative data annotations. (2) They respect user-level consent and preferences (3) They are context-aware, encoding a different set of transformations for different use cases (4) They are portable; while the SQL logic is only implemented in one SQL dialect, it is accessible in all engines.
#SQL #Views #Privacy #Compliance #DataLake
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
原版一模一样【微信：741003700 】【(uts毕业证书)悉尼科技大学毕业证学历证书】【微信：741003700 】学位证，留信认证（真实可查，永久存档）offer、雅思、外壳等材料/诚信可靠,可直接看成品样本，帮您解决无法毕业带来的各种难题！外壳，原版制作，诚信可靠，可直接看成品样本。行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备。十五年致力于帮助留学生解决难题，包您满意。
本公司拥有海外各大学样板无数，能完美还原海外各大学 Bachelor Diploma degree, Master Degree Diploma
1:1完美还原海外各大学毕业材料上的工艺：水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠。文字图案浮雕、激光镭射、紫外荧光、温感、复印防伪等防伪工艺。材料咨询办理、认证咨询办理请加学历顾问Q/微741003700
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
Analysis insight about a Flyball dog competition team's performance
Insight of my analysis about a Flyball dog competition team's last year performance. Find more: https://github.com/rolandnagy-ds/flyball_race_analysis/tree/main
State of Artificial intelligence Report 2023
Artificial intelligence (AI) is a multidisciplinary field of science and engineering whose goal is to create intelligent machines.
We believe that AI will be a force multiplier on technological progress in our increasingly digital, data-driven world. This is because everything around us today, ranging from culture to consumer products, is a product of intelligence.
The State of AI Report is now in its sixth year. Consider this report as a compilation of the most interesting things we’ve seen with a goal of triggering an informed conversation about the state of AI and its implication for the future.
We consider the following key dimensions in our report:
Research: Technology breakthroughs and their capabilities.
Industry: Areas of commercial application for AI and its business impact.
Politics: Regulation of AI, its economic implications and the evolving geopolitics of AI.
Safety: Identifying and mitigating catastrophic risks that highly-capable future AI systems could pose to us.
Predictions: What we believe will happen in the next 12 months and a 2022 performance review to keep us honest.
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Harness the power of AI-backed reports, benchmarking and data analysis to predict trends and detect anomalies in your marketing efforts.
Peter Caputa, CEO at Databox, reveals how you can discover the strategies and tools to increase your growth rate (and margins!).
From metrics to track to data habits to pick up, enhance your reporting for powerful insights to improve your B2B tech company's marketing.
- - -
This is the webinar recording from the June 2024 HubSpot User Group (HUG) for B2B Technology USA.
Watch the video recording at https://youtu.be/5vjwGfPN9lw
Sign up for future HUG events at https://events.hubspot.com/b2b-technology-usa/
Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...
This webinar will explore cutting-edge, less familiar but powerful experimentation methodologies which address well-known limitations of standard A/B Testing. Designed for data and product leaders, this session aims to inspire the embrace of innovative approaches and provide insights into the frontiers of experimentation!
End-to-end pipeline agility - Berlin Buzzwords 2024
We describe how we achieve high change agility in data engineering by eliminating the fear of breaking downstream data pipelines through end-to-end pipeline testing, and by using schema metaprogramming to safely eliminate boilerplate involved in changes that affect whole pipelines.
A quick poll on agility in changing pipelines from end to end indicated a huge span in capabilities. For the question "How long time does it take for all downstream pipelines to be adapted to an upstream change," the median response was 6 months, but some respondents could do it in less than a day. When quantitative data engineering differences between the best and worst are measured, the span is often 100x-1000x, sometimes even more.
A long time ago, we suffered at Spotify from fear of changing pipelines due to not knowing what the impact might be downstream. We made plans for a technical solution to test pipelines end-to-end to mitigate that fear, but the effort failed for cultural reasons. We eventually solved this challenge, but in a different context. In this presentation we will describe how we test full pipelines effectively by manipulating workflow orchestration, which enables us to make changes in pipelines without fear of breaking downstream.
Making schema changes that affect many jobs also involves a lot of toil and boilerplate. Using schema-on-read mitigates some of it, but has drawbacks since it makes it more difficult to detect errors early. We will describe how we have rejected this tradeoff by applying schema metaprogramming, eliminating boilerplate but keeping the protection of static typing, thereby further improving agility to quickly modify data pipelines without fear.
The Building Blocks of QuestDB, a Time Series Database
Talk Delivered at Valencia Codes Meetup 2024-06.
Traditionally, databases have treated timestamps just as another data type. However, when performing real-time analytics, timestamps should be first class citizens and we need rich time semantics to get the most out of our data. We also need to deal with ever growing datasets while keeping performant, which is as fun as it sounds.
It is no wonder time-series databases are now more popular than ever before. Join me in this session to learn about the internal architecture and building blocks of QuestDB, an open source time-series database designed for speed. We will also review a history of some of the changes we have gone over the past two years to deal with late and unordered data, non-blocking writes, read-replicas, or faster batch ingestion.
The Ipsos - AI - Monitor 2024 Report.pdf
According to Ipsos AI Monitor's 2024 report, 65% Indians said that products and services using AI have profoundly changed their daily life in the past 3-5 years.
一比一原版(Chester毕业证书)切斯特大学毕业证如何办理
毕业原版【微信:41543339】【(Chester毕业证书)切斯特大学毕业证】【微信:41543339】成绩单、外壳、offer、留信学历认证（永久存档真实可查）采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。
【我们承诺采用的是学校原版纸张（纸质、底色、纹路），我们拥有全套进口原装设备，特殊工艺都是采用不同机器制作，仿真度基本可以达到100%，所有工艺效果都可提前给客户展示，不满意可以根据客户要求进行调整，直到满意为止！】
【业务选择办理准则】
一、工作未确定，回国需先给父母、亲戚朋友看下文凭的情况，办理一份就读学校的毕业证【微信41543339】文凭即可
二、回国进私企、外企、自己做生意的情况，这些单位是不查询毕业证真伪的，而且国内没有渠道去查询国外文凭的真假，也不需要提供真实教育部认证。鉴于此，办理一份毕业证【微信41543339】即可
三、进国企，银行，事业单位，考公务员等等，这些单位是必需要提供真实教育部认证的，办理教育部认证所需资料众多且烦琐，所有材料您都必须提供原件，我们凭借丰富的经验，快捷的绿色通道帮您快速整合材料，让您少走弯路。
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
留信网服务项目：
1、留学生专业人才库服务（留信分析）
2、国（境）学习人员提供就业推荐信服务
3、留学人员区块链存储服务
→ 【关于价格问题（保证一手价格）】
我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子 我给客户的都是第一手的代理价格，因为我想坦诚对待大家 不想跟大家在价格方面浪费时间
对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。
选择实体注册公司办理，更放心，更安全！我们的承诺：客户在留信官方认证查询网站查询到认证通过结果后付款，不成功不收费！
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
毕业原版【微信:176555708】【(UMN毕业证书)明尼苏达大学毕业证】【微信:176555708】成绩单、外壳、offer、留信学历认证（永久存档真实可查）采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。
【我们承诺采用的是学校原版纸张（纸质、底色、纹路），我们拥有全套进口原装设备，特殊工艺都是采用不同机器制作，仿真度基本可以达到100%，所有工艺效果都可提前给客户展示，不满意可以根据客户要求进行调整，直到满意为止！】
【业务选择办理准则】
一、工作未确定，回国需先给父母、亲戚朋友看下文凭的情况，办理一份就读学校的毕业证【微信176555708】文凭即可
二、回国进私企、外企、自己做生意的情况，这些单位是不查询毕业证真伪的，而且国内没有渠道去查询国外文凭的真假，也不需要提供真实教育部认证。鉴于此，办理一份毕业证【微信176555708】即可
三、进国企，银行，事业单位，考公务员等等，这些单位是必需要提供真实教育部认证的，办理教育部认证所需资料众多且烦琐，所有材料您都必须提供原件，我们凭借丰富的经验，快捷的绿色通道帮您快速整合材料，让您少走弯路。
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
留信网服务项目：
1、留学生专业人才库服务（留信分析）
2、国（境）学习人员提供就业推荐信服务
3、留学人员区块链存储服务
→ 【关于价格问题（保证一手价格）】
我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子 我给客户的都是第一手的代理价格，因为我想坦诚对待大家 不想跟大家在价格方面浪费时间
对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。
选择实体注册公司办理，更放心，更安全！我们的承诺：客户在留信官方认证查询网站查询到认证通过结果后付款，不成功不收费！
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
"Join us for STATATHON, a dynamic 2-day event dedicated to exploring statistical knowledge and its real-world applications. From theory to practice, participants engage in intensive learning sessions, workshops, and challenges, fostering a deeper understanding of statistical methodologies and their significance in various fields."
DSSML24_tspann_CodelessGenerativeAIPipelines
Codeless Generative AI Pipelines
(GenAI with Milvus)
https://ml.dssconf.pl/user.html#!/lecture/DSSML24-041a/rate
Discover the potential of real-time streaming in the context of GenAI as we delve into the intricacies of Apache NiFi and its capabilities. Learn how this tool can significantly simplify the data engineering workflow for GenAI applications, allowing you to focus on the creative aspects rather than the technical complexities. I will guide you through practical examples and use cases, showing the impact of automation on prompt building. From data ingestion to transformation and delivery, witness how Apache NiFi streamlines the entire pipeline, ensuring a smooth and hassle-free experience.
Timothy Spann
https://www.youtube.com/@FLaNK-Stack
https://medium.com/@tspann
https://www.datainmotion.dev/
milvus, unstructured data, vector database, zilliz, cloud, vectors, python, deep learning, generative ai, genai, nifi, kafka, flink, streaming, iot, edge
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
The Modern Marketing Reckoner (MMR) is a comprehensive resource packed with POVs from 60+ industry leaders on how AI is transforming the 4 key pillars of marketing – product, place, price and promotions.
My burning issue is homelessness K.C.M.O.
My burning issue is homelessness in Kansas City, MO
To: Tom Tresser
From: Roger Warren
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
毕业原版【微信:176555708】【(GWU,GW毕业证书)乔治·华盛顿大学毕业证】【微信:176555708】成绩单、外壳、offer、留信学历认证（永久存档真实可查）采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。
【我们承诺采用的是学校原版纸张（纸质、底色、纹路），我们拥有全套进口原装设备，特殊工艺都是采用不同机器制作，仿真度基本可以达到100%，所有工艺效果都可提前给客户展示，不满意可以根据客户要求进行调整，直到满意为止！】
【业务选择办理准则】
一、工作未确定，回国需先给父母、亲戚朋友看下文凭的情况，办理一份就读学校的毕业证【微信176555708】文凭即可
二、回国进私企、外企、自己做生意的情况，这些单位是不查询毕业证真伪的，而且国内没有渠道去查询国外文凭的真假，也不需要提供真实教育部认证。鉴于此，办理一份毕业证【微信176555708】即可
三、进国企，银行，事业单位，考公务员等等，这些单位是必需要提供真实教育部认证的，办理教育部认证所需资料众多且烦琐，所有材料您都必须提供原件，我们凭借丰富的经验，快捷的绿色通道帮您快速整合材料，让您少走弯路。
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
留信网服务项目：
1、留学生专业人才库服务（留信分析）
2、国（境）学习人员提供就业推荐信服务
3、留学人员区块链存储服务
→ 【关于价格问题（保证一手价格）】
我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子 我给客户的都是第一手的代理价格，因为我想坦诚对待大家 不想跟大家在价格方面浪费时间
对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。
选择实体注册公司办理，更放心，更安全！我们的承诺：客户在留信官方认证查询网站查询到认证通过结果后付款，不成功不收费！
Recently uploaded (20)
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
Analysis insight about a Flyball dog competition team's performance
Analysis insight about a Flyball dog competition team's performance
A presentation that explain the Power BI Licensing
A presentation that explain the Power BI Licensing
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...
Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...
End-to-end pipeline agility - Berlin Buzzwords 2024
End-to-end pipeline agility - Berlin Buzzwords 2024
The Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series Database
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
Greenfield data platform implementation
- 1. Greenfield Data Platform Implementation Enabling Data Science on Azure
- 2. IPPON 2019 Data Practice Lead at Ippon Technologies, a boutique consulting firm specializing in Data, Cloud, DevOps, and Application Development. Ippon has deep expertise across all major cloud platforms: AWS, Azure, and GCP. Nearly 20 years of data consulting experience across multiple industries, including Financial Services, Health and Life Sciences, and Media Previous clients include Morgan Stanley, FINRA, Warner Music, and McDonald's Corporation Patent Pending: Data Quality Analysis Tool Peter Choe U.S. Data Practice Lead Project Goal and Timeline Approach Tech Stack and Initial Architecture Tools Selected Realized Benefits Agenda for Today Let’s connect on LinkedIn! linkedin.com/in/pchoe Introduction.
- 3. Background. TickPick offers “what you see is what you get” pricing and a stellar customer experience. 3-year growth (Inc. 5000) - 393% Meetup Promo Code - SAVE10 www.tickpick.com www.youtube.com/tickpick IPPON 2020
- 4. Project Goals. Ippon 2019 Goals Solution Drive insights from their data to 1. Increase Revenue 2. Gain 360° view of markets and margins 3. Measure and increase effectiveness of marketing campaigns ➔ World-class data analytics platform for the purposes of empowering the business to make informed decisions. ➔ Launchpad for kick-starting advanced Data Science initiatives. IPPON 2020
- 5. Continued Model Training Delivery Timeline. - Data Pipelines, - Streaming CDC, - Release Pipelines, - POCs - Data pipelines from source systems into the data lake and Snowflake - CI/CD Pipelines - Airflow - Rata ingested from sources and loaded to data warehouse - In parallel, first data insights derived from data and “test run” marketing campaigns Realized up to 3X on ROAS (Return on advertising spend) with new data backed marketing campaigns Expansion to different business use cases such as Margin Optimizations Assessment 1st MVP up and running 1st Production Release Week 1-3 Week 4-6 Week 10 Week 11-12 Week 12 + 3x ROAS IPPON 2020
- 6. Data Landscape - 2019.
- 7. 7. Approach. Focus on areas with biggest ROI ★ Business Intelligence ★ Data Warehouse ★ Data Orchestration & Data Movement (ELT / ETL) ★ Data Catalog ★ Data Science IPPON 2020
- 8. 8. IPPON 2020 Guiding Principles. ★ Open Source First ★ Cloud Agnostic ★ Streamline Development - Integrate with CI/CD pipelines ★ Elasticity - Scale up when needed, and down when not ★ “Pay as you go” / Cost ★ Skill Set - Leverage existing staff’s skills to easily pick up new technology / know how
- 9. Initial Architecture. Centered on Web and Native Mobile Apps Reports and extracts were highly manual with little to no automation causing delays in reporting metrics Extracts were downloaded, then loaded into excel then cut and pasted into tables and pivot tables Excel graphs and visualizations IPPON 2020
- 10. Before Tech Stack. ❖ Azure ❖ C# ❖ Python ❖ Azure Service Bus After ❖ Azure ❖ C# ❖ Python ❖ Azure Service Bus ❖ Azure Event Grid ❖ Stitch ❖ Airflow ❖ Snowflake ❖ Databricks ❖ Looker IPPON 2020
- 11. Tools Selected. Requirements ❖ ❖ Elasticity - horizontal and vertical scaling ❖ “Pay as you go” ❖ Cloud agnostic ❖ Easy to pick up ❖ Low operational costs ❖ Integrate-able Tools Selected ❖ Snowflake ❖ Looker ❖ Python / Stitch ❖ Databricks Key Functionalities ❖ Near Zero Maintenance ❖ Zero Copy Cloning ❖ Easy to integrate ❖ Fully IPPON 2020
- 12. Realized Benefits. Business Intelligence Looker Fully integrated with Snowflake and leverages Snowflake’s compute capabilities ELT Stitch/Python Ease of development Reusable code Direct connectivity to SaaS offerings Data Warehouse Snowflake Zero Copy Cloning Near Zero Maintenance Elasticity Data Science Databricks Acceleration to delivery, easy collaboration, fully integrated with Azure Data Catalog Azure Data Catalog “Build for Today” Allows for embedding key principles and best practices. Free to start, $1 per user otherwise
- 13. Ippon Technologies © 2017 13 What’s next? Lessons Learned ❖ Build for today - Building a enterprise solution takes time and iterations ❖ Stand alone SQL vs Managed Instances ❖ Managed Services vs Operational Costs Next Steps ❖ Never be satisfied, always room for improvement ❖ Keep up to date with new changes to landscape as things mature ❖ Astronomer ❖ Azure Services ➢ Synapse, Personalizer, ML Service IPPON 2020