This document discusses mechanisms and process excellence. It begins by defining mechanisms as complete processes that convert inputs into outputs and are assembled from organizational levers. The document then provides examples of mechanisms used at Amazon, such as the Andon Cord for customer service and Weekly Business Reviews. It explains how to create mechanisms by starting with a business challenge, working backwards from desired outputs, and focusing on converting inputs. Key elements of mechanisms include tools, adoption, inspection, and iteration. The presentation concludes by discussing when and how to establish mechanisms in an organization.
Amazon’s Culture of Innovation & The Working Backwards session
Working Backwards; leading organisations achieve growth by marrying customer-obsession with a modern technology strategy. Where do you begin? By focusing on the customer.
During this webinar, Amazon will discuss key innovation principles which have been instrumental in their continued success and their Working Backwards approach.
What does it mean to be Well-Architected - Maria Sokolova - AWS TechShift ANZ...Amazon Web Services
The AWS Well-Architected Framework enables customers to understand best practices around security, reliability, performance, and cost optimisation when building systems on AWS. This approach helps customers make informed decisions and weigh the pros and cons of application design patterns for the cloud. In this session, you'll learn about the Well-Architected Framework, and the steps you can take to help ensure your solution is Well Architected on AWS.
Build Your Recommendation Engine on AWS Today - AWS Summit Berlin 2018Yotam Yarden
Recommender systems are an important mechanism to personalize and enhance customer experience. In Amazon, we have been researching recommender systems for over two decades and nowadays AWS customers can use the same technologies to develop, train and deploy their own recommenders systems in just a couple of hours. In my presentation, I will give an overview of the most recent recommender systems papers and techniques, and demonstrate how to train and deploy a recommendation system on AWS in less than 15 minutes.
Presented at the AWS Summit in Berlin, June 6th 2018
커머스 스타트업의 효율적인 데이터 분석 플랫폼 구축기 - 하지양 데이터 엔지니어, 발란 / 강웅석 데이터 엔지니어, 크로키닷컴 :: AWS...Amazon Web Services Korea
스타트업에서 빠르게 분석 서비스를 구성하기 위한 AWS 분석 서비스를 활용하고 있습니다. 본 세션에서는 커머스 서비스의 대용량 데이터를 Amazon Kinesis Firehose를 이용하여 실시간으로 사내에 흐르는 중요 데이터를 캡쳐하여 다양한 용도로 사용하는 방법을 알아봅니다. 매달 수백억 건의 사용자 행동 로그를 안정적이고 견고하게 수집하여 인하우스 데이터 분석 방법을 소개합니다. 또한, Amazon Personalize를 통한 개인화 추천 및 Amazon SageMaker를 이용한 이미지분류 등 기계 학습 활용 사례도 공유합니다.
Operating Models: How Does Your Operating Model Change and Scale in the Cloud?Amazon Web Services
In this session, we share different facets of existing operating models changes and associated benefits of the cloud through organization, autonomy, and stewardship. These customers will discuss large scale change, speed to delivery for the organization, and resulting staffing model changes with cloud adoption. These allow the presenting organization to keep up with customer demand, build internal aptitude, and reduce costs for the organization.
1. Cloud Adoption Journey reference framework to help Teams move to Cloud and become Cloud Native
2. Define basic Pillars to include Security & Compliance, Costs Optimization, Scalability and Performance as well as Operational Excellence, AWS Well-Architected as guidance
3. Goal is to assess and guide Companies/Teams in Portfolio to faster adopt and evolve Cloud concepts to focus on Business value
4. Governance as a key driver to boost flexibility, reduce risks and foster efficiency
5. Enterprise Transformation Architecture offerings
Amazon’s Culture of Innovation & The Working Backwards session
Working Backwards; leading organisations achieve growth by marrying customer-obsession with a modern technology strategy. Where do you begin? By focusing on the customer.
During this webinar, Amazon will discuss key innovation principles which have been instrumental in their continued success and their Working Backwards approach.
What does it mean to be Well-Architected - Maria Sokolova - AWS TechShift ANZ...Amazon Web Services
The AWS Well-Architected Framework enables customers to understand best practices around security, reliability, performance, and cost optimisation when building systems on AWS. This approach helps customers make informed decisions and weigh the pros and cons of application design patterns for the cloud. In this session, you'll learn about the Well-Architected Framework, and the steps you can take to help ensure your solution is Well Architected on AWS.
Build Your Recommendation Engine on AWS Today - AWS Summit Berlin 2018Yotam Yarden
Recommender systems are an important mechanism to personalize and enhance customer experience. In Amazon, we have been researching recommender systems for over two decades and nowadays AWS customers can use the same technologies to develop, train and deploy their own recommenders systems in just a couple of hours. In my presentation, I will give an overview of the most recent recommender systems papers and techniques, and demonstrate how to train and deploy a recommendation system on AWS in less than 15 minutes.
Presented at the AWS Summit in Berlin, June 6th 2018
커머스 스타트업의 효율적인 데이터 분석 플랫폼 구축기 - 하지양 데이터 엔지니어, 발란 / 강웅석 데이터 엔지니어, 크로키닷컴 :: AWS...Amazon Web Services Korea
스타트업에서 빠르게 분석 서비스를 구성하기 위한 AWS 분석 서비스를 활용하고 있습니다. 본 세션에서는 커머스 서비스의 대용량 데이터를 Amazon Kinesis Firehose를 이용하여 실시간으로 사내에 흐르는 중요 데이터를 캡쳐하여 다양한 용도로 사용하는 방법을 알아봅니다. 매달 수백억 건의 사용자 행동 로그를 안정적이고 견고하게 수집하여 인하우스 데이터 분석 방법을 소개합니다. 또한, Amazon Personalize를 통한 개인화 추천 및 Amazon SageMaker를 이용한 이미지분류 등 기계 학습 활용 사례도 공유합니다.
Operating Models: How Does Your Operating Model Change and Scale in the Cloud?Amazon Web Services
In this session, we share different facets of existing operating models changes and associated benefits of the cloud through organization, autonomy, and stewardship. These customers will discuss large scale change, speed to delivery for the organization, and resulting staffing model changes with cloud adoption. These allow the presenting organization to keep up with customer demand, build internal aptitude, and reduce costs for the organization.
1. Cloud Adoption Journey reference framework to help Teams move to Cloud and become Cloud Native
2. Define basic Pillars to include Security & Compliance, Costs Optimization, Scalability and Performance as well as Operational Excellence, AWS Well-Architected as guidance
3. Goal is to assess and guide Companies/Teams in Portfolio to faster adopt and evolve Cloud concepts to focus on Business value
4. Governance as a key driver to boost flexibility, reduce risks and foster efficiency
5. Enterprise Transformation Architecture offerings
These slides look at why IT transformation projects seem so challenging and whether ignoring the probability of success and failure through TCO analysis can make tools dangerous when poorly applied. We’ll also look at the cost of cloud, and whether it’s really lower than buying and running IT on premise; and examine the TCO of cloud adoption.
Rapid Innovation: The Business Case for Modern Application Development (SRV20...Amazon Web Services
Modern application development is not a buzzword—it’s an innovation strategy that organizations of all sizes can use to increase revenue, lower costs, and outpace the competition. In this session, learn how you can unblock digital product and service innovation for your own organization. Putting technology details aside, we explain what modern application development really is, why it matters to the business, what success metrics you should expect, and how to navigate your own transition.
AWS Cloud Adoption Framework and WorkshopsTom Laszewski
The presentation covers the AWS Cloud Adoption Framework (CAF). AWS CAF helps organization accelerate their cloud adoption journey. The framework includes six perspectives - business, people, governance, security, operations, and platform. These six perspectives are used during CAF Envision, Alignment, and Cloud Capability Assessment workshops to enable the art of the possible, identify and mitigate organizational and technology impediments, and score the cloud capabilities of an organization.
Container technology provides unparalleled improvements in efficiency and agility of packaging and deploying applications, and hence are becoming the de-facto method for deploying microservices. However, using containers for running services at scale has required that operations team handle complex, dynamically changing infrastructure requirements, or run the risk or under/over-provisioning infrastructure. Let's explore together best practices for developing containerized applications with AWS services while running them at scale.
Speaker: Donnie Prakoso, ASEAN Technical Evangelist, Amazon Web Services
AWS Customer Speaker: Achmad Nazmy, GM of Technology, MOKA
Leveraging Experts for Scale - Ralf Capel - AWS TechShift ANZ 2018Amazon Web Services
With cloud technologies available to software businesses at a click of a button, one of the key constraint’s software businesses face these days is the availability of human capital. This session will focus on the ecosystem a software business can tap into to complement their workforce for speed, scale and focus. We will share real-world stories from customers who have leveraged AWS Consulting Partners, AWS Support, and Training to achieve increase in quality and speed of delivery of their software.
Governance@scale - Governance of Multi-Account, Large-Scale AWS Environments ...Amazon Web Services
Goveranance@Scale (G@S) is an increasingly important concept for customers as they adopt AWS across the enterprise today in order to facilitate alignment with and responsiveness to business requirements, enterprise security and financial controls. G@S is based on segmenting workloads into separate accounts and applying security in a fashion that is tailored to the nature of the workloads in those accounts. This section will cover the governance concepts and policies to deploy AWS using 10s or even hundreds of accounts to create deep isolation between those workloads.
LFS307_Using AWS to Maximize Digital Marketing Reach and EfficiencyAmazon Web Services
Pharmaceutical company processes tend to be slow when dealing with customer-facing applications that contain FDA-validated messages, all while maintaining infrastructure and security standards. In this session, discover how Mylan, a US–based global generic and specialty pharmaceutical company, overcame these obstacles and provided scalable solutions by leveraging AWS DevOps methods that lower time to market, while maintaining robust security and release management practices. During the presentation, learn how Mylan redefined process models such as infrastructure change management to define new security and process models. Additionally, learn how Mylan used services like Amazon S3, Elastic Load Balancing (ELB), and AWS CloudFormation to define these new models.
Moving to DevOps the Amazon Way (DEV210-R1) - AWS re:Invent 2018Amazon Web Services
DevOps is currently one of the most sought after engineering models. One reason is that it helps enterprise transformations. The Amazon transformation to DevOps was born out of the desire to be even more customer obsessed, more agile, and more innovative. Come and learn from our journey as we share the playbook that helped us successfully implement and adopt DevOps as well as the lessons we learned the hard way.
Implementing a Cloud Center of Excellence (CCoE) promotes a seamless transition to the cloud for any organization. Cloud adoption includes communicating a new strategic direction, involving stakeholders from across the organization, identifying skill gaps, identifying key team members, and establishing a realistic roadmap. JHC Technology presents how organizations can manage, evaluate, automate, and continuously spur cloud adoption through repeatability, allowing the organization to deploy innovation today and be ready for whatever comes tomorrow. As part of this discussion we will review the framework necessary to identify AWS Partners that can provide the best value to your organization.
Elizabeth Boudreau, Cloud Executive Advisor, Amazon Web Services
Matt Jordan, Vice President, Corporate Strategy & Development, JHC Technology
So You Want to be Well-Architected - AWS Summit Sydney 2018Amazon Web Services
So You Want to be Well-Architected?
The AWS Well-Architected Framework enables customers to understand best practices around security, reliability, performance, and cost optimisation when building systems on AWS. This approach helps customers make informed decisions and weigh the pros and cons of application design patterns for the cloud. In this session, you'll learn about the Well-Architected Framework, and the steps you can take to help ensure your solution is Well Architected.
Ben Hunter, Solutions Architect, Amazon Web Services
Modernising the Enterprise: An Evening with the AWS Enterprise User GroupHarley Young
The French aristocrat, writer, and aviator, Antoine De Saint-Exupery most famously wrote The Little Prince. He's also credited with the following quote, "If you want to build a ship, don’t drum up the men and women to gather wood, divide the work, and give orders. Instead, teach them to yearn for the vast and endless sea." Cloud modernisation is a little bit like building that ship. You can't merely command an organisation to pick up its applications and move to the cloud. Instead, you must teach them to yearn for the vast and endless potential the cloud provides to build whatever they can imagine for their business.
In the presentation, I explain a 5-step approach that has been used to transform and modernise some of the world's most successful businesses in nearly all imaginable industry verticals as they contemplated a move to the AWS cloud:
1. Know your business
2. Understand your environment
3. Prepare the organisation
4. Move the first workloads to the cloud
5. Get help when you need it
Automated Monitoring of Best Practices and Operational Health of Your AWS Res...Amazon Web Services
Automated Monitoring of Best Practices and Operational Health of Your AWS Resources
It can be challenging to optimise AWS resources across cost, performance, security, and fault-tolerance, much less do it automatically. Attendees will learn how to implement automation of AWS best practice recommendations from AWS Trusted Advisor, and remediation from the AWS Health API on AWS resources.
Stephen Salim, Technical Account Manager, Amazon Web Services and Tipu Qureshi, Principal Cloud Support Engineer, Amazon Web Services
Leading Your Team Through a Cloud Transformation - Virtual Transformation Day...Amazon Web Services
Speaker: Thomas Blood
Moving to the cloud can help transform technical and non-technical aspects of your organization, enabling agility, scale, security, and cost savings. However, transformational change requires strong leadership at all levels of the organization. In this session, we will review strategies and best practices to help you lead the organization through a successful cloud journey.
AWS Transformation Day is designed for enterprise organizations looking to make the move to the cloud in order to become more responsive, agile and innovative, while still staying secure and compliant. Join us for this virtual event and we'll share our experiences of helping enterprise customers accelerate the pace of migration and adoption of strategic services.
We recommend this event for IT and business leaders who are looking to create sustainable benefits and a competitive advantage by using the AWS Cloud.
Organizing for faster innovation - People, process, culture, and technologyTom Laszewski
Organizing for faster innovation through people, process, culture, and technology transformation. Best practices, lesson learned, and a prescriptive approach to evolving and disrupting a company's people, process, culture, and technology during a digital and cloud transformation.
Analysis insight about a Flyball dog competition team's performanceroli9797
Insight of my analysis about a Flyball dog competition team's last year performance. Find more: https://github.com/rolandnagy-ds/flyball_race_analysis/tree/main
These slides look at why IT transformation projects seem so challenging and whether ignoring the probability of success and failure through TCO analysis can make tools dangerous when poorly applied. We’ll also look at the cost of cloud, and whether it’s really lower than buying and running IT on premise; and examine the TCO of cloud adoption.
Rapid Innovation: The Business Case for Modern Application Development (SRV20...Amazon Web Services
Modern application development is not a buzzword—it’s an innovation strategy that organizations of all sizes can use to increase revenue, lower costs, and outpace the competition. In this session, learn how you can unblock digital product and service innovation for your own organization. Putting technology details aside, we explain what modern application development really is, why it matters to the business, what success metrics you should expect, and how to navigate your own transition.
AWS Cloud Adoption Framework and WorkshopsTom Laszewski
The presentation covers the AWS Cloud Adoption Framework (CAF). AWS CAF helps organization accelerate their cloud adoption journey. The framework includes six perspectives - business, people, governance, security, operations, and platform. These six perspectives are used during CAF Envision, Alignment, and Cloud Capability Assessment workshops to enable the art of the possible, identify and mitigate organizational and technology impediments, and score the cloud capabilities of an organization.
Container technology provides unparalleled improvements in efficiency and agility of packaging and deploying applications, and hence are becoming the de-facto method for deploying microservices. However, using containers for running services at scale has required that operations team handle complex, dynamically changing infrastructure requirements, or run the risk or under/over-provisioning infrastructure. Let's explore together best practices for developing containerized applications with AWS services while running them at scale.
Speaker: Donnie Prakoso, ASEAN Technical Evangelist, Amazon Web Services
AWS Customer Speaker: Achmad Nazmy, GM of Technology, MOKA
Leveraging Experts for Scale - Ralf Capel - AWS TechShift ANZ 2018Amazon Web Services
With cloud technologies available to software businesses at a click of a button, one of the key constraint’s software businesses face these days is the availability of human capital. This session will focus on the ecosystem a software business can tap into to complement their workforce for speed, scale and focus. We will share real-world stories from customers who have leveraged AWS Consulting Partners, AWS Support, and Training to achieve increase in quality and speed of delivery of their software.
Governance@scale - Governance of Multi-Account, Large-Scale AWS Environments ...Amazon Web Services
Goveranance@Scale (G@S) is an increasingly important concept for customers as they adopt AWS across the enterprise today in order to facilitate alignment with and responsiveness to business requirements, enterprise security and financial controls. G@S is based on segmenting workloads into separate accounts and applying security in a fashion that is tailored to the nature of the workloads in those accounts. This section will cover the governance concepts and policies to deploy AWS using 10s or even hundreds of accounts to create deep isolation between those workloads.
LFS307_Using AWS to Maximize Digital Marketing Reach and EfficiencyAmazon Web Services
Pharmaceutical company processes tend to be slow when dealing with customer-facing applications that contain FDA-validated messages, all while maintaining infrastructure and security standards. In this session, discover how Mylan, a US–based global generic and specialty pharmaceutical company, overcame these obstacles and provided scalable solutions by leveraging AWS DevOps methods that lower time to market, while maintaining robust security and release management practices. During the presentation, learn how Mylan redefined process models such as infrastructure change management to define new security and process models. Additionally, learn how Mylan used services like Amazon S3, Elastic Load Balancing (ELB), and AWS CloudFormation to define these new models.
Moving to DevOps the Amazon Way (DEV210-R1) - AWS re:Invent 2018Amazon Web Services
DevOps is currently one of the most sought after engineering models. One reason is that it helps enterprise transformations. The Amazon transformation to DevOps was born out of the desire to be even more customer obsessed, more agile, and more innovative. Come and learn from our journey as we share the playbook that helped us successfully implement and adopt DevOps as well as the lessons we learned the hard way.
Implementing a Cloud Center of Excellence (CCoE) promotes a seamless transition to the cloud for any organization. Cloud adoption includes communicating a new strategic direction, involving stakeholders from across the organization, identifying skill gaps, identifying key team members, and establishing a realistic roadmap. JHC Technology presents how organizations can manage, evaluate, automate, and continuously spur cloud adoption through repeatability, allowing the organization to deploy innovation today and be ready for whatever comes tomorrow. As part of this discussion we will review the framework necessary to identify AWS Partners that can provide the best value to your organization.
Elizabeth Boudreau, Cloud Executive Advisor, Amazon Web Services
Matt Jordan, Vice President, Corporate Strategy & Development, JHC Technology
So You Want to be Well-Architected - AWS Summit Sydney 2018Amazon Web Services
So You Want to be Well-Architected?
The AWS Well-Architected Framework enables customers to understand best practices around security, reliability, performance, and cost optimisation when building systems on AWS. This approach helps customers make informed decisions and weigh the pros and cons of application design patterns for the cloud. In this session, you'll learn about the Well-Architected Framework, and the steps you can take to help ensure your solution is Well Architected.
Ben Hunter, Solutions Architect, Amazon Web Services
Modernising the Enterprise: An Evening with the AWS Enterprise User GroupHarley Young
The French aristocrat, writer, and aviator, Antoine De Saint-Exupery most famously wrote The Little Prince. He's also credited with the following quote, "If you want to build a ship, don’t drum up the men and women to gather wood, divide the work, and give orders. Instead, teach them to yearn for the vast and endless sea." Cloud modernisation is a little bit like building that ship. You can't merely command an organisation to pick up its applications and move to the cloud. Instead, you must teach them to yearn for the vast and endless potential the cloud provides to build whatever they can imagine for their business.
In the presentation, I explain a 5-step approach that has been used to transform and modernise some of the world's most successful businesses in nearly all imaginable industry verticals as they contemplated a move to the AWS cloud:
1. Know your business
2. Understand your environment
3. Prepare the organisation
4. Move the first workloads to the cloud
5. Get help when you need it
Automated Monitoring of Best Practices and Operational Health of Your AWS Res...Amazon Web Services
Automated Monitoring of Best Practices and Operational Health of Your AWS Resources
It can be challenging to optimise AWS resources across cost, performance, security, and fault-tolerance, much less do it automatically. Attendees will learn how to implement automation of AWS best practice recommendations from AWS Trusted Advisor, and remediation from the AWS Health API on AWS resources.
Stephen Salim, Technical Account Manager, Amazon Web Services and Tipu Qureshi, Principal Cloud Support Engineer, Amazon Web Services
Leading Your Team Through a Cloud Transformation - Virtual Transformation Day...Amazon Web Services
Speaker: Thomas Blood
Moving to the cloud can help transform technical and non-technical aspects of your organization, enabling agility, scale, security, and cost savings. However, transformational change requires strong leadership at all levels of the organization. In this session, we will review strategies and best practices to help you lead the organization through a successful cloud journey.
AWS Transformation Day is designed for enterprise organizations looking to make the move to the cloud in order to become more responsive, agile and innovative, while still staying secure and compliant. Join us for this virtual event and we'll share our experiences of helping enterprise customers accelerate the pace of migration and adoption of strategic services.
We recommend this event for IT and business leaders who are looking to create sustainable benefits and a competitive advantage by using the AWS Cloud.
Organizing for faster innovation - People, process, culture, and technologyTom Laszewski
Organizing for faster innovation through people, process, culture, and technology transformation. Best practices, lesson learned, and a prescriptive approach to evolving and disrupting a company's people, process, culture, and technology during a digital and cloud transformation.
Analysis insight about a Flyball dog competition team's performanceroli9797
Insight of my analysis about a Flyball dog competition team's last year performance. Find more: https://github.com/rolandnagy-ds/flyball_race_analysis/tree/main
Learn SQL from basic queries to Advance queriesmanishkhaire30
Dive into the world of data analysis with our comprehensive guide on mastering SQL! This presentation offers a practical approach to learning SQL, focusing on real-world applications and hands-on practice. Whether you're a beginner or looking to sharpen your skills, this guide provides the tools you need to extract, analyze, and interpret data effectively.
Key Highlights:
Foundations of SQL: Understand the basics of SQL, including data retrieval, filtering, and aggregation.
Advanced Queries: Learn to craft complex queries to uncover deep insights from your data.
Data Trends and Patterns: Discover how to identify and interpret trends and patterns in your datasets.
Practical Examples: Follow step-by-step examples to apply SQL techniques in real-world scenarios.
Actionable Insights: Gain the skills to derive actionable insights that drive informed decision-making.
Join us on this journey to enhance your data analysis capabilities and unlock the full potential of SQL. Perfect for data enthusiasts, analysts, and anyone eager to harness the power of data!
#DataAnalysis #SQL #LearningSQL #DataInsights #DataScience #Analytics
State of Artificial intelligence Report 2023kuntobimo2016
Artificial intelligence (AI) is a multidisciplinary field of science and engineering whose goal is to create intelligent machines.
We believe that AI will be a force multiplier on technological progress in our increasingly digital, data-driven world. This is because everything around us today, ranging from culture to consumer products, is a product of intelligence.
The State of AI Report is now in its sixth year. Consider this report as a compilation of the most interesting things we’ve seen with a goal of triggering an informed conversation about the state of AI and its implication for the future.
We consider the following key dimensions in our report:
Research: Technology breakthroughs and their capabilities.
Industry: Areas of commercial application for AI and its business impact.
Politics: Regulation of AI, its economic implications and the evolving geopolitics of AI.
Safety: Identifying and mitigating catastrophic risks that highly-capable future AI systems could pose to us.
Predictions: What we believe will happen in the next 12 months and a 2022 performance review to keep us honest.
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...sameer shah
"Join us for STATATHON, a dynamic 2-day event dedicated to exploring statistical knowledge and its real-world applications. From theory to practice, participants engage in intensive learning sessions, workshops, and challenges, fostering a deeper understanding of statistical methodologies and their significance in various fields."
Enhanced Enterprise Intelligence with your personal AI Data Copilot.pdfGetInData
Recently we have observed the rise of open-source Large Language Models (LLMs) that are community-driven or developed by the AI market leaders, such as Meta (Llama3), Databricks (DBRX) and Snowflake (Arctic). On the other hand, there is a growth in interest in specialized, carefully fine-tuned yet relatively small models that can efficiently assist programmers in day-to-day tasks. Finally, Retrieval-Augmented Generation (RAG) architectures have gained a lot of traction as the preferred approach for LLMs context and prompt augmentation for building conversational SQL data copilots, code copilots and chatbots.
In this presentation, we will show how we built upon these three concepts a robust Data Copilot that can help to democratize access to company data assets and boost performance of everyone working with data platforms.
Why do we need yet another (open-source ) Copilot?
How can we build one?
Architecture and evaluation
The Building Blocks of QuestDB, a Time Series Databasejavier ramirez
Talk Delivered at Valencia Codes Meetup 2024-06.
Traditionally, databases have treated timestamps just as another data type. However, when performing real-time analytics, timestamps should be first class citizens and we need rich time semantics to get the most out of our data. We also need to deal with ever growing datasets while keeping performant, which is as fun as it sounds.
It is no wonder time-series databases are now more popular than ever before. Join me in this session to learn about the internal architecture and building blocks of QuestDB, an open source time-series database designed for speed. We will also review a history of some of the changes we have gone over the past two years to deal with late and unordered data, non-blocking writes, read-replicas, or faster batch ingestion.
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data LakeWalaa Eldin Moustafa
Dynamic policy enforcement is becoming an increasingly important topic in today’s world where data privacy and compliance is a top priority for companies, individuals, and regulators alike. In these slides, we discuss how LinkedIn implements a powerful dynamic policy enforcement engine, called ViewShift, and integrates it within its data lake. We show the query engine architecture and how catalog implementations can automatically route table resolutions to compliance-enforcing SQL views. Such views have a set of very interesting properties: (1) They are auto-generated from declarative data annotations. (2) They respect user-level consent and preferences (3) They are context-aware, encoding a different set of transformations for different use cases (4) They are portable; while the SQL logic is only implemented in one SQL dialect, it is accessible in all engines.
#SQL #Views #Privacy #Compliance #DataLake
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Data and AI
Round table discussion of vector databases, unstructured data, ai, big data, real-time, robots and Milvus.
A lively discussion with NJ Gen AI Meetup Lead, Prasad and Procure.FYI's Co-Found
Unleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdfEnterprise Wired
In this guide, we'll explore the key considerations and features to look for when choosing a Trusted analytics platform that meets your organization's needs and delivers actionable intelligence you can trust.