Building highly-available and highly-scalable applications are one of the main reasons for using NoSQL database systems and processing frameworks over traditional relational database systems. Relational database systems have taken notice and are increasingly moving forward to provide solutions for these class of applications.
In this presentation we will showcase how the Windows Gaming Experience is using SQL Server Azure to build a highly-available and highly-scalable application that is used to create new experiences for millions of casual gamers in the next version of the Bing search engine and integrate Microsoft games with social-networking sites. They employ several of the NoSQL architectural patterns such as sharding. We will be presenting the architecture, lessons learned and also provide an insight into how the SQL Server Azure service is evolving to support NoSQL application development patterns such as sharding and open schema support to make SQL Server Azure a Not Only SQL database engine.
Scaling with SQL Server and SQL Azure FederationsMichael Rys
Slides for my presentation at the Seattle Hadoop/NoSQL Meetup (http://www.meetup.com/Seattle-Hadoop-HBase-NoSQL-Meetup/events/40509972/).
These slides are based on this earlier presentation: http://www.slideshare.net/MichaelRys/scaling-with-sql-server-and-sql-azure-federations.
Firebird 2.1 What's New by Vladislav Khorsun (English)Alexey Kovyazin
Detailed presentation devoted to new features of Firebird 2.1 by Vladislav Khorsun, core Firebird Developer. Main features are covered, including tips and tricks and often usage scenarios.
Performance and scalability of Informix ultimate warehouse edtion on Intel Xe...Keshav Murthy
Talk at Information on Demand Conference 2011. As part of the Informix Ultimate Warehouse Edition, Informix
Warehouse Accelerator (IWA) transparently provides up to several
orders of a magnitude speed up in query performance for
Informix Dynamic Server (IDS), as well as enormous administrative
cost savings. Combined with the Intel Xeon E7 processor series,
Informix and the Accelerator brings the performance and
scalability of IDS solutions to new levels. This presentation will
give best practices and benefits of IWA and the Intel Xeon E7
processors, and highlight the implications and performance
benefits of running IDS and IWA on these processors, compared
to previous releases of IDS and prior Intel server platforms.
Understanding the lock manager internals via the fb_lock_print utility
This session will provide a short introduction to the Firebird lock manager and its usage patterns. It will describe how the lock manager can affect the performance of highly loaded systems and outlines the possible bottlenecks and other problems like unexpected lock-ups/freezes that may require special analysis. The structure of the lock table will also be explained.
It will also include a detailed description of the fb_lock_print utility and its usage that will enable the research of issues that are related to the lock manager. A few practical examples illustrating how to analyze the utility output will be provided. This session is mainly of interest to Classic Server users and DBAs.
NoSQL Databases for Implementing Data Services – Should I Care?Guido Schmutz
Traditionally the data services in a service-oriented solution have been/are implemented using relational data technologies. For lot of scenarios, this might be the best choice. On the other hand there are other use cases, where an alternative storage mechanism , such as a NoSQL database, might help to solve the problem more easily or in a more scalable way, i.e. using a different storage model.
Scaling with SQL Server and SQL Azure FederationsMichael Rys
Slides for my presentation at the Seattle Hadoop/NoSQL Meetup (http://www.meetup.com/Seattle-Hadoop-HBase-NoSQL-Meetup/events/40509972/).
These slides are based on this earlier presentation: http://www.slideshare.net/MichaelRys/scaling-with-sql-server-and-sql-azure-federations.
Firebird 2.1 What's New by Vladislav Khorsun (English)Alexey Kovyazin
Detailed presentation devoted to new features of Firebird 2.1 by Vladislav Khorsun, core Firebird Developer. Main features are covered, including tips and tricks and often usage scenarios.
Performance and scalability of Informix ultimate warehouse edtion on Intel Xe...Keshav Murthy
Talk at Information on Demand Conference 2011. As part of the Informix Ultimate Warehouse Edition, Informix
Warehouse Accelerator (IWA) transparently provides up to several
orders of a magnitude speed up in query performance for
Informix Dynamic Server (IDS), as well as enormous administrative
cost savings. Combined with the Intel Xeon E7 processor series,
Informix and the Accelerator brings the performance and
scalability of IDS solutions to new levels. This presentation will
give best practices and benefits of IWA and the Intel Xeon E7
processors, and highlight the implications and performance
benefits of running IDS and IWA on these processors, compared
to previous releases of IDS and prior Intel server platforms.
Understanding the lock manager internals via the fb_lock_print utility
This session will provide a short introduction to the Firebird lock manager and its usage patterns. It will describe how the lock manager can affect the performance of highly loaded systems and outlines the possible bottlenecks and other problems like unexpected lock-ups/freezes that may require special analysis. The structure of the lock table will also be explained.
It will also include a detailed description of the fb_lock_print utility and its usage that will enable the research of issues that are related to the lock manager. A few practical examples illustrating how to analyze the utility output will be provided. This session is mainly of interest to Classic Server users and DBAs.
NoSQL Databases for Implementing Data Services – Should I Care?Guido Schmutz
Traditionally the data services in a service-oriented solution have been/are implemented using relational data technologies. For lot of scenarios, this might be the best choice. On the other hand there are other use cases, where an alternative storage mechanism , such as a NoSQL database, might help to solve the problem more easily or in a more scalable way, i.e. using a different storage model.
Data-Ed Slides: Data-Centric Strategy & Roadmap - Supercharging Your BusinessDATAVERSITY
In many organizations and functional areas, data has pulled even with money in terms of what makes the proverbial world go ‘round. As businesses struggle to cope with the 21st century’s newfound data flood, it is more important than ever before to prioritize data as an asset that directly supports business imperatives. However, while organizations across most industries make some attempt to address data opportunities (e.g. Big Data) and data challenges (e.g. data quality), the results of these efforts frequently fall far below expectations. At the root of many of these failures is poor organizational data management—which fortunately is a remediable problem.
This webinar will cover three lessons, each illustrated with examples, that will help you establish realistic goals and benchmarks for data management processes and communicate their value to both internal and external decision makers:
- How organizational thinking must change to include value-added data management practices
- The importance of walking before you run with data-focused initiatives
- Prioritizing specification and data governance over “silver bullet” analytical tools
Data-Ed Slides: Exorcising the Seven Deadly Data SinsDATAVERSITY
The difficulty of implementing a new data strategy often goes underappreciated, particularly the multi-faceted procedural challenges that need to be met while doing so. Deficiencies in organizational readiness and core competence represent clearly visible problems faced by data managers, but beyond that there are several cultural and structural barriers common to virtually all organizations that must be eliminated in order to facilitate effective management of data. This webinar will discuss these barriers--as well as the titular "Seven Deadly Data Sins"--and in the process will also:
- Elaborate upon the three critical factors that lead to strategy failure
- Demonstrate a two-stage data strategy implementation process
- Explore the sources and rationales behind the “Seven Deadly Data Sins”, and recommend solutions and alternative approaches
DI&A Slides: Data Insights and Analytics FrameworksDATAVERSITY
This webinar will provide an overview of the standard architecture components needed to perform analytics and derive data insights from within each of the three common database environments. This will include the sandbox environment for initial data assessment and data science modeling, the big data environment for batch analytics that includes critical governance components and the real-time analytics environment for real-time retrieval of data, and lastly, the integration of real-time data sources.
We will also discuss:
- Components for the data scientist sandbox / lab
- Batch analytics with security and metadata
- Data pipelines
- Real-time access and streaming sources
RWDG Slides: Three Approaches to Data StewardshipDATAVERSITY
There are different ways to connect people with data stewardship responsibilities. You can assign people to be data stewards, identify people as data stewards or recognize people as data stewards. These approaches vary in several ways.
Join Bob Seiner for this month’s installment of the RWDG webinar series where he will compare and contrast three distinct approaches to data stewardship. The approach you select and follow will heavily influence how data governance results will be achieved.
In this webinar Bob will discuss:
- Three approaches to data stewardship
- The influence of each approach on program results
- Factors to assist in the selection of the approach to follow
- Obstacles to being successful with each approach
- Benefits of following each approach
Smart Data Slides: Modern AI and Cognitive Computing - Boundaries and Opportu...DATAVERSITY
We will kickoff the 2017 series with an overview of the current state of commercial artificial intelligence (AI) and cognitive computing. The research and commercial communities are far from consensus on a few important definitions, so we will start with two that are critical to our understanding and analysis.
#ModernAI applies research from computer science, psychology, mathematics, linguistics and neuroscience to develop problem-solving applications that supplant or augment human intellectual performance. Unlike more traditional AI R&D, #ModernAI typically leverages machine learning and big data.
Cognitive computing is a problem-solving approach based on #ModernAI that focuses on processes for understanding, reasoning, learning and planning.
In this webinar, we will present a framework for analyzing modern AI/cognitive computing tools and technologies, with an emphasis on the risks and reward of adopting them at varying stages of maturity.
LDM Slides: How Data Modeling Fits into an Overall Enterprise ArchitectureDATAVERSITY
Enterprise Architecture (EA) provides a visual blueprint of the organization, and shows key interrelationships between data, process, applications, and more. By abstracting these assets in a graphical view, it’s possible to see key interrelationships, particularly as it relates to data and its business impact across the organization.
Join this webinar for a discussion on how a data model can be combined with an overall enterprise architecture for enhanced business value and success.
DI&A Slides: Data Lake vs. Data WarehouseDATAVERSITY
Modern data analysis is moving beyond the Data Warehouse to the Data Lake where analysts are able to take advantage of emerging technologies to manage complex analytics on large data volumes and diverse data types. Yet, for some business problems, a Data Warehouse may still be the right solution.
If you’re on the fence, join this webinar as we compare and contrast Data Lakes and Data Warehouses, identifying situations where one approach may be better than the other and highlighting how the two can work together.
Get tips, takeaways and best practices about:
- The benefits and problems of a Data Warehouse
- How a Data Lake can solve the problems of a Data Warehouse
- Data Lake Architecture
- How Data Warehouses and Data Lakes can work together
RWDG Slides: Using Agile to Justify Data GovernanceDATAVERSITY
The Agile development methodology is here to stay. Data Governance is not going away any time soon. These two discipline share some common ground but often compete when it comes to the “right” thing to do when it comes to managing the data. The disciplines need to learn to play well together. The old mantra of “do unto others” applies here in a big way.
In this month’s Real-World Data Governance webinar, Bob Seiner will share tips and techniques to take advantage of the Agile methodology to justify the need for, and practice of, Data Governance. The two disciplines are the core of delivering on-time quality data through timely applications. You will walk away from this session inspired to try ideas on your own organization.
This webinar will cover:
• The governance aspects of Agile
• Why Data Governance Practitioners Should Embrace Agile
• Agile considerations for Data Governance
• The audience of both Agile and Data Governance
• How to Use Agile to Justify Data Governance
This presentation was delivered by Siddick Elaheebocus during Microsoft TechDays 2010 in Mauritius explaining the bolts and nuts behind Public Key Infrastructure and how the same are being used within organizations and on a national level to address IT security concerns.
Presentation to a combined meetup of Bay Area Lisp and Bay Area Clojure groups. Presented three Clojure projects at BackType:
Cascalog - Batch processing in Clojure
ElephantDB - Database written in Clojure
Storm - Distributed, fault-tolerant, reliable stream processing and RPC
Apresentação do Vitor Tomaz sobre a Arquitectura dos Serviços da plataforma Windows Azure na 4a Reunião Presencial da Comunidade NetPonto em Coimbra (http://netponto.org).
[NetPonto] Arquitectura dos Serviços da plataforma Windows AzureVitor Tomaz
O Windows Azure é uma plataforma que fornece serviços de alta disponibilidade e escalabilidade. Nesta sessão iremos abordar a arquitectura dos serviços base desta plataforma (Compute, Storage e SQLAzure) de modo a entendermos de que forma é que a escalabilidade e alta disponibilidade são conseguidas. Iremos ver as diferenças para as plataformas "tradicionais" e algumas consequências no desenvolvimento de soluções para este ambiente.
Data-Ed Slides: Data-Centric Strategy & Roadmap - Supercharging Your BusinessDATAVERSITY
In many organizations and functional areas, data has pulled even with money in terms of what makes the proverbial world go ‘round. As businesses struggle to cope with the 21st century’s newfound data flood, it is more important than ever before to prioritize data as an asset that directly supports business imperatives. However, while organizations across most industries make some attempt to address data opportunities (e.g. Big Data) and data challenges (e.g. data quality), the results of these efforts frequently fall far below expectations. At the root of many of these failures is poor organizational data management—which fortunately is a remediable problem.
This webinar will cover three lessons, each illustrated with examples, that will help you establish realistic goals and benchmarks for data management processes and communicate their value to both internal and external decision makers:
- How organizational thinking must change to include value-added data management practices
- The importance of walking before you run with data-focused initiatives
- Prioritizing specification and data governance over “silver bullet” analytical tools
Data-Ed Slides: Exorcising the Seven Deadly Data SinsDATAVERSITY
The difficulty of implementing a new data strategy often goes underappreciated, particularly the multi-faceted procedural challenges that need to be met while doing so. Deficiencies in organizational readiness and core competence represent clearly visible problems faced by data managers, but beyond that there are several cultural and structural barriers common to virtually all organizations that must be eliminated in order to facilitate effective management of data. This webinar will discuss these barriers--as well as the titular "Seven Deadly Data Sins"--and in the process will also:
- Elaborate upon the three critical factors that lead to strategy failure
- Demonstrate a two-stage data strategy implementation process
- Explore the sources and rationales behind the “Seven Deadly Data Sins”, and recommend solutions and alternative approaches
DI&A Slides: Data Insights and Analytics FrameworksDATAVERSITY
This webinar will provide an overview of the standard architecture components needed to perform analytics and derive data insights from within each of the three common database environments. This will include the sandbox environment for initial data assessment and data science modeling, the big data environment for batch analytics that includes critical governance components and the real-time analytics environment for real-time retrieval of data, and lastly, the integration of real-time data sources.
We will also discuss:
- Components for the data scientist sandbox / lab
- Batch analytics with security and metadata
- Data pipelines
- Real-time access and streaming sources
RWDG Slides: Three Approaches to Data StewardshipDATAVERSITY
There are different ways to connect people with data stewardship responsibilities. You can assign people to be data stewards, identify people as data stewards or recognize people as data stewards. These approaches vary in several ways.
Join Bob Seiner for this month’s installment of the RWDG webinar series where he will compare and contrast three distinct approaches to data stewardship. The approach you select and follow will heavily influence how data governance results will be achieved.
In this webinar Bob will discuss:
- Three approaches to data stewardship
- The influence of each approach on program results
- Factors to assist in the selection of the approach to follow
- Obstacles to being successful with each approach
- Benefits of following each approach
Smart Data Slides: Modern AI and Cognitive Computing - Boundaries and Opportu...DATAVERSITY
We will kickoff the 2017 series with an overview of the current state of commercial artificial intelligence (AI) and cognitive computing. The research and commercial communities are far from consensus on a few important definitions, so we will start with two that are critical to our understanding and analysis.
#ModernAI applies research from computer science, psychology, mathematics, linguistics and neuroscience to develop problem-solving applications that supplant or augment human intellectual performance. Unlike more traditional AI R&D, #ModernAI typically leverages machine learning and big data.
Cognitive computing is a problem-solving approach based on #ModernAI that focuses on processes for understanding, reasoning, learning and planning.
In this webinar, we will present a framework for analyzing modern AI/cognitive computing tools and technologies, with an emphasis on the risks and reward of adopting them at varying stages of maturity.
LDM Slides: How Data Modeling Fits into an Overall Enterprise ArchitectureDATAVERSITY
Enterprise Architecture (EA) provides a visual blueprint of the organization, and shows key interrelationships between data, process, applications, and more. By abstracting these assets in a graphical view, it’s possible to see key interrelationships, particularly as it relates to data and its business impact across the organization.
Join this webinar for a discussion on how a data model can be combined with an overall enterprise architecture for enhanced business value and success.
DI&A Slides: Data Lake vs. Data WarehouseDATAVERSITY
Modern data analysis is moving beyond the Data Warehouse to the Data Lake where analysts are able to take advantage of emerging technologies to manage complex analytics on large data volumes and diverse data types. Yet, for some business problems, a Data Warehouse may still be the right solution.
If you’re on the fence, join this webinar as we compare and contrast Data Lakes and Data Warehouses, identifying situations where one approach may be better than the other and highlighting how the two can work together.
Get tips, takeaways and best practices about:
- The benefits and problems of a Data Warehouse
- How a Data Lake can solve the problems of a Data Warehouse
- Data Lake Architecture
- How Data Warehouses and Data Lakes can work together
RWDG Slides: Using Agile to Justify Data GovernanceDATAVERSITY
The Agile development methodology is here to stay. Data Governance is not going away any time soon. These two discipline share some common ground but often compete when it comes to the “right” thing to do when it comes to managing the data. The disciplines need to learn to play well together. The old mantra of “do unto others” applies here in a big way.
In this month’s Real-World Data Governance webinar, Bob Seiner will share tips and techniques to take advantage of the Agile methodology to justify the need for, and practice of, Data Governance. The two disciplines are the core of delivering on-time quality data through timely applications. You will walk away from this session inspired to try ideas on your own organization.
This webinar will cover:
• The governance aspects of Agile
• Why Data Governance Practitioners Should Embrace Agile
• Agile considerations for Data Governance
• The audience of both Agile and Data Governance
• How to Use Agile to Justify Data Governance
This presentation was delivered by Siddick Elaheebocus during Microsoft TechDays 2010 in Mauritius explaining the bolts and nuts behind Public Key Infrastructure and how the same are being used within organizations and on a national level to address IT security concerns.
Presentation to a combined meetup of Bay Area Lisp and Bay Area Clojure groups. Presented three Clojure projects at BackType:
Cascalog - Batch processing in Clojure
ElephantDB - Database written in Clojure
Storm - Distributed, fault-tolerant, reliable stream processing and RPC
Apresentação do Vitor Tomaz sobre a Arquitectura dos Serviços da plataforma Windows Azure na 4a Reunião Presencial da Comunidade NetPonto em Coimbra (http://netponto.org).
[NetPonto] Arquitectura dos Serviços da plataforma Windows AzureVitor Tomaz
O Windows Azure é uma plataforma que fornece serviços de alta disponibilidade e escalabilidade. Nesta sessão iremos abordar a arquitectura dos serviços base desta plataforma (Compute, Storage e SQLAzure) de modo a entendermos de que forma é que a escalabilidade e alta disponibilidade são conseguidas. Iremos ver as diferenças para as plataformas "tradicionais" e algumas consequências no desenvolvimento de soluções para este ambiente.
GMG203 Meteor Entertainment’s Lessons Learned and Best Practices for Game Dev...Amazon Web Services
Game developers need to spend their time building new games and features, not managing infrastructure. Meteor Entertainment has learned how-to minimize the time they spend managing infrastructure by automating deployments, monitoring systems through log analysis, and by making their data tier easy to scale. Attend this session to hear all about Meteor’s best-practices.
End-to-End Integrated Management with System Center 2012wwwally
Want to see hands-on how all the Microsoft System Center 2012 products work together to manage the common Windows platform? In this session full of demonstrations, Walter Eikenboom, shows you System Center 2012 for the Optimized Datacenter. See Service Manager 2012, Virtual Machine Manager 2012, Operations Manager 2012, Data Protection Manager 2012 and Orchestrator 2012!
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...DATAVERSITY
Organizations today need a broad set of enterprise data cloud services with key data functionality to modernize applications and utilize machine learning. They need a comprehensive platform designed to address multi-faceted needs by offering multi-function data management and analytics to solve the enterprise’s most pressing data and analytic challenges in a streamlined fashion.
In this research-based session, I’ll discuss what the components are in multiple modern enterprise analytics stacks (i.e., dedicated compute, storage, data integration, streaming, etc.) and focus on total cost of ownership.
A complete machine learning infrastructure cost for the first modern use case at a midsize to large enterprise will be anywhere from $3 million to $22 million. Get this data point as you take the next steps on your journey into the highest spend and return item for most companies in the next several years.
Data at the Speed of Business with Data Mastering and GovernanceDATAVERSITY
Do you ever wonder how data-driven organizations fuel analytics, improve customer experience, and accelerate business productivity? They are successful by governing and mastering data effectively so they can get trusted data to those who need it faster. Efficient data discovery, mastering and democratization is critical for swiftly linking accurate data with business consumers. When business teams can quickly and easily locate, interpret, trust, and apply data assets to support sound business judgment, it takes less time to see value.
Join data mastering and data governance experts from Informatica—plus a real-world organization empowering trusted data for analytics—for a lively panel discussion. You’ll hear more about how a single cloud-native approach can help global businesses in any economy create more value—faster, more reliably, and with more confidence—by making data management and governance easier to implement.
What is data literacy? Which organizations, and which workers in those organizations, need to be data-literate? There are seemingly hundreds of definitions of data literacy, along with almost as many opinions about how to achieve it.
In a broader perspective, companies must consider whether data literacy is an isolated goal or one component of a broader learning strategy to address skill deficits. How does data literacy compare to other types of skills or “literacy” such as business acumen?
This session will position data literacy in the context of other worker skills as a framework for understanding how and where it fits and how to advocate for its importance.
Building a Data Strategy – Practical Steps for Aligning with Business GoalsDATAVERSITY
Developing a Data Strategy for your organization can seem like a daunting task – but it’s worth the effort. Getting your Data Strategy right can provide significant value, as data drives many of the key initiatives in today’s marketplace – from digital transformation, to marketing, to customer centricity, to population health, and more. This webinar will help demystify Data Strategy and its relationship to Data Architecture and will provide concrete, practical ways to get started.
Uncover how your business can save money and find new revenue streams.
Driving profitability is a top priority for companies globally, especially in uncertain economic times. It's imperative that companies reimagine growth strategies and improve process efficiencies to help cut costs and drive revenue – but how?
By leveraging data-driven strategies layered with artificial intelligence, companies can achieve untapped potential and help their businesses save money and drive profitability.
In this webinar, you'll learn:
- How your company can leverage data and AI to reduce spending and costs
- Ways you can monetize data and AI and uncover new growth strategies
- How different companies have implemented these strategies to achieve cost optimization benefits
Data Catalogs Are the Answer – What is the Question?DATAVERSITY
Organizations with governed metadata made available through their data catalog can answer questions their people have about the organization’s data. These organizations get more value from their data, protect their data better, gain improved ROI from data-centric projects and programs, and have more confidence in their most strategic data.
Join Bob Seiner for this lively webinar where he will talk about the value of a data catalog and how to build the use of the catalog into your stewards’ daily routines. Bob will share how the tool must be positioned for success and viewed as a must-have resource that is a steppingstone and catalyst to governed data across the organization.
Data Catalogs Are the Answer – What Is the Question?DATAVERSITY
Organizations with governed metadata made available through their data catalog can answer questions their people have about the organization’s data. These organizations get more value from their data, protect their data better, gain improved ROI from data-centric projects and programs, and have more confidence in their most strategic data.
Join Bob Seiner for this lively webinar where he will talk about the value of a data catalog and how to build the use of the catalog into your stewards’ daily routines. Bob will share how the tool must be positioned for success and viewed as a must-have resource that is a steppingstone and catalyst to governed data across the organization.
In this webinar, Bob will focus on:
-Selecting the appropriate metadata to govern
-The business and technical value of a data catalog
-Building the catalog into people’s routines
-Positioning the data catalog for success
-Questions the data catalog can answer
Because every organization produces and propagates data as part of their day-to-day operations, data trends are becoming more and more important in the mainstream business world’s consciousness. For many organizations in various industries, though, comprehension of this development begins and ends with buzzwords: “Big Data,” “NoSQL,” “Data Scientist,” and so on. Few realize that all solutions to their business problems, regardless of platform or relevant technology, rely to a critical extent on the data model supporting them. As such, data modeling is not an optional task for an organization’s data effort, but rather a vital activity that facilitates the solutions driving your business. Since quality engineering/architecture work products do not happen accidentally, the more your organization depends on automation, the more important the data models driving the engineering and architecture activities of your organization. This webinar illustrates data modeling as a key activity upon which so much technology and business investment depends.
Specific learning objectives include:
- Understanding what types of challenges require data modeling to be part of the solution
- How automation requires standardization on derivable via data modeling techniques
- Why only a working partnership between data and the business can produce useful outcomes
Analytics play a critical role in supporting strategic business initiatives. Despite the obvious value to analytic professionals of providing the analytics for these initiatives, many executives question the economic return of analytics as well as data lakes, machine learning, master data management, and the like.
Technology professionals need to calculate and present business value in terms business executives can understand. Unfortunately, most IT professionals lack the knowledge required to develop comprehensive cost-benefit analyses and return on investment (ROI) measurements.
This session provides a framework to help technology professionals research, measure, and present the economic value of a proposed or existing analytics initiative, no matter the form that the business benefit arises. The session will provide practical advice about how to calculate ROI and the formulas, and how to collect the necessary information.
How a Semantic Layer Makes Data Mesh Work at ScaleDATAVERSITY
Data Mesh is a trending approach to building a decentralized data architecture by leveraging a domain-oriented, self-service design. However, the pure definition of Data Mesh lacks a center of excellence or central data team and doesn’t address the need for a common approach for sharing data products across teams. The semantic layer is emerging as a key component to supporting a Hub and Spoke style of organizing data teams by introducing data model sharing, collaboration, and distributed ownership controls.
This session will explain how data teams can define common models and definitions with a semantic layer to decentralize analytics product creation using a Hub and Spoke architecture.
Attend this session to learn about:
- The role of a Data Mesh in the modern cloud architecture.
- How a semantic layer can serve as the binding agent to support decentralization.
- How to drive self service with consistency and control.
Enterprise data literacy. A worthy objective? Certainly! A realistic goal? That remains to be seen. As companies consider investing in data literacy education, questions arise about its value and purpose. While the destination – having a data-fluent workforce – is attractive, we wonder how (and if) we can get there.
Kicking off this webinar series, we begin with a panel discussion to explore the landscape of literacy, including expert positions and results from focus groups:
- why it matters,
- what it means,
- what gets in the way,
- who needs it (and how much they need),
- what companies believe it will accomplish.
In this engaging discussion about literacy, we will set the stage for future webinars to answer specific questions and feature successful literacy efforts.
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...DATAVERSITY
Change is hard, especially in response to negative stimuli or what is perceived as negative stimuli. So organizations need to reframe how they think about data privacy, security and governance, treating them as value centers to 1) ensure enterprise data can flow where it needs to, 2) prevent – not just react – to internal and external threats, and 3) comply with data privacy and security regulations.
Working together, these roles can accelerate faster access to approved, relevant and higher quality data – and that means more successful use cases, faster speed to insights, and better business outcomes. However, both new information and tools are required to make the shift from defense to offense, reducing data drama while increasing its value.
Join us for this panel discussion with experts in these fields as they discuss:
- Recent research about where data privacy, security and governance stand
- The most valuable enterprise data use cases
- The common obstacles to data value creation
- New approaches to data privacy, security and governance
- Their advice on how to shift from a reactive to resilient mindset/culture/organization
You’ll be educated, entertained and inspired by this panel and their expertise in using the data trifecta to innovate more often, operate more efficiently, and differentiate more strategically.
Emerging Trends in Data Architecture – What’s the Next Big Thing?DATAVERSITY
With technological innovation and change occurring at an ever-increasing rate, it’s hard to keep track of what’s hype and what can provide practical value for your organization. Join this webinar to see the results of a recent DATAVERSITY survey on emerging trends in Data Architecture, along with practical commentary and advice from industry expert Donna Burbank.
Data Governance Trends - A Look Backwards and ForwardsDATAVERSITY
As DATAVERSITY’s RWDG series hurdles into our 12th year, this webinar takes a quick look behind us, evaluates the present, and predicts the future of Data Governance. Based on webinar numbers, hot Data Governance topics have evolved over the years from policies and best practices, roles and tools, data catalogs and frameworks, to supporting data mesh and fabric, artificial intelligence, virtualization, literacy, and metadata governance.
Join Bob Seiner as he reflects on the past and what has and has not worked, while sharing examples of enterprise successes and struggles. In this webinar, Bob will challenge the audience to stay a step ahead by learning from the past and blazing a new trail into the future of Data Governance.
In this webinar, Bob will focus on:
- Data Governance’s past, present, and future
- How trials and tribulations evolve to success
- Leveraging lessons learned to improve productivity
- The great Data Governance tool explosion
- The future of Data Governance
Data Governance Trends and Best Practices To Implement TodayDATAVERSITY
Would you share your bank account information on social media? How about shouting your social security number on the New York City subway? We didn’t think so either – that’s why data governance is consistently top of mind.
In this webinar, we’ll discuss the common Cloud data governance best practices – and how to apply them today. Join us to uncover Google Cloud’s investment in data governance and learn practical and doable methods around key management and confidential computing. Hear real customer experiences and leave with insights that you can share with your team. Let’s get solving.
Topics that you will hear addressed in this webinar:
- Understanding the basics of Cloud Incident Response (IR) and anticipated data governance trends
- Best practices for key management and apply data governance to your day-to-day
- The next wave of Confidential Computing and how to get started, including a demo
It is a fascinating, explosive time for enterprise analytics.
It is from the position of analytics leadership that the enterprise mission will be executed and company leadership will emerge. The data professional is absolutely sitting on the performance of the company in this information economy and has an obligation to demonstrate the possibilities and originate the architecture, data, and projects that will deliver analytics. After all, no matter what business you’re in, you’re in the business of analytics.
The coming years will be full of big changes in enterprise analytics and data architecture. William will kick off the fifth year of the Advanced Analytics series with a discussion of the trends winning organizations should build into their plans, expectations, vision, and awareness now.
Too often I hear the question “Can you help me with our data strategy?” Unfortunately, for most, this is the wrong request because it focuses on the least valuable component: the data strategy itself. A more useful request is: “Can you help me apply data strategically?” Yes, at early maturity phases the process of developing strategic thinking about data is more important than the actual product! Trying to write a good (must less perfect) data strategy on the first attempt is generally not productive –particularly given the widespread acceptance of Mike Tyson’s truism: “Everybody has a plan until they get punched in the face.” This program refocuses efforts on learning how to iteratively improve the way data is strategically applied. This will permit data-based strategy components to keep up with agile, evolving organizational strategies. It also contributes to three primary organizational data goals. Learn how to improve the following:
- Your organization’s data
- The way your people use data
- The way your people use data to achieve your organizational strategy
This will help in ways never imagined. Data are your sole non-depletable, non-degradable, durable strategic assets, and they are pervasively shared across every organizational area. Addressing existing challenges programmatically includes overcoming necessary but insufficient prerequisites and developing a disciplined, repeatable means of improving business objectives. This process (based on the theory of constraints) is where the strategic data work really occurs as organizations identify prioritized areas where better assets, literacy, and support (data strategy components) can help an organization better achieve specific strategic objectives. Then the process becomes lather, rinse, and repeat. Several complementary concepts are also covered, including:
- A cohesive argument for why data strategy is necessary for effective data governance
- An overview of prerequisites for effective strategic use of data strategy, as well as common pitfalls
- A repeatable process for identifying and removing data constraints
- The importance of balancing business operation and innovation
Who Should Own Data Governance – IT or Business?DATAVERSITY
The question is asked all the time: “What part of the organization should own your Data Governance program?” The typical answers are “the business” and “IT (information technology).” Another answer to that question is “Yes.” The program must be owned and reside somewhere in the organization. You may ask yourself if there is a correct answer to the question.
Join this new RWDG webinar with Bob Seiner where Bob will answer the question that is the title of this webinar. Determining ownership of Data Governance is a vital first step. Figuring out the appropriate part of the organization to manage the program is an important second step. This webinar will help you address these questions and more.
In this session Bob will share:
- What is meant by “the business” when it comes to owning Data Governance
- Why some people say that Data Governance in IT is destined to fail
- Examples of IT positioned Data Governance success
- Considerations for answering the question in your organization
- The final answer to the question of who should own Data Governance
It is clear that Data Management best practices exist and so does a useful process for improving existing Data Management practices. The question arises: Since we understand the goal, how does one design a process for Data Management goal achievement? This program describes what must be done at the programmatic level to achieve better data use and a way to implement this as part of your data program. The approach combines DMBoK content and CMMI/DMM processes – permitting organizations with the opportunity to benefit from the best of both. It also permits organizations to understand:
- Their current Data Management practices
- Strengths that should be leveraged
- Remediation opportunities
MLOps – Applying DevOps to Competitive AdvantageDATAVERSITY
MLOps is a practice for collaboration between Data Science and operations to manage the production machine learning (ML) lifecycles. As an amalgamation of “machine learning” and “operations,” MLOps applies DevOps principles to ML delivery, enabling the delivery of ML-based innovation at scale to result in:
Faster time to market of ML-based solutions
More rapid rate of experimentation, driving innovation
Assurance of quality, trustworthiness, and ethical AI
MLOps is essential for scaling ML. Without it, enterprises risk struggling with costly overhead and stalled progress. Several vendors have emerged with offerings to support MLOps: the major offerings are Microsoft Azure ML and Google Vertex AI. We looked at these offerings from the perspective of enterprise features and time-to-value.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfPeter Spielvogel
Building better applications for business users with SAP Fiori.
• What is SAP Fiori and why it matters to you
• How a better user experience drives measurable business benefits
• How to get started with SAP Fiori today
• How SAP Fiori elements accelerates application development
• How SAP Build Code includes SAP Fiori tools and other generative artificial intelligence capabilities
• How SAP Fiori paves the way for using AI in SAP apps
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
The Metaverse and AI: how can decision-makers harness the Metaverse for their...Jen Stirrup
The Metaverse is popularized in science fiction, and now it is becoming closer to being a part of our daily lives through the use of social media and shopping companies. How can businesses survive in a world where Artificial Intelligence is becoming the present as well as the future of technology, and how does the Metaverse fit into business strategy when futurist ideas are developing into reality at accelerated rates? How do we do this when our data isn't up to scratch? How can we move towards success with our data so we are set up for the Metaverse when it arrives?
How can you help your company evolve, adapt, and succeed using Artificial Intelligence and the Metaverse to stay ahead of the competition? What are the potential issues, complications, and benefits that these technologies could bring to us and our organizations? In this session, Jen Stirrup will explain how to start thinking about these technologies as an organisation.
Welcome to the first live UiPath Community Day Dubai! Join us for this unique occasion to meet our local and global UiPath Community and leaders. You will get a full view of the MEA region's automation landscape and the AI Powered automation technology capabilities of UiPath. Also, hosted by our local partners Marc Ellis, you will enjoy a half-day packed with industry insights and automation peers networking.
📕 Curious on our agenda? Wait no more!
10:00 Welcome note - UiPath Community in Dubai
Lovely Sinha, UiPath Community Chapter Leader, UiPath MVPx3, Hyper-automation Consultant, First Abu Dhabi Bank
10:20 A UiPath cross-region MEA overview
Ashraf El Zarka, VP and Managing Director MEA, UiPath
10:35: Customer Success Journey
Deepthi Deepak, Head of Intelligent Automation CoE, First Abu Dhabi Bank
11:15 The UiPath approach to GenAI with our three principles: improve accuracy, supercharge productivity, and automate more
Boris Krumrey, Global VP, Automation Innovation, UiPath
12:15 To discover how Marc Ellis leverages tech-driven solutions in recruitment and managed services.
Brendan Lingam, Director of Sales and Business Development, Marc Ellis
Removing Uninteresting Bytes in Software FuzzingAftab Hussain
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
4. Social
Social
Networks
Network
Management s
Ops Services
Data Backend
Data Backend
Services
Data iBackend
Services
S
Services
MSN
MSN Games
Games l
Web Portal
Front Door
GameBar Router
WLM Services
WLM Games
Host
Games Web P t l
W b Portal
Bing
Bing
g Auth
Games
G STS
STS
Games l
Web Portal
Azure Data Centers
8. Partitioned over 100 SQL Azure DBs
Find Friends’ Profiles
Social Get my Profile
Social
Services
User … DB Service Publish feed, read feed
Find Friends’ Profiles
Fi d F i d ’ P fil
Get Friends highscores
Gamer Last Played
Gamer
Services Favorites
STS Services Game Preferences
STS
Leaderb Social Leaderboards
… DB
oard
Partitioned over 298 SQL Azure DBs Game
Game Disable/Enable
Ingestion Games from
Front Door Write user specific game infos Ingestion
accessing services
g
Router
R t
Services
Game
Game binaries
User … DB Catalog
Game metadata
250 i
instances
Partitioned over 100 SQL Azure DBs 250 instances
9. • Fanout: Parallel calls to
multiple database
partitions
• Q
Quorum: Abl t
Able to
tolerate a percentage of
request failures during
Fanout
F t
• Retry: Retry on database
requests error
17. Federation
Azure DB with Federation Root
− Represents the data being sharded
Federation Root
Federation Directories, Federation Users,
− Database that logically houses federations,
contains federation meta data Federation Distributions, …
Distributions
Federation Key
− Value that determines the routing of a piece
of data (defines a Federation Distribution)
Federation Member (aka Shard)
Federation “Orders_Fed”
− A physical container f a set of federated
h i l t i for t ff d t d (Federation Key: CustomerID)
tables for a specific key range and reference
tables
Member: PK [min, 100)
Federated Table
− Table that contains only atomic units for the AU AU AU
member s
member’s key range PK=5 PK=25 PK=35
Reference Table
− Non-sharded table
Atomic Unit Member: PK [100, 488)
− All rows with the same federation
key value: always together! AU AU AU
Connectio
PK=105 PK=235 PK=365
Gateway
Member: PK [488, max)
on
y
AU AU AU
Sharded PK=555 PK=2545 PK=3565
Application 17
20. http://www.microsoft.com/casestudies/Case_Study Detail.aspx?CaseSt
p // / / y_ p
udyID=4000008310
http://cacm.acm.org/magazines/2011/6/108663-
scalable-sql
l bl l
http://download.microsoft.com/download/9/E/9/9E9F240D-0EB6-472E-
B4DE-
6D9FCBB505DD/Windows%20Azure%20No%20SQL%20White%20Paper.p
df
http://blogs.msdn.com/b/cbiyikoglu/archive/2011/03/03/nosql genes in
http://blogs msdn com/b/cbiyikoglu/archive/2011/03/03/nosql-genes-in-
sql-azure-federations.aspx
mrys@microsoft.com
y
http://sqlblog.com/blogs/michael_rys/default.aspx
21.
22. Connection:
Server=az1cl
l321.db.wind
dows.net;
Database=MyD
DB;
User=AppUser
r;
Passwd=****;
;
Gatew
way
CREATE FEDERATION
g
Existing Database
(customer_id bi i
CREATE FEDERATION sales
i bigint RANGE)
22
23. Federation with a Single Shard
Existing Database
g
CREATE FEDERATION sales
(customer_id bigint RANGE)
Database root contains:
sales
• Federation root = DB level object
containing federation scheme
way
• Federation users
Gatew
• Federation metadata incl. federation
Connection:
map
net;
er=az1cl321.db.windows.n
Range: Min...Max
base=MyDB;
=AppUser;
wd=****;
Serve
Datab
User=
Passw
Federation Member
23
24. Introducing Two Connection Modes
• Filtered Connection
– Guarantees that any queries or DML will produce the
same results independent of changes to the physical
layout of the federation members
–SScoped to an “Atomic Unit”
d “A i U i”
• Unfiltered Connection
– Scoped to a Federation Member
– Management Connection
24
27. More Detail
• Supported data types for federation key : bigint, int, GUID, and varbinary
Supported data types for federation key : bigint int GUID and varbinary
(900)
– Only range partitioning
• Federation key must be part of unique index
• Foreign key constraints only allowed between federated tables and from
federated table to reference table
• Not all Azure programmability features supported
– Sequence timestamp
Sequence, timestamp
• Additional surface area restrictions
– Indexed views, drop database (members)
• Schemas are allowed to diverge over time
g
– Furthermore, in v1, schema updates to existing members must be done in each
member (where the change is needed)
• USE FEDERATION “rewires a connection”
– Connection is reestablished
Connection is reestablished
– All existing settings and context of the connection is lost (sp_reset_connection)
– Must be in a batch by itself
27
28. Connect to Atomic Unit: Filtered
Existing Database
g
When using into a specific key
value, SELECT will only return
sales
records from federated tables that
match that value. It will still return
way
all records from non‐federated
Gatew
tables.
Connection:
USE FEDEDERATION sales (customer_id=3) Inserts and UPDATES operating
WITH FILTERING=ON, RESET;
outside of the value will fail.
net;
er=az1cl321.db.windows.n
Range: Min...Max
customer order product
3
base=MyDB;
3
=AppUser;
SELECT * from customer
wd=****;
SELECT * from product
SELECT * from order
Serve
Datab
User=
Passw
Federation Member
28
29. More on Connection Filtering
• Most operations behave differently in filtered vs
unfiltered connections
• C
Connection filtering is a property of the session
ti filt i i t f th i
– Filter injected dynamically at runtime
– Cannot inspect source code to determine how it behaves
Cannot inspect source code to determine how it behaves
• E.g., running stored proc written for filtered mode on unfiltered
connection could lead to unintended results
• There are several operations that will not work in
There are several operations that will not work in
filtered connection in v1
– DDL, DML on reference tables, …
• Fan‐out, bulk operations not efficient in filtered mode
– For now, filter=off is our best offer
29
30. Support Matrix
Connection Type Filtered Unfiltered Named
Operation (unfiltered)
Dynamic SELECT
DML (federated tables)
DML* (federated tables)
DML* (reference tables) X
DDL X
Views (not indexed)
UDF ‐ activate
Stored Proc ‐ activate
Trigger (all modes) ‐ activate
CREATE/UPDATE Stats
CREATE/UPDATE Stats X
Bulk Ops
openrowset bulk, bcp, bulk
insert X
* not including SELECT & modules
^ autostats will work on all connections
System stored procs, intrinsics will be unaffected (run unfiltered)
30
31. Splitting a Member
Existing Database
g
ALTER FEDERATION sales
l
sales SPLIT AT (customer_id=50)
way
Gatew
USE FEDERATION ROOT
Connection:
WITH RESET
Using to the
net;
federation ROOT
er=az1cl321.db.windows.n
will pop you out of
a member back Range: Min...Max
into the database
that hosts the customer order product
federation 3 3
base=MyDB;
=AppUser;
wd=****;
40 58
58 58
Serve
Datab
User=
Passw
Federation Member
31
32. Two New Members
Existing Database
g
ALTER FEDERATION sales
l
sales SPLIT AT (customer_id=50)
way
Gatew
USE FEDEDERATION ROOT
WITH RESET
Connection:
net;
er=az1cl321.db.windows.n
Range: Min...50 Range: 51...Max
customer order product customer order product
3
base=MyDB;
3
=AppUser;
wd=****;
58
40 58 58
Serve
Datab
User=
Passw
Federation Member Federation Member
32
33. Two New Members
Existing Database
g
sales
way
Gatew
USE FEDEDERATION sales (customer_id=40)
Connection:
WITH FILTERING=ON, RESET;
net;
er=az1cl321.db.windows.n
Range: Min...50 Range: 51...Max
customer order product customer order product
base=MyDB;
SELECT *
=AppUser;
wd=****;
from customer 58
40
40 58 58
SELECT * from order
Serve
Datab
User=
Passw
33