This document provides an overview and comparison of different client-server data access techniques in Visual FoxPro, including remote views, dynamic SQL pass-through, stored procedures, and cursor adapters. It evaluates these techniques based on categories like ease of use, performance/scalability, maintainability, flexibility, and security concerns. The document recommends choosing the best approach for each application and mixing techniques when necessary to achieve flexibility. It also encourages developers to be informed when selecting a data access strategy.
This presentation is for enterprises that are considering adopting Scala. The author is managing editor of http://scalacourses.com, which offers self-paced online courses that teach Introductory and Intermediate Scala and Play Framework.
Cassandra Summit 2015 - Building a multi-tenant API PaaS with DataStax Enterp...Restlet
Lessons learned by Restlet when deploying DataStax Enterprise search with APISpark. Presentation by Jerome Louvel and Guillaume Blondeau at the Cassandra Summit 2015. Includes 7 challenges and solutions when deploying DataStax.
@MarketaAdamova Slides from 'Road Trip To Component' talk (Dutch Clojure Days 2017)
'Few months ago our company NomNom decided to move all its backend services from Ruby to Clojure. And I think a road trip is best comparison for this migration. There was excitement at start, then panic a few hours down the road wondering what was left behind, but now a constant joy of discovering new things. In this talk I’d like to share how we eventually arrived at Stuart Sierra’s Component. Let’s take a look at how components improved our quickly growing codebase and testing, as well as some of the trade-offs we had to make. Finally I’ll show how components can help with managing running code in production.'
This presentation is for enterprises that are considering adopting Scala. The author is managing editor of http://scalacourses.com, which offers self-paced online courses that teach Introductory and Intermediate Scala and Play Framework.
Cassandra Summit 2015 - Building a multi-tenant API PaaS with DataStax Enterp...Restlet
Lessons learned by Restlet when deploying DataStax Enterprise search with APISpark. Presentation by Jerome Louvel and Guillaume Blondeau at the Cassandra Summit 2015. Includes 7 challenges and solutions when deploying DataStax.
@MarketaAdamova Slides from 'Road Trip To Component' talk (Dutch Clojure Days 2017)
'Few months ago our company NomNom decided to move all its backend services from Ruby to Clojure. And I think a road trip is best comparison for this migration. There was excitement at start, then panic a few hours down the road wondering what was left behind, but now a constant joy of discovering new things. In this talk I’d like to share how we eventually arrived at Stuart Sierra’s Component. Let’s take a look at how components improved our quickly growing codebase and testing, as well as some of the trade-offs we had to make. Finally I’ll show how components can help with managing running code in production.'
Architect’s Open-Source Guide for a Data Mesh ArchitectureDatabricks
Data Mesh is an innovative concept addressing many data challenges from an architectural, cultural, and organizational perspective. But is the world ready to implement Data Mesh?
In this session, we will review the importance of core Data Mesh principles, what they can offer, and when it is a good idea to try a Data Mesh architecture. We will discuss common challenges with implementation of Data Mesh systems and focus on the role of open-source projects for it. Projects like Apache Spark can play a key part in standardized infrastructure platform implementation of Data Mesh. We will examine the landscape of useful data engineering open-source projects to utilize in several areas of a Data Mesh system in practice, along with an architectural example. We will touch on what work (culture, tools, mindset) needs to be done to ensure Data Mesh is more accessible for engineers in the industry.
The audience will leave with a good understanding of the benefits of Data Mesh architecture, common challenges, and the role of Apache Spark and other open-source projects for its implementation in real systems.
This session is targeted for architects, decision-makers, data-engineers, and system designers.
A machine learning and data science pipeline for real companiesDataWorks Summit
Comcast is one of the largest cable and telecommunications providers in the country built on decades of mergers, acquisitions, and subscriber growth. The success of our company depends on keeping our customers happy and how quickly we can pivot with changing trends and new technologies. Data abounds within our internal data centers and edge networks as well as both the private and public cloud across multiple vendors.
Within such an environment and given such challenges, how do we get AI, machine learning, and data science platforms built so our company can respond to the market, predict our customers’ needs and create new revenue generating products that delight our customers? If you don’t happen to be our friends and colleagues at Google, Facebook, and Amazon, what are technologies, strategies, and toolkits you can employ to bring together disparate data sets and quickly get them into the hands of your data scientists and then into your own production systems for use by your customers and business partners?
We’ll explore our journey and evolution and look at specific technologies and decisions that have gotten us to where we are today and demo how our platform works.
Speaker
Ray Harrison, Comcast, Enterprise Architect
Prashant Khanolkar, Comcast, Principal Architect Big Data
Enterprise Data Integration for Microsoft Dynamics CRMDaniel Cai
This is the deck that I used for my presentation for XrmVirtual on Apr 9, 2013, which discusses various options that you may have for Microsoft Dynamics CRM data migration and integration.
Extended Flexagon FlexDeploy® Technical Overview presentation with product screenshots. Presentation extended with their permission. Slides demonstrating connection and deployment to Oracle Service Bus.
Migration from Oracle to PostgreSQL: NEED vs REALITYAshnikbiz
Some of the largest organization in the world today are going cost-efficient by innovating their database layer. Migrating workloads from legacy systems to an enterprise open source database technology like Postgres is a preferred choice for many.
DevOps is changing today's software development world by helping us build better software, faster. However most of the knowledge and experience with DevOps is based around application software and ignores the database. We will examine how the concepts and principles of DevOps can be applied to database development by looking at both automated comparison analysis as well as migration script management. Automated building, testing, and deployment of database changes will be shown.
About the Presenter
Steve Jones is a Microsoft SQL Server MVP and has been working with SQL Server since version 4.2 on OS/2. After working as a DBA and developer for a variety of companies, Steve co-founded the community website SQLServerCentral.com in 2001. Since 2004, Steve has been the full-time editor of the site, ensuring it continues to be a great resource for SQL Server professionals. Over the last decade, Steve has written hundreds of articles about SQL Server for SQLServerCentral.com, SQL Server Standard magazine, SQL Server Magazine, and Database Journal.
What is Data Warehousing? ,
Who needs Data Warehousing? ,
Why Data Warehouse is required? ,
Types of Systems ,
OLTP
OLAP
Maintenance of Data Warehouse
Data Warehousing Life Cycle
Debugging Microservices - key challenges and techniques - Microservices Odesa...Lohika_Odessa_TechTalks
Microservice architecture is widespread our days. It comes with a lot of benefits and challenges to solve. Main goal of this talk is to go through troubleshooting and debugging in the distributed micro-service world. Topic would cover:
main aspects of the logging,
monitoring,
distributed tracing,
debugging services on the cluster.
About speaker:
Andrеy Kolodnitskiy is Staff engineer in the Lohika and his primary focus is around distributed systems, microservices and JVM based languages.
Majority of time engineers spend debugging and fixing the issues. This talk will be dedicated to best practicies and tools Andrеys team uses on its project which do help to find issues more efficiently.
2. Who Am I?
• mfeltman@f1tech.com
• F1 Technologies Partner
• Visual FoxExpress Developer
• Former Fox Software Employee
• Application Programmer
3. Our Goals
• Provide you with an overview of each of the
data access techniques
• Make you aware of the pros and cons of the
various techniques
• Equip you with the information necessary to
make an informed choice of data access
technique.
4. Agenda
• Overview of Various Data Access Techniques
• Evaluation Categories
– Ease of Use
– Performance and Scalability
– Maintainability
– Flexibility
– Security Concerns/Issues
• Mixing and Matching Techniques
5. The Data Access Methods
• Remote Views
• Dynamic SQL Pass-Through
• Stored Procedures
• CursorAdapter
• ADO
• XML
6. Ease of Use
• UI and Tool Support
• Data Binding
• Normalcy
• Completeness
• Plays Well With Others
• Distribution Difficulties
7. Remote Views
• UI & Tools Support
– View Builder, GenDBC
– eView & View Editor
– xCase
– DBCX
• Data Binding
– Full Support in Data Environment
• Normalcy
– Most similar to tables
8. Remote Views
• Completeness
– Full Language Support in VFP
– Limited Access to Back-end Features
• Plays Well With Others
– Very well, Can share connections
• Distribution
– DBC Distribution
9. Dynamic SPT – Ease of Use
• UI and Tool Support
– None Native, Some 3rd Party
• Data Binding
– Manual or Tricks
• Normalcy
– Requires More Code to work like a View
(CursorSetProp())
10. Dynamic SPT – Ease of Use
• Completeness
– Access to full back-end
• Plays well with others
– Very well except for ADO
• Distribution Issues
– None
11. Stored Procedures – Ease of Use
• UI and Tool Support
– None in VFP
– DataClas
– Enterprise Manager and QueryAnalyzer
– Mike Levy’s Classes from various conferences
12. Stored Procedures – Ease of Use
• Completeness
– Access to everything the back-end has to offer
– Great for Multiple and/or Complex Statements
• Distribution Difficulties
– Must update stored procedures
– Code Conflict Resolution
13. CursorAdapter with ODBC – Ease of
Use
• Similar to Remote Views
• UI and Tool Support
– CursorAdapter & DE Builder
– 3rd Party Tools
• Normalcy
– Just like a Table or View
14. CursorAdapter with ODBC – Ease of
Use
• Completeness
– More code than remote views, less than other
techniques
• Plays Well With Others
– Easiest
15. CursorAdapter with ADO/OLEDB –
Ease of Use
• Similar to CursorAdapter with ODBC
• Plays Well With Others
– Cannot share connection with other data access
strategies
• Distribution Concerns
– MDAC
16. Performance and Scalability
• The differences between various techniques are
generally minor.
• Server, Workstation & LAN/WAN performance and
scalability must ALL be taken into account
• Size (& Contents) Matters
• Query optimization in SQL Server is much different
than in VFP. Syntax vs. Content-based optimization.
17. Performance and Scalability
• Results can vary widely for the same tests.
• Those with much more experience than me with
large databases (million rows+) all swear Stored
Procedures produce the best performance.
• Microsoft tends to get very angry at those who
publish SQL Server benchmarks.
18. Maintainability
• Code Requirements
– How much code?
• Maintenance Points
– How many?
– Easy to find and work with?
• Tools
– Are there any?
• Schema Changes
– What happens when schema changes?
20. Maintainability - Remote Views
– Tools
• View Designer, eView, ViewEditor, xCase, GenDBC
– Schema Changes
• Use xCase
• Unit test remote views
21. Maintainability - Dynamic SPT
– Code Requirements
• One good base class
• App specific subclasses
– Maintenance Points
• Custom Class Code
22. Maintainability - Dynamic SPT
– Tools
• None
– Schema Changes
• Maybe do nothing
• Unit test data access code
23. Maintainability - Stored
Procedures
– Code Requirements
• VFP – One good set of classes
• 4 or more Procedures for basically every table
– Maintenance Points
• Custom classes
• Actual Stored Procedures
24. Maintainability - Stored
Procedures
– Tools
• None for VFP
• DataClas, 3rd Party
– Schema Changes
• All Procedures
• Unit Test all Stored Procedures
25. Maintainability - CursorAdapters
– Code Requirements
• One good base class
– Maintenance Points
• Individual subclasses
– Tools
• 3rd party, DE and CA Builder
– Schema Changes
• Modify CA properties
• Unit test all cursor adapters
26. Flexibility
• Remote Views
– Inflexible without other techniques
• Dynamic SPT
– Highly flexible with custom classes, but overly
difficult to write
27. Flexibility
• Stored Procedures
– Very Flexible
– Much like Dynamic SQL Pass-Through
• Cursor Adapter
– Most Flexible – mix & match with all techniques
– Native class provides appropriate locations for
customization
28. Security
• Stored Procedures – Execute Rights on Stored
Procedures Only
• All Others – Provide direct rights to update
tables or views
• DSN Based Connection vs. Connection String
is more important
• Use Application Roles
29. Mixing and Matching
• CURSORSETPROP()
– Make SPT Cursor Updatable
– Load data into remote view
• USE … CONNSTRING (handle)
• CursorAdapter.CursorAttach
• SQLSTRINGCONNECT()
30. Summary
• Be Informed!
• It is Not an “All or Nothing” Situation
• Choose the Best Approach for the Application
• Mix and Match When Necessary.