SlideShare a Scribd company logo
1 of 8
Download to read offline
6/8/2013
XRec – Extended
Reconciliation
using Excel VBA
White Paper
Senthil Murugan Sundaresan
IT Consultant – BI, SQL, Python, VBA
XRec – Extended Reconciliation using Excel VBA
ABSTRACT
This paper describes the use of an Excel Application
which was developed during the Testing phase of the project
[Mainframe Information Delivery Management System – It’s a
Reverse engineering project where in we have to migrate the
existing FEEDS from Mainframes to Open Systems (ETL)]. We
have developed two applications; each will have its own
Advantages and uniqueness in terms of generating output. This
document describes one of the applications. The Name of the
Application is ComparX-R. Prior to the development of this
application we had to compare the Mainframe Feed data with
ETL Generated Feed data manually. This was time consuming
in terms of judging the accuracy of the output data. With the use
of this application we were able to present the comparison,
mismatched, statistics reports to our client successfully. This
application is used to automate the comparison process [of Data
from Legacy systems and Data generated by Open systems -
ETL]. It’s created with the help of Excel and VBA codes and
was very much handy at the time of Testing, Implementation. It
can be used for MIS related presentations too.
TARGET AUDIENCE
End Users, Testers, ETL/Report Developers, Data Migration
Developers, and Managers
1. INTRODUCTION
ComparX – R [Compare eXcel Row wise] is a
Comparison Tool which is primarily helpful for you when
you have to comparing huge data. Normally in Day to day
activities Excel is very much a part of our both Official work
and personal work.
Here we can put the data in source sheets and execute the
options available in Menu to perform any operation on the
data. This tool will generate 10 Reports which can be for
used for analysis further.
Process:
It takes the first row from ETL source data and
compares it with first row of Mainframes source data. Both
Mainframes and ETL data should be sorted in the same order
based on same number of columns. If Mainframe has one
record in row number 2 then ETL also should have the same
row in the same row number. [You may or may not have
mismatched columns in that rows] But Key [Columns used
for sorting] should be synchronized between Mainframe
system and ETL.
2. CHALLENGES
 Display the data in readable format so that the same is handy
at the time of presentation to the users
 Understand the requirement and choose the optimum logic
 Generate the various reports in quick succession
 Make it as user friendly
 Optimize the Report Running time
3. REQUIRED COMPONENTS
The following table lists these identified Components.
Table 1: Components
S. No Component Name Type
1. MS EXCEL Application
2. Windows XP or
higher
OS
4. CONTENTS
Comprises of Sheets like Navigation, Steps, Sample
Data, Colors List, Mainframe, ETL, and Compare Data. Each
sheet has its own options and descriptions. Compare Data is a
Main menu option where we can generate reports, Format the
reports, and Export the reports in various formats like TXT,
HTML and CSV.
5. FEATURES
 Statistics - This will be useful for analysis and
presentation.
 Gives Report Generation Time, Reports Count
 We can Load External Files.
 Formatting the reports for presentation
 Converting the Excel Data into HTML, CSV, Delimited
TXT file formats
 Row and Column count - To decide whether to go for
the result set or not.
 Colors list generation to see what colors can be used for
the report formatting.
 Loading external delimited data files, loading the
sample data for testing.
 Save Sources and Reports alone in a new file.
 Exported reports will be saved in the same folder of
application.
 Deletion of Reports, Navigation to all reports
6. REPORTS
Compared Report:
Gives the comparison of two sheets with format.
Layout attached in Appendix A.
Compared > 2000 Rows Report:
Gives the comparison of two sheets without format.
Layout attached in Appendix A.
[This is for Greater than 2000 Rows].
Matched Report:
Gives the comparison of two sheets, but only
the MATCHED Records with format.
Layout attached in Appendix A.
Matched > 2000 Rows Report:
Gives the comparison of two sheets, but only
the MATCHED Records without format.
Layout attached in Appendix A.
[This is for Greater than 2000 Rows]
MisMatched Report:
Gives the comparison of two sheets, but only
the MISMATCHED Records with format.
Layout attached in Appendix A.
MisMatched > 2000 Rows Report:
Gives the comparison of two sheets, but only the
MISMATCHED Records without format.
Layout attached in Appendix A.
[This is for Greater than 2000 Rows]
Mismatched_Cols Report:
Gives the MISMATCHES between two sheets,
but only the MISMATCHED Columns with format.
Layout attached in Appendix A.
Mismatched_Cols > 2000:
Gives the MISMATCHES between two sheets,
but only the Rows Report MISMATCHED
Columns without format.
Layout attached in Appendix A.
[This is for Greater than 2000 Rows]
Stats Report:
Gives the STATISTICS of two sheets like
Total Rows and Columns, Matched/Mismatched
Rows and columns. MisMatched Column names
and Column Number etc. You can find the layout
in Appendix A.
Stats > 2000 Rows Report:
Gives the STATISTICS of two sheets like
Total Rows and Columns, Matched/ Mismatched
Rows and columns. MisMatched Column names
and Column Number etc. You can find the layout
in Appendix A. [This is for Greater than 2000 Rows]
7. REPORT LAYOUTS
Compared Report and Compared > 2000 Rows Report:
[MF] <Mainframe data> = <ETL data> [ETL] if both data
are equal - This will be displayed in Single cell.
[MF] <Mainframe data> <> <ETL data> [ETL] {Row #: |
Column :} if both data are NOT equal - This will be
displayed in single cell.
Status Column will have value as MATCHED if both data
are matched, MISMATCHED if both data are not matched.
Status Rows:
1st Row:
No. of Rows in mainframe = No. of Rows in ETL.
Row count matched or not matched.
Completely matched Records.
2nd Row: No. of Mismatched Records
Report Generation time.
3rd Row:
Link to Top Row of the Report, to Compare
Data Menu, to Steps Sheet.
Compared Report generates with format
Compared > 2000 Rows Report generates
without format
Refer Appendix A
Matched Report and Matched > 2000 Rows Report:
[MF] <Mainframe data> = <ETL data> [ETL] if both data
are equal - This will be displayed in single cell.
Status Column will only have values MATCHED if both
data are matched.
Status Rows:
1st Row:
No. of Rows in mainframe = No. of Rows in ETL.
Completely matched Records.
2nd Row: No. of Matched Records
Report Generation time.
3rd Row:
Link to Top Row of the Report, to Compare
Data Menu, to Steps Sheet.
Matched Report generates with format
Matched > 2000 Rows Report generates
without format
Refer Appendix A
MisMatched Report and MisMatched > 2000 Rows
Report:
[MF] <Mainframe data> <> <ETL data> [ETL] if both data
are equal - This will be displayed in single cell.
[MF] <Mainframe data> = <ETL data> [ETL] if both data
are equal - This will be displayed in Single cell.
Status Column will only have value as MISMATCHED if
both data are NOT matched.
Status Rows:
1st Row:
No. of Rows in mainframe = No. of Rows in ETL.
MISMATCHED Records Count.
2nd Row: No. of MisMatched Records
Report Generation time.
3rd Row:
Link to Top Row of the Report, to Compare
Data Menu, to Steps Sheet.
MisMatched Report generates with format
MisMatched > 2000 Rows Report generates
without format
Refer Appendix A
Mismatched_Cols Report and Mismatched_Cols > 2000
Rows Report:
[MF] <Mainframe data> <> <ETL data> [ETL] if both data
are equal - This will be displayed in single cell.
[MF] <Mainframe data> = <ETL data> [ETL] if both data
are equal - This will be displayed in single cell.
If Entire Column has matching value that column will be
deleted.
Status Column will only have values MISMATCHED if both
data are NOT matched.
Status Rows:
1st Row:
No. of Rows in mainframe = No. of Rows in ETL.
MISMATCHED Records Count.
2nd Row: No. of MisMatched Records
Report Generation time.
3rd Row:
Link to Top Row of the Report, to Compare
Data Menu, to Steps Sheet.
MisMatched Report generates with format
MisMatched > 2000 Rows Report
generates without format
Refer Appendix A
Stats Report and Stats > 2000 Rows Report:
Table 1
Mismatched Column's Number
Mismatched Column's Name
Mismatched Records for Each column
Total Mismatched Values <Sum>
Table 2
<Count of Records for each category >
<Percentage of Records for each category>
Total Rows
Total Columns
Mismatched Rows
Mismatched columns of Mismatched Rows
Matched columns of Mismatched Rows
Matched Rows
Matched columns
Link to Compare Data Menu, Link to MisMatched Report,
Link to Compared Report
Refer Appendix A
8. LIMITAIONS
 Can process 255 columns as excel column limit per
sheet is 255 plus one status column.
 Can process 65533 rows as excel sheet limit is 65536
rows and status will take 3 rows.
 Row Count should be equal in both sources to get the
desired result.
 Source files should be sorted properly.
 This is really helpful for Sequential Comparison and
gives accurate result.
 Not as fast as than UNIX or other scripts, as it has to
compare each cell of one sheet against each cell in other
sheet in a sequential manner
 But Comparison wise it gives Accurate results with a
good look and feel.
 Rejected records will not be saved in separate file.
Even if there are columns with no values when comparing
columns, it displays the status as Mismatched only.
9. SUMMARY
It can be used as a Standard and Standalone Reporting
Tool. Various complex Reporting features like Statistics, Matched
and Mismatched, Export Options, etc. can be clubbed using the
integrated solution which ComparX Offers.
The solution is ideal for users who:
 Want a single Reporting solution that incorporates all of their
Comparison and Presentation Requirements.
 Need to compare Mainframe and ETL data
 Want to see Comparison report
 Need to reconcile data across systems to gain a complete
view of customers.
 Want to Export generated reports in HTML formats
 Want to supplement Comparison reporting with a full breadth
of other options like Matched vs. Mismatched, Statistics reports
etc.
 Wants to load external text files into excel for comparison.
 Wants to format the reports.
Appendix A
Compared Report
Matched Report
Mismatched Report
Mismatched_Cols report
Stats Report

More Related Content

What's hot

Application of excel and spss programme in statistical
Application of excel and spss programme in statisticalApplication of excel and spss programme in statistical
Application of excel and spss programme in statisticalVeenaV29
 
Sap abap-data structures and internal tables
Sap abap-data structures and internal tablesSap abap-data structures and internal tables
Sap abap-data structures and internal tablesMustafa Nadim
 
Creation of spreadsheets
Creation of spreadsheetsCreation of spreadsheets
Creation of spreadsheetsNITISH SADOTRA
 
CCPRO 2016 Power Presentation
CCPRO 2016 Power PresentationCCPRO 2016 Power Presentation
CCPRO 2016 Power PresentationDavid Onder
 
Internal tables
Internal tablesInternal tables
Internal tableswaseem27
 
Excel and SQL Quick Tricks for Merchandisers
Excel and SQL Quick Tricks for MerchandisersExcel and SQL Quick Tricks for Merchandisers
Excel and SQL Quick Tricks for Merchandiserswebhostingguy
 
Internal tables
Internal tables Internal tables
Internal tables Jibu Jose
 
Introduction to spreadsheets
Introduction to spreadsheetsIntroduction to spreadsheets
Introduction to spreadsheetsCasey Robertson
 
Reports Dashboards SQL Demo
Reports Dashboards SQL DemoReports Dashboards SQL Demo
Reports Dashboards SQL DemoHong-Bing Li
 
RDAP 15 Excel Archival Tool: Automating the Spreadsheet Conversion Process
RDAP 15 Excel Archival Tool: Automating the Spreadsheet Conversion ProcessRDAP 15 Excel Archival Tool: Automating the Spreadsheet Conversion Process
RDAP 15 Excel Archival Tool: Automating the Spreadsheet Conversion ProcessASIS&T
 
Power ups non standard column names
Power ups non standard column namesPower ups non standard column names
Power ups non standard column namesJohann Krugell
 

What's hot (16)

Application of excel and spss programme in statistical
Application of excel and spss programme in statisticalApplication of excel and spss programme in statistical
Application of excel and spss programme in statistical
 
Sap abap-data structures and internal tables
Sap abap-data structures and internal tablesSap abap-data structures and internal tables
Sap abap-data structures and internal tables
 
Creation of spreadsheets
Creation of spreadsheetsCreation of spreadsheets
Creation of spreadsheets
 
CCPRO 2016 Power Presentation
CCPRO 2016 Power PresentationCCPRO 2016 Power Presentation
CCPRO 2016 Power Presentation
 
Internal tables
Internal tablesInternal tables
Internal tables
 
'Spreadsheet'
'Spreadsheet''Spreadsheet'
'Spreadsheet'
 
Excel and SQL Quick Tricks for Merchandisers
Excel and SQL Quick Tricks for MerchandisersExcel and SQL Quick Tricks for Merchandisers
Excel and SQL Quick Tricks for Merchandisers
 
05 internal tables
05 internal tables05 internal tables
05 internal tables
 
Internal tables
Internal tables Internal tables
Internal tables
 
Spreadsheet Concepts
Spreadsheet ConceptsSpreadsheet Concepts
Spreadsheet Concepts
 
Introduction to spreadsheets
Introduction to spreadsheetsIntroduction to spreadsheets
Introduction to spreadsheets
 
Reports Dashboards SQL Demo
Reports Dashboards SQL DemoReports Dashboards SQL Demo
Reports Dashboards SQL Demo
 
Spreadsheet
SpreadsheetSpreadsheet
Spreadsheet
 
Chapter 4
Chapter 4Chapter 4
Chapter 4
 
RDAP 15 Excel Archival Tool: Automating the Spreadsheet Conversion Process
RDAP 15 Excel Archival Tool: Automating the Spreadsheet Conversion ProcessRDAP 15 Excel Archival Tool: Automating the Spreadsheet Conversion Process
RDAP 15 Excel Archival Tool: Automating the Spreadsheet Conversion Process
 
Power ups non standard column names
Power ups non standard column namesPower ups non standard column names
Power ups non standard column names
 

Similar to X rec extened reconciliation using excel vba

C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003
C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003
C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003Hong-Bing Li
 
Ssis Ssas Ssrs Sp Pps Hong Bing Li
Ssis Ssas Ssrs Sp Pps Hong Bing LiSsis Ssas Ssrs Sp Pps Hong Bing Li
Ssis Ssas Ssrs Sp Pps Hong Bing LiHong-Bing Li
 
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing Li
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing LiSSIS_SSRS_PPS_SP_SSAS_Hong_Bing Li
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing LiHong-Bing Li
 
4b6c1c5c-e913-4bbf-b3a4-41e23cb961ba-161004200047.pdf
4b6c1c5c-e913-4bbf-b3a4-41e23cb961ba-161004200047.pdf4b6c1c5c-e913-4bbf-b3a4-41e23cb961ba-161004200047.pdf
4b6c1c5c-e913-4bbf-b3a4-41e23cb961ba-161004200047.pdfNitish Nagar
 
SSIS_SSAS_SSRS_SP_PPS_HongBingLi
SSIS_SSAS_SSRS_SP_PPS_HongBingLiSSIS_SSAS_SSRS_SP_PPS_HongBingLi
SSIS_SSAS_SSRS_SP_PPS_HongBingLiHong-Bing Li
 
ReportsDashboardsSql_hbli
ReportsDashboardsSql_hbliReportsDashboardsSql_hbli
ReportsDashboardsSql_hbliHong-Bing Li
 
Reports Dashboards ETL SQL_HBLI
Reports Dashboards ETL SQL_HBLIReports Dashboards ETL SQL_HBLI
Reports Dashboards ETL SQL_HBLIHong-Bing Li
 
ReportsDashboardsSQLDemoHBLI
ReportsDashboardsSQLDemoHBLIReportsDashboardsSQLDemoHBLI
ReportsDashboardsSQLDemoHBLIHong-Bing Li
 
Reports Dashboards SQL SSIS Demo
Reports Dashboards SQL SSIS DemoReports Dashboards SQL SSIS Demo
Reports Dashboards SQL SSIS DemoHong-Bing Li
 
ReportsDashboardsSql_hbli
ReportsDashboardsSql_hbliReportsDashboardsSql_hbli
ReportsDashboardsSql_hbliHong-Bing Li
 
Ssis sql ssrs_sp_ssas_mdx_hb_li
Ssis sql ssrs_sp_ssas_mdx_hb_liSsis sql ssrs_sp_ssas_mdx_hb_li
Ssis sql ssrs_sp_ssas_mdx_hb_liHong-Bing Li
 
Automating Test File Creation
Automating Test File CreationAutomating Test File Creation
Automating Test File Creationbdebruin
 
Itm310 problem solving #7 complete solutions correct answers key
Itm310 problem solving #7 complete solutions correct answers keyItm310 problem solving #7 complete solutions correct answers key
Itm310 problem solving #7 complete solutions correct answers keySong Love
 
Chapter 29Foundations of Family CareFamily DefinedT.docx
Chapter 29Foundations of Family CareFamily DefinedT.docxChapter 29Foundations of Family CareFamily DefinedT.docx
Chapter 29Foundations of Family CareFamily DefinedT.docxcravennichole326
 

Similar to X rec extened reconciliation using excel vba (20)

C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003
C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003
C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003
 
Ssis Ssas Ssrs Sp Pps Hong Bing Li
Ssis Ssas Ssrs Sp Pps Hong Bing LiSsis Ssas Ssrs Sp Pps Hong Bing Li
Ssis Ssas Ssrs Sp Pps Hong Bing Li
 
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing Li
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing LiSSIS_SSRS_PPS_SP_SSAS_Hong_Bing Li
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing Li
 
4b6c1c5c-e913-4bbf-b3a4-41e23cb961ba-161004200047.pdf
4b6c1c5c-e913-4bbf-b3a4-41e23cb961ba-161004200047.pdf4b6c1c5c-e913-4bbf-b3a4-41e23cb961ba-161004200047.pdf
4b6c1c5c-e913-4bbf-b3a4-41e23cb961ba-161004200047.pdf
 
Advanced Excel ppt
Advanced Excel pptAdvanced Excel ppt
Advanced Excel ppt
 
SSIS_SSAS_SSRS_SP_PPS_HongBingLi
SSIS_SSAS_SSRS_SP_PPS_HongBingLiSSIS_SSAS_SSRS_SP_PPS_HongBingLi
SSIS_SSAS_SSRS_SP_PPS_HongBingLi
 
Chapter.07
Chapter.07Chapter.07
Chapter.07
 
ReportsDashboardsSql_hbli
ReportsDashboardsSql_hbliReportsDashboardsSql_hbli
ReportsDashboardsSql_hbli
 
Reports Dashboards ETL SQL_HBLI
Reports Dashboards ETL SQL_HBLIReports Dashboards ETL SQL_HBLI
Reports Dashboards ETL SQL_HBLI
 
ReportsDashboardsSQLDemoHBLI
ReportsDashboardsSQLDemoHBLIReportsDashboardsSQLDemoHBLI
ReportsDashboardsSQLDemoHBLI
 
Reports Dashboards SQL SSIS Demo
Reports Dashboards SQL SSIS DemoReports Dashboards SQL SSIS Demo
Reports Dashboards SQL SSIS Demo
 
ReportsDashboardsSql_hbli
ReportsDashboardsSql_hbliReportsDashboardsSql_hbli
ReportsDashboardsSql_hbli
 
ITB - UNIT 4.pdf
ITB - UNIT 4.pdfITB - UNIT 4.pdf
ITB - UNIT 4.pdf
 
Ssis sql ssrs_sp_ssas_mdx_hb_li
Ssis sql ssrs_sp_ssas_mdx_hb_liSsis sql ssrs_sp_ssas_mdx_hb_li
Ssis sql ssrs_sp_ssas_mdx_hb_li
 
BIWorkDemos
BIWorkDemosBIWorkDemos
BIWorkDemos
 
Fg d
Fg dFg d
Fg d
 
Automating Test File Creation
Automating Test File CreationAutomating Test File Creation
Automating Test File Creation
 
Oracle report from ppt
Oracle report from pptOracle report from ppt
Oracle report from ppt
 
Itm310 problem solving #7 complete solutions correct answers key
Itm310 problem solving #7 complete solutions correct answers keyItm310 problem solving #7 complete solutions correct answers key
Itm310 problem solving #7 complete solutions correct answers key
 
Chapter 29Foundations of Family CareFamily DefinedT.docx
Chapter 29Foundations of Family CareFamily DefinedT.docxChapter 29Foundations of Family CareFamily DefinedT.docx
Chapter 29Foundations of Family CareFamily DefinedT.docx
 

Recently uploaded

KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxKnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxTier1 app
 
software engineering Chapter 5 System modeling.pptx
software engineering Chapter 5 System modeling.pptxsoftware engineering Chapter 5 System modeling.pptx
software engineering Chapter 5 System modeling.pptxnada99848
 
Implementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureImplementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureDinusha Kumarasiri
 
Cloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStackCloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStackVICTOR MAESTRE RAMIREZ
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...MyIntelliSource, Inc.
 
Asset Management Software - Infographic
Asset Management Software - InfographicAsset Management Software - Infographic
Asset Management Software - InfographicHr365.us smith
 
Folding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesFolding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesPhilip Schwarz
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptkotipi9215
 
Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)OPEN KNOWLEDGE GmbH
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantAxelRicardoTrocheRiq
 
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024StefanoLambiase
 
Unveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsUnveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsAhmed Mohamed
 
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...soniya singh
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideChristina Lin
 
Cloud Data Center Network Construction - IEEE
Cloud Data Center Network Construction - IEEECloud Data Center Network Construction - IEEE
Cloud Data Center Network Construction - IEEEVICTOR MAESTRE RAMIREZ
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...Christina Lin
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio, Inc.
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityNeo4j
 

Recently uploaded (20)

Call Girls In Mukherjee Nagar 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
Call Girls In Mukherjee Nagar 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...Call Girls In Mukherjee Nagar 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
Call Girls In Mukherjee Nagar 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
 
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxKnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
 
software engineering Chapter 5 System modeling.pptx
software engineering Chapter 5 System modeling.pptxsoftware engineering Chapter 5 System modeling.pptx
software engineering Chapter 5 System modeling.pptx
 
Implementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureImplementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with Azure
 
Cloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStackCloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStack
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
 
Asset Management Software - Infographic
Asset Management Software - InfographicAsset Management Software - Infographic
Asset Management Software - Infographic
 
Folding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesFolding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a series
 
Hot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort Service
Hot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort ServiceHot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort Service
Hot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort Service
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.ppt
 
Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service Consultant
 
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
 
Unveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsUnveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML Diagrams
 
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
 
Cloud Data Center Network Construction - IEEE
Cloud Data Center Network Construction - IEEECloud Data Center Network Construction - IEEE
Cloud Data Center Network Construction - IEEE
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered Sustainability
 

X rec extened reconciliation using excel vba

  • 1. 6/8/2013 XRec – Extended Reconciliation using Excel VBA White Paper Senthil Murugan Sundaresan IT Consultant – BI, SQL, Python, VBA
  • 2. XRec – Extended Reconciliation using Excel VBA ABSTRACT This paper describes the use of an Excel Application which was developed during the Testing phase of the project [Mainframe Information Delivery Management System – It’s a Reverse engineering project where in we have to migrate the existing FEEDS from Mainframes to Open Systems (ETL)]. We have developed two applications; each will have its own Advantages and uniqueness in terms of generating output. This document describes one of the applications. The Name of the Application is ComparX-R. Prior to the development of this application we had to compare the Mainframe Feed data with ETL Generated Feed data manually. This was time consuming in terms of judging the accuracy of the output data. With the use of this application we were able to present the comparison, mismatched, statistics reports to our client successfully. This application is used to automate the comparison process [of Data from Legacy systems and Data generated by Open systems - ETL]. It’s created with the help of Excel and VBA codes and was very much handy at the time of Testing, Implementation. It can be used for MIS related presentations too. TARGET AUDIENCE End Users, Testers, ETL/Report Developers, Data Migration Developers, and Managers 1. INTRODUCTION ComparX – R [Compare eXcel Row wise] is a Comparison Tool which is primarily helpful for you when you have to comparing huge data. Normally in Day to day activities Excel is very much a part of our both Official work and personal work. Here we can put the data in source sheets and execute the options available in Menu to perform any operation on the data. This tool will generate 10 Reports which can be for used for analysis further. Process: It takes the first row from ETL source data and compares it with first row of Mainframes source data. Both Mainframes and ETL data should be sorted in the same order based on same number of columns. If Mainframe has one record in row number 2 then ETL also should have the same row in the same row number. [You may or may not have mismatched columns in that rows] But Key [Columns used for sorting] should be synchronized between Mainframe system and ETL. 2. CHALLENGES  Display the data in readable format so that the same is handy at the time of presentation to the users  Understand the requirement and choose the optimum logic  Generate the various reports in quick succession  Make it as user friendly  Optimize the Report Running time 3. REQUIRED COMPONENTS The following table lists these identified Components. Table 1: Components S. No Component Name Type 1. MS EXCEL Application 2. Windows XP or higher OS 4. CONTENTS Comprises of Sheets like Navigation, Steps, Sample Data, Colors List, Mainframe, ETL, and Compare Data. Each sheet has its own options and descriptions. Compare Data is a Main menu option where we can generate reports, Format the reports, and Export the reports in various formats like TXT, HTML and CSV.
  • 3. 5. FEATURES  Statistics - This will be useful for analysis and presentation.  Gives Report Generation Time, Reports Count  We can Load External Files.  Formatting the reports for presentation  Converting the Excel Data into HTML, CSV, Delimited TXT file formats  Row and Column count - To decide whether to go for the result set or not.  Colors list generation to see what colors can be used for the report formatting.  Loading external delimited data files, loading the sample data for testing.  Save Sources and Reports alone in a new file.  Exported reports will be saved in the same folder of application.  Deletion of Reports, Navigation to all reports 6. REPORTS Compared Report: Gives the comparison of two sheets with format. Layout attached in Appendix A. Compared > 2000 Rows Report: Gives the comparison of two sheets without format. Layout attached in Appendix A. [This is for Greater than 2000 Rows]. Matched Report: Gives the comparison of two sheets, but only the MATCHED Records with format. Layout attached in Appendix A. Matched > 2000 Rows Report: Gives the comparison of two sheets, but only the MATCHED Records without format. Layout attached in Appendix A. [This is for Greater than 2000 Rows] MisMatched Report: Gives the comparison of two sheets, but only the MISMATCHED Records with format. Layout attached in Appendix A. MisMatched > 2000 Rows Report: Gives the comparison of two sheets, but only the MISMATCHED Records without format. Layout attached in Appendix A. [This is for Greater than 2000 Rows] Mismatched_Cols Report: Gives the MISMATCHES between two sheets, but only the MISMATCHED Columns with format. Layout attached in Appendix A. Mismatched_Cols > 2000: Gives the MISMATCHES between two sheets, but only the Rows Report MISMATCHED Columns without format. Layout attached in Appendix A. [This is for Greater than 2000 Rows] Stats Report: Gives the STATISTICS of two sheets like Total Rows and Columns, Matched/Mismatched Rows and columns. MisMatched Column names and Column Number etc. You can find the layout in Appendix A. Stats > 2000 Rows Report: Gives the STATISTICS of two sheets like Total Rows and Columns, Matched/ Mismatched Rows and columns. MisMatched Column names and Column Number etc. You can find the layout in Appendix A. [This is for Greater than 2000 Rows] 7. REPORT LAYOUTS Compared Report and Compared > 2000 Rows Report: [MF] <Mainframe data> = <ETL data> [ETL] if both data are equal - This will be displayed in Single cell. [MF] <Mainframe data> <> <ETL data> [ETL] {Row #: | Column :} if both data are NOT equal - This will be displayed in single cell. Status Column will have value as MATCHED if both data are matched, MISMATCHED if both data are not matched. Status Rows: 1st Row: No. of Rows in mainframe = No. of Rows in ETL. Row count matched or not matched. Completely matched Records. 2nd Row: No. of Mismatched Records
  • 4. Report Generation time. 3rd Row: Link to Top Row of the Report, to Compare Data Menu, to Steps Sheet. Compared Report generates with format Compared > 2000 Rows Report generates without format Refer Appendix A Matched Report and Matched > 2000 Rows Report: [MF] <Mainframe data> = <ETL data> [ETL] if both data are equal - This will be displayed in single cell. Status Column will only have values MATCHED if both data are matched. Status Rows: 1st Row: No. of Rows in mainframe = No. of Rows in ETL. Completely matched Records. 2nd Row: No. of Matched Records Report Generation time. 3rd Row: Link to Top Row of the Report, to Compare Data Menu, to Steps Sheet. Matched Report generates with format Matched > 2000 Rows Report generates without format Refer Appendix A MisMatched Report and MisMatched > 2000 Rows Report: [MF] <Mainframe data> <> <ETL data> [ETL] if both data are equal - This will be displayed in single cell. [MF] <Mainframe data> = <ETL data> [ETL] if both data are equal - This will be displayed in Single cell. Status Column will only have value as MISMATCHED if both data are NOT matched. Status Rows: 1st Row: No. of Rows in mainframe = No. of Rows in ETL. MISMATCHED Records Count. 2nd Row: No. of MisMatched Records Report Generation time. 3rd Row: Link to Top Row of the Report, to Compare Data Menu, to Steps Sheet. MisMatched Report generates with format MisMatched > 2000 Rows Report generates without format Refer Appendix A Mismatched_Cols Report and Mismatched_Cols > 2000 Rows Report: [MF] <Mainframe data> <> <ETL data> [ETL] if both data are equal - This will be displayed in single cell. [MF] <Mainframe data> = <ETL data> [ETL] if both data are equal - This will be displayed in single cell. If Entire Column has matching value that column will be deleted. Status Column will only have values MISMATCHED if both data are NOT matched. Status Rows: 1st Row: No. of Rows in mainframe = No. of Rows in ETL. MISMATCHED Records Count. 2nd Row: No. of MisMatched Records Report Generation time. 3rd Row: Link to Top Row of the Report, to Compare Data Menu, to Steps Sheet. MisMatched Report generates with format MisMatched > 2000 Rows Report generates without format Refer Appendix A Stats Report and Stats > 2000 Rows Report: Table 1 Mismatched Column's Number Mismatched Column's Name Mismatched Records for Each column Total Mismatched Values <Sum> Table 2 <Count of Records for each category > <Percentage of Records for each category>
  • 5. Total Rows Total Columns Mismatched Rows Mismatched columns of Mismatched Rows Matched columns of Mismatched Rows Matched Rows Matched columns Link to Compare Data Menu, Link to MisMatched Report, Link to Compared Report Refer Appendix A 8. LIMITAIONS  Can process 255 columns as excel column limit per sheet is 255 plus one status column.  Can process 65533 rows as excel sheet limit is 65536 rows and status will take 3 rows.  Row Count should be equal in both sources to get the desired result.  Source files should be sorted properly.  This is really helpful for Sequential Comparison and gives accurate result.  Not as fast as than UNIX or other scripts, as it has to compare each cell of one sheet against each cell in other sheet in a sequential manner  But Comparison wise it gives Accurate results with a good look and feel.  Rejected records will not be saved in separate file. Even if there are columns with no values when comparing columns, it displays the status as Mismatched only. 9. SUMMARY It can be used as a Standard and Standalone Reporting Tool. Various complex Reporting features like Statistics, Matched and Mismatched, Export Options, etc. can be clubbed using the integrated solution which ComparX Offers. The solution is ideal for users who:  Want a single Reporting solution that incorporates all of their Comparison and Presentation Requirements.  Need to compare Mainframe and ETL data  Want to see Comparison report  Need to reconcile data across systems to gain a complete view of customers.  Want to Export generated reports in HTML formats  Want to supplement Comparison reporting with a full breadth of other options like Matched vs. Mismatched, Statistics reports etc.  Wants to load external text files into excel for comparison.  Wants to format the reports.