Day5-Informatica Cloud Data Quality(CDQ)
Data profiling service
Create Data profile and
execute it
Explain data profiling
metrics
InventModel Technology Solution +91-98219-31210 support@inventmodel.com
Agenda
InventModel Technology Solution
+91-9821931210
support@inventmodel.com
Data profiling service
Data Profiling Service in Informatica Data Management Cloud (IDMC) is a powerful feature that helps
you understand the structure, quality, and content of your data. It provides insights into data patterns,
inconsistencies, and anomalies, which are crucial for data governance, data quality, and analytics.
📊Key Features of Data Profiling Service:
Column Profiling:
Analyzes data at the column level to identify data types, null values, unique counts, patterns, and
more.
Data Quality Metrics:
Measures data accuracy, completeness, consistency, and validity.
Pattern Recognition:
Detects patterns like phone numbers, email formats, ZIP codes, etc.
Anomaly Detection:
Identifies outliers or unusual data points.
Data Relationship Discovery:
Discovers relationships between tables or datasets.
InventModel Technology Solution +91-98219-31210 support@inventmodel.com
InventModel Technology Solution
+91-9821931210
support@inventmodel.com
🚀How to Use Data Profiling Service in IDMC:
Log in to IDMC.
Go to "Data" → "Data Profiling".
Click "Create New Profile".
Select the connection (e.g., database, flat file, etc.) and the specific data objects to
analyze.
Choose the profiling rules or configurations.
Click "Run" to start profiling.
Review the profiling reports for insights on data quality, patterns, and anomalies.
InventModel Technology Solution +91-98219-31210 support@inventmodel.com
Data profiling service
InventModel Technology Solution
+91-9821931210
support@inventmodel.com
Common Use Cases:
Data Quality Assessment: Identifying missing values, duplicates, or inconsistent data.
Data Migration Validation: Ensuring accuracy during system migrations.
Regulatory Compliance: Verifying data integrity for GDPR, HIPAA, etc.
ETL Optimization: Understanding data characteristics to improve data pipelines.
InventModel Technology Solution +91-98219-31210 support@inventmodel.com
Data profiling service
Create Data profile and execute it
InventModel Technology Solution
+91-9821931210
support@inventmodel.com
To create and execute a Data Profile in Informatica Data Management Cloud (IDMC),
follow these steps. I'll guide you through the process step-by-step.
🚀Step 1: Log In to IDMC
Go to Informatica Cloud and log in with your credentials.
📊Step 2: Access Data Profiling
Click on the "Data" tab in the top navigation bar.
Select "Data Profiling" from the dropdown.
🗂️Step 3: Create a New Data Profile
Click "New Profile" or "Create".
Provide a name for the data profile (e.g., "Customer Data Profile").
Add an optional description for future reference.
InventModel Technology Solution +91-98219-31210 support@inventmodel.com
InventModel Technology Solution
+91-9821931210
support@inventmodel.com
Create Data profile and execute it
🌐Step 4: Select Data Source
Choose the connection to your data source (e.g., SQL Server, Oracle, Flat File, etc.).
Select the specific table or file you want to profile.
⚙️Step 5: Configure Profiling Settings
Choose the profiling rules you want to apply:
Column Profiling: Analyzes data types, null values, unique counts.
Data Quality Checks: Looks for duplicates, patterns, etc.
Relationship Discovery: Identifies data relationships.
You can customize the settings as needed.
▶️ Step 6: Run the Data Profile
Click "Run" or "Execute" to start the profiling process.
The system will analyze the data and generate reports.
InventModel Technology Solution +91-98219-31210 support@inventmodel.com
InventModel Technology Solution
+91-9821931210
support@inventmodel.com
Create Data profile and execute it
📈Step 7: Review the Results
Once the profile is complete, go to the "Results" tab.
Review metrics like:
Data distribution
Data quality scores
Anomalies or outliers detected
You can export the report if needed.
InventModel Technology Solution +91-98219-31210 support@inventmodel.com
InventModel Technology Solution
+91-9821931210
support@inventmodel.com
Explain data profiling metrics
Data Profiling Metrics are key indicators that help you assess the quality, structure,
and content of your data. They provide insights into data consistency, completeness,
uniqueness, and more, enabling informed decisions for data governance, analytics,
and quality management.
Here’s a breakdown of the common data profiling metrics:
InventModel Technology Solution +91-98219-31210 support@inventmodel.com
Explain data profiling metrics
InventModel Technology Solution
+91-9821931210
support@inventmodel.com
📊1. Column-Level Metrics
These metrics provide insights into individual columns within your dataset:
Data Type: Identifies the type of data (e.g., integer, string, date).
Distinct Count: Number of unique values in the column.
Null Count: Number of null or missing values.
Null Percentage: Percentage of nulls compared to the total number of rows.
Max/Min Values: Identifies the highest and lowest values.
Data Length: Length of text data or number of characters.
Data Patterns: Detects patterns like email formats, phone numbers, ZIP codes.
Value Distribution: Shows the frequency distribution of values.
InventModel Technology Solution +91-98219-31210 support@inventmodel.com
InventModel Technology Solution
+91-9821931210
support@inventmodel.com
Explain data profiling metrics
🔍2. Data Quality Metrics
These metrics assess how well the data meets business requirements:
Completeness: Measures if all required data fields are populated.
Uniqueness: Identifies duplicate records or values.
Consistency: Checks if data values are consistent across different datasets.
Validity: Ensures data adheres to defined formats, rules, and standards.
Accuracy: Compares data to a trusted source to verify correctness.
InventModel Technology Solution +91-98219-31210 support@inventmodel.com
Thank You !
InventModel Technology Solution +91-98219-31210 support@inventmodel.com

Informatica CDQ | How to Create & Execute a Data Profile + Metrics Explained

  • 1.
    Day5-Informatica Cloud DataQuality(CDQ) Data profiling service Create Data profile and execute it Explain data profiling metrics InventModel Technology Solution +91-98219-31210 support@inventmodel.com Agenda
  • 2.
    InventModel Technology Solution +91-9821931210 support@inventmodel.com Dataprofiling service Data Profiling Service in Informatica Data Management Cloud (IDMC) is a powerful feature that helps you understand the structure, quality, and content of your data. It provides insights into data patterns, inconsistencies, and anomalies, which are crucial for data governance, data quality, and analytics. 📊Key Features of Data Profiling Service: Column Profiling: Analyzes data at the column level to identify data types, null values, unique counts, patterns, and more. Data Quality Metrics: Measures data accuracy, completeness, consistency, and validity. Pattern Recognition: Detects patterns like phone numbers, email formats, ZIP codes, etc. Anomaly Detection: Identifies outliers or unusual data points. Data Relationship Discovery: Discovers relationships between tables or datasets. InventModel Technology Solution +91-98219-31210 support@inventmodel.com
  • 3.
    InventModel Technology Solution +91-9821931210 support@inventmodel.com 🚀Howto Use Data Profiling Service in IDMC: Log in to IDMC. Go to "Data" → "Data Profiling". Click "Create New Profile". Select the connection (e.g., database, flat file, etc.) and the specific data objects to analyze. Choose the profiling rules or configurations. Click "Run" to start profiling. Review the profiling reports for insights on data quality, patterns, and anomalies. InventModel Technology Solution +91-98219-31210 support@inventmodel.com Data profiling service
  • 4.
    InventModel Technology Solution +91-9821931210 support@inventmodel.com CommonUse Cases: Data Quality Assessment: Identifying missing values, duplicates, or inconsistent data. Data Migration Validation: Ensuring accuracy during system migrations. Regulatory Compliance: Verifying data integrity for GDPR, HIPAA, etc. ETL Optimization: Understanding data characteristics to improve data pipelines. InventModel Technology Solution +91-98219-31210 support@inventmodel.com Data profiling service
  • 5.
    Create Data profileand execute it InventModel Technology Solution +91-9821931210 support@inventmodel.com To create and execute a Data Profile in Informatica Data Management Cloud (IDMC), follow these steps. I'll guide you through the process step-by-step. 🚀Step 1: Log In to IDMC Go to Informatica Cloud and log in with your credentials. 📊Step 2: Access Data Profiling Click on the "Data" tab in the top navigation bar. Select "Data Profiling" from the dropdown. 🗂️Step 3: Create a New Data Profile Click "New Profile" or "Create". Provide a name for the data profile (e.g., "Customer Data Profile"). Add an optional description for future reference. InventModel Technology Solution +91-98219-31210 support@inventmodel.com
  • 6.
    InventModel Technology Solution +91-9821931210 support@inventmodel.com CreateData profile and execute it 🌐Step 4: Select Data Source Choose the connection to your data source (e.g., SQL Server, Oracle, Flat File, etc.). Select the specific table or file you want to profile. ⚙️Step 5: Configure Profiling Settings Choose the profiling rules you want to apply: Column Profiling: Analyzes data types, null values, unique counts. Data Quality Checks: Looks for duplicates, patterns, etc. Relationship Discovery: Identifies data relationships. You can customize the settings as needed. ▶️ Step 6: Run the Data Profile Click "Run" or "Execute" to start the profiling process. The system will analyze the data and generate reports. InventModel Technology Solution +91-98219-31210 support@inventmodel.com
  • 7.
    InventModel Technology Solution +91-9821931210 support@inventmodel.com CreateData profile and execute it 📈Step 7: Review the Results Once the profile is complete, go to the "Results" tab. Review metrics like: Data distribution Data quality scores Anomalies or outliers detected You can export the report if needed. InventModel Technology Solution +91-98219-31210 support@inventmodel.com
  • 8.
    InventModel Technology Solution +91-9821931210 support@inventmodel.com Explaindata profiling metrics Data Profiling Metrics are key indicators that help you assess the quality, structure, and content of your data. They provide insights into data consistency, completeness, uniqueness, and more, enabling informed decisions for data governance, analytics, and quality management. Here’s a breakdown of the common data profiling metrics: InventModel Technology Solution +91-98219-31210 support@inventmodel.com
  • 9.
    Explain data profilingmetrics InventModel Technology Solution +91-9821931210 support@inventmodel.com 📊1. Column-Level Metrics These metrics provide insights into individual columns within your dataset: Data Type: Identifies the type of data (e.g., integer, string, date). Distinct Count: Number of unique values in the column. Null Count: Number of null or missing values. Null Percentage: Percentage of nulls compared to the total number of rows. Max/Min Values: Identifies the highest and lowest values. Data Length: Length of text data or number of characters. Data Patterns: Detects patterns like email formats, phone numbers, ZIP codes. Value Distribution: Shows the frequency distribution of values. InventModel Technology Solution +91-98219-31210 support@inventmodel.com
  • 10.
    InventModel Technology Solution +91-9821931210 support@inventmodel.com Explaindata profiling metrics 🔍2. Data Quality Metrics These metrics assess how well the data meets business requirements: Completeness: Measures if all required data fields are populated. Uniqueness: Identifies duplicate records or values. Consistency: Checks if data values are consistent across different datasets. Validity: Ensures data adheres to defined formats, rules, and standards. Accuracy: Compares data to a trusted source to verify correctness. InventModel Technology Solution +91-98219-31210 support@inventmodel.com
  • 11.
    Thank You ! InventModelTechnology Solution +91-98219-31210 support@inventmodel.com