SlideShare a Scribd company logo
BizTalk Server: Teach me something new about
Flat Files (or not) – Part II
Sandro Pereira
linkedin.com/in/sandropereira
Sandro Pereira
Who am I?
• Codeless Wizard
• Microsoft Azure & Visio MVP
• sandro.pereira@devscope.net
• linkedin.com/in/sandropereira
• @sandro_asp
• https://blog.sandro-pereira.com/
• Public speaker
• Book author: “BizTalk Mapping Patterns
and Best Practices”
+351 223 751 350
www.devscope.net
… they simply drive
me crazy
sometimes!
4
Resume of Part I…
How to remove Headers from the beginning of the files
How to suppress Optional Empty Elements
How to suppress Empty Lines at the end of the file
6
What to expect in Part II…
How to suppress Empty Lines everywhere (end or middle)?
What if we don’t want to remove Headers but… in fact we want to deal
with Headers and Trailers?
Do I need to always create a custom pipeline for dealing with Flat-
Files? Or it is possible to create a Generic Pipeline?
My positional flat-file contains data that does not match the length
expected and does not spaces. How can I handle that?
BizTalk Server: Teach me something new about Flat Files (or not) - Part 2
BizTalk Server: Teach me something new about Flat Files (or not) - Part 2
BizTalk Server: Teach me something new about Flat Files (or not) - Part 2

More Related Content

Similar to BizTalk Server: Teach me something new about Flat Files (or not) - Part 2

Look into Azure Active Directory
Look into Azure Active DirectoryLook into Azure Active Directory
Look into Azure Active Directory
Enrique Lima
 
Codemotion 2013 - Designing complex applications using html5 and knockoutjs
Codemotion 2013 - Designing complex applications using html5 and knockoutjsCodemotion 2013 - Designing complex applications using html5 and knockoutjs
Codemotion 2013 - Designing complex applications using html5 and knockoutjs
Fabio Franzini
 
Managing Responsive Design Projects
Managing Responsive Design ProjectsManaging Responsive Design Projects
Managing Responsive Design Projects
Andrew Smyk
 
Cerebro for advertising eng
Cerebro for advertising engCerebro for advertising eng
Cerebro for advertising eng
CineSoft
 
Project folder-structure-
Project folder-structure-Project folder-structure-
Project folder-structure-
Daniel Downs
 

Similar to BizTalk Server: Teach me something new about Flat Files (or not) - Part 2 (20)

Azure Ninja Tips and Tricks
Azure Ninja Tips and TricksAzure Ninja Tips and Tricks
Azure Ninja Tips and Tricks
 
Drupal Basics
Drupal BasicsDrupal Basics
Drupal Basics
 
Look into Azure Active Directory
Look into Azure Active DirectoryLook into Azure Active Directory
Look into Azure Active Directory
 
Managing a Project the Drupal Way - Drupal Open Days Ireland
Managing a Project the Drupal Way - Drupal Open Days IrelandManaging a Project the Drupal Way - Drupal Open Days Ireland
Managing a Project the Drupal Way - Drupal Open Days Ireland
 
eZ Summer Camp 2014: interactive dive into ez product backlog
eZ Summer Camp 2014:  interactive dive into ez product backlogeZ Summer Camp 2014:  interactive dive into ez product backlog
eZ Summer Camp 2014: interactive dive into ez product backlog
 
Turning huge ships - Open Source and Microsoft
Turning huge ships - Open Source and MicrosoftTurning huge ships - Open Source and Microsoft
Turning huge ships - Open Source and Microsoft
 
DrupalSouth 2014: Managing Complex Projects with Design Components
DrupalSouth 2014: Managing Complex Projects with Design ComponentsDrupalSouth 2014: Managing Complex Projects with Design Components
DrupalSouth 2014: Managing Complex Projects with Design Components
 
Dapper: the microORM that will change your life
Dapper: the microORM that will change your lifeDapper: the microORM that will change your life
Dapper: the microORM that will change your life
 
The web standards gentleman: a matter of (evolving) standards)
The web standards gentleman: a matter of (evolving) standards)The web standards gentleman: a matter of (evolving) standards)
The web standards gentleman: a matter of (evolving) standards)
 
Cerebro for creative teams
Cerebro for creative teamsCerebro for creative teams
Cerebro for creative teams
 
How to build the perfect pattern library
How to build the perfect pattern libraryHow to build the perfect pattern library
How to build the perfect pattern library
 
Codemotion 2013 - Designing complex applications using html5 and knockoutjs
Codemotion 2013 - Designing complex applications using html5 and knockoutjsCodemotion 2013 - Designing complex applications using html5 and knockoutjs
Codemotion 2013 - Designing complex applications using html5 and knockoutjs
 
How to do b tech be projects or any academic projects
How to do b tech be projects or any academic projectsHow to do b tech be projects or any academic projects
How to do b tech be projects or any academic projects
 
Feature folders
Feature foldersFeature folders
Feature folders
 
Managing Responsive Design Projects
Managing Responsive Design ProjectsManaging Responsive Design Projects
Managing Responsive Design Projects
 
Cerebro for advertising eng
Cerebro for advertising engCerebro for advertising eng
Cerebro for advertising eng
 
Theme customisation for beginners
Theme customisation for beginnersTheme customisation for beginners
Theme customisation for beginners
 
DocOps: Documentation at the Speed of Agile
DocOps: Documentation at the Speed of AgileDocOps: Documentation at the Speed of Agile
DocOps: Documentation at the Speed of Agile
 
MWLUG 2015 - An Introduction to MVC
MWLUG 2015 - An Introduction to MVCMWLUG 2015 - An Introduction to MVC
MWLUG 2015 - An Introduction to MVC
 
Project folder-structure-
Project folder-structure-Project folder-structure-
Project folder-structure-
 

More from BizTalk360

More from BizTalk360 (20)

Optimise Business Activity Tracking – Insights from Smurfit Kappa
Optimise Business Activity Tracking – Insights from Smurfit KappaOptimise Business Activity Tracking – Insights from Smurfit Kappa
Optimise Business Activity Tracking – Insights from Smurfit Kappa
 
Optimise Business Activity Tracking – Insights from Smurfit Kappa
Optimise Business Activity Tracking – Insights from Smurfit KappaOptimise Business Activity Tracking – Insights from Smurfit Kappa
Optimise Business Activity Tracking – Insights from Smurfit Kappa
 
What's inside "migrating to biz talk server 2020" Book (BizTalk360 Webinar)
What's inside "migrating to biz talk server 2020" Book (BizTalk360 Webinar)What's inside "migrating to biz talk server 2020" Book (BizTalk360 Webinar)
What's inside "migrating to biz talk server 2020" Book (BizTalk360 Webinar)
 
Integration Monday - Logic Apps: Development Experiences
Integration Monday - Logic Apps: Development ExperiencesIntegration Monday - Logic Apps: Development Experiences
Integration Monday - Logic Apps: Development Experiences
 
Integration Monday - BizTalk Migrator Deep Dive
Integration Monday - BizTalk Migrator Deep DiveIntegration Monday - BizTalk Migrator Deep Dive
Integration Monday - BizTalk Migrator Deep Dive
 
Testing for Logic App Solutions | Integration Monday
Testing for Logic App Solutions | Integration MondayTesting for Logic App Solutions | Integration Monday
Testing for Logic App Solutions | Integration Monday
 
No-Slides
No-SlidesNo-Slides
No-Slides
 
System Integration using Reactive Programming | Integration Monday
System Integration using Reactive Programming | Integration MondaySystem Integration using Reactive Programming | Integration Monday
System Integration using Reactive Programming | Integration Monday
 
Building workflow solution with Microsoft Azure and Cloud | Integration Monday
Building workflow solution with Microsoft Azure and Cloud | Integration MondayBuilding workflow solution with Microsoft Azure and Cloud | Integration Monday
Building workflow solution with Microsoft Azure and Cloud | Integration Monday
 
Serverless Minimalism: How to architect your apps to save 98% on your Azure b...
Serverless Minimalism: How to architect your apps to save 98% on your Azure b...Serverless Minimalism: How to architect your apps to save 98% on your Azure b...
Serverless Minimalism: How to architect your apps to save 98% on your Azure b...
 
Migrating BizTalk Solutions to Azure: Mapping Messages | Integration Monday
Migrating BizTalk Solutions to Azure: Mapping Messages | Integration MondayMigrating BizTalk Solutions to Azure: Mapping Messages | Integration Monday
Migrating BizTalk Solutions to Azure: Mapping Messages | Integration Monday
 
Integration-Monday-Infrastructure-As-Code-With-Terraform
Integration-Monday-Infrastructure-As-Code-With-TerraformIntegration-Monday-Infrastructure-As-Code-With-Terraform
Integration-Monday-Infrastructure-As-Code-With-Terraform
 
Integration-Monday-Stateful-Programming-Models-Serverless-Functions
Integration-Monday-Stateful-Programming-Models-Serverless-FunctionsIntegration-Monday-Stateful-Programming-Models-Serverless-Functions
Integration-Monday-Stateful-Programming-Models-Serverless-Functions
 
Integration-Monday-Serverless-Slackbots-with-Azure-Durable-Functions
Integration-Monday-Serverless-Slackbots-with-Azure-Durable-FunctionsIntegration-Monday-Serverless-Slackbots-with-Azure-Durable-Functions
Integration-Monday-Serverless-Slackbots-with-Azure-Durable-Functions
 
Integration-Monday-Building-Stateful-Workloads-Kubernetes
Integration-Monday-Building-Stateful-Workloads-KubernetesIntegration-Monday-Building-Stateful-Workloads-Kubernetes
Integration-Monday-Building-Stateful-Workloads-Kubernetes
 
Integration-Monday-Logic-Apps-Tips-Tricks
Integration-Monday-Logic-Apps-Tips-TricksIntegration-Monday-Logic-Apps-Tips-Tricks
Integration-Monday-Logic-Apps-Tips-Tricks
 
Integration-Monday-Terraform-Serverless
Integration-Monday-Terraform-ServerlessIntegration-Monday-Terraform-Serverless
Integration-Monday-Terraform-Serverless
 
Integration-Monday-Microsoft-Power-Platform
Integration-Monday-Microsoft-Power-PlatformIntegration-Monday-Microsoft-Power-Platform
Integration-Monday-Microsoft-Power-Platform
 
One name unify them all
One name unify them allOne name unify them all
One name unify them all
 
Securely Publishing Azure Services
Securely Publishing Azure ServicesSecurely Publishing Azure Services
Securely Publishing Azure Services
 

Recently uploaded

Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Peter Udo Diehl
 

Recently uploaded (20)

Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
Introduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG EvaluationIntroduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG Evaluation
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
 
IESVE for Early Stage Design and Planning
IESVE for Early Stage Design and PlanningIESVE for Early Stage Design and Planning
IESVE for Early Stage Design and Planning
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Optimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through ObservabilityOptimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through Observability
 
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCustom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John Staveley
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2
 
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxUnpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 

BizTalk Server: Teach me something new about Flat Files (or not) - Part 2

  • 1. BizTalk Server: Teach me something new about Flat Files (or not) – Part II Sandro Pereira linkedin.com/in/sandropereira
  • 2. Sandro Pereira Who am I? • Codeless Wizard • Microsoft Azure & Visio MVP • sandro.pereira@devscope.net • linkedin.com/in/sandropereira • @sandro_asp • https://blog.sandro-pereira.com/ • Public speaker • Book author: “BizTalk Mapping Patterns and Best Practices” +351 223 751 350 www.devscope.net
  • 3. … they simply drive me crazy sometimes!
  • 5. How to remove Headers from the beginning of the files How to suppress Optional Empty Elements How to suppress Empty Lines at the end of the file
  • 6. 6 What to expect in Part II…
  • 7. How to suppress Empty Lines everywhere (end or middle)? What if we don’t want to remove Headers but… in fact we want to deal with Headers and Trailers? Do I need to always create a custom pipeline for dealing with Flat- Files? Or it is possible to create a Generic Pipeline? My positional flat-file contains data that does not match the length expected and does not spaces. How can I handle that?

Editor's Notes

  1. Interested in all things integration – which of course includes MS Flow
  2. XML schemas define the data structure for all XML business documents that you exchange within and across organizations by using BizTalk. BizTalk also requires schemas in order to have an XML representation of the flat file messages that it will be processing. BizTalk Schemas BizTalk can use schemas provided by trading partners or created by using other third-party schema creation tools and applications. BizTalk includes tools for creating (or modifying) schemas, including schemas to be used for flat file processing. Generally speaking, it is a good idea to get in the habit of creating your schemas by using the BizTalk Editor, which will be discussed in the next lesson. The XML schema defines: Elements and attributes, which are the building blocks of a schema. Data types that appear in document instances, including simple and complex data types. Simple data types, which are data types that contain data and cannot be nested. Examples of simple data types include xs:string, xs:int, and xs:long. Elements or attributes can be simple data types. Complex data types. Complex data types can contain both data and nested data. For example, in the slide for this section, the Item element is a complex type because it contains other elements. Only elements can be complex data types; an attribute must be associated with one, and only one, element. Namespace declarations and version information. The ordering of tags in the document. Fields that are mandatory or that may occur multiple times in a single document.
  3. XML schemas define the data structure for all XML business documents that you exchange within and across organizations by using BizTalk. BizTalk also requires schemas in order to have an XML representation of the flat file messages that it will be processing. BizTalk Schemas BizTalk can use schemas provided by trading partners or created by using other third-party schema creation tools and applications. BizTalk includes tools for creating (or modifying) schemas, including schemas to be used for flat file processing. Generally speaking, it is a good idea to get in the habit of creating your schemas by using the BizTalk Editor, which will be discussed in the next lesson. The XML schema defines: Elements and attributes, which are the building blocks of a schema. Data types that appear in document instances, including simple and complex data types. Simple data types, which are data types that contain data and cannot be nested. Examples of simple data types include xs:string, xs:int, and xs:long. Elements or attributes can be simple data types. Complex data types. Complex data types can contain both data and nested data. For example, in the slide for this section, the Item element is a complex type because it contains other elements. Only elements can be complex data types; an attribute must be associated with one, and only one, element. Namespace declarations and version information. The ordering of tags in the document. Fields that are mandatory or that may occur multiple times in a single document.