SlideShare a Scribd company logo
1 of 23
Download to read offline
Migrating Deployment
and Configuration to SSIS 2012
Bhavik Merchant
Bhavik.Merchant@csg.com.au
Twitter: @BhavikMerchant

my other passions
• Cricket (Watching), Squash (Playing)
• Travelling.. Anywhere
• Whisky
Agenda

   Speaker Intro
   Goals
   Looking back
   New technologies
   Demo
   Q&A
Did I hear a chirp?

             @BhavikMerchant




                #SQLSAT140
A little about me..
 Background
     BI Team Manager and Lead MSBI Consultant at CSG
     Certified End-to-End Microsoft BI practitioner
     Microsoft vTSP for BI
     Trainer (SSAS, SSIS, SSRS, PowerPivot, Sharepoint BI)

 Experience
   Started in Web Development and SysAdmin
   Thereafter, been in BI for about 7 years. SQL 2000 to
    2012; MOSS 2007 to SP2010
Presentation Goals

 Identify config/deployment challenges in SSIS 2008 R2

 Learn about new paradigms/architecture in SSIS 2012

 Understand migration options

 Put knowledge into action via demos

 Identify pitfalls in the demos
Audience Poll
 Who is currently using
     Direct (Static) XML or SQL Server config
     Indirect (dynamic) XML or SQL Server config
     Others e.g. Registry?
     Custom configuration (e.g. script, component)


 Can anyone share a war story? I have some, more
  on this later!
History - The Direct Approach
Direct XML - Options
Direct SQL - Options
Common Problem – Moving environment

 Direct works great until you need to promote to
  TEST, PROD
   Path to XML file, or connection to SQL is hardcoded
 Things may not be consistent (shares, drive
  letters, DB names, table names)
 What you change depends on your design
  choices
   XML Config - Shared storage vs local, file naming
   SQL Config – connection strings
History - The Indirect Approach
Indirect Config

 Same concept for both XML and SQL

 Store location of XML file or connection string to
  SQL in Environment Variable

 At face value, appears to solve the environment
  crisis
Indirect is the answer?

 Hmmm… What about
     Clusters – no “localhost”
     Multiple instances on server (e.g. DEV, TEST)
     A properly secured environment – config order
     External overrides from job
     Child packages
     Metadata driven framework – custom config tables
Boiling it all Down…
What is the crux of the problem?

 There isnt any concept of a solution-wide
  configuration

 Without nifty customisation, we cant simply pick a
  set of values for an agent job

 We cannot escape environment variables, and with
  them we cant do multiple environments on a box

 Parent-child development can be restrictive
Never Fear, Our Hero Returns!
Introducing Project Deployment

 Groups an SSIS solution into a logical unit
 Different to SSIS 2005-2008R2 .. how?
    Shared entities across the Project. Will see in demo
    Lots more features for running and configuring
How to Migrate? - Option 1

 If it aint broke, don’t fix it – legacy config
 It really is time for a DEMO!
How to Migrate? - Option 2

 Convert to Project Deployment Model

 Another DEMO!
     Projects
     Parameters
     Project Connections
     Parameters and Solution Configurations
Deployment

 Final DEMO
   The SSIS Catalog
   Configurations and Execution
   Environments
Benefits of the New Model
 Proper support for environments
= simplified deployment and maintenance
= no hacking the default SQL config
= multiple instances no longer an issue

 Reduced use of variables
= cleaner package, variables more traditionally

 Configurations are managed centrally
= easier development and debugging
Resources
 Intro series to new SSIS features:
http://blogs.msdn.com/b/mattm/archive/2011/07/
12/30-days-of-ssis.aspx
 Jamie Thomson’s great mostly SSIS blog:
http://sqlblog.com/blogs/jamie_thomson/
 Microsoft SSIS 2012 migration tips:
http://msdn.microsoft.com/en-
us/library/hh667275.aspx
Questions?
 Please complete an evaluation form for this session
    …and thanks again to our awesome sponsors!

More Related Content

Similar to 2012-04-28 (SQL Saturday 140 Perth) Migrating Deployment and Config to SSIS 2012_merchant

new resume of Database Administrator
new resume of Database Administratornew resume of Database Administrator
new resume of Database Administrator
Getahun Gebremariam
 
Satwinder SQL.SSK_Brd_2015
Satwinder SQL.SSK_Brd_2015Satwinder SQL.SSK_Brd_2015
Satwinder SQL.SSK_Brd_2015
Satwinder Khural
 
Resume-pradeep SQL DBA
Resume-pradeep SQL DBAResume-pradeep SQL DBA
Resume-pradeep SQL DBA
Pradeep GP
 
ETL Developer Resume
ETL Developer ResumeETL Developer Resume
ETL Developer Resume
Teferi Tamiru
 

Similar to 2012-04-28 (SQL Saturday 140 Perth) Migrating Deployment and Config to SSIS 2012_merchant (20)

SriramadeviResume_Updated1
SriramadeviResume_Updated1SriramadeviResume_Updated1
SriramadeviResume_Updated1
 
SriramadeviResume
SriramadeviResumeSriramadeviResume
SriramadeviResume
 
Senior database administrator
Senior database administratorSenior database administrator
Senior database administrator
 
new resume of Database Administrator
new resume of Database Administratornew resume of Database Administrator
new resume of Database Administrator
 
Satwinder SQL.SSK_Brd_2015
Satwinder SQL.SSK_Brd_2015Satwinder SQL.SSK_Brd_2015
Satwinder SQL.SSK_Brd_2015
 
Day2
Day2Day2
Day2
 
Resume-pradeep SQL DBA
Resume-pradeep SQL DBAResume-pradeep SQL DBA
Resume-pradeep SQL DBA
 
Praveen Kumar Resume
Praveen Kumar ResumePraveen Kumar Resume
Praveen Kumar Resume
 
ETL Developer Resume
ETL Developer ResumeETL Developer Resume
ETL Developer Resume
 
It ready dw_day3_rev00
It ready dw_day3_rev00It ready dw_day3_rev00
It ready dw_day3_rev00
 
CV Chandrajit Samanta
CV Chandrajit SamantaCV Chandrajit Samanta
CV Chandrajit Samanta
 
Azure DevOps for Developers
Azure DevOps for DevelopersAzure DevOps for Developers
Azure DevOps for Developers
 
Top new ssis 2012 features
Top new ssis 2012 featuresTop new ssis 2012 features
Top new ssis 2012 features
 
Alejandro_Laverdet - EN
Alejandro_Laverdet - ENAlejandro_Laverdet - EN
Alejandro_Laverdet - EN
 
Getting Your DB Schema Under Control With SSDT.pptx
Getting Your DB Schema Under Control With SSDT.pptxGetting Your DB Schema Under Control With SSDT.pptx
Getting Your DB Schema Under Control With SSDT.pptx
 
NiveditaResumeDBA
NiveditaResumeDBA NiveditaResumeDBA
NiveditaResumeDBA
 
suri sql sevrer dba
suri sql sevrer dbasuri sql sevrer dba
suri sql sevrer dba
 
Data modeling star schema
Data modeling star schemaData modeling star schema
Data modeling star schema
 
Be a database professional
Be a database professionalBe a database professional
Be a database professional
 
Be a database professional
Be a database professionalBe a database professional
Be a database professional
 

Recently uploaded

Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 

Recently uploaded (20)

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Cyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfCyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdf
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 

2012-04-28 (SQL Saturday 140 Perth) Migrating Deployment and Config to SSIS 2012_merchant

  • 1. Migrating Deployment and Configuration to SSIS 2012 Bhavik Merchant Bhavik.Merchant@csg.com.au Twitter: @BhavikMerchant my other passions • Cricket (Watching), Squash (Playing) • Travelling.. Anywhere • Whisky
  • 2. Agenda  Speaker Intro  Goals  Looking back  New technologies  Demo  Q&A
  • 3. Did I hear a chirp? @BhavikMerchant #SQLSAT140
  • 4. A little about me..  Background  BI Team Manager and Lead MSBI Consultant at CSG  Certified End-to-End Microsoft BI practitioner  Microsoft vTSP for BI  Trainer (SSAS, SSIS, SSRS, PowerPivot, Sharepoint BI)  Experience  Started in Web Development and SysAdmin  Thereafter, been in BI for about 7 years. SQL 2000 to 2012; MOSS 2007 to SP2010
  • 5. Presentation Goals  Identify config/deployment challenges in SSIS 2008 R2  Learn about new paradigms/architecture in SSIS 2012  Understand migration options  Put knowledge into action via demos  Identify pitfalls in the demos
  • 6. Audience Poll  Who is currently using  Direct (Static) XML or SQL Server config  Indirect (dynamic) XML or SQL Server config  Others e.g. Registry?  Custom configuration (e.g. script, component)  Can anyone share a war story? I have some, more on this later!
  • 7. History - The Direct Approach
  • 8. Direct XML - Options
  • 9. Direct SQL - Options
  • 10. Common Problem – Moving environment  Direct works great until you need to promote to TEST, PROD  Path to XML file, or connection to SQL is hardcoded  Things may not be consistent (shares, drive letters, DB names, table names)  What you change depends on your design choices  XML Config - Shared storage vs local, file naming  SQL Config – connection strings
  • 11. History - The Indirect Approach
  • 12. Indirect Config  Same concept for both XML and SQL  Store location of XML file or connection string to SQL in Environment Variable  At face value, appears to solve the environment crisis
  • 13. Indirect is the answer?  Hmmm… What about  Clusters – no “localhost”  Multiple instances on server (e.g. DEV, TEST)  A properly secured environment – config order  External overrides from job  Child packages  Metadata driven framework – custom config tables
  • 14. Boiling it all Down…
  • 15. What is the crux of the problem?  There isnt any concept of a solution-wide configuration  Without nifty customisation, we cant simply pick a set of values for an agent job  We cannot escape environment variables, and with them we cant do multiple environments on a box  Parent-child development can be restrictive
  • 16. Never Fear, Our Hero Returns!
  • 17. Introducing Project Deployment  Groups an SSIS solution into a logical unit  Different to SSIS 2005-2008R2 .. how?  Shared entities across the Project. Will see in demo  Lots more features for running and configuring
  • 18. How to Migrate? - Option 1  If it aint broke, don’t fix it – legacy config  It really is time for a DEMO!
  • 19. How to Migrate? - Option 2  Convert to Project Deployment Model  Another DEMO!  Projects  Parameters  Project Connections  Parameters and Solution Configurations
  • 20. Deployment  Final DEMO  The SSIS Catalog  Configurations and Execution  Environments
  • 21. Benefits of the New Model  Proper support for environments = simplified deployment and maintenance = no hacking the default SQL config = multiple instances no longer an issue  Reduced use of variables = cleaner package, variables more traditionally  Configurations are managed centrally = easier development and debugging
  • 22. Resources  Intro series to new SSIS features: http://blogs.msdn.com/b/mattm/archive/2011/07/ 12/30-days-of-ssis.aspx  Jamie Thomson’s great mostly SSIS blog: http://sqlblog.com/blogs/jamie_thomson/  Microsoft SSIS 2012 migration tips: http://msdn.microsoft.com/en- us/library/hh667275.aspx
  • 23. Questions? Please complete an evaluation form for this session …and thanks again to our awesome sponsors!