SlideShare a Scribd company logo
1 Practical Guidance for Large Scale Migrations public
Practical Guidance for Large Scale Migrations 
SharePoint vNext: The true Story of a bulk migration 
Andries den HaanNovember 2014
A brief personal introduction 
•Working in IT since 1999 
•Passionate about portals, collaboration and social media 
•Certified expert on Microsoft SharePoint products and technologies 
•Focus on business processes optimization, platform infrastructure, migrations and governance 
•Contact details: 
•andries.denhaan@kpn.com 
•www.twitter.com/awdhaan 
•www.linkedin.com/in/andriesdenhaan 
•www.slideshare.net/awdhaan. 
3 Practical Guidance for Large Scale Migrations public
…and working at KPN Consulting 
•Veterans when it comes to the web, enterprise search, corporate portals, content management and information worker solutions 
•The current Web, Apps and Data team is the typical “Gallic village” within the greater KPN 
•Part of Application Services (ERP/Applications/Testing) 
•Not only SharePoint, but also: 
•Mobile Apps (TEDx Amsterdam, Bijenradar) 
•Application frameworks (Amber Alert) 
•Content management (Tridion, Orchard). 
4 Practical Guidance for Large Scale Migrations public
What you can expect from this session 
•A true story on how we approach(ed) large scale legacy SharePoint migration projects 
•How to deal with common pitfalls 
•Working with 3rdparty tools and extending them to fit our needs 
•Lessons learned on choices we’ve made and issues we solved along the way. 
5 Practical Guidance for Large Scale Migrations public
Agenda 
•Setting the scene 
•Our approach 
•Tooling choices 
•Challenges along the way 
•Lessons learned 
6 Practical Guidance for Large Scale Migrations public
Our mission: “Migrate 4 TB in 2.5 Months!” 
7 Practical Guidance for Large Scale Migrations public 
Our mission: Migrate 4 TB in 2.5 Months! 
•Andries den Haan (project leader, lead consultant) 
•Mathijs Vlasveld (SharePoint developer) 
•Terence Bahlen (SharePoint developer) 
•Neal de Jel (SharePoint developer).
Prior to the project, a site survey was performed to gain insight on the state of things 
•Microsoft SharePoint Portal Server 2003 
•Some metrics: 
•3-tier topology (2 WFE’s, 1 APP) 
•Total data volume: 4.5 TB 
•Approx. 12.000 site collections 
•Data gathered via: 
•Microsoft tooling (stsadm) 
•Database queries (and being naughty by doing so) 
•Typical tooling (e.g. Windiff, SPSitemanager) 
•Server, web.configscan (manual ) 
•Site owner interviews (e.g. for special sites). 
8 Practical Guidance for Large Scale Migrations public
The site survey showed some interesting challenges to be expected during the migration 
•Support effort focused on availability 
•No governance model: 
•Unlimited site growth 
•2 GB file uploads possible 
•No blocked file types 
•Multiple site collections above 300 GB 
•Large sites within the same database 
•A fair amount of orphaned items 
•Custom site definitions and web parts (used in over 6.000 site collections). 
9 Practical Guidance for Large Scale Migrations public
Main project drivers 
10 Practical Guidance for Large Scale Migrations public 
Main project drivers: 
•Clean-up and restructure required 
•The existing SharePoint version was not able to keep up with evolving user requirements 
•Software and hardware end-of-life (duh!) 
•Improve on governance and support.
Customer expectations were straight forward! 
11 Practical Guidance for Large Scale Migrations public 
Customer expectations were straight forward!
The migration was to be finished before the end of the year! 
12 Practical Guidance for Large Scale Migrations public 
The migration was to be finished before the end of the year!
The urgency to migrate was also driven by the state 
13 Practical Guidance for Large Scale Migrations public 
The urgency to migrate was also driven by the state of the data: 
a warehouse in need of a clean-up and restructure!
Our customer’s expectations were clear and simple, avoid disrupting daily business! 
14 Practical Guidance for Large Scale Migrations public 
Business continuity was key: 
Avoid disrupting daily business!
Risks 
15 Practical Guidance for Large Scale Migrations public 
This mission was not without impediments: 
•No changes to the source system allowed! 
•Limited support on the current environment 
•Custom coded site definitions and web parts 
•Migration performance (and how to plan on this) 
•How to handle obsolete data or sites without ownership.
Our approach was based on an extensive preparation phase and Agile SCRUM principles 
16 Practical Guidance for Large Scale Migrations public 
Preparation(site survey) Go LiveStartlocks andmigrationsDailystand-upPreparebatch jobsPre and post migration issue relatedtasksMonitoring and sleep  MigrationResultchecksDaily cyclePost-migration(decommissioning) Ongoing migrations
Why did we choose 3rdparty tooling to support the migration? 
•No direct upgrade path from SharePoint Portal Server 2003 to SharePoint Server 2010 
•Required clean-up and restructure 
•Pressure to deliver within a short timeframe 
•Migration requirements: 
•Preservation of (system)metadata and permissions 
•Speed: optimize the throughput to meet our deadline 
•Mapping of old and new sites or definitions, content types, lists or web parts 
•Granularity (sometimes only a sub site/list/specific item may require migration) 
•Filtering (e.g. on date or other properties) 
•Support for full and incremental (bulk) migrations. 
17 Practical Guidance for Large Scale Migrations public
The AvePoint DocAve platform provided us with the tools needed to get the job done 
•Track record(including large scale Microsoft IT migration) 
•Rich set of migration (and content mgt.) capabilities 
•Acceptable software costs 
•Warm response to vendor inquiry 
•Handling of support requests prior and during the project. 
Extensions required to optimize the bulk migration process! 
18 Practical Guidance for Large Scale Migrations public
We built a custom batch builder tool to support planning and reporting of ongoing migrations 
We extended the DocAve tooling to optimize bulk migration planning and reporting: 
•Import unscheduled sites from the migration to-do list matching the amount of data that could be processed within a service window 
•Choose target database (allowing for redistribution of site collections) 
•Create DocAve batch migration configuration job files for the selected sites 
•Check on potential issues prior to migration 
•Generate mapping files for automated redirects and various scripts 
•Read back migration job reports from DocAve and update the To-do list. 
19 Practical Guidance for Large Scale Migrations public
A public to-do list allowed the migration team to plan bulk migrations and report on progress 
•Just a SharePoint list with relevant columns to describe the state of the sites in the context of the migration 
•Sites may have an (un)scheduled, migrated or ignored state 
•Site owners able to check planning and migration result of sites through search 
•Open communication to all stakeholders. 
20 Practical Guidance for Large Scale Migrations public
The same list was also used to report progress to the project owner 
•The project owner had a transparent view on migration progress and possible issues on a daily basis 
•The list was also used to comply with the acceptance criteria for project closure (our definition of done). 
21 Practical Guidance for Large Scale Migrations public
Our Batch builder tool supports the selection of sites from the to-do list for bulk job creation 
22 Practical Guidance for Large Scale Migrations public
The Batch builder tool also provides the creation of other batch files or data checks 
•Setting sites to read-only or (un)lock scripts 
•mappings.csv for URL redirection or sites.txt to activate a notification bar feature 
•Check if sites exists or other pre-checks (e.g. too long URL’s or large files/lists) and export reports to share with site owners or the migration team. 
23 Practical Guidance for Large Scale Migrations public
After the migration, the Batch builder tool provides a means of bulk reporting 
•Import DocAve migration job reports to update the to-do list for successful, failed or migrations with exceptions and overall progress reporting 
•Additionally add comments about e.g. exceptions, delayed go live or reschedule. 
24 Practical Guidance for Large Scale Migrations public
Our migration setup was built for both performance and flexibility 
25 Practical Guidance for Large Scale Migrations public 
SharePoint 2003 
Collaboration farm 
DOCAVE 
AGENT 
DOCAVE 
AGENT 
Batch builder tool 
SharePoint 2010 
Collaboration farm 
DOCAVE 
AGENT 
DOCAVE 
AGENT 
WFE1 
WFE2 
WFE1 
WFE2 
3.75 GB per hour per agent set 
To-do list 
SharePoint 2010Legal content farm 
DOCAVE 
AGENT 
DOCAVE 
AGENT 
WFE1 
WFE2 
DocAve management server
A custom C# script in the global.asax on each source WFE selectively redirects user requests 
•Custom code was added to the global.asax of each web application in the source environment 
•Using a mappings.csv file with a source and target URL value pair on each line 
•All requests for a specific URL (and below) were redirected to the new site 
•Appended with each new migration 
•Low server resource usage(tested with 10.000+ entries) 
•Not applicable to web folder mappings. 
26 Practical Guidance for Large Scale Migrations public
Migrated sites temporarily show a custom notification bar linking to the migration info site 
•Site collection feature displaying a custom message in the notification bar area 
•Only visible for migrated sites (not for new ones) 
•Bulk feature activation using the Batch builder tool 
•Removed after the migration project finished. 
27 Practical Guidance for Large Scale Migrations public
Migrations performed via a standard operating procedure 
•Prior to the migration, each site collection is set to read-only 
•To finalize a successful migration, no-access locks and redirects are set for the old sites and notification bars enabled for the new sites 
•In case of a roll-back, the redirect and notification bar functions are not enabled and the source site is set back to read/write. 
28 Practical Guidance for Large Scale Migrations public 
Content freeze 
Execute migration job 
Enabled redirect and notification bar 
Go live! 
Validate migration- result 
Prepare migrations
The daily cycle for the team during the 2.5 month migration period 
•Daily migrations (standard sites) from Monday to Friday (18:00-7:00) 
•Weekends (special cases or large sites) 
•Last 2 weeks: Legal case sites (24/7). 
29 Practical Guidance for Large Scale Migrations public 
7:00 
8:00 
16:00 
9:00-15:00 
Migration result checks 
Daily check-in (stand-up) 
Pre and post migration issue related tasks 
Prepare batch jobs 
18:00 
Start locks and migrations
Our challenges and solutions 
30 Practical Guidance for Large Scale Migrations public 
Common challenges along the way: 
•Extra large file uploads not possible in the new farm 
•Blocked file types (so MP3’s, .EXE files, VB scripts, …) 
•Supersized site collections (over 200 GB) 
•Large lists (slow migration).
But we also had some unexpected challenges 
For reasons still unknown the migration of a large site collection (100+ webs) had an unexpected result: 
•Each library URL in the site collection was named after the first folder or item within that library 
•Resolved by using a database query (being naughty again ) in the source system to get the original library URL’s and PowerShell to “system”updatethe library URL’s in bulk ($list.RootFolder.MoveTo($listUrl)) 
•Apart from this the migration was successful . 
31 Practical Guidance for Large Scale Migrations public
We saved the biggest challenge for last: migrating 5.000+ customized legal case sites 
•24/7 migration jobs during 15 days for only 100 GB (# of objects overrules size) 
•Some jobs spanning multiple days 
•Site definition/content type/field type mapping and obsolete web part removal. 
32 Practical Guidance for Large Scale Migrations public
Highlights of a successful project 
•2.220 sites (4.1 TB) migrated in 2.5 months 
•5.681 customized sites migrated within the last 2 weeks 
•Creative solutions for (un)expected challenges 
•Project delivery within time and budget 
•Effective collaboration with the other teams: 
•Adaptation 
•Infrastructure 
•Offshore support 
•AvePoint support. 
33 Practical Guidance for Large Scale Migrations public
The secret of our success is based on a small dedicated team with a clear mission and process 
•Customer oriented SCRUM-like approach(business continuity) 
•Sufficient and open communication to site owners and stakeholders 
•A very robust, but flexible migration process 
•Ensuring the right tools for the job (consider homemade) 
•Frequent team stand-up meetings regarding progress, impediments and solutions 
•Leveraging our knowledge, creativity and Windows PowerShell to solve the encountered issues 
•Reusable for an upcoming SharePoint 2007-2013 migration. 
34 Practical Guidance for Large Scale Migrations public
Connect | Share | Discover 
Would you like to know more? 
andries.denhaan@kpn.com
36 Practical Guidance for Large Scale Migrations public

More Related Content

What's hot

Real-time Data Warehouse Upgrade – Success Stories
Real-time Data Warehouse Upgrade – Success StoriesReal-time Data Warehouse Upgrade – Success Stories
Real-time Data Warehouse Upgrade – Success Stories
Michael Rainey
 
HDF Powered by Apache NiFi Introduction
HDF Powered by Apache NiFi IntroductionHDF Powered by Apache NiFi Introduction
HDF Powered by Apache NiFi Introduction
Milind Pandit
 
Hortonworks DataFlow & Apache Nifi @Oslo Hadoop Big Data
Hortonworks DataFlow & Apache Nifi @Oslo Hadoop Big DataHortonworks DataFlow & Apache Nifi @Oslo Hadoop Big Data
Hortonworks DataFlow & Apache Nifi @Oslo Hadoop Big Data
Mats Johansson
 
Synchronicity of a distributed financial system
Synchronicity of a distributed financial systemSynchronicity of a distributed financial system
Synchronicity of a distributed financial system
DataWorks Summit
 
Joe witt may2015_kafka_nyc_apachenifi-overview
Joe witt may2015_kafka_nyc_apachenifi-overviewJoe witt may2015_kafka_nyc_apachenifi-overview
Joe witt may2015_kafka_nyc_apachenifi-overview
Joseph Witt
 
Large Scale Production DITA landscape @SAP
Large Scale Production DITA landscape @SAPLarge Scale Production DITA landscape @SAP
Large Scale Production DITA landscape @SAP
Youssef Bennani
 
MiNiFi 0.0.1 MeetUp talk
MiNiFi 0.0.1 MeetUp talkMiNiFi 0.0.1 MeetUp talk
MiNiFi 0.0.1 MeetUp talk
Joe Percivall
 
Introduction to Apache NiFi - Seattle Scalability Meetup
Introduction to Apache NiFi - Seattle Scalability MeetupIntroduction to Apache NiFi - Seattle Scalability Meetup
Introduction to Apache NiFi - Seattle Scalability Meetup
Saptak Sen
 
Successes, Challenges, and Pitfalls Migrating a SAAS business to Hadoop
Successes, Challenges, and Pitfalls Migrating a SAAS business to HadoopSuccesses, Challenges, and Pitfalls Migrating a SAAS business to Hadoop
Successes, Challenges, and Pitfalls Migrating a SAAS business to Hadoop
DataWorks Summit/Hadoop Summit
 
Rebuilding Web Tracking Infrastructure for Scale
Rebuilding Web Tracking Infrastructure for ScaleRebuilding Web Tracking Infrastructure for Scale
Rebuilding Web Tracking Infrastructure for Scale
DataWorks Summit/Hadoop Summit
 
Taking DataFlow Management to the Edge with Apache NiFi/MiNiFi
Taking DataFlow Management to the Edge with Apache NiFi/MiNiFiTaking DataFlow Management to the Edge with Apache NiFi/MiNiFi
Taking DataFlow Management to the Edge with Apache NiFi/MiNiFi
Bryan Bende
 
Practical Tips for Oracle Business Intelligence Applications 11g Implementations
Practical Tips for Oracle Business Intelligence Applications 11g ImplementationsPractical Tips for Oracle Business Intelligence Applications 11g Implementations
Practical Tips for Oracle Business Intelligence Applications 11g Implementations
Michael Rainey
 
OBIEE12c and Embedded Essbase 12c - An Initial Look at Query Acceleration Use...
OBIEE12c and Embedded Essbase 12c - An Initial Look at Query Acceleration Use...OBIEE12c and Embedded Essbase 12c - An Initial Look at Query Acceleration Use...
OBIEE12c and Embedded Essbase 12c - An Initial Look at Query Acceleration Use...
Mark Rittman
 
Deploying Full BI Platforms to Oracle Cloud
Deploying Full BI Platforms to Oracle CloudDeploying Full BI Platforms to Oracle Cloud
Deploying Full BI Platforms to Oracle Cloud
Mark Rittman
 
Oracle data integrator 12c - getting started
Oracle data integrator 12c - getting startedOracle data integrator 12c - getting started
Oracle data integrator 12c - getting started
Michael Rainey
 
Nifi workshop
Nifi workshopNifi workshop
Nifi workshop
Yifeng Jiang
 
Hortonworks Data in Motion Webinar Series - Part 1
Hortonworks Data in Motion Webinar Series - Part 1Hortonworks Data in Motion Webinar Series - Part 1
Hortonworks Data in Motion Webinar Series - Part 1
Hortonworks
 
Oracle Data Integrator 12c - Getting Started
Oracle Data Integrator 12c - Getting StartedOracle Data Integrator 12c - Getting Started
Oracle Data Integrator 12c - Getting Started
Michael Rainey
 
Breathing New Life into Apache Oozie with Apache Ambari Workflow Manager
Breathing New Life into Apache Oozie with Apache Ambari Workflow ManagerBreathing New Life into Apache Oozie with Apache Ambari Workflow Manager
Breathing New Life into Apache Oozie with Apache Ambari Workflow Manager
DataWorks Summit
 
Log Analytics Optimization
Log Analytics OptimizationLog Analytics Optimization
Log Analytics Optimization
Hortonworks
 

What's hot (20)

Real-time Data Warehouse Upgrade – Success Stories
Real-time Data Warehouse Upgrade – Success StoriesReal-time Data Warehouse Upgrade – Success Stories
Real-time Data Warehouse Upgrade – Success Stories
 
HDF Powered by Apache NiFi Introduction
HDF Powered by Apache NiFi IntroductionHDF Powered by Apache NiFi Introduction
HDF Powered by Apache NiFi Introduction
 
Hortonworks DataFlow & Apache Nifi @Oslo Hadoop Big Data
Hortonworks DataFlow & Apache Nifi @Oslo Hadoop Big DataHortonworks DataFlow & Apache Nifi @Oslo Hadoop Big Data
Hortonworks DataFlow & Apache Nifi @Oslo Hadoop Big Data
 
Synchronicity of a distributed financial system
Synchronicity of a distributed financial systemSynchronicity of a distributed financial system
Synchronicity of a distributed financial system
 
Joe witt may2015_kafka_nyc_apachenifi-overview
Joe witt may2015_kafka_nyc_apachenifi-overviewJoe witt may2015_kafka_nyc_apachenifi-overview
Joe witt may2015_kafka_nyc_apachenifi-overview
 
Large Scale Production DITA landscape @SAP
Large Scale Production DITA landscape @SAPLarge Scale Production DITA landscape @SAP
Large Scale Production DITA landscape @SAP
 
MiNiFi 0.0.1 MeetUp talk
MiNiFi 0.0.1 MeetUp talkMiNiFi 0.0.1 MeetUp talk
MiNiFi 0.0.1 MeetUp talk
 
Introduction to Apache NiFi - Seattle Scalability Meetup
Introduction to Apache NiFi - Seattle Scalability MeetupIntroduction to Apache NiFi - Seattle Scalability Meetup
Introduction to Apache NiFi - Seattle Scalability Meetup
 
Successes, Challenges, and Pitfalls Migrating a SAAS business to Hadoop
Successes, Challenges, and Pitfalls Migrating a SAAS business to HadoopSuccesses, Challenges, and Pitfalls Migrating a SAAS business to Hadoop
Successes, Challenges, and Pitfalls Migrating a SAAS business to Hadoop
 
Rebuilding Web Tracking Infrastructure for Scale
Rebuilding Web Tracking Infrastructure for ScaleRebuilding Web Tracking Infrastructure for Scale
Rebuilding Web Tracking Infrastructure for Scale
 
Taking DataFlow Management to the Edge with Apache NiFi/MiNiFi
Taking DataFlow Management to the Edge with Apache NiFi/MiNiFiTaking DataFlow Management to the Edge with Apache NiFi/MiNiFi
Taking DataFlow Management to the Edge with Apache NiFi/MiNiFi
 
Practical Tips for Oracle Business Intelligence Applications 11g Implementations
Practical Tips for Oracle Business Intelligence Applications 11g ImplementationsPractical Tips for Oracle Business Intelligence Applications 11g Implementations
Practical Tips for Oracle Business Intelligence Applications 11g Implementations
 
OBIEE12c and Embedded Essbase 12c - An Initial Look at Query Acceleration Use...
OBIEE12c and Embedded Essbase 12c - An Initial Look at Query Acceleration Use...OBIEE12c and Embedded Essbase 12c - An Initial Look at Query Acceleration Use...
OBIEE12c and Embedded Essbase 12c - An Initial Look at Query Acceleration Use...
 
Deploying Full BI Platforms to Oracle Cloud
Deploying Full BI Platforms to Oracle CloudDeploying Full BI Platforms to Oracle Cloud
Deploying Full BI Platforms to Oracle Cloud
 
Oracle data integrator 12c - getting started
Oracle data integrator 12c - getting startedOracle data integrator 12c - getting started
Oracle data integrator 12c - getting started
 
Nifi workshop
Nifi workshopNifi workshop
Nifi workshop
 
Hortonworks Data in Motion Webinar Series - Part 1
Hortonworks Data in Motion Webinar Series - Part 1Hortonworks Data in Motion Webinar Series - Part 1
Hortonworks Data in Motion Webinar Series - Part 1
 
Oracle Data Integrator 12c - Getting Started
Oracle Data Integrator 12c - Getting StartedOracle Data Integrator 12c - Getting Started
Oracle Data Integrator 12c - Getting Started
 
Breathing New Life into Apache Oozie with Apache Ambari Workflow Manager
Breathing New Life into Apache Oozie with Apache Ambari Workflow ManagerBreathing New Life into Apache Oozie with Apache Ambari Workflow Manager
Breathing New Life into Apache Oozie with Apache Ambari Workflow Manager
 
Log Analytics Optimization
Log Analytics OptimizationLog Analytics Optimization
Log Analytics Optimization
 

Viewers also liked

Ccd adventures technology presentation 02 2014 final
Ccd adventures technology presentation 02 2014 finalCcd adventures technology presentation 02 2014 final
Ccd adventures technology presentation 02 2014 final
Lorrie Evans
 
Elements of a plot diagram
Elements of a plot diagramElements of a plot diagram
Elements of a plot diagram
Kevin Yates
 
Metroleads jan 2013 presentation
Metroleads jan 2013 presentationMetroleads jan 2013 presentation
Metroleads jan 2013 presentation
Lorrie Evans
 
Music presentation
Music presentationMusic presentation
Music presentation
danielle batchelor
 
Case rates presentation gen rules
Case rates presentation gen rules Case rates presentation gen rules
Case rates presentation gen rules
Francis Philip Duremdes Doromal
 
Presentation for IT 101
Presentation for IT 101Presentation for IT 101
Presentation for IT 101
Steve Nguyen
 
Icd updt
Icd updtIcd updt
Deploying the share point user profile service
Deploying the share point user profile serviceDeploying the share point user profile service
Deploying the share point user profile service
Andries den Haan
 
Posterworkshop Auraria Library
Posterworkshop Auraria LibraryPosterworkshop Auraria Library
Posterworkshop Auraria Library
Lorrie Evans
 
Salmos 34
Salmos 34Salmos 34
Salmos 34
Luz DeMorla
 
Legal aspects up hospital administrators lect[1]
Legal aspects up hospital administrators lect[1]Legal aspects up hospital administrators lect[1]
Legal aspects up hospital administrators lect[1]
Francis Philip Duremdes Doromal
 
Imroving profitability through nncc operation
Imroving profitability through nncc operationImroving profitability through nncc operation
Imroving profitability through nncc operation
Francis Philip Duremdes Doromal
 
Activity based costing
Activity based costingActivity based costing
Activity based costing
Prakash D
 
Budget planning and management
Budget planning and managementBudget planning and management
Budget planning and management
Francis Philip Duremdes Doromal
 
SSB Interview
SSB InterviewSSB Interview
SSB Interview
Neeraj Dwivedi
 
Maintenance, Management & Planning of Hospital Facilities
Maintenance, Management & Planning of Hospital FacilitiesMaintenance, Management & Planning of Hospital Facilities
Maintenance, Management & Planning of Hospital Facilities
Francis Philip Duremdes Doromal
 

Viewers also liked (16)

Ccd adventures technology presentation 02 2014 final
Ccd adventures technology presentation 02 2014 finalCcd adventures technology presentation 02 2014 final
Ccd adventures technology presentation 02 2014 final
 
Elements of a plot diagram
Elements of a plot diagramElements of a plot diagram
Elements of a plot diagram
 
Metroleads jan 2013 presentation
Metroleads jan 2013 presentationMetroleads jan 2013 presentation
Metroleads jan 2013 presentation
 
Music presentation
Music presentationMusic presentation
Music presentation
 
Case rates presentation gen rules
Case rates presentation gen rules Case rates presentation gen rules
Case rates presentation gen rules
 
Presentation for IT 101
Presentation for IT 101Presentation for IT 101
Presentation for IT 101
 
Icd updt
Icd updtIcd updt
Icd updt
 
Deploying the share point user profile service
Deploying the share point user profile serviceDeploying the share point user profile service
Deploying the share point user profile service
 
Posterworkshop Auraria Library
Posterworkshop Auraria LibraryPosterworkshop Auraria Library
Posterworkshop Auraria Library
 
Salmos 34
Salmos 34Salmos 34
Salmos 34
 
Legal aspects up hospital administrators lect[1]
Legal aspects up hospital administrators lect[1]Legal aspects up hospital administrators lect[1]
Legal aspects up hospital administrators lect[1]
 
Imroving profitability through nncc operation
Imroving profitability through nncc operationImroving profitability through nncc operation
Imroving profitability through nncc operation
 
Activity based costing
Activity based costingActivity based costing
Activity based costing
 
Budget planning and management
Budget planning and managementBudget planning and management
Budget planning and management
 
SSB Interview
SSB InterviewSSB Interview
SSB Interview
 
Maintenance, Management & Planning of Hospital Facilities
Maintenance, Management & Planning of Hospital FacilitiesMaintenance, Management & Planning of Hospital Facilities
Maintenance, Management & Planning of Hospital Facilities
 

Similar to Practical large scale migration guidance

Techniques for scaling application with security and visibility in cloud
Techniques for scaling application with security and visibility in cloudTechniques for scaling application with security and visibility in cloud
Techniques for scaling application with security and visibility in cloud
Akshay Mathur
 
SPTechCon Austin - The Slippery Slope of SharePoint Migrations
SPTechCon Austin - The Slippery Slope of SharePoint MigrationsSPTechCon Austin - The Slippery Slope of SharePoint Migrations
SPTechCon Austin - The Slippery Slope of SharePoint Migrations
Jill Hannemann
 
Performing successful migrations to the microsoft cloud
Performing successful migrations to the microsoft cloudPerforming successful migrations to the microsoft cloud
Performing successful migrations to the microsoft cloud
Andries den Haan
 
Putting the Ops in DataOps: Orchestrate the Flow of Data Across Data Pipelines
Putting the Ops in DataOps: Orchestrate the Flow of Data Across Data PipelinesPutting the Ops in DataOps: Orchestrate the Flow of Data Across Data Pipelines
Putting the Ops in DataOps: Orchestrate the Flow of Data Across Data Pipelines
DATAVERSITY
 
Capstone presentation
Capstone presentationCapstone presentation
Capstone presentation
Vikal Gupta
 
Big Data Ingestion Using Hadoop - Capstone Presentation
Big Data Ingestion Using Hadoop - Capstone PresentationBig Data Ingestion Using Hadoop - Capstone Presentation
Big Data Ingestion Using Hadoop - Capstone Presentation
Samkannan
 
Initiative Based Technology Consulting Case Studies
Initiative Based Technology Consulting Case StudiesInitiative Based Technology Consulting Case Studies
Initiative Based Technology Consulting Case Studies
chanderdw
 
An overview of modern scalable web development
An overview of modern scalable web developmentAn overview of modern scalable web development
An overview of modern scalable web development
Tung Nguyen
 
Tips and tricks for complex migrations to SharePoint Online
Tips and tricks for complex migrations to SharePoint OnlineTips and tricks for complex migrations to SharePoint Online
Tips and tricks for complex migrations to SharePoint Online
Andries den Haan
 
Cloud-Native Data: What data questions to ask when building cloud-native apps
Cloud-Native Data: What data questions to ask when building cloud-native appsCloud-Native Data: What data questions to ask when building cloud-native apps
Cloud-Native Data: What data questions to ask when building cloud-native apps
VMware Tanzu
 
Engage 2020-nerd-for-move-on-from-x pages
Engage 2020-nerd-for-move-on-from-x pagesEngage 2020-nerd-for-move-on-from-x pages
Engage 2020-nerd-for-move-on-from-x pages
Heiko Voigt
 
Big data meet_up_08042016
Big data meet_up_08042016Big data meet_up_08042016
Big data meet_up_08042016
Mark Smith
 
SharePoint Migration-What you need to know
SharePoint Migration-What you need to knowSharePoint Migration-What you need to know
SharePoint Migration-What you need to know
Oliver Wirkus
 
Streamline Cognos Migrations & Consolidations
Streamline Cognos Migrations & ConsolidationsStreamline Cognos Migrations & Consolidations
Streamline Cognos Migrations & Consolidations
Senturus
 
Webinar: The Slippery Slope of Migrating to SharePoint Online or On-Premise
Webinar: The Slippery Slope of Migrating to SharePoint Online or On-PremiseWebinar: The Slippery Slope of Migrating to SharePoint Online or On-Premise
Webinar: The Slippery Slope of Migrating to SharePoint Online or On-Premise
WithumSmith+Brown, formerly Portal Solutions
 
How to Restructure and Modernize Active Directory
How to Restructure and Modernize Active DirectoryHow to Restructure and Modernize Active Directory
How to Restructure and Modernize Active Directory
Quest
 
Microsoft SharePoint Presentation from All Covered
Microsoft SharePoint Presentation from All CoveredMicrosoft SharePoint Presentation from All Covered
Microsoft SharePoint Presentation from All Covered
All Covered
 
How to Restructure Active Directory with ZeroIMPACT
How to Restructure Active Directory with ZeroIMPACTHow to Restructure Active Directory with ZeroIMPACT
How to Restructure Active Directory with ZeroIMPACT
Quest
 
A proven path for migrating from clearcase to git and or subversion
A proven path for migrating from clearcase to git and or subversionA proven path for migrating from clearcase to git and or subversion
A proven path for migrating from clearcase to git and or subversion
CollabNet
 
Delivering changes for applications and databases
Delivering changes for applications and databasesDelivering changes for applications and databases
Delivering changes for applications and databases
Eduardo Piairo
 

Similar to Practical large scale migration guidance (20)

Techniques for scaling application with security and visibility in cloud
Techniques for scaling application with security and visibility in cloudTechniques for scaling application with security and visibility in cloud
Techniques for scaling application with security and visibility in cloud
 
SPTechCon Austin - The Slippery Slope of SharePoint Migrations
SPTechCon Austin - The Slippery Slope of SharePoint MigrationsSPTechCon Austin - The Slippery Slope of SharePoint Migrations
SPTechCon Austin - The Slippery Slope of SharePoint Migrations
 
Performing successful migrations to the microsoft cloud
Performing successful migrations to the microsoft cloudPerforming successful migrations to the microsoft cloud
Performing successful migrations to the microsoft cloud
 
Putting the Ops in DataOps: Orchestrate the Flow of Data Across Data Pipelines
Putting the Ops in DataOps: Orchestrate the Flow of Data Across Data PipelinesPutting the Ops in DataOps: Orchestrate the Flow of Data Across Data Pipelines
Putting the Ops in DataOps: Orchestrate the Flow of Data Across Data Pipelines
 
Capstone presentation
Capstone presentationCapstone presentation
Capstone presentation
 
Big Data Ingestion Using Hadoop - Capstone Presentation
Big Data Ingestion Using Hadoop - Capstone PresentationBig Data Ingestion Using Hadoop - Capstone Presentation
Big Data Ingestion Using Hadoop - Capstone Presentation
 
Initiative Based Technology Consulting Case Studies
Initiative Based Technology Consulting Case StudiesInitiative Based Technology Consulting Case Studies
Initiative Based Technology Consulting Case Studies
 
An overview of modern scalable web development
An overview of modern scalable web developmentAn overview of modern scalable web development
An overview of modern scalable web development
 
Tips and tricks for complex migrations to SharePoint Online
Tips and tricks for complex migrations to SharePoint OnlineTips and tricks for complex migrations to SharePoint Online
Tips and tricks for complex migrations to SharePoint Online
 
Cloud-Native Data: What data questions to ask when building cloud-native apps
Cloud-Native Data: What data questions to ask when building cloud-native appsCloud-Native Data: What data questions to ask when building cloud-native apps
Cloud-Native Data: What data questions to ask when building cloud-native apps
 
Engage 2020-nerd-for-move-on-from-x pages
Engage 2020-nerd-for-move-on-from-x pagesEngage 2020-nerd-for-move-on-from-x pages
Engage 2020-nerd-for-move-on-from-x pages
 
Big data meet_up_08042016
Big data meet_up_08042016Big data meet_up_08042016
Big data meet_up_08042016
 
SharePoint Migration-What you need to know
SharePoint Migration-What you need to knowSharePoint Migration-What you need to know
SharePoint Migration-What you need to know
 
Streamline Cognos Migrations & Consolidations
Streamline Cognos Migrations & ConsolidationsStreamline Cognos Migrations & Consolidations
Streamline Cognos Migrations & Consolidations
 
Webinar: The Slippery Slope of Migrating to SharePoint Online or On-Premise
Webinar: The Slippery Slope of Migrating to SharePoint Online or On-PremiseWebinar: The Slippery Slope of Migrating to SharePoint Online or On-Premise
Webinar: The Slippery Slope of Migrating to SharePoint Online or On-Premise
 
How to Restructure and Modernize Active Directory
How to Restructure and Modernize Active DirectoryHow to Restructure and Modernize Active Directory
How to Restructure and Modernize Active Directory
 
Microsoft SharePoint Presentation from All Covered
Microsoft SharePoint Presentation from All CoveredMicrosoft SharePoint Presentation from All Covered
Microsoft SharePoint Presentation from All Covered
 
How to Restructure Active Directory with ZeroIMPACT
How to Restructure Active Directory with ZeroIMPACTHow to Restructure Active Directory with ZeroIMPACT
How to Restructure Active Directory with ZeroIMPACT
 
A proven path for migrating from clearcase to git and or subversion
A proven path for migrating from clearcase to git and or subversionA proven path for migrating from clearcase to git and or subversion
A proven path for migrating from clearcase to git and or subversion
 
Delivering changes for applications and databases
Delivering changes for applications and databasesDelivering changes for applications and databases
Delivering changes for applications and databases
 

More from Andries den Haan

Why content management maturity matters...
Why content management maturity matters...Why content management maturity matters...
Why content management maturity matters...
Andries den Haan
 
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdfDIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
Andries den Haan
 
Embracing the long term view to build a true digital workplace
Embracing the long term view to build a true digital workplaceEmbracing the long term view to build a true digital workplace
Embracing the long term view to build a true digital workplace
Andries den Haan
 
Tips and tricks for complex migrations to SharePoint Online
Tips and tricks for complex migrations to SharePoint OnlineTips and tricks for complex migrations to SharePoint Online
Tips and tricks for complex migrations to SharePoint Online
Andries den Haan
 
Msol10 extending social features in share point 2010 v0.4
Msol10   extending social features in share point 2010 v0.4Msol10   extending social features in share point 2010 v0.4
Msol10 extending social features in share point 2010 v0.4
Andries den Haan
 
Moving beyond service applications to build a social ecosystem v1.1
Moving beyond service applications to build a social ecosystem v1.1Moving beyond service applications to build a social ecosystem v1.1
Moving beyond service applications to build a social ecosystem v1.1
Andries den Haan
 

More from Andries den Haan (6)

Why content management maturity matters...
Why content management maturity matters...Why content management maturity matters...
Why content management maturity matters...
 
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdfDIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
 
Embracing the long term view to build a true digital workplace
Embracing the long term view to build a true digital workplaceEmbracing the long term view to build a true digital workplace
Embracing the long term view to build a true digital workplace
 
Tips and tricks for complex migrations to SharePoint Online
Tips and tricks for complex migrations to SharePoint OnlineTips and tricks for complex migrations to SharePoint Online
Tips and tricks for complex migrations to SharePoint Online
 
Msol10 extending social features in share point 2010 v0.4
Msol10   extending social features in share point 2010 v0.4Msol10   extending social features in share point 2010 v0.4
Msol10 extending social features in share point 2010 v0.4
 
Moving beyond service applications to build a social ecosystem v1.1
Moving beyond service applications to build a social ecosystem v1.1Moving beyond service applications to build a social ecosystem v1.1
Moving beyond service applications to build a social ecosystem v1.1
 

Recently uploaded

Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
Claudio Di Ciccio
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI modelsInfrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
Zilliz
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
Zilliz
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
Daiki Mogmet Ito
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Zilliz
 

Recently uploaded (20)

Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI modelsInfrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
 

Practical large scale migration guidance

  • 1. 1 Practical Guidance for Large Scale Migrations public
  • 2. Practical Guidance for Large Scale Migrations SharePoint vNext: The true Story of a bulk migration Andries den HaanNovember 2014
  • 3. A brief personal introduction •Working in IT since 1999 •Passionate about portals, collaboration and social media •Certified expert on Microsoft SharePoint products and technologies •Focus on business processes optimization, platform infrastructure, migrations and governance •Contact details: •andries.denhaan@kpn.com •www.twitter.com/awdhaan •www.linkedin.com/in/andriesdenhaan •www.slideshare.net/awdhaan. 3 Practical Guidance for Large Scale Migrations public
  • 4. …and working at KPN Consulting •Veterans when it comes to the web, enterprise search, corporate portals, content management and information worker solutions •The current Web, Apps and Data team is the typical “Gallic village” within the greater KPN •Part of Application Services (ERP/Applications/Testing) •Not only SharePoint, but also: •Mobile Apps (TEDx Amsterdam, Bijenradar) •Application frameworks (Amber Alert) •Content management (Tridion, Orchard). 4 Practical Guidance for Large Scale Migrations public
  • 5. What you can expect from this session •A true story on how we approach(ed) large scale legacy SharePoint migration projects •How to deal with common pitfalls •Working with 3rdparty tools and extending them to fit our needs •Lessons learned on choices we’ve made and issues we solved along the way. 5 Practical Guidance for Large Scale Migrations public
  • 6. Agenda •Setting the scene •Our approach •Tooling choices •Challenges along the way •Lessons learned 6 Practical Guidance for Large Scale Migrations public
  • 7. Our mission: “Migrate 4 TB in 2.5 Months!” 7 Practical Guidance for Large Scale Migrations public Our mission: Migrate 4 TB in 2.5 Months! •Andries den Haan (project leader, lead consultant) •Mathijs Vlasveld (SharePoint developer) •Terence Bahlen (SharePoint developer) •Neal de Jel (SharePoint developer).
  • 8. Prior to the project, a site survey was performed to gain insight on the state of things •Microsoft SharePoint Portal Server 2003 •Some metrics: •3-tier topology (2 WFE’s, 1 APP) •Total data volume: 4.5 TB •Approx. 12.000 site collections •Data gathered via: •Microsoft tooling (stsadm) •Database queries (and being naughty by doing so) •Typical tooling (e.g. Windiff, SPSitemanager) •Server, web.configscan (manual ) •Site owner interviews (e.g. for special sites). 8 Practical Guidance for Large Scale Migrations public
  • 9. The site survey showed some interesting challenges to be expected during the migration •Support effort focused on availability •No governance model: •Unlimited site growth •2 GB file uploads possible •No blocked file types •Multiple site collections above 300 GB •Large sites within the same database •A fair amount of orphaned items •Custom site definitions and web parts (used in over 6.000 site collections). 9 Practical Guidance for Large Scale Migrations public
  • 10. Main project drivers 10 Practical Guidance for Large Scale Migrations public Main project drivers: •Clean-up and restructure required •The existing SharePoint version was not able to keep up with evolving user requirements •Software and hardware end-of-life (duh!) •Improve on governance and support.
  • 11. Customer expectations were straight forward! 11 Practical Guidance for Large Scale Migrations public Customer expectations were straight forward!
  • 12. The migration was to be finished before the end of the year! 12 Practical Guidance for Large Scale Migrations public The migration was to be finished before the end of the year!
  • 13. The urgency to migrate was also driven by the state 13 Practical Guidance for Large Scale Migrations public The urgency to migrate was also driven by the state of the data: a warehouse in need of a clean-up and restructure!
  • 14. Our customer’s expectations were clear and simple, avoid disrupting daily business! 14 Practical Guidance for Large Scale Migrations public Business continuity was key: Avoid disrupting daily business!
  • 15. Risks 15 Practical Guidance for Large Scale Migrations public This mission was not without impediments: •No changes to the source system allowed! •Limited support on the current environment •Custom coded site definitions and web parts •Migration performance (and how to plan on this) •How to handle obsolete data or sites without ownership.
  • 16. Our approach was based on an extensive preparation phase and Agile SCRUM principles 16 Practical Guidance for Large Scale Migrations public Preparation(site survey) Go LiveStartlocks andmigrationsDailystand-upPreparebatch jobsPre and post migration issue relatedtasksMonitoring and sleep  MigrationResultchecksDaily cyclePost-migration(decommissioning) Ongoing migrations
  • 17. Why did we choose 3rdparty tooling to support the migration? •No direct upgrade path from SharePoint Portal Server 2003 to SharePoint Server 2010 •Required clean-up and restructure •Pressure to deliver within a short timeframe •Migration requirements: •Preservation of (system)metadata and permissions •Speed: optimize the throughput to meet our deadline •Mapping of old and new sites or definitions, content types, lists or web parts •Granularity (sometimes only a sub site/list/specific item may require migration) •Filtering (e.g. on date or other properties) •Support for full and incremental (bulk) migrations. 17 Practical Guidance for Large Scale Migrations public
  • 18. The AvePoint DocAve platform provided us with the tools needed to get the job done •Track record(including large scale Microsoft IT migration) •Rich set of migration (and content mgt.) capabilities •Acceptable software costs •Warm response to vendor inquiry •Handling of support requests prior and during the project. Extensions required to optimize the bulk migration process! 18 Practical Guidance for Large Scale Migrations public
  • 19. We built a custom batch builder tool to support planning and reporting of ongoing migrations We extended the DocAve tooling to optimize bulk migration planning and reporting: •Import unscheduled sites from the migration to-do list matching the amount of data that could be processed within a service window •Choose target database (allowing for redistribution of site collections) •Create DocAve batch migration configuration job files for the selected sites •Check on potential issues prior to migration •Generate mapping files for automated redirects and various scripts •Read back migration job reports from DocAve and update the To-do list. 19 Practical Guidance for Large Scale Migrations public
  • 20. A public to-do list allowed the migration team to plan bulk migrations and report on progress •Just a SharePoint list with relevant columns to describe the state of the sites in the context of the migration •Sites may have an (un)scheduled, migrated or ignored state •Site owners able to check planning and migration result of sites through search •Open communication to all stakeholders. 20 Practical Guidance for Large Scale Migrations public
  • 21. The same list was also used to report progress to the project owner •The project owner had a transparent view on migration progress and possible issues on a daily basis •The list was also used to comply with the acceptance criteria for project closure (our definition of done). 21 Practical Guidance for Large Scale Migrations public
  • 22. Our Batch builder tool supports the selection of sites from the to-do list for bulk job creation 22 Practical Guidance for Large Scale Migrations public
  • 23. The Batch builder tool also provides the creation of other batch files or data checks •Setting sites to read-only or (un)lock scripts •mappings.csv for URL redirection or sites.txt to activate a notification bar feature •Check if sites exists or other pre-checks (e.g. too long URL’s or large files/lists) and export reports to share with site owners or the migration team. 23 Practical Guidance for Large Scale Migrations public
  • 24. After the migration, the Batch builder tool provides a means of bulk reporting •Import DocAve migration job reports to update the to-do list for successful, failed or migrations with exceptions and overall progress reporting •Additionally add comments about e.g. exceptions, delayed go live or reschedule. 24 Practical Guidance for Large Scale Migrations public
  • 25. Our migration setup was built for both performance and flexibility 25 Practical Guidance for Large Scale Migrations public SharePoint 2003 Collaboration farm DOCAVE AGENT DOCAVE AGENT Batch builder tool SharePoint 2010 Collaboration farm DOCAVE AGENT DOCAVE AGENT WFE1 WFE2 WFE1 WFE2 3.75 GB per hour per agent set To-do list SharePoint 2010Legal content farm DOCAVE AGENT DOCAVE AGENT WFE1 WFE2 DocAve management server
  • 26. A custom C# script in the global.asax on each source WFE selectively redirects user requests •Custom code was added to the global.asax of each web application in the source environment •Using a mappings.csv file with a source and target URL value pair on each line •All requests for a specific URL (and below) were redirected to the new site •Appended with each new migration •Low server resource usage(tested with 10.000+ entries) •Not applicable to web folder mappings. 26 Practical Guidance for Large Scale Migrations public
  • 27. Migrated sites temporarily show a custom notification bar linking to the migration info site •Site collection feature displaying a custom message in the notification bar area •Only visible for migrated sites (not for new ones) •Bulk feature activation using the Batch builder tool •Removed after the migration project finished. 27 Practical Guidance for Large Scale Migrations public
  • 28. Migrations performed via a standard operating procedure •Prior to the migration, each site collection is set to read-only •To finalize a successful migration, no-access locks and redirects are set for the old sites and notification bars enabled for the new sites •In case of a roll-back, the redirect and notification bar functions are not enabled and the source site is set back to read/write. 28 Practical Guidance for Large Scale Migrations public Content freeze Execute migration job Enabled redirect and notification bar Go live! Validate migration- result Prepare migrations
  • 29. The daily cycle for the team during the 2.5 month migration period •Daily migrations (standard sites) from Monday to Friday (18:00-7:00) •Weekends (special cases or large sites) •Last 2 weeks: Legal case sites (24/7). 29 Practical Guidance for Large Scale Migrations public 7:00 8:00 16:00 9:00-15:00 Migration result checks Daily check-in (stand-up) Pre and post migration issue related tasks Prepare batch jobs 18:00 Start locks and migrations
  • 30. Our challenges and solutions 30 Practical Guidance for Large Scale Migrations public Common challenges along the way: •Extra large file uploads not possible in the new farm •Blocked file types (so MP3’s, .EXE files, VB scripts, …) •Supersized site collections (over 200 GB) •Large lists (slow migration).
  • 31. But we also had some unexpected challenges For reasons still unknown the migration of a large site collection (100+ webs) had an unexpected result: •Each library URL in the site collection was named after the first folder or item within that library •Resolved by using a database query (being naughty again ) in the source system to get the original library URL’s and PowerShell to “system”updatethe library URL’s in bulk ($list.RootFolder.MoveTo($listUrl)) •Apart from this the migration was successful . 31 Practical Guidance for Large Scale Migrations public
  • 32. We saved the biggest challenge for last: migrating 5.000+ customized legal case sites •24/7 migration jobs during 15 days for only 100 GB (# of objects overrules size) •Some jobs spanning multiple days •Site definition/content type/field type mapping and obsolete web part removal. 32 Practical Guidance for Large Scale Migrations public
  • 33. Highlights of a successful project •2.220 sites (4.1 TB) migrated in 2.5 months •5.681 customized sites migrated within the last 2 weeks •Creative solutions for (un)expected challenges •Project delivery within time and budget •Effective collaboration with the other teams: •Adaptation •Infrastructure •Offshore support •AvePoint support. 33 Practical Guidance for Large Scale Migrations public
  • 34. The secret of our success is based on a small dedicated team with a clear mission and process •Customer oriented SCRUM-like approach(business continuity) •Sufficient and open communication to site owners and stakeholders •A very robust, but flexible migration process •Ensuring the right tools for the job (consider homemade) •Frequent team stand-up meetings regarding progress, impediments and solutions •Leveraging our knowledge, creativity and Windows PowerShell to solve the encountered issues •Reusable for an upcoming SharePoint 2007-2013 migration. 34 Practical Guidance for Large Scale Migrations public
  • 35. Connect | Share | Discover Would you like to know more? andries.denhaan@kpn.com
  • 36. 36 Practical Guidance for Large Scale Migrations public