SlideShare a Scribd company logo
Tips and tricks for complex
migrations to SharePoint Online
Office 365 and SharePoint Connect – Community Edition, October 2019
Are you considering, preparing or executing a
large-scale migration to Office 365?
Expect to run into some problems along the way
This session aims to help you with tips and
tricks to increase your project’s success rate
Are you in the right session?
• Expect a mix of technical and tactical topics that will help you to
design and execute your large-scale migration project
• Large-scale migrations as in Terabytes and Petabytes
• We’re talking documents, file shares and SharePoint, not Exchange
• Some live-demo’s and walk-throughs
• Not really a business session
• Up-tempo due to time constraints (45 minutes).
Agenda
• Introductions and objectives
• Typical migration challenges
• Migration means rationalization
• Moving from classic to modern
• Choosing the right migration tool
• Bulk migrations using pipelines
• Maximize automation for large-scale
A brief personal introduction
• Working in technology since 1999
• Architect for Wortell (via ETTU) since March 2015
• Previously: Pink Elephant, PinkRoccade, Getronics,
Ordina & KPN Consulting
• Crazy about technology that connects people
• Focus on Business & IT Alignment:
 Governance & security
 Use of Best practices
 Certified Microsoft Office 365 technology expert
 Addicted to large-scale migrations 
Andries.den.Haan@wortell.nl
Twitter: @awdhaan
Organizations have built up large collections
of “Dark data” over the years…
Typical challenges for large-scale migrations
• Organizations with multiple divisions and offices
• File shares existing for a long time, supporting various processes
• Also SharePoint Server environments with multiple site collections
• Variety in file structures and authorizations
• Difficult to track responsible owner (if any)
• Decisions on what to do with the data (migrate, dispose, quarantine or …)
• Protecting sensitive data (PII, financial or even medical)
• Designing a futureproof target architecture in the cloud
• Remapping data from source
• The sheer volume of data can result in longer processing time.
What about business continuity?
Typical project approach for large-scale migrations*
Discover
• Identify stakeholders
and requirements
• Prepare tooling and
access to data sources
• Conduct stakeholder
interviews
• Start scanning data
sources
• ….
Analyze Rationalize Design Deploy
• Implement target
architecture
• Deploy migration
solution
• Perform test
migrations for
technical validity and
to gain performance
metrics
• Plan and estimate the
migration
• …
Migrate
• Perform continuous
migrations
• Adjust and optimize
• Resolve known issues
and investigate new
• Progress reporting
• …
• Analyze scan results
• Review functional and
security requirements
• Determine potential
target locations
• Define business rules
to classify data
• …
• Classify data via
defined business rules
• Identify migration and
relocation scenarios
• Estimate migration
throughput
• Determine ordering
and priority
• …
• Envision future state
• Design target
architecture
• Determine governance
guidelines and security
baseline
• Prepare migration and
onboarding process
• …
* Technical perspective only. Parallel activities commonly include adoption and training
Engage your stakeholders to set and keep
things in motion
To the Cloud
and beyond
Archive,
dispose or …
Application or HMUD?
File types
Ownership
Age
Sensitivity
Rationalizing your data is hard work
Tools you can use to support inventory and rationalization
Tool Source Usage
NTFS Permissions Reporter File share Analyze permission structures
Microsoft Inventory Manager
File share, SharePoint, Box,
OneDrive, Google Drive
Fasttrack tool: Inventory and issue reporting
(use, file type and aging for file share data)
Jam Software Tree Size Pro File share Analyze data (storage) structures and aging
SharePoint Modernization
Scanner
SharePoint
Provides insights on readiness and issues for
modernizing classic sites
SharePoint Migration
Assessment Tool
SharePoint
Identify issues for SharePoint Server 2013
source environments
Veritas Data Insights File share
Inventory and analysis. Can extract
presumable ownership
NTFS Permissions Reporter can help to
determine permission structures
Demo: Microsoft Inventory Manager
Your target architecture should be futureproof
• Leverage the goodness of the Microsoft Cloud:
 Better control of data lifecycle using retention policies and labels
 Increased protection of sensitive data using DLP and sensitivity labels a.o.
 Guided provisioning and flexibility through templating
 Governance for policies & standards, operations and innovation
• Easier to identify ownership (person, team, division, org)
• Flexible site/team structure to accommodate for
changes in the organization (Hub sites FTW)
• …
Mapping source and targets
• Avoid granular permissions, follow the Office
365 Group structure and split into multiple
groups/teams if required
• Use sensitivity labels for item-level protection
• Look for data and permission patterns
• Design a naming convention for sites/teams
and then design it again after validation with
your stakeholders
• Only migrate active data
• Keep it simple.
File share Finance division
Teams
Corporate Finance
Admin
Contracts
Reports
Archive
Incoming
Choosing between migration tools
Microsoft SharePoint Migration tool:
• Basic set of migration features
• Support for one direction: on-premises-cloud
• Basic PowerShell module
• Currently lacking support for mapping, migration of
specific content
• Suitable for basic migrations
• Easily scalable
• Free to use
• Improving with each new update.
ShareGate:
• Lot’s of features for migrations and reporting
• Rich PowerShell module
• On-premises-on-premises, on-premises-cloud,
cloud-on-premises, cloud-cloud
• Map and migrate specific data
• Copy, flatten and merge site objects
• Suitable for complex migrations
• Export data to file system
• Migrate term sets, web parts and other artefacts
• Metadata enrichment during migrations
• Reasonable pricing and excellent support service
• Improving with each new update.
Performance characteristics when using the
SharePoint API for migration (Microsoft)
Type of metadata Examples Maximum
Light ISO files, video files 2 TB/day
Medium List items, Office files (~1.5MB) 1 TB/day
Heavy
List items with custom
columns, small files (~50kb)
250 GB /day
Rules of thumb:
• Large file size migrates faster than smaller ones
• Files migrate faster than objects and list items
• Actual throughput depends on local infrastructure, network speeds etc.
A single ShareGate:Desktop instance typically
migrates 5-15 GB/hour with peaks up to 35 GB
• Sharegate is optimized to run with 4 cores (64 concurrent threads)
• Also consider pre- and postmigration activities:
 SharePoint site/Team provisioning (fair)
 Applying configuration (depends on complexity)
 Assigning Owner and Membership (fast)
 Reporting and logging (fast)
• Network dependencies:
 1 GB via 5/1 Mbps ADSL line takes 16 minutes
 1 GB via 1 GBPS line takes 8 seconds
• Number simultaneous import jobs to each separate Content Database
(contact Microsoft to pre-provision content databases for > 1TB migrations)
• Provisioning sites and Teams in bulk prior to starting data migrations.
Improving migration performance in ShareGate:Desktop
• ShareGate:Desktop 12.0 can now register as
an Azure application
• This allows ShareGate to identify to Office
365 that it is running operations on your
tenant through an access token
• This will reduce throttling on tasks between
Sharegate and Office 365
• Also grants ShareGate rights to use certain
Microsoft functionality, such as the Graph API
• Global Administrator role required for
consent of the permissions.
Azure Active Directory App registration
Modernizing classic SharePoint sites
• Converting classic artefacts to modern experiences
• Why? Duh! Modern is simple, responsive and benefits from ongoing
Microsoft investments
• Some basic principles:
 When moving to the cloud, only migrate data
 When already in the Cloud, modernize what’s classic
• SharePoint Patterns and Practices (PnP) are your best friends:
 Guidance: http://aka.ms/sppnp-modernize
 Toolkit: https://github.com/SharePoint/sp-dev-modernization
• Start with gaining insights on modernization
readiness and issues.
The Modernization Scanner is awesome
• Only for SharePoint Online
• Use via GUI or command line
• Scope to entire tenant, csv or
individual sites
• Configure specific scans or
perform a full scan
• Various authentication options
• Detailed reports in Excel and csv.
Demo: Modernization Scanner
Modernize by connecting to an Office 365 group
• Not supported for classic publishing portals
• Upon “Groupify”:
 A new Office 365 group is created, and connected to
the site A new modern home page is created and set
as home page
 Group owners are now the site collection admins
 Group owners are added to the site's Owners group
 Group members are added to the site's Members
group
• Options to perform “Groupification”:
 Self-service on the site
(“Connect to new Office 365 Group”)
 Via PnP PowerShell: Add-PnPOffice365GroupToSite.
Demo: Modernizing by Groupification
Options for modernizing SharePoint pages
PnP PowerShell conversion:
• Great for centrally managed scenarios
• Superfast and easy to deploy
• Integrates into a migration pipeline
• Mapping files for web parts and layouts
• Built-in logging.
PnP Page Transformation UI solution:
• Great for self-service scenarios
• Fully deploy using a provided script
• Best for non-customized environments
• Feedback option
• Enable or disable on a per site basis.
Demos: SharePoint page conversion
Main script
Create a migration pipeline with all required functions
{f} {f} {f} {f} {f}
csv input
Logging,
reporting
<xml>
<xml>
mapping
file(s)
Designing a migration pipeline
• Design each function with the expected input variables
• Securely cache source and destination credentials
(encrypted xml, Windows Credential Manager)
• Accommodate for nesting of functions
(e.g. copy-data in sub sites)
• Handle errors if e.g. artefacts already exist
• Functions are called through a “main” script and fed by
input files (to-do, mappings, configs).
Demo: Anatomy of a migration pipeline
Complexity increases
when the numbers go up
• IT does not have the full insights on
ownership, and they can’t make decisions
for data at scale. And they shouldn’t
anyway!
• Bigger organizations have multiple
divisions each with different rhythms.
Planning migrations becomes difficult at
scale
• Complexity of merging or splitting data
and other transformations
• Multiple sources: File shares, SharePoint
• Processing time of all repeating tasks are
multiplied by the amount of data: e.g. 1
min. x 20.000 migrations already takes ~
14 days.
For large-scale, even common actions take time
• Creating and continuously updating inventories
• Typical actions like creating mappings or input files
• Logging success and failure
• Scripting solutions for known issues
• Cleaning and customizing
• Liaising with data stewards to resolve data issues
• …
Automate to epic proportions using a Migration Factory
• Build and (incrementally) refresh data source inventories
• Provide self-service to the business to:
 Determine and claim ownership
 Help resolve data related issues
 Enrich inventories with sensitivity info
 Prepare and approve decisions on what to do with the data
 Choose an appropriate migration scenario
 Allow for opt-in on scheduled migration batches
 (Dis)approve migration outcome
 Lock source environment and display banners
• Be flexible in supporting different business requirements*
• Scale up for increasing demand
• Optimize the process of solving problems
• Realtime reporting on progress and issues.
Supporting multiple migration scenarios
• Each migration scenario may contain multiple steps to:
 Provision SharePoint Online sites or Teams (PnP)
 Apply specific configurations (Site Design, PnP)
 Migrate data (ShareGate:Desktop)
 Perform checks and compares
 Notify data stewards to approve migration outcome
 Report output of each step back to the central database
• PowerShell for a high degree of flexibility and extensibility
• Standardized by function approach and shared elements
• Use a repo for source control.
High level design of a Migration Factory
Migration
database
Migration
Administrator
Stakeholders
SharePoint
2013
SharePoint
2010
Filers
Inventory clientInventory client
Migration
portal
C#js
Migration servers
PS
SharePoint Online
Microsoft Teams
Reporting
Migration
AIP-Scanner
Disposition
Inventory client
Decision n
Data
Owner(s)
Data
Steward(s)
Walkthrough: Migration Factory portal
Key takeaways of this session
• Complexity increases with increasing amounts of data
• The business owns the data, support them to rationalize
and facilitate them to migrate their own stuff
• large-scale is all about optimizing the process
• Current technology allow for a high degree of automation
• Keep things simple when the numbers go up. Move first,
adjust later! The nitty gritty stuff will slow you down
• The PnP Community is simply awesome!
Tips and tricks for complex migrations to SharePoint Online

More Related Content

What's hot

Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...
Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...
Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...
Lucas Jellema
 
SQL to NoSQL: Top 6 Questions
SQL to NoSQL: Top 6 QuestionsSQL to NoSQL: Top 6 Questions
SQL to NoSQL: Top 6 Questions
Mike Broberg
 
slides
slidesslides
Share point 2013 enterprise search (public)
Share point 2013 enterprise search (public)Share point 2013 enterprise search (public)
Share point 2013 enterprise search (public)
Petter Skodvin-Hvammen
 
Data Lake and the rise of the microservices
Data Lake and the rise of the microservicesData Lake and the rise of the microservices
Data Lake and the rise of the microservices
Bigstep
 
SQL Server 2017 Enhancements You Need To Know
SQL Server 2017 Enhancements You Need To KnowSQL Server 2017 Enhancements You Need To Know
SQL Server 2017 Enhancements You Need To Know
Quest
 
introduction v4
introduction v4introduction v4
introduction v4
transformtoit
 
Data Con LA 2018 - Streaming and IoT by Pat Alwell
Data Con LA 2018 - Streaming and IoT by Pat AlwellData Con LA 2018 - Streaming and IoT by Pat Alwell
Data Con LA 2018 - Streaming and IoT by Pat Alwell
Data Con LA
 
Tableau API
Tableau APITableau API
Tableau API
Dmitry Anoshin
 
ADDO 2021: Why and how to include database changes in the deployment pipeline
ADDO 2021: Why and how to include database changes in the deployment pipelineADDO 2021: Why and how to include database changes in the deployment pipeline
ADDO 2021: Why and how to include database changes in the deployment pipeline
Eduardo Piairo
 
Lotus notes app migration process v1.2
Lotus notes app migration process   v1.2Lotus notes app migration process   v1.2
Lotus notes app migration process v1.2
Officience
 
Designing a Real Time Data Ingestion Pipeline
Designing a Real Time Data Ingestion PipelineDesigning a Real Time Data Ingestion Pipeline
Designing a Real Time Data Ingestion Pipeline
DataScience
 
Cloudant Overview Bluemix Meetup from Lisa Neddam
Cloudant Overview Bluemix Meetup from Lisa NeddamCloudant Overview Bluemix Meetup from Lisa Neddam
Cloudant Overview Bluemix Meetup from Lisa Neddam
Romeo Kienzler
 
Elasticsearch + Cascading for Scalable Log Processing
Elasticsearch + Cascading for Scalable Log ProcessingElasticsearch + Cascading for Scalable Log Processing
Elasticsearch + Cascading for Scalable Log Processing
Cascading
 
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part20812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
Raul Chong
 
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...
Patrick Guimonet
 
Introduction to couchbase
Introduction to couchbaseIntroduction to couchbase
Introduction to couchbase
Dipti Borkar
 
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...
Lucas Jellema
 
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, Confluent
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, ConfluentApache Kafka and the Data Mesh | Ben Stopford and Michael Noll, Confluent
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, Confluent
HostedbyConfluent
 
Relational databases vs Non-relational databases
Relational databases vs Non-relational databasesRelational databases vs Non-relational databases
Relational databases vs Non-relational databases
James Serra
 

What's hot (20)

Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...
Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...
Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...
 
SQL to NoSQL: Top 6 Questions
SQL to NoSQL: Top 6 QuestionsSQL to NoSQL: Top 6 Questions
SQL to NoSQL: Top 6 Questions
 
slides
slidesslides
slides
 
Share point 2013 enterprise search (public)
Share point 2013 enterprise search (public)Share point 2013 enterprise search (public)
Share point 2013 enterprise search (public)
 
Data Lake and the rise of the microservices
Data Lake and the rise of the microservicesData Lake and the rise of the microservices
Data Lake and the rise of the microservices
 
SQL Server 2017 Enhancements You Need To Know
SQL Server 2017 Enhancements You Need To KnowSQL Server 2017 Enhancements You Need To Know
SQL Server 2017 Enhancements You Need To Know
 
introduction v4
introduction v4introduction v4
introduction v4
 
Data Con LA 2018 - Streaming and IoT by Pat Alwell
Data Con LA 2018 - Streaming and IoT by Pat AlwellData Con LA 2018 - Streaming and IoT by Pat Alwell
Data Con LA 2018 - Streaming and IoT by Pat Alwell
 
Tableau API
Tableau APITableau API
Tableau API
 
ADDO 2021: Why and how to include database changes in the deployment pipeline
ADDO 2021: Why and how to include database changes in the deployment pipelineADDO 2021: Why and how to include database changes in the deployment pipeline
ADDO 2021: Why and how to include database changes in the deployment pipeline
 
Lotus notes app migration process v1.2
Lotus notes app migration process   v1.2Lotus notes app migration process   v1.2
Lotus notes app migration process v1.2
 
Designing a Real Time Data Ingestion Pipeline
Designing a Real Time Data Ingestion PipelineDesigning a Real Time Data Ingestion Pipeline
Designing a Real Time Data Ingestion Pipeline
 
Cloudant Overview Bluemix Meetup from Lisa Neddam
Cloudant Overview Bluemix Meetup from Lisa NeddamCloudant Overview Bluemix Meetup from Lisa Neddam
Cloudant Overview Bluemix Meetup from Lisa Neddam
 
Elasticsearch + Cascading for Scalable Log Processing
Elasticsearch + Cascading for Scalable Log ProcessingElasticsearch + Cascading for Scalable Log Processing
Elasticsearch + Cascading for Scalable Log Processing
 
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part20812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
 
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...
 
Introduction to couchbase
Introduction to couchbaseIntroduction to couchbase
Introduction to couchbase
 
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...
 
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, Confluent
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, ConfluentApache Kafka and the Data Mesh | Ben Stopford and Michael Noll, Confluent
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, Confluent
 
Relational databases vs Non-relational databases
Relational databases vs Non-relational databasesRelational databases vs Non-relational databases
Relational databases vs Non-relational databases
 

Similar to Tips and tricks for complex migrations to SharePoint Online

O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
NCCOMMS
 
11 Strategic Considerations for SharePoint Migration presented by Christian B...
11 Strategic Considerations for SharePoint Migration presented by Christian B...11 Strategic Considerations for SharePoint Migration presented by Christian B...
11 Strategic Considerations for SharePoint Migration presented by Christian B...
European SharePoint Conference
 
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...One101 double the trouble double the fun_ migrating to one_drive and sharepoi...
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...
Craig Jahnke
 
Webinar: The Slippery Slope of Migrating to SharePoint Online or On-Premise
Webinar: The Slippery Slope of Migrating to SharePoint Online or On-PremiseWebinar: The Slippery Slope of Migrating to SharePoint Online or On-Premise
Webinar: The Slippery Slope of Migrating to SharePoint Online or On-Premise
WithumSmith+Brown, formerly Portal Solutions
 
SPTechCon Austin - The Slippery Slope of SharePoint Migrations
SPTechCon Austin - The Slippery Slope of SharePoint MigrationsSPTechCon Austin - The Slippery Slope of SharePoint Migrations
SPTechCon Austin - The Slippery Slope of SharePoint Migrations
Jill Hannemann
 
Practical Tips for Migrating SharePoint Customizations to Office 365
Practical Tips for Migrating SharePoint Customizations to Office 365Practical Tips for Migrating SharePoint Customizations to Office 365
Practical Tips for Migrating SharePoint Customizations to Office 365
Haniel Croitoru
 
SPS Toronto 2015
SPS Toronto 2015SPS Toronto 2015
SPS Toronto 2015
Mike Maadarani
 
Webinar: Slippery Slope of SharePoint Migrations
Webinar: Slippery Slope of SharePoint Migrations Webinar: Slippery Slope of SharePoint Migrations
Webinar: Slippery Slope of SharePoint Migrations
WithumSmith+Brown, formerly Portal Solutions
 
SPS Toronto 2017 Keith Tuomi - Migrating to SharePoint Online & OneDrive for ...
SPS Toronto 2017 Keith Tuomi - Migrating to SharePoint Online & OneDrive for ...SPS Toronto 2017 Keith Tuomi - Migrating to SharePoint Online & OneDrive for ...
SPS Toronto 2017 Keith Tuomi - Migrating to SharePoint Online & OneDrive for ...
Keith Tuomi
 
Katpro Technologies- SharePoint Portfolio
Katpro Technologies- SharePoint PortfolioKatpro Technologies- SharePoint Portfolio
Katpro Technologies- SharePoint Portfolio
Katpro Technologies Pvt Ltd
 
Tips in migrating to SharePoint 2016 or O365, to avoid a migration headache
Tips in migrating to SharePoint 2016 or O365, to avoid a migration headacheTips in migrating to SharePoint 2016 or O365, to avoid a migration headache
Tips in migrating to SharePoint 2016 or O365, to avoid a migration headache
Mike Maadarani
 
Share point development thrust 2019
Share point development thrust 2019Share point development thrust 2019
Share point development thrust 2019
Leon Sonntag
 
What You Need to Know Before Upgrading to SharePoint 2013
What You Need to Know Before Upgrading to SharePoint 2013What You Need to Know Before Upgrading to SharePoint 2013
What You Need to Know Before Upgrading to SharePoint 2013
Perficient, Inc.
 
SharePoint 2013 Migration - Your 5 Rules for Success
SharePoint 2013 Migration  - Your 5 Rules for SuccessSharePoint 2013 Migration  - Your 5 Rules for Success
SharePoint 2013 Migration - Your 5 Rules for Success
Christian Buckley
 
Office365 Governance Is Changing!!
Office365 Governance Is Changing!!Office365 Governance Is Changing!!
Office365 Governance Is Changing!!
Stacy Deere
 
Office 365 and using SharePoint Online
Office 365 and using SharePoint OnlineOffice 365 and using SharePoint Online
Office 365 and using SharePoint Online
Cliff Ashcroft
 
SharePoint Migration - To Be Or Not To Be ‘In The Cloud’
SharePoint Migration - To Be Or Not To Be ‘In The Cloud’ SharePoint Migration - To Be Or Not To Be ‘In The Cloud’
SharePoint Migration - To Be Or Not To Be ‘In The Cloud’
Adam Levithan
 
WISPUG - Fun with SharePoint Migrations
WISPUG - Fun with SharePoint MigrationsWISPUG - Fun with SharePoint Migrations
WISPUG - Fun with SharePoint Migrations
Brian Caauwe
 
Customizing Microsoft Teams Provisioning and-Governance
Customizing Microsoft Teams Provisioning and-GovernanceCustomizing Microsoft Teams Provisioning and-Governance
Customizing Microsoft Teams Provisioning and-Governance
Olli Jääskeläinen
 
SharePoint Conference North America 2018 - Las Vegas - Announcements
SharePoint Conference North America 2018 - Las Vegas - AnnouncementsSharePoint Conference North America 2018 - Las Vegas - Announcements
SharePoint Conference North America 2018 - Las Vegas - Announcements
Nick Hobbs
 

Similar to Tips and tricks for complex migrations to SharePoint Online (20)

O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
 
11 Strategic Considerations for SharePoint Migration presented by Christian B...
11 Strategic Considerations for SharePoint Migration presented by Christian B...11 Strategic Considerations for SharePoint Migration presented by Christian B...
11 Strategic Considerations for SharePoint Migration presented by Christian B...
 
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...One101 double the trouble double the fun_ migrating to one_drive and sharepoi...
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...
 
Webinar: The Slippery Slope of Migrating to SharePoint Online or On-Premise
Webinar: The Slippery Slope of Migrating to SharePoint Online or On-PremiseWebinar: The Slippery Slope of Migrating to SharePoint Online or On-Premise
Webinar: The Slippery Slope of Migrating to SharePoint Online or On-Premise
 
SPTechCon Austin - The Slippery Slope of SharePoint Migrations
SPTechCon Austin - The Slippery Slope of SharePoint MigrationsSPTechCon Austin - The Slippery Slope of SharePoint Migrations
SPTechCon Austin - The Slippery Slope of SharePoint Migrations
 
Practical Tips for Migrating SharePoint Customizations to Office 365
Practical Tips for Migrating SharePoint Customizations to Office 365Practical Tips for Migrating SharePoint Customizations to Office 365
Practical Tips for Migrating SharePoint Customizations to Office 365
 
SPS Toronto 2015
SPS Toronto 2015SPS Toronto 2015
SPS Toronto 2015
 
Webinar: Slippery Slope of SharePoint Migrations
Webinar: Slippery Slope of SharePoint Migrations Webinar: Slippery Slope of SharePoint Migrations
Webinar: Slippery Slope of SharePoint Migrations
 
SPS Toronto 2017 Keith Tuomi - Migrating to SharePoint Online & OneDrive for ...
SPS Toronto 2017 Keith Tuomi - Migrating to SharePoint Online & OneDrive for ...SPS Toronto 2017 Keith Tuomi - Migrating to SharePoint Online & OneDrive for ...
SPS Toronto 2017 Keith Tuomi - Migrating to SharePoint Online & OneDrive for ...
 
Katpro Technologies- SharePoint Portfolio
Katpro Technologies- SharePoint PortfolioKatpro Technologies- SharePoint Portfolio
Katpro Technologies- SharePoint Portfolio
 
Tips in migrating to SharePoint 2016 or O365, to avoid a migration headache
Tips in migrating to SharePoint 2016 or O365, to avoid a migration headacheTips in migrating to SharePoint 2016 or O365, to avoid a migration headache
Tips in migrating to SharePoint 2016 or O365, to avoid a migration headache
 
Share point development thrust 2019
Share point development thrust 2019Share point development thrust 2019
Share point development thrust 2019
 
What You Need to Know Before Upgrading to SharePoint 2013
What You Need to Know Before Upgrading to SharePoint 2013What You Need to Know Before Upgrading to SharePoint 2013
What You Need to Know Before Upgrading to SharePoint 2013
 
SharePoint 2013 Migration - Your 5 Rules for Success
SharePoint 2013 Migration  - Your 5 Rules for SuccessSharePoint 2013 Migration  - Your 5 Rules for Success
SharePoint 2013 Migration - Your 5 Rules for Success
 
Office365 Governance Is Changing!!
Office365 Governance Is Changing!!Office365 Governance Is Changing!!
Office365 Governance Is Changing!!
 
Office 365 and using SharePoint Online
Office 365 and using SharePoint OnlineOffice 365 and using SharePoint Online
Office 365 and using SharePoint Online
 
SharePoint Migration - To Be Or Not To Be ‘In The Cloud’
SharePoint Migration - To Be Or Not To Be ‘In The Cloud’ SharePoint Migration - To Be Or Not To Be ‘In The Cloud’
SharePoint Migration - To Be Or Not To Be ‘In The Cloud’
 
WISPUG - Fun with SharePoint Migrations
WISPUG - Fun with SharePoint MigrationsWISPUG - Fun with SharePoint Migrations
WISPUG - Fun with SharePoint Migrations
 
Customizing Microsoft Teams Provisioning and-Governance
Customizing Microsoft Teams Provisioning and-GovernanceCustomizing Microsoft Teams Provisioning and-Governance
Customizing Microsoft Teams Provisioning and-Governance
 
SharePoint Conference North America 2018 - Las Vegas - Announcements
SharePoint Conference North America 2018 - Las Vegas - AnnouncementsSharePoint Conference North America 2018 - Las Vegas - Announcements
SharePoint Conference North America 2018 - Las Vegas - Announcements
 

More from Andries den Haan

Why content management maturity matters...
Why content management maturity matters...Why content management maturity matters...
Why content management maturity matters...
Andries den Haan
 
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdfDIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
Andries den Haan
 
Embracing the long term view to build a true digital workplace
Embracing the long term view to build a true digital workplaceEmbracing the long term view to build a true digital workplace
Embracing the long term view to build a true digital workplace
Andries den Haan
 
Practical large scale migration guidance
Practical large scale migration guidancePractical large scale migration guidance
Practical large scale migration guidance
Andries den Haan
 
Msol10 extending social features in share point 2010 v0.4
Msol10   extending social features in share point 2010 v0.4Msol10   extending social features in share point 2010 v0.4
Msol10 extending social features in share point 2010 v0.4
Andries den Haan
 
Moving beyond service applications to build a social ecosystem v1.1
Moving beyond service applications to build a social ecosystem v1.1Moving beyond service applications to build a social ecosystem v1.1
Moving beyond service applications to build a social ecosystem v1.1
Andries den Haan
 
Deploying the share point user profile service
Deploying the share point user profile serviceDeploying the share point user profile service
Deploying the share point user profile service
Andries den Haan
 

More from Andries den Haan (7)

Why content management maturity matters...
Why content management maturity matters...Why content management maturity matters...
Why content management maturity matters...
 
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdfDIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
 
Embracing the long term view to build a true digital workplace
Embracing the long term view to build a true digital workplaceEmbracing the long term view to build a true digital workplace
Embracing the long term view to build a true digital workplace
 
Practical large scale migration guidance
Practical large scale migration guidancePractical large scale migration guidance
Practical large scale migration guidance
 
Msol10 extending social features in share point 2010 v0.4
Msol10   extending social features in share point 2010 v0.4Msol10   extending social features in share point 2010 v0.4
Msol10 extending social features in share point 2010 v0.4
 
Moving beyond service applications to build a social ecosystem v1.1
Moving beyond service applications to build a social ecosystem v1.1Moving beyond service applications to build a social ecosystem v1.1
Moving beyond service applications to build a social ecosystem v1.1
 
Deploying the share point user profile service
Deploying the share point user profile serviceDeploying the share point user profile service
Deploying the share point user profile service
 

Recently uploaded

Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
Ivo Velitchkov
 
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid ResearchHarnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Neo4j
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
operationspcvita
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
Pablo Gómez Abajo
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
Neo4j
 
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge GraphGraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
Neo4j
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
JavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green MasterplanJavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green Masterplan
Miro Wengner
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota
Fwdays
 
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
Fwdays
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
Tatiana Kojar
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
Edge AI and Vision Alliance
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
Alex Pruden
 
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
Edge AI and Vision Alliance
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
Antonios Katsarakis
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
saastr
 

Recently uploaded (20)

Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
 
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid ResearchHarnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
 
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge GraphGraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
JavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green MasterplanJavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green Masterplan
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota
 
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
 
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
 

Tips and tricks for complex migrations to SharePoint Online

  • 1.
  • 2. Tips and tricks for complex migrations to SharePoint Online Office 365 and SharePoint Connect – Community Edition, October 2019
  • 3. Are you considering, preparing or executing a large-scale migration to Office 365?
  • 4. Expect to run into some problems along the way
  • 5. This session aims to help you with tips and tricks to increase your project’s success rate
  • 6. Are you in the right session? • Expect a mix of technical and tactical topics that will help you to design and execute your large-scale migration project • Large-scale migrations as in Terabytes and Petabytes • We’re talking documents, file shares and SharePoint, not Exchange • Some live-demo’s and walk-throughs • Not really a business session • Up-tempo due to time constraints (45 minutes).
  • 7. Agenda • Introductions and objectives • Typical migration challenges • Migration means rationalization • Moving from classic to modern • Choosing the right migration tool • Bulk migrations using pipelines • Maximize automation for large-scale
  • 8. A brief personal introduction • Working in technology since 1999 • Architect for Wortell (via ETTU) since March 2015 • Previously: Pink Elephant, PinkRoccade, Getronics, Ordina & KPN Consulting • Crazy about technology that connects people • Focus on Business & IT Alignment:  Governance & security  Use of Best practices  Certified Microsoft Office 365 technology expert  Addicted to large-scale migrations  Andries.den.Haan@wortell.nl Twitter: @awdhaan
  • 9. Organizations have built up large collections of “Dark data” over the years…
  • 10. Typical challenges for large-scale migrations • Organizations with multiple divisions and offices • File shares existing for a long time, supporting various processes • Also SharePoint Server environments with multiple site collections • Variety in file structures and authorizations • Difficult to track responsible owner (if any) • Decisions on what to do with the data (migrate, dispose, quarantine or …) • Protecting sensitive data (PII, financial or even medical) • Designing a futureproof target architecture in the cloud • Remapping data from source • The sheer volume of data can result in longer processing time.
  • 11. What about business continuity?
  • 12. Typical project approach for large-scale migrations* Discover • Identify stakeholders and requirements • Prepare tooling and access to data sources • Conduct stakeholder interviews • Start scanning data sources • …. Analyze Rationalize Design Deploy • Implement target architecture • Deploy migration solution • Perform test migrations for technical validity and to gain performance metrics • Plan and estimate the migration • … Migrate • Perform continuous migrations • Adjust and optimize • Resolve known issues and investigate new • Progress reporting • … • Analyze scan results • Review functional and security requirements • Determine potential target locations • Define business rules to classify data • … • Classify data via defined business rules • Identify migration and relocation scenarios • Estimate migration throughput • Determine ordering and priority • … • Envision future state • Design target architecture • Determine governance guidelines and security baseline • Prepare migration and onboarding process • … * Technical perspective only. Parallel activities commonly include adoption and training
  • 13. Engage your stakeholders to set and keep things in motion
  • 14. To the Cloud and beyond Archive, dispose or … Application or HMUD? File types Ownership Age Sensitivity Rationalizing your data is hard work
  • 15. Tools you can use to support inventory and rationalization Tool Source Usage NTFS Permissions Reporter File share Analyze permission structures Microsoft Inventory Manager File share, SharePoint, Box, OneDrive, Google Drive Fasttrack tool: Inventory and issue reporting (use, file type and aging for file share data) Jam Software Tree Size Pro File share Analyze data (storage) structures and aging SharePoint Modernization Scanner SharePoint Provides insights on readiness and issues for modernizing classic sites SharePoint Migration Assessment Tool SharePoint Identify issues for SharePoint Server 2013 source environments Veritas Data Insights File share Inventory and analysis. Can extract presumable ownership
  • 16. NTFS Permissions Reporter can help to determine permission structures
  • 18. Your target architecture should be futureproof • Leverage the goodness of the Microsoft Cloud:  Better control of data lifecycle using retention policies and labels  Increased protection of sensitive data using DLP and sensitivity labels a.o.  Guided provisioning and flexibility through templating  Governance for policies & standards, operations and innovation • Easier to identify ownership (person, team, division, org) • Flexible site/team structure to accommodate for changes in the organization (Hub sites FTW) • …
  • 19. Mapping source and targets • Avoid granular permissions, follow the Office 365 Group structure and split into multiple groups/teams if required • Use sensitivity labels for item-level protection • Look for data and permission patterns • Design a naming convention for sites/teams and then design it again after validation with your stakeholders • Only migrate active data • Keep it simple. File share Finance division Teams Corporate Finance Admin Contracts Reports Archive Incoming
  • 20. Choosing between migration tools Microsoft SharePoint Migration tool: • Basic set of migration features • Support for one direction: on-premises-cloud • Basic PowerShell module • Currently lacking support for mapping, migration of specific content • Suitable for basic migrations • Easily scalable • Free to use • Improving with each new update. ShareGate: • Lot’s of features for migrations and reporting • Rich PowerShell module • On-premises-on-premises, on-premises-cloud, cloud-on-premises, cloud-cloud • Map and migrate specific data • Copy, flatten and merge site objects • Suitable for complex migrations • Export data to file system • Migrate term sets, web parts and other artefacts • Metadata enrichment during migrations • Reasonable pricing and excellent support service • Improving with each new update.
  • 21. Performance characteristics when using the SharePoint API for migration (Microsoft) Type of metadata Examples Maximum Light ISO files, video files 2 TB/day Medium List items, Office files (~1.5MB) 1 TB/day Heavy List items with custom columns, small files (~50kb) 250 GB /day Rules of thumb: • Large file size migrates faster than smaller ones • Files migrate faster than objects and list items • Actual throughput depends on local infrastructure, network speeds etc.
  • 22. A single ShareGate:Desktop instance typically migrates 5-15 GB/hour with peaks up to 35 GB • Sharegate is optimized to run with 4 cores (64 concurrent threads) • Also consider pre- and postmigration activities:  SharePoint site/Team provisioning (fair)  Applying configuration (depends on complexity)  Assigning Owner and Membership (fast)  Reporting and logging (fast) • Network dependencies:  1 GB via 5/1 Mbps ADSL line takes 16 minutes  1 GB via 1 GBPS line takes 8 seconds • Number simultaneous import jobs to each separate Content Database (contact Microsoft to pre-provision content databases for > 1TB migrations) • Provisioning sites and Teams in bulk prior to starting data migrations.
  • 23. Improving migration performance in ShareGate:Desktop • ShareGate:Desktop 12.0 can now register as an Azure application • This allows ShareGate to identify to Office 365 that it is running operations on your tenant through an access token • This will reduce throttling on tasks between Sharegate and Office 365 • Also grants ShareGate rights to use certain Microsoft functionality, such as the Graph API • Global Administrator role required for consent of the permissions.
  • 24. Azure Active Directory App registration
  • 25. Modernizing classic SharePoint sites • Converting classic artefacts to modern experiences • Why? Duh! Modern is simple, responsive and benefits from ongoing Microsoft investments • Some basic principles:  When moving to the cloud, only migrate data  When already in the Cloud, modernize what’s classic • SharePoint Patterns and Practices (PnP) are your best friends:  Guidance: http://aka.ms/sppnp-modernize  Toolkit: https://github.com/SharePoint/sp-dev-modernization • Start with gaining insights on modernization readiness and issues.
  • 26. The Modernization Scanner is awesome • Only for SharePoint Online • Use via GUI or command line • Scope to entire tenant, csv or individual sites • Configure specific scans or perform a full scan • Various authentication options • Detailed reports in Excel and csv.
  • 28. Modernize by connecting to an Office 365 group • Not supported for classic publishing portals • Upon “Groupify”:  A new Office 365 group is created, and connected to the site A new modern home page is created and set as home page  Group owners are now the site collection admins  Group owners are added to the site's Owners group  Group members are added to the site's Members group • Options to perform “Groupification”:  Self-service on the site (“Connect to new Office 365 Group”)  Via PnP PowerShell: Add-PnPOffice365GroupToSite.
  • 29. Demo: Modernizing by Groupification
  • 30. Options for modernizing SharePoint pages PnP PowerShell conversion: • Great for centrally managed scenarios • Superfast and easy to deploy • Integrates into a migration pipeline • Mapping files for web parts and layouts • Built-in logging. PnP Page Transformation UI solution: • Great for self-service scenarios • Fully deploy using a provided script • Best for non-customized environments • Feedback option • Enable or disable on a per site basis.
  • 32. Main script Create a migration pipeline with all required functions {f} {f} {f} {f} {f} csv input Logging, reporting <xml> <xml> mapping file(s)
  • 33. Designing a migration pipeline • Design each function with the expected input variables • Securely cache source and destination credentials (encrypted xml, Windows Credential Manager) • Accommodate for nesting of functions (e.g. copy-data in sub sites) • Handle errors if e.g. artefacts already exist • Functions are called through a “main” script and fed by input files (to-do, mappings, configs).
  • 34. Demo: Anatomy of a migration pipeline
  • 35. Complexity increases when the numbers go up • IT does not have the full insights on ownership, and they can’t make decisions for data at scale. And they shouldn’t anyway! • Bigger organizations have multiple divisions each with different rhythms. Planning migrations becomes difficult at scale • Complexity of merging or splitting data and other transformations • Multiple sources: File shares, SharePoint • Processing time of all repeating tasks are multiplied by the amount of data: e.g. 1 min. x 20.000 migrations already takes ~ 14 days.
  • 36. For large-scale, even common actions take time • Creating and continuously updating inventories • Typical actions like creating mappings or input files • Logging success and failure • Scripting solutions for known issues • Cleaning and customizing • Liaising with data stewards to resolve data issues • …
  • 37. Automate to epic proportions using a Migration Factory • Build and (incrementally) refresh data source inventories • Provide self-service to the business to:  Determine and claim ownership  Help resolve data related issues  Enrich inventories with sensitivity info  Prepare and approve decisions on what to do with the data  Choose an appropriate migration scenario  Allow for opt-in on scheduled migration batches  (Dis)approve migration outcome  Lock source environment and display banners • Be flexible in supporting different business requirements* • Scale up for increasing demand • Optimize the process of solving problems • Realtime reporting on progress and issues.
  • 38. Supporting multiple migration scenarios • Each migration scenario may contain multiple steps to:  Provision SharePoint Online sites or Teams (PnP)  Apply specific configurations (Site Design, PnP)  Migrate data (ShareGate:Desktop)  Perform checks and compares  Notify data stewards to approve migration outcome  Report output of each step back to the central database • PowerShell for a high degree of flexibility and extensibility • Standardized by function approach and shared elements • Use a repo for source control.
  • 39. High level design of a Migration Factory Migration database Migration Administrator Stakeholders SharePoint 2013 SharePoint 2010 Filers Inventory clientInventory client Migration portal C#js Migration servers PS SharePoint Online Microsoft Teams Reporting Migration AIP-Scanner Disposition Inventory client Decision n Data Owner(s) Data Steward(s)
  • 41.
  • 42.
  • 43.
  • 44.
  • 45.
  • 46. Key takeaways of this session • Complexity increases with increasing amounts of data • The business owns the data, support them to rationalize and facilitate them to migrate their own stuff • large-scale is all about optimizing the process • Current technology allow for a high degree of automation • Keep things simple when the numbers go up. Move first, adjust later! The nitty gritty stuff will slow you down • The PnP Community is simply awesome!

Editor's Notes

  1. Gartner defines dark data as the information assets organizations collect, process and store during regular business activities, but generally fail to use for other purposes (for example, analytics, business relationships and direct monetizing). Similar to dark matter in physics, dark data often comprises most organizations’ universe of information assets. Thus, organizations often retain dark data for compliance purposes only. Storing and securing data typically incurs more expense (and sometimes greater risk) than value.
  2. PII - Personally identifiable information PHI - Protected Health Information
  3. Plan frequent update sessions and keep them short and sweet; In case of issues that require stakeholder approval, provide options and advice Share progress reports and elaborate during update sessions.
  4. https://get.share-gate.com/rs/250-JDV-062/images/How_to_Optimize_Your_Migration_Speed_When_Using_Sharegate.pdf
  5. Multiple scan (inventory client) and migration servers Single central database containing all (meta)data