SlideShare a Scribd company logo
1 of 21
Download to read offline
Performing successful
migrations to the
Microsoft Cloud
CD36 • Andries den Haan • @awdhaan
Platinum sponsors
Gold sponsors
Silver sponsors
Community sponsor
Code of Conduct
As event and experience organizers, we seek to provide a respectful, friendly, professional experience for
everyone, regardless of gender, sexual orientation, physical appearance, disability, age, race or religion.
We do not tolerate any behavior that is degrading to any gender, race, sexual orientation, or disability, or any
behavior that would be deemed harassment or discrimination.
Individuals are responsible for knowing and abiding by our standards and we encourage everyone to assist in
creating a welcoming and safe environment. Please report any concerns, suspicious or disruptive activity or
behavior to the organizing team, so that we can address the issue immediately.
More information can be found on the CollabDays Benelux website at
https://www.collabdays.org/2020-benelux-online/about/
A brief personal introduction
• Working in technology since 1999
• Currently as a Cloud Solution Architect at Wortell, which is an awesome
company
• Previously: Pink Elephant, PinkRoccade, Getronics, Ordina, KPN
Consulting & ETTU
• Crazy about technology that connects people
• Focus on Business & IT Alignment:
o Governance & security
o Use of Best practices
• Certified Microsoft Office 365 technology expert
• Proudly addicted to (large-scale) migrations ☺
Andries.den.Haan@wortell.nl
Twitter: @awdhaan
Blog: www.tribework.nl
What you can expect from this session
Focus on technology
opposed to other
project streams
Fuzzy blend of slides
& demos when
you’re neck-deep
into migrations
Inspiration on how to
handle and admin
your large-scale
scenarios
Getting the latest
info on what is
happening around
tools and approaches
(excluding Mover)
Sharing some
experiences from
previous projects
This is not a 101
session
Advice from the
Microsoft and
ShareGate product
teams
Some (PnP)
PowerShell, fun and
interaction! ☺
Session agenda
• Getting the best migration performance
• Gathering metrics from your migrations
• How to proof migrations were done in full
• Automating like a boss
• Tenant-2-tenant migrations for Microsoft Teams.
Some fundamental
recommendations
• Choose the right tool for the job (the list below is based on previous experiences):
• SharePoint Migration Tool (SharePoint, file shares, PowerShell-driven)
• Migration Manager (file shares, scalable, new features coming later)
• Migrate through the SharePoint Online PowerShell module > Walkthrough
• ShareGate:Desktop
• AP Elements Fly
• Register ShareGate:Desktop (if used) as an Azure AD Desktop application
• Also use PnP PowerShell Azure AD App registration (which is now super easy) for improved
performance during pre- or postmigration actions (also to workaround ADFS/MFA-issues) -> Demo
PnP PowerShell Azure AD App registration Demo summary
• Use the latest PnP PowerShell release which includes a bug fix when using PowerShell ISE
• Run Initialize-PnPPowerShellAuthentication as a Global Administrator
• Give consent for the required permissions
• Import the certificate into the local certificate store including the private key
• Store the Client Id and Certificate Thumb in the Windows Credential store
• Authenticate using the new Azure AD App credentials.
Recommendations from the Microsoft & ShareGate:Desktop product
teams:
• Limit to 200-300K files per migration to keep things manageable
during the ‘Azure hop’
• Don’t migrate large amounts to a single site. Sites per organization
(2.000.000) is sufficient, so plenty of room to split up data
• Limit the amount of simultaneous operations
• For typical office file share migrations (~1.5 MB/file), 1 TB/day should
be feasible
• Throttling is less outside of typical business hours. Daytime migration
are still possible, but with a little bit more throttling.
Sizing your migrations is key
Ground rules: keep it simple
• Data needs to be copied from A to B, that’s all!
• Avoid pre- or postmigration script actions to
beautify or tidy the folder structure
(especially with large-scale file shares)
• Don’t migrate (granular) permissions. People work
differently in the target-environment, so that
same applies to authorizations.
Incremental vs. delta-migrations?
• Incremental migrations compares each file in source and destination
which can be really time consuming with large amounts of files
• Delta migrations are faster as these use date filters to only overwrite
files that were added or modified since the last full migration.
Initial full migration “Delta” migration
Register the start time
End-users continue to work in the source environment
Migrate in “Overwrite”-mode using
the date filter
Content freeze in the source
Why should you care about gathering metrics
from your migrations?
• Especially relevant for large-scale migrations
• All activities cost time, but how much by average?
• How much data can be migrated within e.g. a day?
• It can help you to determine a baseline.
Comparing some popular tools on metrics
ShareGate:Desktop
• Summary reporting is limited
to ItemsCopied, Successes,
Warnings and Errors
• Detailed reports can become
difficult to process for large
amounts of data, although
still valuable. Especially,
when exporting to CSV.
SharePoint Migration Tool
• Summary reporting is
surprisingly useful -> Demo
• GB/Hour metric
• GB in source and migrated
• Item-level summaries are
also included -> Demo.
Migration manager
• Similar reporting as SharePoint
Migration Tool
• Currently manual download from
the SharePoint Admin Center
(this will change soon).
Migration
Manager
How to proof that you’re done
• In addition to migration reports, item count comparison
shows if all in scope was copied as expected
• PowerShell to the rescue as always
• Consider UNC path length limitations in scripting logic
• Consider 5.000 item query limit when programmatically
querying the list
• Distinguish between files and folders
• Use a loop and function approach to populate e.g. a csv-
based report
• Demo!
Automating like a boss
• Why? Because the administration
can be time consuming with large
amounts of data
• Stakeholders expect (near) real-time
progress reporting
• It should be one of your goals as a
migration admin to spend the least
amount of time on administration.
• Alternate approach when you are working on large-scale migrations
with 10.000’s of users and multiple Terabytes of data
• Data-model can be easily created using Visual Studio and published
to Azure
• Use common PowerShell functions to execute stored procedures to
Create, Read, Update or Delete data through PowerShell
• Link scripts to scheduled tasks
• Works when using e.g. SPMT or ShareGate as these tools have
sufficient PowerShell support
• Use email as a means of notifying the migration admin about errors
(could also be used to inform data owners on migration start/end)
• Simplified walkthrough and demo of a Data Migration Factory.
Stepping up from CSV’s to databases
Error
notification
using
PowerShell
Data Migration Factory High level architecture
• Inventory clients importing
data for each organizational
entity into the database
• Batches are created and
assigned to file shares and
migration servers to
distribute the load
• Scheduled console apps poll
the database for any batch-
items that needs to be
processed and trigger the
PowerShell scripts using the
record Id as the only
parameter
• Integrated reporting through
database queries.
Migration
database
SharePoint
2013
SharePoint
2010
Filers
Inventory clientInventory client
Migration servers
PS
SharePoint Online
Microsoft Teams
Reporting
Inventory client
Migrating Teams tenant-2-tenant
• Copy Channels (conversations and files), Tabs and Apps
• Some limitations apply (more on support articles):
• Migrations are limited to the last 50 messages including replies. All other messages
are stored in an HTML archive page (tab)
• Meeting URL’s are tenant-specific, so recreate meetings after migration
• Private channel (files, not conversations) can be difficult to migrate
• ShareGate is doing a great job, supports PowerShell (GUI is currently
richer) for this and will extend their capability soon:
• Choosing specific channels to migrate
• Merge into existing Teams.
Let’s wrap-up this session…
• Slides will be shared
• Script examples available upon request
• Check my blog for upcoming posts
• Contact me for any questions or comments ☺
Thank you!

More Related Content

What's hot

SPS Chevy Chase Tips on migrating to Office 365
SPS Chevy Chase Tips on migrating to Office 365SPS Chevy Chase Tips on migrating to Office 365
SPS Chevy Chase Tips on migrating to Office 365Mike Maadarani
 
Oracle GoldenGate and Apache Kafka A Deep Dive Into Real-Time Data Streaming
Oracle GoldenGate and Apache Kafka A Deep Dive Into Real-Time Data StreamingOracle GoldenGate and Apache Kafka A Deep Dive Into Real-Time Data Streaming
Oracle GoldenGate and Apache Kafka A Deep Dive Into Real-Time Data StreamingMichael Rainey
 
Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...
Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...
Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...Lucas Jellema
 
SQL to NoSQL: Top 6 Questions
SQL to NoSQL: Top 6 QuestionsSQL to NoSQL: Top 6 Questions
SQL to NoSQL: Top 6 QuestionsMike Broberg
 
ADDO 2021: Why and how to include database changes in the deployment pipeline
ADDO 2021: Why and how to include database changes in the deployment pipelineADDO 2021: Why and how to include database changes in the deployment pipeline
ADDO 2021: Why and how to include database changes in the deployment pipelineEduardo Piairo
 
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...Patrick Guimonet
 
Data Con LA 2018 - Streaming and IoT by Pat Alwell
Data Con LA 2018 - Streaming and IoT by Pat AlwellData Con LA 2018 - Streaming and IoT by Pat Alwell
Data Con LA 2018 - Streaming and IoT by Pat AlwellData Con LA
 
Data Lake and the rise of the microservices
Data Lake and the rise of the microservicesData Lake and the rise of the microservices
Data Lake and the rise of the microservicesBigstep
 
SQL Server 2017 Enhancements You Need To Know
SQL Server 2017 Enhancements You Need To KnowSQL Server 2017 Enhancements You Need To Know
SQL Server 2017 Enhancements You Need To KnowQuest
 
Designing a Real Time Data Ingestion Pipeline
Designing a Real Time Data Ingestion PipelineDesigning a Real Time Data Ingestion Pipeline
Designing a Real Time Data Ingestion PipelineDataScience
 
Share point 2013 enterprise search (public)
Share point 2013 enterprise search (public)Share point 2013 enterprise search (public)
Share point 2013 enterprise search (public)Petter Skodvin-Hvammen
 
VTU 6th Sem Elective CSE - Module 4 cloud computing
VTU 6th Sem Elective CSE - Module 4  cloud computingVTU 6th Sem Elective CSE - Module 4  cloud computing
VTU 6th Sem Elective CSE - Module 4 cloud computingSachin Gowda
 
Cloudant Overview Bluemix Meetup from Lisa Neddam
Cloudant Overview Bluemix Meetup from Lisa NeddamCloudant Overview Bluemix Meetup from Lisa Neddam
Cloudant Overview Bluemix Meetup from Lisa NeddamRomeo Kienzler
 
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, Confluent
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, ConfluentApache Kafka and the Data Mesh | Ben Stopford and Michael Noll, Confluent
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, ConfluentHostedbyConfluent
 
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part20812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2Raul Chong
 
Chicago HUG Presentation Oct 2011
Chicago HUG Presentation Oct 2011Chicago HUG Presentation Oct 2011
Chicago HUG Presentation Oct 2011Abe Taha
 
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...Lucas Jellema
 

What's hot (20)

SPS Chevy Chase Tips on migrating to Office 365
SPS Chevy Chase Tips on migrating to Office 365SPS Chevy Chase Tips on migrating to Office 365
SPS Chevy Chase Tips on migrating to Office 365
 
Oracle GoldenGate and Apache Kafka A Deep Dive Into Real-Time Data Streaming
Oracle GoldenGate and Apache Kafka A Deep Dive Into Real-Time Data StreamingOracle GoldenGate and Apache Kafka A Deep Dive Into Real-Time Data Streaming
Oracle GoldenGate and Apache Kafka A Deep Dive Into Real-Time Data Streaming
 
Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...
Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...
Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...
 
SQL to NoSQL: Top 6 Questions
SQL to NoSQL: Top 6 QuestionsSQL to NoSQL: Top 6 Questions
SQL to NoSQL: Top 6 Questions
 
introduction v4
introduction v4introduction v4
introduction v4
 
ADDO 2021: Why and how to include database changes in the deployment pipeline
ADDO 2021: Why and how to include database changes in the deployment pipelineADDO 2021: Why and how to include database changes in the deployment pipeline
ADDO 2021: Why and how to include database changes in the deployment pipeline
 
slides
slidesslides
slides
 
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...
 
Data Con LA 2018 - Streaming and IoT by Pat Alwell
Data Con LA 2018 - Streaming and IoT by Pat AlwellData Con LA 2018 - Streaming and IoT by Pat Alwell
Data Con LA 2018 - Streaming and IoT by Pat Alwell
 
Data Lake and the rise of the microservices
Data Lake and the rise of the microservicesData Lake and the rise of the microservices
Data Lake and the rise of the microservices
 
Tableau API
Tableau APITableau API
Tableau API
 
SQL Server 2017 Enhancements You Need To Know
SQL Server 2017 Enhancements You Need To KnowSQL Server 2017 Enhancements You Need To Know
SQL Server 2017 Enhancements You Need To Know
 
Designing a Real Time Data Ingestion Pipeline
Designing a Real Time Data Ingestion PipelineDesigning a Real Time Data Ingestion Pipeline
Designing a Real Time Data Ingestion Pipeline
 
Share point 2013 enterprise search (public)
Share point 2013 enterprise search (public)Share point 2013 enterprise search (public)
Share point 2013 enterprise search (public)
 
VTU 6th Sem Elective CSE - Module 4 cloud computing
VTU 6th Sem Elective CSE - Module 4  cloud computingVTU 6th Sem Elective CSE - Module 4  cloud computing
VTU 6th Sem Elective CSE - Module 4 cloud computing
 
Cloudant Overview Bluemix Meetup from Lisa Neddam
Cloudant Overview Bluemix Meetup from Lisa NeddamCloudant Overview Bluemix Meetup from Lisa Neddam
Cloudant Overview Bluemix Meetup from Lisa Neddam
 
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, Confluent
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, ConfluentApache Kafka and the Data Mesh | Ben Stopford and Michael Noll, Confluent
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, Confluent
 
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part20812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
 
Chicago HUG Presentation Oct 2011
Chicago HUG Presentation Oct 2011Chicago HUG Presentation Oct 2011
Chicago HUG Presentation Oct 2011
 
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...
 

Similar to Performing successful migrations to the microsoft cloud

O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...NCCOMMS
 
SPTechCon Austin - The Slippery Slope of SharePoint Migrations
SPTechCon Austin - The Slippery Slope of SharePoint MigrationsSPTechCon Austin - The Slippery Slope of SharePoint Migrations
SPTechCon Austin - The Slippery Slope of SharePoint MigrationsJill Hannemann
 
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...One101 double the trouble double the fun_ migrating to one_drive and sharepoi...
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...Craig Jahnke
 
SPUnite17 Migrating to SharePoint Online Fast Track
SPUnite17 Migrating to SharePoint Online Fast TrackSPUnite17 Migrating to SharePoint Online Fast Track
SPUnite17 Migrating to SharePoint Online Fast TrackNCCOMMS
 
Making the Transition from the Suite to the Hub
Making the Transition from the Suite to the HubMaking the Transition from the Suite to the Hub
Making the Transition from the Suite to the HubJerika Phelps
 
Making the Transition from the Suite to the Hub
Making the Transition from the Suite to the HubMaking the Transition from the Suite to the Hub
Making the Transition from the Suite to the HubBlack Duck by Synopsys
 
How to prepare your site for content migration
How to prepare your site for content migrationHow to prepare your site for content migration
How to prepare your site for content migrationBlend Interactive
 
ActiveMigrate - ECM Renovation Roadshow
ActiveMigrate - ECM Renovation RoadshowActiveMigrate - ECM Renovation Roadshow
ActiveMigrate - ECM Renovation RoadshowZia Consulting
 
Data Vault Automation at the Bijenkorf
Data Vault Automation at the BijenkorfData Vault Automation at the Bijenkorf
Data Vault Automation at the BijenkorfRob Winters
 
Migrating on premises and cloud contents to SharePoint Online at no cost with...
Migrating on premises and cloud contents to SharePoint Online at no cost with...Migrating on premises and cloud contents to SharePoint Online at no cost with...
Migrating on premises and cloud contents to SharePoint Online at no cost with...Juan Carlos Gonzalez
 
Making the Transition from Suite to the Hub
Making the Transition from Suite to the HubMaking the Transition from Suite to the Hub
Making the Transition from Suite to the HubBlack Duck by Synopsys
 
Collab 365 - Real world scenarios to migrate to SharePoint 2016 or Office 365
Collab 365 - Real world scenarios to migrate to SharePoint 2016 or Office 365Collab 365 - Real world scenarios to migrate to SharePoint 2016 or Office 365
Collab 365 - Real world scenarios to migrate to SharePoint 2016 or Office 365Patrick Guimonet
 
Automation options with Office 365
Automation options with Office 365Automation options with Office 365
Automation options with Office 365Robert Crane
 
Acceleration Technology: Taking Media File Transfers From Days to Minutes
Acceleration Technology: Taking Media File Transfers From Days to MinutesAcceleration Technology: Taking Media File Transfers From Days to Minutes
Acceleration Technology: Taking Media File Transfers From Days to MinutesFileCatalyst
 
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your Mind
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your MindDeliver Best-in-Class HPC Cloud Solutions Without Losing Your Mind
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your MindAvere Systems
 
How to Build a Compute Cluster
How to Build a Compute ClusterHow to Build a Compute Cluster
How to Build a Compute ClusterRamsay Key
 
ECM Renovation Roadshow - ECM System Migration
ECM Renovation Roadshow - ECM System MigrationECM Renovation Roadshow - ECM System Migration
ECM Renovation Roadshow - ECM System MigrationZia Consulting
 
Plan to Migrate to SharePoint Online
Plan to Migrate to SharePoint OnlinePlan to Migrate to SharePoint Online
Plan to Migrate to SharePoint OnlineErica Toelle
 

Similar to Performing successful migrations to the microsoft cloud (20)

O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
 
SPTechCon Austin - The Slippery Slope of SharePoint Migrations
SPTechCon Austin - The Slippery Slope of SharePoint MigrationsSPTechCon Austin - The Slippery Slope of SharePoint Migrations
SPTechCon Austin - The Slippery Slope of SharePoint Migrations
 
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...One101 double the trouble double the fun_ migrating to one_drive and sharepoi...
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...
 
SPUnite17 Migrating to SharePoint Online Fast Track
SPUnite17 Migrating to SharePoint Online Fast TrackSPUnite17 Migrating to SharePoint Online Fast Track
SPUnite17 Migrating to SharePoint Online Fast Track
 
Making the Transition from the Suite to the Hub
Making the Transition from the Suite to the HubMaking the Transition from the Suite to the Hub
Making the Transition from the Suite to the Hub
 
Making the Transition from the Suite to the Hub
Making the Transition from the Suite to the HubMaking the Transition from the Suite to the Hub
Making the Transition from the Suite to the Hub
 
How to prepare your site for content migration
How to prepare your site for content migrationHow to prepare your site for content migration
How to prepare your site for content migration
 
ActiveMigrate - ECM Renovation Roadshow
ActiveMigrate - ECM Renovation RoadshowActiveMigrate - ECM Renovation Roadshow
ActiveMigrate - ECM Renovation Roadshow
 
Data Vault Automation at the Bijenkorf
Data Vault Automation at the BijenkorfData Vault Automation at the Bijenkorf
Data Vault Automation at the Bijenkorf
 
Migrating on premises and cloud contents to SharePoint Online at no cost with...
Migrating on premises and cloud contents to SharePoint Online at no cost with...Migrating on premises and cloud contents to SharePoint Online at no cost with...
Migrating on premises and cloud contents to SharePoint Online at no cost with...
 
Datastage Introduction To Data Warehousing
Datastage Introduction To Data WarehousingDatastage Introduction To Data Warehousing
Datastage Introduction To Data Warehousing
 
Making the Transition from Suite to the Hub
Making the Transition from Suite to the HubMaking the Transition from Suite to the Hub
Making the Transition from Suite to the Hub
 
Collab 365 - Real world scenarios to migrate to SharePoint 2016 or Office 365
Collab 365 - Real world scenarios to migrate to SharePoint 2016 or Office 365Collab 365 - Real world scenarios to migrate to SharePoint 2016 or Office 365
Collab 365 - Real world scenarios to migrate to SharePoint 2016 or Office 365
 
Automation options with Office 365
Automation options with Office 365Automation options with Office 365
Automation options with Office 365
 
Acceleration Technology: Taking Media File Transfers From Days to Minutes
Acceleration Technology: Taking Media File Transfers From Days to MinutesAcceleration Technology: Taking Media File Transfers From Days to Minutes
Acceleration Technology: Taking Media File Transfers From Days to Minutes
 
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your Mind
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your MindDeliver Best-in-Class HPC Cloud Solutions Without Losing Your Mind
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your Mind
 
To the cloud!
To the cloud!To the cloud!
To the cloud!
 
How to Build a Compute Cluster
How to Build a Compute ClusterHow to Build a Compute Cluster
How to Build a Compute Cluster
 
ECM Renovation Roadshow - ECM System Migration
ECM Renovation Roadshow - ECM System MigrationECM Renovation Roadshow - ECM System Migration
ECM Renovation Roadshow - ECM System Migration
 
Plan to Migrate to SharePoint Online
Plan to Migrate to SharePoint OnlinePlan to Migrate to SharePoint Online
Plan to Migrate to SharePoint Online
 

More from Andries den Haan

DIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdfDIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdfAndries den Haan
 
Embracing the long term view to build a true digital workplace
Embracing the long term view to build a true digital workplaceEmbracing the long term view to build a true digital workplace
Embracing the long term view to build a true digital workplaceAndries den Haan
 
Practical large scale migration guidance
Practical large scale migration guidancePractical large scale migration guidance
Practical large scale migration guidanceAndries den Haan
 
Msol10 extending social features in share point 2010 v0.4
Msol10   extending social features in share point 2010 v0.4Msol10   extending social features in share point 2010 v0.4
Msol10 extending social features in share point 2010 v0.4Andries den Haan
 
Moving beyond service applications to build a social ecosystem v1.1
Moving beyond service applications to build a social ecosystem v1.1Moving beyond service applications to build a social ecosystem v1.1
Moving beyond service applications to build a social ecosystem v1.1Andries den Haan
 
Deploying the share point user profile service
Deploying the share point user profile serviceDeploying the share point user profile service
Deploying the share point user profile serviceAndries den Haan
 

More from Andries den Haan (6)

DIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdfDIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
 
Embracing the long term view to build a true digital workplace
Embracing the long term view to build a true digital workplaceEmbracing the long term view to build a true digital workplace
Embracing the long term view to build a true digital workplace
 
Practical large scale migration guidance
Practical large scale migration guidancePractical large scale migration guidance
Practical large scale migration guidance
 
Msol10 extending social features in share point 2010 v0.4
Msol10   extending social features in share point 2010 v0.4Msol10   extending social features in share point 2010 v0.4
Msol10 extending social features in share point 2010 v0.4
 
Moving beyond service applications to build a social ecosystem v1.1
Moving beyond service applications to build a social ecosystem v1.1Moving beyond service applications to build a social ecosystem v1.1
Moving beyond service applications to build a social ecosystem v1.1
 
Deploying the share point user profile service
Deploying the share point user profile serviceDeploying the share point user profile service
Deploying the share point user profile service
 

Recently uploaded

Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfFIDO Alliance
 
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfSimplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfFIDO Alliance
 
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptxWSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptxJennifer Lim
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireExakis Nelite
 
Syngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon
 
Your enemies use GenAI too - staying ahead of fraud with Neo4j
Your enemies use GenAI too - staying ahead of fraud with Neo4jYour enemies use GenAI too - staying ahead of fraud with Neo4j
Your enemies use GenAI too - staying ahead of fraud with Neo4jNeo4j
 
ECS 2024 Teams Premium - Pretty Secure
ECS 2024   Teams Premium - Pretty SecureECS 2024   Teams Premium - Pretty Secure
ECS 2024 Teams Premium - Pretty SecureFemke de Vroome
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfSrushith Repakula
 
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...FIDO Alliance
 
What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024Stephanie Beckett
 
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...CzechDreamin
 
Working together SRE & Platform Engineering
Working together SRE & Platform EngineeringWorking together SRE & Platform Engineering
Working together SRE & Platform EngineeringMarcus Vechiato
 
PLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsPLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsStefano
 
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...FIDO Alliance
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceSamy Fodil
 
Oauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftOauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftshyamraj55
 
Structuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessStructuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessUXDXConf
 
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfThe Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfFIDO Alliance
 
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...CzechDreamin
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfFIDO Alliance
 

Recently uploaded (20)

Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
 
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfSimplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
 
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptxWSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - Questionnaire
 
Syngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdf
 
Your enemies use GenAI too - staying ahead of fraud with Neo4j
Your enemies use GenAI too - staying ahead of fraud with Neo4jYour enemies use GenAI too - staying ahead of fraud with Neo4j
Your enemies use GenAI too - staying ahead of fraud with Neo4j
 
ECS 2024 Teams Premium - Pretty Secure
ECS 2024   Teams Premium - Pretty SecureECS 2024   Teams Premium - Pretty Secure
ECS 2024 Teams Premium - Pretty Secure
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdf
 
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
 
What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024
 
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
 
Working together SRE & Platform Engineering
Working together SRE & Platform EngineeringWorking together SRE & Platform Engineering
Working together SRE & Platform Engineering
 
PLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsPLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. Startups
 
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM Performance
 
Oauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftOauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoft
 
Structuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessStructuring Teams and Portfolios for Success
Structuring Teams and Portfolios for Success
 
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfThe Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
 
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
 

Performing successful migrations to the microsoft cloud

  • 1. Performing successful migrations to the Microsoft Cloud CD36 • Andries den Haan • @awdhaan
  • 2. Platinum sponsors Gold sponsors Silver sponsors Community sponsor
  • 3. Code of Conduct As event and experience organizers, we seek to provide a respectful, friendly, professional experience for everyone, regardless of gender, sexual orientation, physical appearance, disability, age, race or religion. We do not tolerate any behavior that is degrading to any gender, race, sexual orientation, or disability, or any behavior that would be deemed harassment or discrimination. Individuals are responsible for knowing and abiding by our standards and we encourage everyone to assist in creating a welcoming and safe environment. Please report any concerns, suspicious or disruptive activity or behavior to the organizing team, so that we can address the issue immediately. More information can be found on the CollabDays Benelux website at https://www.collabdays.org/2020-benelux-online/about/
  • 4. A brief personal introduction • Working in technology since 1999 • Currently as a Cloud Solution Architect at Wortell, which is an awesome company • Previously: Pink Elephant, PinkRoccade, Getronics, Ordina, KPN Consulting & ETTU • Crazy about technology that connects people • Focus on Business & IT Alignment: o Governance & security o Use of Best practices • Certified Microsoft Office 365 technology expert • Proudly addicted to (large-scale) migrations ☺ Andries.den.Haan@wortell.nl Twitter: @awdhaan Blog: www.tribework.nl
  • 5. What you can expect from this session Focus on technology opposed to other project streams Fuzzy blend of slides & demos when you’re neck-deep into migrations Inspiration on how to handle and admin your large-scale scenarios Getting the latest info on what is happening around tools and approaches (excluding Mover) Sharing some experiences from previous projects This is not a 101 session Advice from the Microsoft and ShareGate product teams Some (PnP) PowerShell, fun and interaction! ☺
  • 6. Session agenda • Getting the best migration performance • Gathering metrics from your migrations • How to proof migrations were done in full • Automating like a boss • Tenant-2-tenant migrations for Microsoft Teams.
  • 7. Some fundamental recommendations • Choose the right tool for the job (the list below is based on previous experiences): • SharePoint Migration Tool (SharePoint, file shares, PowerShell-driven) • Migration Manager (file shares, scalable, new features coming later) • Migrate through the SharePoint Online PowerShell module > Walkthrough • ShareGate:Desktop • AP Elements Fly • Register ShareGate:Desktop (if used) as an Azure AD Desktop application • Also use PnP PowerShell Azure AD App registration (which is now super easy) for improved performance during pre- or postmigration actions (also to workaround ADFS/MFA-issues) -> Demo
  • 8. PnP PowerShell Azure AD App registration Demo summary • Use the latest PnP PowerShell release which includes a bug fix when using PowerShell ISE • Run Initialize-PnPPowerShellAuthentication as a Global Administrator • Give consent for the required permissions • Import the certificate into the local certificate store including the private key • Store the Client Id and Certificate Thumb in the Windows Credential store • Authenticate using the new Azure AD App credentials.
  • 9. Recommendations from the Microsoft & ShareGate:Desktop product teams: • Limit to 200-300K files per migration to keep things manageable during the ‘Azure hop’ • Don’t migrate large amounts to a single site. Sites per organization (2.000.000) is sufficient, so plenty of room to split up data • Limit the amount of simultaneous operations • For typical office file share migrations (~1.5 MB/file), 1 TB/day should be feasible • Throttling is less outside of typical business hours. Daytime migration are still possible, but with a little bit more throttling. Sizing your migrations is key
  • 10. Ground rules: keep it simple • Data needs to be copied from A to B, that’s all! • Avoid pre- or postmigration script actions to beautify or tidy the folder structure (especially with large-scale file shares) • Don’t migrate (granular) permissions. People work differently in the target-environment, so that same applies to authorizations.
  • 11. Incremental vs. delta-migrations? • Incremental migrations compares each file in source and destination which can be really time consuming with large amounts of files • Delta migrations are faster as these use date filters to only overwrite files that were added or modified since the last full migration. Initial full migration “Delta” migration Register the start time End-users continue to work in the source environment Migrate in “Overwrite”-mode using the date filter Content freeze in the source
  • 12. Why should you care about gathering metrics from your migrations? • Especially relevant for large-scale migrations • All activities cost time, but how much by average? • How much data can be migrated within e.g. a day? • It can help you to determine a baseline.
  • 13. Comparing some popular tools on metrics ShareGate:Desktop • Summary reporting is limited to ItemsCopied, Successes, Warnings and Errors • Detailed reports can become difficult to process for large amounts of data, although still valuable. Especially, when exporting to CSV. SharePoint Migration Tool • Summary reporting is surprisingly useful -> Demo • GB/Hour metric • GB in source and migrated • Item-level summaries are also included -> Demo. Migration manager • Similar reporting as SharePoint Migration Tool • Currently manual download from the SharePoint Admin Center (this will change soon). Migration Manager
  • 14. How to proof that you’re done • In addition to migration reports, item count comparison shows if all in scope was copied as expected • PowerShell to the rescue as always • Consider UNC path length limitations in scripting logic • Consider 5.000 item query limit when programmatically querying the list • Distinguish between files and folders • Use a loop and function approach to populate e.g. a csv- based report • Demo!
  • 15. Automating like a boss • Why? Because the administration can be time consuming with large amounts of data • Stakeholders expect (near) real-time progress reporting • It should be one of your goals as a migration admin to spend the least amount of time on administration.
  • 16. • Alternate approach when you are working on large-scale migrations with 10.000’s of users and multiple Terabytes of data • Data-model can be easily created using Visual Studio and published to Azure • Use common PowerShell functions to execute stored procedures to Create, Read, Update or Delete data through PowerShell • Link scripts to scheduled tasks • Works when using e.g. SPMT or ShareGate as these tools have sufficient PowerShell support • Use email as a means of notifying the migration admin about errors (could also be used to inform data owners on migration start/end) • Simplified walkthrough and demo of a Data Migration Factory. Stepping up from CSV’s to databases
  • 18. Data Migration Factory High level architecture • Inventory clients importing data for each organizational entity into the database • Batches are created and assigned to file shares and migration servers to distribute the load • Scheduled console apps poll the database for any batch- items that needs to be processed and trigger the PowerShell scripts using the record Id as the only parameter • Integrated reporting through database queries. Migration database SharePoint 2013 SharePoint 2010 Filers Inventory clientInventory client Migration servers PS SharePoint Online Microsoft Teams Reporting Inventory client
  • 19. Migrating Teams tenant-2-tenant • Copy Channels (conversations and files), Tabs and Apps • Some limitations apply (more on support articles): • Migrations are limited to the last 50 messages including replies. All other messages are stored in an HTML archive page (tab) • Meeting URL’s are tenant-specific, so recreate meetings after migration • Private channel (files, not conversations) can be difficult to migrate • ShareGate is doing a great job, supports PowerShell (GUI is currently richer) for this and will extend their capability soon: • Choosing specific channels to migrate • Merge into existing Teams.
  • 20. Let’s wrap-up this session… • Slides will be shared • Script examples available upon request • Check my blog for upcoming posts • Contact me for any questions or comments ☺