Data migration to Drupal using the migrate module

Data Migration with
Drupal using Migrate
Drupal を使ったデータ移行について
Data Migration with Drupal using Migrate, Drupalcamp Kyoto.
12th April 2014 - Luc Bézier, @Luukyb
Drupalcamp
Kyoto, Japan
https://www.flickr.com/photos/lifes26/4509331619/

Who am I
Luc Bézier, @Luukyb

Who am I
Freelance web, exclusively
Drupal projects since ~ 4 years.
I moved to Cebu City, Philippines ~ 1 year.
Twitter @Luukyb
luc@webizat.com
Luukyb on drupal.org

Who am I
Contributed to several large data migration
to drupal using migrate module.
Oracle to drupal :
BBC Good Food
UK public sector organisation

http://www.flickr.com/photos/larahsphotography/2795859728/
1. Introduction to data migration
2. Understanding the migrate module
3. Organise your Data migration with Migrate
4. Migrate in Drupal 8

Data migration
https://www.flickr.com/photos/usace_albuquerque/5547589951/

Data migration
Moving data from A to B
(and often, in the middle
you transform the data.)

Data migration
Simple migration?
Feeds module
Data mapping using UI.
drupal.org/project/feeds

Data migration
Use migrate module for a
complex migration.
Complex source or destination.

Data migration
https://www.flickr.com/photos/kieranlane/6635502419/

Data migration
Using the migrate module
can require code, coffee
and patience.
https://www.flickr.com/photos/kieranlane/6635502419/

Data migration
Good news:
Migrate module is very
flexible, powerful and well
documented.

Introduction to Migrate module
http://www.flickr.com/photos/zigazou76/9104028602

Drupal module
Install and enable
like any other contrib module
drupal.org/project/migrate

Created by Mike Ryan.
drupal.org/user/4420
Senior Technical Consultant
at Acquia

“framework for migrating
content into Drupal from other
sources”

What’s inside ?
- OOP Architecture
- An API
- Some drush commands
- Migrate UI

Built-in support of core items
(Nodes, Users, Files, Taxonomy
and comments)

Built-in support for
PDO, XML, CSV, JSON, and
native MSSQL and Oracle API
sources

You can extend
all sources, destinations.

Migration:
- 100% native drupal
- iterative

Related modules:
- Drupal-to-Drupal data migration (migrate_d2d)
- WordPress Migrate
- TYPO3_migrate

Understanding Migrate module

Your migration classes
extends the
abstract class Migration

Your source.
$this->source = new MigrateSourceSQL($query);

Your destination.
$this->destination = new
MigrateDestinationNode(’article');

Your mapping.
$this->addFieldMapping
('field_summary', 'summary');

Transform your data.
$this->addFieldMapping
('field_summary', 'summary’)
->callbacks(array($this, ’summaryFormat'));

Extra transformation and
processing can be done using
methods like:
function prepareRow($row)

Some cool features !
Source dependency definition.
$this->addFieldMapping('field_image', ’imagepath')
->sourceMigration(’MediaImages');

Easy to rollback the data.
When you run a migration,
migrate module stores the keys.

If you import into a
contributed module: 2 cases.

First case, my contrib module
does not support migrate.

Example: Media module.
Migrating content for the media
module requires migrate_extras.

Migrate extras module
implements extra support.
drupal.org/project/migrate_extras

Module maintainers are now
recommended to implement
migration directly in the
modules.

So second case, my contrib
module implements migrate.

Example: field collection.
Comes with a file
dedicated to migrate:
field_collection.migrate.inc

Use drush !
Limit the number of items to import,
Rollback the data,
Audit your migration, …

Organise your Data migration

Study the source data,
keep track of the changes.

Use a separate migration
environment.

Use a script to build this
environment from scratch.

Install your site with a profile
$ drush si profile
Migrate the data
$ drush mi MyMigration

Migrate to D8
https://www.flickr.com/photos/michaeljohn/306759922/

Migrate to D8
Drupal 8 will integrate a
Migration API to migrate your site from
Drupal 6 and Drupal 7 to Drupal 8.

Migrate to D8
This API will be
based on migrate module.
(currently still in progress)

Migrate to D8
Migration API in D8:
drupal.org/node/2127611
Migration modules list :
drupal.org/documentation/migrate

Questions?

Coming camps in PHL
Drupalcamp Manila : 26th April
Drupalcamp Cebu :
October 2014 (TBC)

Thank you !
ありがとう
luc@webizat.com
@luukyb

Data migration to Drupal using the migrate module

More Related Content

Viewers also liked

Similar to Data migration to Drupal using the migrate module

More from Luc Bézier

Recently uploaded

Data migration to Drupal using the migrate module