Lando Migration Webinar Part 1 Followup
Thank you for everyone who attended our first webinar. We are extremely appreciative that you decided to spend a Friday afternoon with us. For those of you who missed it, here is the YouTube video of the webinar:
Here is a brief overview what was discussed with relevant samples and links per section.
Setting up a 2nd DB container
In the first part of the webinar, I showed everyone how to setup a 2nd database container in your Lando. This is so you can run your Drupal 8/9 migrations locally. Here is the configuration needed to get that going:
name: migration-webinar excludes: - drush - scripts - vendor - web/core - web/modules/contrib - web/profiles/contrib - web/sites/default/files - web/themes/contrib recipe: drupal8 config: via: nginx webroot: web php: 7.3 database: mariadb xdebug: false services: d7db: type: mariadb creds: user: drupal7db password: drupal7db database: drupal7db portforward: true
$databases['migrate']['default'] = [ 'database' => 'drupal7db', 'username' => 'drupal7db', 'password' => 'drupal7db', 'prefix' => '', 'host' => 'd7db', 'port' => '3306', 'namespace' => 'Drupal\\Core\\Database\\Driver\\mysql', 'driver' => 'mysql', ];
Finally, to import the second database with lando, run:
lando db-import --host=d7db --user=drupal7db dump.sql.gz. That's it, you should now have your Drupal 7 database locally andd ready to run migrations.
Drupal 8/9 Migration Modules to use
In this section, I went over the main modules I use to do migrations. They were as follows:
Drupal Core’s Migrate & Migrate Drupal
Contains all the base functionality & plugins needed for the migration. You technically only need these two modules, but your life would be exponentially easier if you used all the modules I suggest.
Adds a lot of widely used plugins, makes migrations config entities, and allows grouping of configs. This is by far the most useful out of all the contrib modules for migrations.
Gives you the drush commands needed to run a migration via the CLI.
Give you the drush migrate-upgrade command needed to get your initial config over. You really only use this module one time and then you are done.
Obtaining the config for the migration
In this section we learned about the config and how to get it out of the Drupal 7 site. I also had the migration boilerplate enabled by this point. The steps to obtain the config from your Drupal 7 site are as follows:
lando drush migrate-upgrade --legacy-db-key=migrate --configure-only lando drush config-export --destination=/tmp/migrate lando ssh -s appserver -u root cp /tmp/migrate/migrate_plus.* /app/path/to/migration_boilerplate/unused_config chown -R www-data:www-data /app/path/to/migration_boilerplate/unused_config
This will get us all the config for our migration. This also puts all the migration config in active storage within config management. Since we will be cherry picking our specific items, you will need to nuke your active config with
lando drush cim -y.
In this section, I went over the various drush commands I use on a regular basis. They are as follows:
This command lists our all your migrations. You can use this to see what has been run. Make sure to slap on the --tag="Drupal 7" flag so you don't get all those red errors from Drupal 6 configs.
drush mim config_name
This command allows you to import your migrations based on the config name. You can also use the --group flag as well to run items within your migration groups all at once.
drush mr config_name
This command allows you to rollback your migrations based on the config name. You can also use the --group flag here as well.
drush mrs config_name
This command resets a migration status back to idle. This is commonly used when a migration has become stuck.
drush mmsg config_name
This is used to display the migration message when a migration fails. You can also use this as a debugging method via the MigrationSkipRow class and custom messages.
Debugging Migration with XDebug
This final part I should you how to setup XDebug in PHPStorm, debugging via the UI, and debugging via PHPStorm's console. It is best to watch through the video, because this is the heftier part of the webinar.
Here are some quick takeaways from this part:
If your XDebug session does not start
Check to make sure that XDebug is in your CLI Interpretor. If it is not, then do the following:
lando ssh -s appserver -u root cat /usr/local/etc/php/conf.d/docker-php-ext-xdebug.ini
Then add the output of the cat command to the Debugger extension in the CLI Interpretor. Hit Apply, then the refresh button next to the PHP executable. The XDebug version should now be there. Hit apply and OK and you will be good to go.
Enabling XDebug via the CLI
To enable XDebug for drush, go into your PHPStorm settings. Look under Languages, PHP, Server and grab the name of your server. It should be localhost, if not make note regardless. Use that to put this part in the services key of your .lando.yml
services: appserver: overrides: environment: PHP_IDE_CONFIG: "serverName=localhost"
Do a lando rebuild, and you should be ready to debug via your PHPStorm's console section.
I am very glad that you decided to attend this webinar. As I mentioned I have written numerous other migration blog posts over the years. For easy reference, here is the complete list:
- Migrating a Drupal 7 Body Field to a Drupal 8 Paragraph
- Migrating to a Drupal 8 Date Range
- Migrating Drupal 7 Organic Groups to Drupal 8 Group
- Handling Post Migration Events in Drupal 8
- Changing a Content Type Name During a Drupal 8 Migration
- Writing a Custom Drupal 8 Module Upgrade Path
- Writing a Drupal 8 Table to Table Migration Path
- Migrating a Drupal 7 File To a Drupal 8 Media Entity
- Migrating a Drupal 7 AddressField To a Drupal 8 Address
- Migrating a Drupal 8 Multisite to a Standalone Drupal 8 Site
Our next webinar will be held on May 8, 2020; sign up here to attend. I will be diving into Source, Process and Destination plugins in great detail. I will also be showing you how to handle some of the usual cases of complex data transformations as well.
In the interim, if your organization has any questions with a migration you are performing, please fill out the form below so we can chat more.