G Suite (Gmail API) to G Suite (Gmail API) Migration Guide

This is the guide for migrating folders and documents (emails, calendars and contacts) from one G Suite instance to another through the Gmail API endpoints. There are some tools and resources that will make the migration easier.

First migration?

We’ve created a guide on scoping, planning, and managing the migration process for your use. If this is your first migration, we recommend reading this guide carefully.

To discover what items are moved with MigrationWiz in this scenario, and which items will not be moved, see MigrationWiz: Migrated and Not Migrated Items. Note that these items will vary by source and destination, so check the proper environment listings carefully.

MigrationWiz

MigrationWiz is a migration tool, not a syncing tool. If changes are made at the source after migration, they will not sync to the destination, nor will changes made at the destination sync to the source. We do not have “live” monitoring of changes (as with a sync agent) and we cannot handle scenarios such as conflict resolution without user interaction.

MigrationWiz supports the capability to share migration projects across a Workgroup. When the Project Sharing feature is turned on, all Agents besides those who are Inactive can view all migrations projects. 

We are not able to support migrations with a service account with two-factor or multifactor authentication. 

Preparing the Source

The G Suite (Gmail API) source endpoint requires your tenant service account to be set up and that Google APIs be enabled. 

Prerequisites

  • Subscription to Google Cloud Platform.
  • Google Super Administrator account.
  • Ability to set up a service account on the G Suite tenant.
  • Service account must be set up before the MigrationWiz project is created.

Create a Google Project

  1. Go to the Google Cloud Platform (GCP) Console and sign in as a super administrator. Choose one of the options below:
    • If you haven't used the Google Cloud Platform Console before, agree to the Terms of Service and click Create Project.
    • If you have used Google Cloud Platform Console before, at the top of the screen next to your most recent project name, click Down to open your projects list. Then, click New Project.
  2. Enter a project name and click Create.

Enable APIs for Service Account

  1. From the Google Cloud Platform Console, click Menu (Google_Menu.png) > APIs & Services > Library.
  2. Enable the following APIs by selecting the specific API and clicking Enable. Repeat for each API:
    • Google Drive API
    • Google Calendar API
    • Gmail API
    • Contacts API
    • People API
    • Admin SDK

Make sure that the Gmail, Calendar, and Contacts services are enabled within the Google tenant. You can control services for your users using the instructions on this page: Control who can access G Suite and Google Services.

Create Customer Tenant Service Account

  1. From the Google Cloud Platform Console, click Menu (Google_Menu.png) > API & Services > Credentials > CREATE CREDENTIALS > Service account
  2. Click Create Service Account and enter a name.
  3. Click Create.
  4. Assign the role of Owner to the new Service Account by selecting Owner from the Role Dropdown menu.
  5. Click Continue.
  6. Click Done.
  7. Click on the service account and select ADD KEY > Create new key.
  8. Make sure that JSON is selected and click Create.
    • Make sure that you download the key as a JSON file and make a note of the name and location of the file. This JSON file will be used when setting up the migration endpoint in the Mailbox Migration project.
    • The JSON file must contain information in the following fields: “type”, “private key”, and “client email”. If these mandatory fields are empty the file upload during endpoint creation will fail.
  9. Click Close.

Setting the Scopes for the migration

  1. From the Google Cloud Platform Console, click Menu (Google_Menu.png) > API & Services > Credentials >
  2. Find the service account that was set up in Step 3.
  3. Find the Unique ID field for that service account and copy the ID number. This is the Client ID number that will be used in a later step.
    • This field often needs to be added to the view. Click on the Column display options button (UniqueID2.png) and add a checkmark to Unique ID, then click OK.
    • This Client ID should be considered similar to Administrator account passwords and handled securely.

You will now have one of two options, depending on if the Google UI has been updated for your tenant.

Old Google Tenant:

Go to the G Suite admin page at google.com

Click Security.

Click Advanced Settings.

Click Manage API Client Access.

OR If your account shows the latest UI updates from Google, as shown below:New_Google_Admin_APP_Access_Control.JPG

Go to the G Suite admin page at google.com

Click Security.

Click Advanced Settings.

Under ‘Domain-wide delegation’, click Manage domain-wide delegation.

On the Manage domain-wide delegation page, click Add new.

 Once these steps are complete:

  1. In the Client Name field, paste the Unique ID copied above.
  2. In the scopes field, paste all scopes listed below:
    https://mail.google.com/, https://www.google.com/m8/feeds, https://www.googleapis.com/auth/contacts.readonly, https://www.googleapis.com/auth/calendar, https://www.googleapis.com/auth/admin.directory.group, https://www.googleapis.com/auth/admin.directory.user, https://www.googleapis.com/auth/drive, https://sites.google.com/feeds/, https://www.googleapis.com/auth/gmail.settings.sharing, https://www.googleapis.com/auth/gmail.settings.basic, https://www.googleapis.com/auth/admin.directory.group.readonly,https://www.googleapis.com/auth/admin.directory.user.readonly,https://www.googleapis.com/auth/calendar.readonly,https://www.googleapis.com/auth/gmail.readonly, https://www.googleapis.com/auth/contacts.other.readonly 
  3. Click Authorize.

You should now see your specific Unique ID and the scopes listed, similar to what is shown below:

40520a97-ba80-46f1-ae4b-710e52fe251f.png

2c5866c2-efbb-499f-89a2-e55f36b8f5e7.png

Preparing the Destination

Create users on G Suite

Google provides clear, step-by-step guidance for this project.

Service account

The G Suite (Gmail API) destination endpoint requires your tenant service account to be set up and google APIs be enabled. You can either create separate service account for destination, or use the same service account setup for source.

  • Different service account for destination: Follow the steps outlined in Set Up Google API before configuring the destination endpoint in MigrationWiz.
    OR

  • Shared service account between destination and source : If you are sharing the service account already setup for the source endpoint, then only the following additional steps are required to enable scopes for destination:

  1. Log in to your Google Cloud Platform (GCP) Console. Click Menu (mceclip0.png) > API & Services > Credentials >

  2. Find the service account that was set up for source.

  3. Find the Unique ID field for that service account. If the Unique ID column is not displayed, Click on the service account and then copy the Unique ID value. This ID should be considered similar to Administrator account passwords and handled securely.

  4. Go to the G Suite admin page at admin.google.com click on Security > Advanced Settings > Manage API Client Access.
    OR
    If your account shows the latest UI updates from Google, Go to the G Suite admin page at admin.google.com click on Security > Advanced Settings > Under ‘Domain-wide delegation’, click Manage domain-wide delegation > On the Manage domain-wide delegation page, click Add new.

  5. In the Client Name field, paste the Unique ID copied above.

  6. In the scopes field, paste the following scopes: https://mail.google.com/, https://www.google.com/m8/feeds, https://www.googleapis.com/auth/contacts.readonly, https://www.googleapis.com/auth/calendar, https://www.googleapis.com/auth/admin.directory.group, https://www.googleapis.com/auth/admin.directory.user, https://www.googleapis.com/auth/drive, https://sites.google.com/feeds/, https://www.googleapis.com/auth/gmail.settings.sharing, https://www.googleapis.com/auth/gmail.settings.basic, https://www.googleapis.com/auth/contacts

  7. Click Authorize.

  8. You should now see your specific Unique ID and the scopes listed.

Create a Mailbox Migration Project

    1. From the MigrationWiz dashboard, click Go To My Projects.

    2. Click Create Project.

    3. Select a Mailbox migration type. 

    4. Click Next Step.

    5. Enter a project name and select a Customer from the list.

      1. If the customer hasn’t already been created, you can do so now.

      2. To create a new Customer, click New, provide the required details including Primary Email Domain and Company Name, and click Save.

    6. Click Next Step.

    7. Select the G Suite (Gmail API) endpoint from the source drop-down menu. If an endpoint has not been created, click New, enter a name in the "Endpoint Name" field, select G Suite (Gmail API) from the Endpoint Type drop-down menu, and provide the requested information in the endpoint creation flyout window.

    8. Select the G Suite (Gmail API) destination endpoint from the destination drop-down menu. If an endpoint has not been created, click New, enter a name in the "Endpoint Name" field, select G Suite (Gmail API) from the Endpoint Type drop-down menu, and provide the requested information in the endpoint creation flyout window.

Set the Endpoints

If you have not previously created endpoints, the following steps will guide you through the process.

  1. When creating the project on your Source Settings or Destination Settings tab, click New.

  2. Fill in the fields below. Once the endpoint has been saved in the project, it will automatically be assigned to the customer that was selected in the Project Information tab when creating the project.

    1. Endpoint Name: Type any name you want for the endpoint. This is case and character specific. 

    2. Select service provider.
    3. Endpoint Type: Click the Endpoint Type drop-down, and then click the ‘G Suite (Gmail API)’ endpoint type in the list. When you select the endpoint type, the form will expand so that you can provide additional connection information and credentials.

    4. Provide the Google service account credentials using the JSON file: Upload the JSON file for your service account setup.

    5. If separate service accounts are set up for source and destination, please ensure that the correct JSON file is uploaded respectively for source & destination endpoints.

    6. If a service account is shared between source and destination, then the same JSON file can be used for both source as well as destination.

    7. Administrator Username: Provide a valid administrator email address for your G Suite account.

Support Options

The following Support Options are the most useful for this scenario. 

    • StoreOverflowGooglePropertiesInNotes=1 
    • StoreOverflowGooglePropertiesInNotesPrefix="enter your text here" 
    • Click Save and Go to Summary.

Add Accounts (Items)

In MSPComplete, add the accounts that will be migrated, also referred to as items, to a project using one of the following options:

Quick Add: This option allows you to add items o​ne at a time. Provide an email address for source and destination for each.

Bulk Add: This option allows you to add multiple items at once by copying and pasting from a spreadsheet or by importing a CSV file. The domain names at the source and at the destination might be different. Make sure to provide the right information in the project. If they are different, it's best to modify these in your CSV file, and then use the Bulk Add feature to import the users into the dashboard.

  1. Select the Project for which you want to perform the bulk import.
  2. Click Add.
  3. Click Bulk Add.
  4. Follow the instructions on the page.  

Purchase and Apply UMB Licenses

Licenses are required to run a migration project in MigrationWiz. To obtain license pricing information, or to purchase licenses, click the Purchase button in the top of your MigrationWiz dashboard.

Payment: We accept credit cards, and wire transfer in certain situations.  

  • When purchasing with a credit card, payment is immediately processed during checkout. If successful, licenses are granted to your account instantly.

  • Wire transfers are available for purchases of 100 or more licenses. If you are purchasing at least 100 licenses, you will be presented an option to purchase via wire transfer during checkout. A wire transfer checkout will generate an invoice with wiring information for your accounts payable department and bank. Once the funds are received by our system, the licenses are granted to your account immediately. 

For this project type, we recommend using our User Migration Bundle licenses. 

  • These licenses enable you to perform multiple migrations of User mailboxes, documents, and in-place archives.

  • Further information on User Migration Bundle Licenses:

    • User Migration Bundle Licenses have unlimited data available per license.

    • User Migration Bundle Licenses are applied to the customer's users, for whom you'll be performing migrations, and are valid for one year.

Apply UMB Licenses

  1. Sign in to MigrationWiz at https://migrationwiz.bittitan.com.
    • You can either sign in and make sure to select the MigrationWiz button above the email field or sign into MSPComplete page, then click the All Products button and select MigrationWiz.
  2. Select the correct workgroup on the top of the left navigation pane. This is the workgroup that the customer and migration project were created under. Your account must be part of the workgroup and project sharing must be enabled, if the project was not created under your account. 
  3. Click the project that requires licenses to be applied. For more information see Add and Edit Workgroups and Project Sharing in MigrationWiz.
  4. Check the box to the left of the email for the user(s) to whom you want to apply a User Migration Bundle license.
  5. Click the More menu (3 stacked lines) at the top of the project page.
  6. Click Apply User Migration Bundle License.

Run Migration

The following sections will guide you through running your migration. Each header is one step, with its component steps below. Follow these steps in order, and read the notes for important information about dependencies or best practices.

Run Verify Credentials

  1. Open the Project containing items you wish to validate​.

  2. Select the items you wish to validate.

  3. Click on the Start button in your dashboard.

  4. Select Verify Credentials from the drop-down list.

  5. Once complete, the results of the verification will be shown in the Status section.

Notify Users

Send out the final notification that the migration is beginning. Include when the migration will start, expected duration, any usage instructions during migration, and any expected steps or notifications for the post-migration timeline.

Pre-Stage Pass

  1. Select the users

  2. Click the Start button from the top, and select Pre-Stage Migration 

  3. Under the Migration Scheduling section, from the drop-down list, select 90 days ago

  4. Click Start Migration

MX Record Cutover

On the DNS provider's portal, change the primary MX record to reflect the DNS settings for the destination G Suite tenant.

Full (Delta) Pass

  1. Select the users.

  2. Click the Start button from the top.

  3. Select Full Migration.

  4. Select/ Deselect check boxes (for Contact, Calendars, Mails) based on your migration need.

  5. Click Start Migration.
    This migration should complete quickly since most data is migrated during the Pre-Stage migration.

Run Retry Errors

Each error logged represents an item that was not migrated. MigrationWiz contains a mode in which you can resubmit the migration to retry failed items. This mode of operation is always free of charge. You may only submit mailboxes in this mode only if they satisfy all of the following conditions:

  1. The last migration completed successfully.

  2. The mailbox contains at least one error.

If your mailbox does not satisfy these conditions, you will receive a warning when submitting the migration in this mode and your request will not be fulfilled.

To submit one or more mailboxes in retry mode, perform the following steps:

  1. Click the Go To My Projects button.

  2. Select the project that contains the mailboxes that you want to retry.

  3. Select the mailboxes that have migration errors.

  4. Click on the Start button.

  5. Select Retry Errors from the menu.

  6. Click the Retry Errors button.

When errors are repaired, they will disappear from the error log. Some errors may not disappear if the Source item was not reprocessed (due to filters, for example), has been deleted or moved, or if the item failed again.

Post Migration

Click the bar chart icon in the MigrationWiz dashboard to receive an email containing all the project migration statistics.

Was this article helpful?
1 out of 2 found this helpful