Introduction to BigQuery Migration Service

This document provides an overview of the BigQuery Migration Service.

The BigQuery Migration Service is a comprehensive solution for migrating your data warehouse to BigQuery. It includes features that help you with each phase of migration, including assessment and planning, SQL translation for a variety of SQL dialects, data transfer, and data validation. Together, these tools help you accelerate migrations and reduce risk, shortening the time to value.

The BigQuery Migration Service includes the following features:

You can also use the following open-source tools to help you with your migration process:

  • Data migration tool: Use the data migration tool to automate your data warehouse migration to BigQuery. The tool uses the BigQuery Data Transfer Service, the BigQuery translation services, and the data validation tool to transfer data, translate and validate DDL, DML, and SQL queries.
  • Data validation tool: After migrating your data to BigQuery, run the data validation tool to validate that your source and destination tables match.
  • BigQuery permission mapper: Use the permission mapper to automate the creation and maintenance of user-modifiable permission maps. You can use the permission mapper to analyze and reconcile duplicate permissions and user groups, while also generating error reports. The tool outputs JSON and Terraform scripts for BigQuery group, user, and binding creation.
  • Cloud Composer templates: Use Cloud Composer templates to simplify the creation of new Airflow DAGs or the migration of existing orchestrated jobs from on-premise to the cloud.
  • Cloud Foundation Fabric: View Terraform examples and modules for Google Cloud, including an organization-wide landing zone blueprint, reference blueprints for network patterns and product features, and a library of adaptable modules.

Quotas

Quotas and limits apply to the number of jobs as well as the size of files. For more information on migration service quotas and limits, see Quotas and limits.

Pricing

There is no charge to use the BigQuery Migration API. However, storage used for input and output files incurs the normal fees. For more information, see Storage pricing.

Additionally, you can use the cost estimation functionality in Google Cloud Migration Center to generate a cost estimate of running your data warehouse setup that you migrate to BigQuery. For more information, see Start a cost estimation and Specify data warehousing requirements.

What's next