Manually trigger runs

This document shows you how to manually trigger runs of your entire workflow or only selected elements in your workflow.

You can trigger a run for the following elements of your workflow:

  • All actions in your workflow
  • Selected actions
  • Actions with selected tags

Before you begin

  1. In the Google Cloud console, go to the Dataform page.

    Go to the Dataform page

  2. Select or create a repository.

  3. Select or create a development workspace.

  4. Develop your workflow.

Required roles

To get the permissions that you need to manually trigger a run , ask your administrator to grant you the following IAM roles on workflowInvocations:

For more information about granting roles, see Manage access to projects, folders, and organizations.

You might also be able to get the required permissions through custom roles or other predefined roles.

Manually run all the actions in your workflow

To manually trigger a run of all the actions in your workflow, follow these steps:

  1. Go to a development workspace.
  2. Click Start execution.
  3. Click Actions > Multiple actions.

  4. In the Authentication section, authorize the execution with your Google Account user credentials or a service account.

    • To use your Google Account user credentials (Preview), select Execute with user credentials.
    • To use a service account, select Execute with selected service account, and then select a service account.

  5. Select All actions.

  6. Optional: To rebuild all tables from scratch, select the Run with full refresh option. Without this option, Dataform updates incremental tables without rebuilding them from scratch.

  7. Click Start execution. If you selected Execute with user credentials for your authentication method, you must authorize your Google Account (Preview).

Manually run selected actions

To manually trigger a run of selected actions, follow these steps:

  1. Go to your development workspace.

  2. Click Start execution, then do either of the following:

    • Click Actions, then select an action that you want to run.
    • Click Actions > Multiple actions.

  3. In the Authentication section, authorize the execution with your Google Account user credentials or a service account.

    • To use your Google Account user credentials (Preview), select Execute with user credentials.
    • To use a service account, select Execute with selected service account, and then select a service account.

  4. Verify that Selection of actions is selected.

  5. In the Select actions to execute menu, select the actions that you want to run.

  6. Optional: To run the selected actions and their dependencies, select the Include dependencies option.

  7. Optional: To run the selected actions and the actions that depend on them, select the Include dependents option.

  8. Optional: To rebuild all tables from scratch, select the Run with full refresh option.

  9. Click Start execution. If you selected Execute with my user credentials for your authentication method, you must authorize your Google Account (Preview).

Manually run actions with selected tags

To manually trigger a run of actions with selected tags, follow these steps:

  1. Go to your development workspace.

  2. Click Start execution, then do either of the following:

    • Click Tags, then select a tag that you want to run.
    • Click Tags > Multiple tags.

  3. In the Authentication section, authorize the execution with your Google Account user credentials or a service account.

    • To use your Google Account user credentials (Preview), select Execute with user credentials.
    • To use a service account, select Execute with selected service account, and then select a service account.

  4. Verify that Selection of tags is selected.

  5. In the Select tags to execute menu, select the tags that you want to run.

  6. Optional: To run the actions with the selected tags and their dependencies, select the Include dependencies option.

  7. Optional: To run the actions with the selected tags and the actions that depend on them, select the Include dependents option.

  8. Optional: To rebuild all tables from scratch, select the Run with full refresh option. Without this option, Dataform updates incremental tables without rebuilding them from scratch.

  9. Click Start execution. If you selected Execute with my user credentials for your authentication method, you must authorize your Google Account (Preview).

Authorize your Google Account

To authenticate the resource with your Google Account user credentials, you must manually grant permission for BigQuery pipelines to get the access token for your Google Account and access the source data on your behalf. You can grant manual approval with the OAuth dialog interface.

You only need to give permission to BigQuery pipelines once.

To revoke the permission that you granted, follow these steps:

  1. Go to your Google Account page.
  2. Click BigQuery Pipelines.
  3. Click Remove access.

What's next