Snapshot build of the main branch. Updated automatically on each commit.

Changelog

• 09a8f0c [Release] Release v0.264.2

Release v0.264.1

Notable Changes

• Fixed regression in databricks auth login for OAuth redirect URL (#3417)

Bundles

• Add supported enum values to JSON schema for volume grant privileges (#3395)

Changelog

Dependency updates

• Upgrade TF provider to 1.86.0 (#3374)
• Update Go SDK to 0.79.0 (#3376)

CLI

• Fixed panic when providing a CLI command with an incorrect JSON input (#3398)

Bundles

• Changed logic for resolving ${resources...} references. Previously this would be done by terraform at deploy time. Now if it references a field that is present in the config, it will be done by DABs during bundle loading (#3370)
• Add support for tagging pipelines (#3086)
• Add warning for when an invalid value is specified for an enum field (#3050)
• Add support for running specified job tasks instead of all job tasks (#3388)

CLI

• Show "DEFAULT" as the default profile for databricks auth login #3252

Bundles

• Always set default value for source field for tasks if not explicitly set already (#3359)
• Fix panic in auto completion handler for bundler run/open. Regression introduced in 0.259.0. #3358
• Fix error propagation in the bundle generate dashboard command. Regression introduced in 0.259.0. #3354

Release v0.262.0

CLI

• Fixed auth login ignoring DATABRICKS_CONFIG_FILE environmental variable when saving profile (#3266)

Bundles

• Modified run flag validation to allow --refresh and --full-refresh flags to be used together (#3300)
• Fixed bundle generate for not yet deployed apps (#3319)
• Respect export format for notebooks on bundle generate (#3316)

Notable Changes

The following CLI commands now have additional required positional arguments:

• alerts-v2 update-alert ID UPDATE_MASK - Update an alert (v2)
• database update-database-instance NAME UPDATE_MASK - Update a database instance
• external-lineage create-external-lineage-relationship SOURCE TARGET - Create an external lineage relationship
• external-lineage update-external-lineage-relationship UPDATE_MASK SOURCE TARGET - Update an external lineage relationship
• external-metadata update-external-metadata NAME UPDATE_MASK SYSTEM_TYPE ENTITY_TYPE - Update external metadata
• feature-store update-online-store NAME UPDATE_MASK CAPACITY - Update an online store
• lakeview create-schedule DASHBOARD_ID CRON_SCHEDULE - Create a schedule
• lakeview create-subscription DASHBOARD_ID SCHEDULE_ID SUBSCRIBER - Create a subscription
• lakeview update-schedule DASHBOARD_ID SCHEDULE_ID CRON_SCHEDULE - Update a schedule
• network-connectivity update-private-endpoint-rule NETWORK_CONNECTIVITY_CONFIG_ID PRIVATE_ENDPOINT_RULE_ID UPDATE_MASK - Update a private endpoint rule

CLI

• Add required query parameters as positional arguments in CLI commands (#3289)

Bundles

• Fixed an issue where allow_duplicate_names field on the pipeline definition was ignored by the bundle (#3274)
• Add warning for when required bundle fields are not set (#3044)

Notable Changes

• Added support for creating SQL warehouses in DABs (#3129)

Dependency updates

• Upgrade Go SDK to 0.75.0 (#3256)

CLI

• Add databricks psql command to connect to Lakebase with a single command (#3128)

Bundles

• Jobs that use cluster policy default values for their cluster configuration now correctly update those defaults on every deployment (#3255).
• Add upper and lower helper methods for bundle templates (#3242)

Release v0.259.0

Notable Changes

• Add support for arbitrary scripts in DABs. Users can now define scripts in their bundle configuration. These scripts automatically inherit the bundle's credentials for authentication. They can be invoked with the bundle run command. (#2813)
• Error when the absolute path to databricks.yml contains a glob character. These are: *, ?, [, ] and ^. If the path to the databricks.yml file on your local filesystem contains one of these characters, that could lead to incorrect computation of glob patterns for the includes block and might cause resources to be deleted. After this patch users will not be at risk for unexpected deletions due to this issue. (#3096)
• Diagnostics messages are no longer buffered to be printed at the end of command, flushed after every mutator (#3175)
• Diagnostics are now always rendered with forward slashes in file paths, even on Windows (#3175)
• "bundle summary" now prints diagnostics to stderr instead of stdout in text output mode (#3175)
• "bundle summary" no longer prints recommendations, it will only prints warnings and errors (#3175)

Bundles

• Fix default search location for whl artifacts (#3184). This was a regression introduced in 0.255.0.
• The job tasks are now sorted by task key in "bundle validate/summary" output (#3212)

Release v0.258.0

Notable Changes

• Switch default-python template to use pyproject.toml + dynamic_version in dev target. uv is now required. (#3042)

Dependency updates

• Upgraded TF provider to 1.84.0 (#3151)

CLI

• Fixed an issue where running databricks auth login would remove the cluster_id field from profiles in .databrickscfg. The login process now preserves the cluster_id field. (#2988)

Bundles

• Added support for pipeline environment field (#3153)
• "bundle summary" now prints diagnostic warnings to stderr (#3123)
• "bundle open" will print the URL before opening the browser (#3168)