Clusters

Built-in InfiniBand support in dstack Docker images

The dstack default Docker images now come with built-in InfiniBand support, which includes the necessary libibverbs library and InfiniBand utilities from rdma-core. This means you can run torch distributed and other workloads utilizing NCCL, and they'll take full advantage of InfiniBand without custom Docker images.

You can try InfiniBand clusters with dstack on Nebius.

Built-in EFA support in dstack VM images

dstack switches to DLAMI as the default AWS GPU VM image from a custom one. DLAMI supports EFA out-of-the-box, so you no longer need to use a custom VM image to take advantage of EFA.

Server

GCS support for code uploads

It's now possible to configure the dstack server to use GCP Cloud Storage for code uploads. Previously, only DB and S3 storages were supported. Learn more in the Server deployment guide.

What's Changed

• Support file upload to gcs bucket by @colinjc in #2737
• Document File storage by @r4victor in #2755
• [Docs] Minor update of Clusters and Distributed tasks sections by @peterschmidt85 in #2741
• Fix CLI exiting while master starting by @r4victor in #2757
• [UI] Implement property filter on Run list page by @olgenn in #2762
• [Bug]: Text is unavailable for selection on run logs page by @olgenn in #2763
• Preinstall rdma-core packages into dstack Docker image by @r4victor in #2764
• [UX] Show status message as retrying in case a run or job is being retired by @peterschmidt85 in #2758
• [Docs] Minor improvements by @peterschmidt85 in #2766
• [Feature]: Include priority to the list of runs and sort runs by priority by @olgenn in #2768
• [Feature]: The Run details page should display the same fields as the Run list page by @olgenn in #2769
• [Feature]: Show Quickstart button if user don't have any runs by @olgenn in #2770
• [Feature]: Implement links for elements that have details page by @olgenn in #2772
• [Feature]: Add Refresh button on Run details page by @olgenn in #2773
• [Bug]: Tab Billing changes to Settings after top up balance by @olgenn in #2774
• Exclude backward incompatible fields from rest plugin calls by @colinjc in #2767
• [UI] Minor fixes by @peterschmidt85 in #2775
• Pin dkms by @r4victor in #2776
• Use DLAMI on AWS by @r4victor in #2782
• 2674 prop filter by @olgenn in #2778
• Fixed defect #2752 by @olgenn in #2784
• Update base image to 0.9 by @r4victor in #2786
• Fix status_message with missing on_events by @r4victor in #2788
• [Bug]: UI doesn't show Resources for instances of SSH fleets by @peterschmidt85 in #2785
• Ignore AWS quotas when hitting rate limits by @r4victor in #2791

Full Changelog: 0.19.12...0.19.13