Skip to content

Skypilot Gcp

Initialization of the Skypilot GCP integration for ZenML.

The Skypilot integration sub-module powers an alternative to the local orchestrator for a remote orchestration of ZenML pipelines on VMs.

SkypilotGCPIntegration

Bases: Integration

Definition of Skypilot (GCP) Integration for ZenML.

Source code in src/zenml/integrations/skypilot_gcp/__init__.py 
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
class SkypilotGCPIntegration(Integration):
    """Definition of Skypilot (GCP) Integration for ZenML."""

    NAME = SKYPILOT_GCP
    REQUIREMENTS = [
        "skypilot[gcp]==0.9.3",
        # TODO: Remove this once the issue is fixed:
        # Adding the dependencies of the GCP integration on top of the
        # requirements of the skypilot integration results in a
        # very long resolution time for pip. This is a workaround to
        # speed up the resolution.
        "protobuf>=4.25.0,<5.0.0",
    ]
    APT_PACKAGES = ["openssh-client", "rsync"]

    @classmethod
    def flavors(cls) -> List[Type[Flavor]]:
        """Declare the stack component flavors for the Skypilot GCP integration.

        Returns:
            List of stack component flavors for this integration.
        """
        from zenml.integrations.skypilot_gcp.flavors import (
            SkypilotGCPOrchestratorFlavor,
        )

        return [SkypilotGCPOrchestratorFlavor]

flavors() classmethod

Declare the stack component flavors for the Skypilot GCP integration.

Returns:

Type Description
List[Type[Flavor]]

List of stack component flavors for this integration.
Source code in src/zenml/integrations/skypilot_gcp/__init__.py 
45
46
47
48
49
50
51
52
53
54
55
56
@classmethod
def flavors(cls) -> List[Type[Flavor]]:
    """Declare the stack component flavors for the Skypilot GCP integration.

    Returns:
        List of stack component flavors for this integration.
    """
    from zenml.integrations.skypilot_gcp.flavors import (
        SkypilotGCPOrchestratorFlavor,
    )

    return [SkypilotGCPOrchestratorFlavor]