Skypilot Azure

`zenml.integrations.skypilot_azure` `special`

Initialization of the Skypilot Azure integration for ZenML.

The Skypilot integration sub-module powers an alternative to the local orchestrator for a remote orchestration of ZenML pipelines on VMs.

`SkypilotAzureIntegration (Integration)`

Definition of Skypilot (Azure) Integration for ZenML.

Source code in zenml/integrations/skypilot_azure/__init__.py

class SkypilotAzureIntegration(Integration):
    """Definition of Skypilot (Azure) Integration for ZenML."""

    NAME = SKYPILOT_AZURE
    REQUIREMENTS = ["skypilot[azure]<=0.5.0"]
    APT_PACKAGES = ["openssh-client","rsync"]

    @classmethod
    def flavors(cls) -> List[Type[Flavor]]:
        """Declare the stack component flavors for the Skypilot Azure integration.

        Returns:
            List of stack component flavors for this integration.
        """
        from zenml.integrations.skypilot_azure.flavors import (
            SkypilotAzureOrchestratorFlavor,
        )

        return [SkypilotAzureOrchestratorFlavor]

`flavors()` `classmethod`

Declare the stack component flavors for the Skypilot Azure integration.

Returns:

Type	Description
`List[Type[zenml.stack.flavor.Flavor]]`	List of stack component flavors for this integration.

Source code in zenml/integrations/skypilot_azure/__init__.py

@classmethod
def flavors(cls) -> List[Type[Flavor]]:
    """Declare the stack component flavors for the Skypilot Azure integration.

    Returns:
        List of stack component flavors for this integration.
    """
    from zenml.integrations.skypilot_azure.flavors import (
        SkypilotAzureOrchestratorFlavor,
    )

    return [SkypilotAzureOrchestratorFlavor]

`flavors` `special`

Skypilot integration flavor for Skypilot Azure orchestrator.

`skypilot_orchestrator_azure_vm_flavor`

Skypilot orchestrator Azure flavor.

`SkypilotAzureOrchestratorConfig (SkypilotBaseOrchestratorConfig, SkypilotAzureOrchestratorSettings)` `pydantic-model`

Skypilot orchestrator config for Azure.

Source code in zenml/integrations/skypilot_azure/flavors/skypilot_orchestrator_azure_vm_flavor.py

class SkypilotAzureOrchestratorConfig(  # type: ignore[misc] # https://github.com/pydantic/pydantic/issues/4173
    SkypilotBaseOrchestratorConfig, SkypilotAzureOrchestratorSettings
):
    """Skypilot orchestrator config for Azure."""

`SkypilotAzureOrchestratorFlavor (BaseOrchestratorFlavor)`

Flavor for the Skypilot orchestrator for Azure.

Source code in zenml/integrations/skypilot_azure/flavors/skypilot_orchestrator_azure_vm_flavor.py

class SkypilotAzureOrchestratorFlavor(BaseOrchestratorFlavor):
    """Flavor for the Skypilot orchestrator for Azure."""

    @property
    def name(self) -> str:
        """Name of the orchestrator flavor.

        Returns:
            Name of the orchestrator flavor.
        """
        return SKYPILOT_AZURE_ORCHESTRATOR_FLAVOR

    @property
    def service_connector_requirements(
        self,
    ) -> Optional[ServiceConnectorRequirements]:
        """Service connector resource requirements for service connectors.

        Specifies resource requirements that are used to filter the available
        service connector types that are compatible with this flavor.

        Returns:
            Requirements for compatible service connectors, if a service
            connector is required for this flavor.
        """
        return ServiceConnectorRequirements(
            resource_type="azure-generic",
        )

    @property
    def docs_url(self) -> Optional[str]:
        """A url to point at docs explaining this flavor.

        Returns:
            A flavor docs url.
        """
        return self.generate_default_docs_url()

    @property
    def sdk_docs_url(self) -> Optional[str]:
        """A url to point at SDK docs explaining this flavor.

        Returns:
            A flavor SDK docs url.
        """
        return self.generate_default_sdk_docs_url()

    @property
    def logo_url(self) -> str:
        """A url to represent the flavor in the dashboard.

        Returns:
            The flavor logo.
        """
        return "https://public-flavor-logos.s3.eu-central-1.amazonaws.com/orchestrator/azure-skypilot.png"

    @property
    def config_class(self) -> Type[BaseOrchestratorConfig]:
        """Config class for the base orchestrator flavor.

        Returns:
            The config class.
        """
        return SkypilotAzureOrchestratorConfig

    @property
    def implementation_class(self) -> Type["SkypilotAzureOrchestrator"]:
        """Implementation class for this flavor.

        Returns:
            Implementation class for this flavor.
        """
        from zenml.integrations.skypilot_azure.orchestrators import (
            SkypilotAzureOrchestrator,
        )

        return SkypilotAzureOrchestrator

`config_class: Type[zenml.orchestrators.base_orchestrator.BaseOrchestratorConfig]` `property` `readonly`

Config class for the base orchestrator flavor.

Returns:

Type	Description
`Type[zenml.orchestrators.base_orchestrator.BaseOrchestratorConfig]`	The config class.

`docs_url: Optional[str]` `property` `readonly`

A url to point at docs explaining this flavor.

Returns:

Type	Description
`Optional[str]`	A flavor docs url.

`implementation_class: Type[SkypilotAzureOrchestrator]` `property` `readonly`

Implementation class for this flavor.

Returns:

Type	Description
`Type[SkypilotAzureOrchestrator]`	Implementation class for this flavor.

`logo_url: str` `property` `readonly`

A url to represent the flavor in the dashboard.

Returns:

Type	Description
`str`	The flavor logo.

`name: str` `property` `readonly`

Name of the orchestrator flavor.

Returns:

Type	Description
`str`	Name of the orchestrator flavor.

`sdk_docs_url: Optional[str]` `property` `readonly`

A url to point at SDK docs explaining this flavor.

Returns:

Type	Description
`Optional[str]`	A flavor SDK docs url.

`service_connector_requirements: Optional[zenml.models.v2.misc.service_connector_type.ServiceConnectorRequirements]` `property` `readonly`

Service connector resource requirements for service connectors.

Specifies resource requirements that are used to filter the available service connector types that are compatible with this flavor.

Returns:

Type	Description
`Optional[zenml.models.v2.misc.service_connector_type.ServiceConnectorRequirements]`	Requirements for compatible service connectors, if a service connector is required for this flavor.

`SkypilotAzureOrchestratorSettings (SkypilotBaseOrchestratorSettings)` `pydantic-model`

Skypilot orchestrator settings for Azure.

Source code in zenml/integrations/skypilot_azure/flavors/skypilot_orchestrator_azure_vm_flavor.py

class SkypilotAzureOrchestratorSettings(SkypilotBaseOrchestratorSettings):
    """Skypilot orchestrator settings for Azure."""

`orchestrators` `special`

Initialization of the Skypilot Azure ZenML orchestrator.

`skypilot_azure_vm_orchestrator`

Implementation of the a Skypilot based Azure VM orchestrator.

`SkypilotAzureOrchestrator (SkypilotBaseOrchestrator)`

Orchestrator responsible for running pipelines remotely in a VM on Azure.

This orchestrator does not support running on a schedule.

Source code in zenml/integrations/skypilot_azure/orchestrators/skypilot_azure_vm_orchestrator.py

class SkypilotAzureOrchestrator(SkypilotBaseOrchestrator):
    """Orchestrator responsible for running pipelines remotely in a VM on Azure.

    This orchestrator does not support running on a schedule.
    """

    DEFAULT_INSTANCE_TYPE: str = "Standard_B1ms"

    @property
    def cloud(self) -> sky.clouds.Cloud:
        """The type of sky cloud to use.

        Returns:
            A `sky.clouds.Cloud` instance.
        """
        return sky.clouds.Azure()

    @property
    def config(self) -> SkypilotAzureOrchestratorConfig:
        """Returns the `SkypilotAzureOrchestratorConfig` config.

        Returns:
            The configuration.
        """
        return cast(SkypilotAzureOrchestratorConfig, self._config)

    @property
    def settings_class(self) -> Optional[Type["BaseSettings"]]:
        """Settings class for the Skypilot orchestrator.

        Returns:
            The settings class.
        """
        return SkypilotAzureOrchestratorSettings

    def prepare_environment_variable(self, set: bool = True) -> None:
        """Set up Environment variables that are required for the orchestrator.

        Args:
            set: Whether to set the environment variables or not.
        """
        pass

`cloud: sky.clouds.Cloud` `property` `readonly`

The type of sky cloud to use.

Returns:

Type	Description
`sky.clouds.Cloud`	A `sky.clouds.Cloud` instance.

`config: SkypilotAzureOrchestratorConfig` `property` `readonly`

Returns the SkypilotAzureOrchestratorConfig config.

Returns:

Type	Description
`SkypilotAzureOrchestratorConfig`	The configuration.

`settings_class: Optional[Type[BaseSettings]]` `property` `readonly`

Settings class for the Skypilot orchestrator.

Returns:

Type	Description
`Optional[Type[BaseSettings]]`	The settings class.

`prepare_environment_variable(self, set=True)`

Set up Environment variables that are required for the orchestrator.

Parameters:

Name	Type	Description	Default
`set`	`bool`	Whether to set the environment variables or not.	`True`

Source code in zenml/integrations/skypilot_azure/orchestrators/skypilot_azure_vm_orchestrator.py

def prepare_environment_variable(self, set: bool = True) -> None:
    """Set up Environment variables that are required for the orchestrator.

    Args:
        set: Whether to set the environment variables or not.
    """
    pass

Skypilot Azure

zenml.integrations.skypilot_azure special

SkypilotAzureIntegration (Integration)

flavors() classmethod

flavors special

skypilot_orchestrator_azure_vm_flavor

SkypilotAzureOrchestratorConfig (SkypilotBaseOrchestratorConfig, SkypilotAzureOrchestratorSettings) pydantic-model

SkypilotAzureOrchestratorFlavor (BaseOrchestratorFlavor)

config_class: Type[zenml.orchestrators.base_orchestrator.BaseOrchestratorConfig] property readonly

docs_url: Optional[str] property readonly

implementation_class: Type[SkypilotAzureOrchestrator] property readonly

logo_url: str property readonly

name: str property readonly

sdk_docs_url: Optional[str] property readonly

service_connector_requirements: Optional[zenml.models.v2.misc.service_connector_type.ServiceConnectorRequirements] property readonly

SkypilotAzureOrchestratorSettings (SkypilotBaseOrchestratorSettings) pydantic-model

orchestrators special

skypilot_azure_vm_orchestrator

SkypilotAzureOrchestrator (SkypilotBaseOrchestrator)

cloud: sky.clouds.Cloud property readonly

config: SkypilotAzureOrchestratorConfig property readonly

settings_class: Optional[Type[BaseSettings]] property readonly

prepare_environment_variable(self, set=True)

`zenml.integrations.skypilot_azure` `special`

`SkypilotAzureIntegration (Integration)`

`flavors()` `classmethod`

`flavors` `special`

`skypilot_orchestrator_azure_vm_flavor`

`SkypilotAzureOrchestratorConfig (SkypilotBaseOrchestratorConfig, SkypilotAzureOrchestratorSettings)` `pydantic-model`

`SkypilotAzureOrchestratorFlavor (BaseOrchestratorFlavor)`

`config_class: Type[zenml.orchestrators.base_orchestrator.BaseOrchestratorConfig]` `property` `readonly`

`docs_url: Optional[str]` `property` `readonly`

`implementation_class: Type[SkypilotAzureOrchestrator]` `property` `readonly`

`logo_url: str` `property` `readonly`

`name: str` `property` `readonly`

`sdk_docs_url: Optional[str]` `property` `readonly`

`service_connector_requirements: Optional[zenml.models.v2.misc.service_connector_type.ServiceConnectorRequirements]` `property` `readonly`

`SkypilotAzureOrchestratorSettings (SkypilotBaseOrchestratorSettings)` `pydantic-model`

`orchestrators` `special`

`skypilot_azure_vm_orchestrator`

`SkypilotAzureOrchestrator (SkypilotBaseOrchestrator)`

`cloud: sky.clouds.Cloud` `property` `readonly`

`config: SkypilotAzureOrchestratorConfig` `property` `readonly`

`settings_class: Optional[Type[BaseSettings]]` `property` `readonly`

`prepare_environment_variable(self, set=True)`