Configure Union features on your own cluster.
Advanced configurations
This section covers the configuration of union features on your Union.ai cluster.
Interruptible task schedulingLet interruptible tasks run on spot instances, and handle reclamation.Node poolsSeparate Union services from worker pods so they do not contend for resources.AuthenticationConfigure OIDC user authentication and OAuth 2.0 service authorization.Code ViewerLet the console show the exact code a task ran, transferred from the code bundle.Image BuilderBuild container images inside the data plane so tasks can use the remote builder.Multiple ClustersAttach several Kubernetes clusters to one control plane with the clusterPool abstraction.Persistent logsHow FluentBit collects container logs from every node and ships them for retention.MonitoringThe Prometheus instance the data plane deploys, and the metrics it collects.SecretsHow Union Secrets are stored as Kubernetes secrets, and what to configure.Data retention policiesImplications of object storage retention or lifecycle policies on the data plane bucket.Compute pluginsEnable the compute plugins that need cluster-side configuration, such as Dask, Ray, and Spark.Namespace mappingChange how project and domain pairs map onto Kubernetes namespaces.VolumesConfigure the durable, versioned file systems tasks mount and read and write.