org.apache.spark.scheduler.cluster.mesos

Class MesosSchedulerBackendUtil

Object

org.apache.spark.scheduler.cluster.mesos.MesosSchedulerBackendUtil

public class MesosSchedulerBackendUtil
extends Object

A collection of utility functions which can be used by both the MesosSchedulerBackend and the MesosFineGrainedSchedulerBackend.

Constructor Summary

Constructors

Constructor and Description
MesosSchedulerBackendUtil()

Method Summary

Methods

Modifier and Type	Method and Description
static void	addDockerInfo(org.apache.mesos.Protos.ContainerInfo.Builder container, String image, scala.Option<scala.collection.immutable.List<org.apache.mesos.Protos.Volume>> volumes, scala.Option<org.apache.mesos.Protos.ContainerInfo.DockerInfo.Network> network, scala.Option<scala.collection.immutable.List<org.apache.mesos.Protos.ContainerInfo.DockerInfo.PortMapping>> portmaps) Construct a DockerInfo structure and insert it into a ContainerInfo
static scala.collection.immutable.List<org.apache.mesos.Protos.ContainerInfo.DockerInfo.PortMapping>	parsePortMappingsSpec(String portmaps) Parse a comma-delimited list of port mapping specs, each of which takes the form host_port:container_port[:udp|:tcp]
static scala.collection.immutable.List<org.apache.mesos.Protos.Volume>	parseVolumesSpec(String volumes) Parse a comma-delimited list of volume specs, each of which takes the form [host-dir:]container-dir[:rw|:ro].
static void	setupContainerBuilderDockerInfo(String imageName, SparkConf conf, org.apache.mesos.Protos.ContainerInfo.Builder builder) Setup a docker containerizer

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MesosSchedulerBackendUtil

public MesosSchedulerBackendUtil()

Method Detail

parseVolumesSpec

public static scala.collection.immutable.List<org.apache.mesos.Protos.Volume> parseVolumesSpec(String volumes)

Parse a comma-delimited list of volume specs, each of which takes the form [host-dir:]container-dir[:rw|:ro].

Parameters:

volumes - (undocumented)

Returns:

(undocumented)

parsePortMappingsSpec

public static scala.collection.immutable.List<org.apache.mesos.Protos.ContainerInfo.DockerInfo.PortMapping> parsePortMappingsSpec(String portmaps)

Parse a comma-delimited list of port mapping specs, each of which takes the form host_port:container_port[:udp|:tcp]

Note: the docker form is [ip:]host_port:container_port, but the DockerInfo message has no field for 'ip', and instead has a 'protocol' field. Docker itself only appears to support TCP, so this alternative form anticipates the expansion of the docker form to allow for a protocol and leaves open the chance for mesos to begin to accept an 'ip' field

Parameters:

portmaps - (undocumented)

Returns:

(undocumented)

addDockerInfo

public static void addDockerInfo(org.apache.mesos.Protos.ContainerInfo.Builder container,
                 String image,
                 scala.Option<scala.collection.immutable.List<org.apache.mesos.Protos.Volume>> volumes,
                 scala.Option<org.apache.mesos.Protos.ContainerInfo.DockerInfo.Network> network,
                 scala.Option<scala.collection.immutable.List<org.apache.mesos.Protos.ContainerInfo.DockerInfo.PortMapping>> portmaps)

Construct a DockerInfo structure and insert it into a ContainerInfo

Parameters:

container - (undocumented)

image - (undocumented)

volumes - (undocumented)

network - (undocumented)

portmaps - (undocumented)

setupContainerBuilderDockerInfo

public static void setupContainerBuilderDockerInfo(String imageName,
                                   SparkConf conf,
                                   org.apache.mesos.Protos.ContainerInfo.Builder builder)

Setup a docker containerizer

Parameters:

imageName - (undocumented)

conf - (undocumented)

builder - (undocumented)