Plugins

Typed namespace

class livy.cli.submit.PreSubmitArguments

Typed Namespace for arguments before task submission.

script: str

class_name: str

jars: List[str]

py_files: List[str]

files: List[str]

archives: List[str]

queue_name: str

session_name: str

api_url: str

driver_memory: str

driver_cores: int

executor_memory: str

executor_cores: int

num_executors: int

spark_conf: List[Tuple[str, str]]

watch_log: bool

time_prog_start: datetime.datetime

Local time this script is called

class livy.cli.submit.TaskEndedArguments

Typed Namespace for arguments when task is ended. It contains all attributes from PreSubmitArguments.

batch_id: int

Batch ID response by livy server

state: str

Task ended state

time_task_submit: datetime.datetime

Local time before task is submitted

time_task_ended: datetime.datetime

Local time that detected task is ended

Utility