pyspark.SparkContext.setSystemProperty

classmethod SparkContext.setSystemProperty(key: str, value: str) → None

Set a Java system property, such as spark.executor.memory. This must be invoked before instantiating SparkContext.

New in version 0.9.0.

Parameters

keystr

The key of a new Java system property.

valuestr

The value of a new Java system property.

previous

pyspark.SparkContext.setLogLevel

next

pyspark.SparkContext.show_profiles