SHUFFLE
BlockId
SHUFFLE_DATA
BlockId
SHUFFLE_INDEX
BlockId
SPARK_VERSION
spark
SPMap
ShortestPaths
SQLContext
sql
SQLSession
SQLContext HiveContext
SQLUserDefinedType
types
STREAM
BlockId
SVDPlusPlus
lib
SVMDataGenerator
util
SVMModel
classification
SVMWithSGD
classification
SYSTEM_DEFAULT
DecimalType
SaveMode
sql
Saveable
util
SchedulingMode
scheduler SchedulingMode
SchemaRDD
sql
SchemaRelationProvider
sources
Seconds
streaming
SequenceFileRDDFunctions
rdd
SerializableWritable
spark
SerializationStream
serializer
Serializer
serializer
SerializerInstance
serializer
ShortType
types
ShortestPaths
lib
ShuffleBlockId
storage
ShuffleDataBlockId
storage
ShuffleDependency
spark
ShuffleIndexBlockId
storage
ShuffleReadMetricDistributions
v1
ShuffleReadMetrics
v1
ShuffleWriteMetricDistributions
v1
ShuffleWriteMetrics
v1
ShuffledRDD
rdd
SimpleFutureAction
spark
SimpleUpdater
optimization
SingularValueDecomposition
linalg
SizeEstimator
util
SnappyCompressionCodec
io
Sort
QuantileStrategy
SparkConf
spark
SparkContext
spark
SparkEnv
spark
SparkException
spark
SparkFiles
spark
SparkFirehoseListener
spark
SparkFlumeEvent
flume
SparkHadoopMapRedUtil
mapred
SparkJobInfo
spark
SparkLauncher
launcher
SparkListener
scheduler
SparkListenerApplicationEnd
scheduler
SparkListenerApplicationStart
scheduler
SparkListenerBlockManagerAdded
scheduler
SparkListenerBlockManagerRemoved
scheduler
SparkListenerBlockUpdated
scheduler
SparkListenerEnvironmentUpdate
scheduler
SparkListenerEvent
scheduler
SparkListenerExecutorAdded
scheduler
SparkListenerExecutorMetricsUpdate
scheduler
SparkListenerExecutorRemoved
scheduler
SparkListenerJobEnd
scheduler
SparkListenerJobStart
scheduler
SparkListenerStageCompleted
scheduler
SparkListenerStageSubmitted
scheduler
SparkListenerTaskEnd
scheduler
SparkListenerTaskGettingResult
scheduler
SparkListenerTaskStart
scheduler
SparkListenerUnpersistRDD
scheduler
SparkPlanner
SQLContext
SparkStageInfo
spark
SparkStatusTracker
spark
SparseMatrix
linalg
SparseVector
linalg
Split
tree model
SplitInfo
scheduler
SquaredError
loss
SquaredL2Updater
optimization
StageAttemptId
JobProgressListener
StageData
v1
StageId
JobProgressListener
StageInfo
scheduler
StageStatus
v1
StandardNormalGenerator
random
StandardScaler
feature feature
StandardScalerModel
feature feature
StatCounter
util
Statistics
stat receiver
StatsReportListener
scheduler scheduler
StopWordsRemover
feature
StorageLevel
storage
StorageLevels
java
StorageListener
storage
StorageStatus
storage
StorageStatusListener
storage
Strategy
configuration sql
StreamBlockId
storage
StreamInputInfo
scheduler
StreamingContext
streaming
StreamingContextState
streaming
StreamingKMeans
clustering
StreamingKMeansModel
clustering
StreamingLinearAlgorithm
regression
StreamingLinearRegressionWithSGD
regression
StreamingListener
scheduler
StreamingListenerBatchCompleted
scheduler
StreamingListenerBatchStarted
scheduler
StreamingListenerBatchSubmitted
scheduler
StreamingListenerEvent
scheduler
StreamingListenerReceiverError
scheduler
StreamingListenerReceiverStarted
scheduler
StreamingListenerReceiverStopped
scheduler
StreamingLogisticRegressionWithSGD
classification
StringArrayParam
param
StringContains
sources
StringEndsWith
sources
StringIndexer
feature
StringIndexerModel
feature
StringStartsWith
sources
StringToColumn
implicits
StringType
types
StronglyConnectedComponents
lib
StructField
types
StructType
types
Success
spark
s
SingularValueDecomposition
sample
JavaDoubleRDD JavaPairRDD JavaRDD RDD DataFrame BernoulliCellSampler BernoulliSampler PoissonSampler RandomSampler
sampleBy
DataFrameStatFunctions
sampleByKey
JavaPairRDD PairRDDFunctions
sampleByKeyExact
JavaPairRDD PairRDDFunctions
sampleStdev
JavaDoubleRDD DoubleRDDFunctions StatCounter
sampleVariance
JavaDoubleRDD DoubleRDDFunctions StatCounter
save
LogisticRegressionModel NaiveBayesModel SVMModel DistributedLDAModel GaussianMixtureModel KMeansModel LocalLDAModel PowerIterationClusteringModel Word2VecModel MatrixFactorizationModel IsotonicRegressionModel LassoModel LinearRegressionModel RidgeRegressionModel DecisionTreeModel GradientBoostedTreesModel RandomForestModel Saveable DataFrame DataFrameWriter
saveAsHadoopDataset
JavaPairRDD PairRDDFunctions
saveAsHadoopFile
JavaPairRDD PairRDDFunctions
saveAsHadoopFiles
JavaPairDStream PairDStreamFunctions
saveAsLibSVMFile
MLUtils
saveAsNewAPIHadoopDataset
JavaPairRDD PairRDDFunctions
saveAsNewAPIHadoopFile
JavaPairRDD PairRDDFunctions
saveAsNewAPIHadoopFiles
JavaPairDStream PairDStreamFunctions
saveAsObjectFile
JavaRDDLike RDD
saveAsObjectFiles
DStream
saveAsParquetFile
DataFrame
saveAsSequenceFile
SequenceFileRDDFunctions
saveAsTable
DataFrame DataFrameWriter
saveAsTextFile
JavaRDDLike RDD
saveAsTextFiles
DStream
saveLabeledData
MLUtils
sc
JavaSparkContext StringToColumn JavaStreamingContext
scalaIntToJavaLong
JavaDStreamLike
scalaToJavaLong
JavaPairDStream
scale
GammaGenerator Decimal DecimalType PrecisionInfo
scalingVec
ElementwiseProduct ElementwiseProduct
scheduler
spark streaming
schedulingDelay
BatchInfo
schedulingMode
JobProgressListener
schedulingPool
StageData
schema
DataFrame DataFrameReader Row BaseRelation HadoopFsRelation
scope
RDDInfo
scoreAndLabels
BinaryClassificationMetrics
second
functions
seconds
Durations
securityManager
SparkEnv
select
DataFrame
selectExpr
DataFrame
selectedFeatures
ChiSqSelectorModel
sendToDst
EdgeContext
sendToSrc
EdgeContext
sequence
FreqSequence
sequenceFile
SparkContext JavaSparkContext
serialize
VectorUDT DummySerializerInstance SerializerInstance UserDefinedType
serializeStream
DummySerializerInstance SerializerInstance
serializedPyClass
UserDefinedType
serializer
ShuffleDependency SparkEnv spark
sessionState
SQLSession
set
SparkConf SparkEnv EdgeTriplet Params Decimal
setAggregator
ShuffledRDD
setAlgo
Strategy
setAll
SparkConf
setAlpha
ALS LDA ALS
setAppName
SparkConf SparkLauncher
setAppResource
SparkLauncher
setBandwidth
KernelDensity
setBeta
LDA
setBlockSize
MultilayerPerceptronClassifier
setBlocks
ALS
setCacheNodeIds
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor
setCallSite
SparkContext JavaSparkContext
setCaseSensitive
StopWordsRemover
setCategoricalFeaturesInfo
Strategy
setCheckpointDir
SparkContext JavaSparkContext
setCheckpointInterval
DecisionTreeClassifier GBTClassifier RandomForestClassifier ALS DecisionTreeRegressor GBTRegressor RandomForestRegressor LDA ALS Strategy
setClassifier
OneVsRest
setConf
SparkLauncher SQLContext HiveContext
setConvergenceTol
GaussianMixture GradientDescent LBFGS StreamingLinearRegressionWithSGD
setDecayFactor
StreamingKMeans
setDefault
Params
setDefaultClassLoader
Serializer
setDegree
PolynomialExpansion
setDeployMode
SparkLauncher
setDocConcentration
LDA
setDropLast
OneHotEncoder
setElasticNetParam
LogisticRegression LinearRegression
setEpsilon
KMeans
setEstimator
CrossValidator TrainValidationSplit
setEstimatorParamMaps
CrossValidator TrainValidationSplit
setEvaluator
CrossValidator TrainValidationSplit
setExecutorEnv
SparkConf
setFeatureIndex
IsotonicRegression IsotonicRegressionModel
setFeatureSubsetStrategy
RandomForestClassifier RandomForestRegressor
setFeaturesCol
PredictionModel Predictor OneVsRest KMeans RFormula IsotonicRegression IsotonicRegressionModel
setFinalRDDStorageLevel
ALS
setFitIntercept
LogisticRegression LinearRegression
setFormula
RFormula
setGaps
RegexTokenizer
setGradient
GradientDescent LBFGS
setHalfLife
StreamingKMeans
setIfMissing
SparkConf
setImplicitPrefs
ALS ALS
setImpurity
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setIndices
VectorSlicer
setInitMode
KMeans
setInitSteps
KMeans
setInitialCenters
StreamingKMeans
setInitialModel
GaussianMixture KMeans
setInitialWeights
StreamingLogisticRegressionWithSGD StreamingLinearRegressionWithSGD
setInitializationMode
KMeans PowerIterationClustering
setInitializationSteps
KMeans
setInputCol
UnaryTransformer Binarizer Bucketizer CountVectorizer CountVectorizerModel HashingTF IDF IDFModel IndexToString MinMaxScaler MinMaxScalerModel OneHotEncoder PCA PCAModel StandardScaler StandardScalerModel StopWordsRemover StringIndexer StringIndexerModel VectorIndexer VectorIndexerModel VectorSlicer Word2Vec Word2VecModel
setInputCols
VectorAssembler
setIntercept
GeneralizedLinearAlgorithm
setIntermediateRDDStorageLevel
ALS
setInverse
DCT
setIsotonic
IsotonicRegression IsotonicRegression
setItemCol
ALS ALSModel
setIterations
ALS
setJars
SparkConf
setJavaHome
SparkLauncher
setJobDescription
SparkContext
setJobGroup
SparkContext JavaSparkContext
setK
KMeans PCA GaussianMixture KMeans LDA PowerIterationClustering StreamingKMeans
setKappa
OnlineLDAOptimizer
setKeyOrdering
ShuffledRDD
setLabelCol
Predictor OneVsRest BinaryClassificationEvaluator MulticlassClassificationEvaluator RegressionEvaluator RFormula IsotonicRegression
setLabels
IndexToString
setLambda
NaiveBayes ALS
setLayers
MultilayerPerceptronClassifier
setLearningRate
Word2Vec BoostingStrategy
setLocalProperty
SparkContext JavaSparkContext
setLogLevel
SparkContext JavaSparkContext
setLoss
BoostingStrategy
setLossType
GBTClassifier GBTRegressor
setMainClass
SparkLauncher
setMapSideCombine
ShuffledRDD
setMaster
SparkConf SparkLauncher
setMax
MinMaxScaler MinMaxScalerModel
setMaxBins
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMaxCategories
VectorIndexer
setMaxDepth
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMaxIter
GBTClassifier LogisticRegression MultilayerPerceptronClassifier KMeans Word2Vec ALS GBTRegressor LinearRegression
setMaxIterations
GaussianMixture KMeans LDA PowerIterationClustering
setMaxLocalProjDBSize
PrefixSpan
setMaxMemoryInMB
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMaxNumIterations
LBFGS
setMaxPatternLength
PrefixSpan
setMetricName
BinaryClassificationEvaluator MulticlassClassificationEvaluator RegressionEvaluator
setMin
MinMaxScaler MinMaxScalerModel
setMinConfidence
AssociationRules
setMinCount
Word2Vec Word2Vec
setMinDF
CountVectorizer
setMinDocFreq
IDF
setMinInfoGain
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMinInstancesPerNode
DecisionTreeClassifier GBTClassifier RandomForestClassifier DecisionTreeRegressor GBTRegressor RandomForestRegressor Strategy
setMinSupport
FPGrowth PrefixSpan
setMinTF
CountVectorizer CountVectorizerModel
setMinTokenLength
RegexTokenizer
setMiniBatchFraction
StreamingLogisticRegressionWithSGD OnlineLDAOptimizer GradientDescent StreamingLinearRegressionWithSGD
setModelType
NaiveBayes NaiveBayes
setN
NGram
setName
JavaDoubleRDD JavaPairRDD JavaRDD EdgeRDDImpl VertexRDDImpl RDD
setNames
VectorSlicer
setNonnegative
ALS ALS
setNumBlocks
ALS
setNumClasses
LogisticRegressionWithLBFGS Strategy
setNumCorrections
LBFGS
setNumFeatures
HashingTF
setNumFolds
CrossValidator
setNumItemBlocks
ALS
setNumIterations
StreamingLogisticRegressionWithSGD Word2Vec GradientDescent LBFGS StreamingLinearRegressionWithSGD BoostingStrategy
setNumPartitions
Word2Vec Word2Vec FPGrowth
setNumTrees
RandomForestClassifier RandomForestRegressor
setNumUserBlocks
ALS
setOptimizeDocConcentration
OnlineLDAOptimizer
setOptimizer
LDA
setOrNull
Decimal
setOutputCol
UnaryTransformer Binarizer Bucketizer CountVectorizer CountVectorizerModel HashingTF IDF IDFModel IndexToString MinMaxScaler MinMaxScalerModel OneHotEncoder PCA PCAModel StandardScaler StandardScalerModel StopWordsRemover StringIndexer StringIndexerModel VectorAssembler VectorIndexer VectorIndexerModel VectorSlicer Word2Vec Word2VecModel
setP
Normalizer
setParent
Model
setPattern
RegexTokenizer
setPredictionCol
PredictionModel Predictor OneVsRest KMeans MulticlassClassificationEvaluator RegressionEvaluator ALS ALSModel IsotonicRegression IsotonicRegressionModel
setProbabilityCol
ProbabilisticClassificationModel ProbabilisticClassifier
setProductBlocks
ALS
setPropertiesFile
SparkLauncher
setQuantileCalculationStrategy
Strategy
setRandomCenters
StreamingKMeans
setRank
ALS ALS
setRatingCol
ALS
setRawPredictionCol
ClassificationModel Classifier BinaryClassificationEvaluator
setRegParam
LogisticRegression ALS LinearRegression StreamingLogisticRegressionWithSGD GradientDescent LBFGS
setRuns
KMeans
setSample
KernelDensity
setScalingVec
ElementwiseProduct
setScoreCol
BinaryClassificationEvaluator
setSeed
GBTClassifier MultilayerPerceptronClassifier RandomForestClassifier KMeans Word2Vec ALS GBTRegressor RandomForestRegressor GaussianMixture KMeans LDA Word2Vec ExponentialGenerator GammaGenerator LogNormalGenerator PoissonGenerator StandardNormalGenerator UniformGenerator ALS BernoulliCellSampler BernoulliSampler PoissonSampler Pseudorandom
setSerializer
CoGroupedRDD ShuffledRDD
setSession
SQLContext
setSmoothing
NaiveBayes
setSparkHome
SparkConf SparkLauncher
setSplits
Bucketizer
setStages
Pipeline
setStandardization
LogisticRegression LinearRegression
setStepSize
GBTClassifier Word2Vec GBTRegressor StreamingLogisticRegressionWithSGD GradientDescent StreamingLinearRegressionWithSGD
setStopWords
StopWordsRemover
setSubsamplingRate
GBTClassifier RandomForestClassifier GBTRegressor RandomForestRegressor Strategy
setTaskContext
TaskContext
setTau0
OnlineLDAOptimizer
setThreshold
LogisticRegression LogisticRegressionModel Binarizer LogisticRegressionModel SVMModel
setThresholds
LogisticRegression LogisticRegressionModel ProbabilisticClassificationModel ProbabilisticClassifier
setTol
LogisticRegression MultilayerPerceptronClassifier KMeans LinearRegression
setTopicConcentration
LDA
setTrainRatio
TrainValidationSplit
setTreeStrategy
BoostingStrategy
setUpdater
GradientDescent LBFGS
setUseNodeIdCache
Strategy
setUserBlocks
ALS
setUserCol
ALS ALSModel
setValidateData
GeneralizedLinearAlgorithm
setValidationTol
BoostingStrategy
setValue
Accumulable
setVectorSize
Word2Vec Word2Vec
setVerbose
SparkLauncher
setVocabSize
CountVectorizer
setWeightCol
IsotonicRegression
setWithMean
StandardScaler StandardScalerModel
setWithStd
StandardScaler StandardScalerModel
sha1
functions
sha2
functions
shape
GammaGenerator
shiftLeft
functions
shiftRight
functions
shiftRightUnsigned
functions
short
ColumnName
shortName
DataSourceRegister
show
DataFrame
showMillisDistribution
StatsReportListener
shuffleHandle
ShuffleDependency
shuffleId
FetchFailed ShuffleDependency ShuffleBlockId ShuffleDataBlockId ShuffleIndexBlockId
shuffleManager
SparkEnv
shuffleMemoryManager
SparkEnv
shuffleRead
ExecutorStageSummary
shuffleReadBytes
StageData
shuffleReadMetrics
TaskMetricDistributions TaskMetrics
shuffleReadRecords
StageData
shuffleWrite
ExecutorStageSummary
shuffleWriteBytes
StageData
shuffleWriteMetrics
TaskMetricDistributions TaskMetrics
shuffleWriteRecords
StageData
sigma
MultivariateGaussian
signum
functions
simpleString
QueryExecution QueryExecution ArrayType ByteType DataType DecimalType IntegerType LongType MapType ShortType StructType
sin
functions
sinh
functions
size
AttributeGroup ParamMap DenseVector SparseVector Vector Row functions
sizeInBytes
BaseRelation HadoopFsRelation
skippedStages
JobProgressListener
slice
JavaDStreamLike DStream
slideDuration
DStream InputDStream
sliding
RDDFunctions
socketStream
StreamingContext JavaStreamingContext
socketTextStream
StreamingContext JavaStreamingContext
sort
DataFrame
sortBy
JavaRDD RDD
sortByKey
JavaPairRDD OrderedRDDFunctions
sort_array
functions
soundex
functions
sources
sql
spark
apache
sparkContext
RDD SQLContext SparkPlanner StreamingContext JavaStreamingContext
sparkFilesDir
SparkEnv
sparkPartitionId
functions
sparkPlan
QueryExecution
sparkProperties
EnvironmentListener
sparkUser
SparkContext JavaSparkContext SparkListenerApplicationStart ApplicationAttemptInfo
sparse
Matrices Vectors
sparsity
NumericAttribute
spdiag
SparseMatrix
speculative
TaskInfo TaskData
speye
Matrices SparseMatrix
split
InternalNode Node functions
splitIndex
RDDBlockId
splits
JavaRDDLike Bucketizer
sprand
Matrices SparseMatrix
sprandn
Matrices SparseMatrix
sqdist
Vectors
sql
spark SQLContext
sqlContext
DataFrame SparkPlanner BaseRelation
sqlParser
SQLContext
sqlType
VectorUDT UserDefinedType
sqrt
functions
squaredDist
Vector
srcAttr
EdgeContext EdgeTriplet
srcId
Edge EdgeContext
srdd
JavaDoubleRDD
ssc
JavaStreamingContext
stackTrace
ExceptionFailure
stageAttemptId
SparkListenerTaskEnd SparkListenerTaskStart
stageFailed
StageInfo
stageId
SparkStageInfo TaskContext SparkListenerTaskEnd SparkListenerTaskStart StageInfo StageData
stageIdToActiveJobIds
JobProgressListener
stageIdToData
JobProgressListener
stageIdToInfo
JobProgressListener
stageIds
SparkJobInfo SparkListenerJobStart JobData
stageInfo
SparkListenerStageCompleted SparkListenerStageSubmitted
stageInfos
SparkListenerJobStart
stageLogInfo
JobLogger
stages
Pipeline PipelineModel
starGraph
GraphGenerators
start
StreamingContext JavaStreamingContext ConstantInputDStream InputDStream ReceiverInputDStream
startPosition
AnalysisException
startTime
SparkContext JavaSparkContext ApplicationAttemptInfo JobProgressListener
startsWith
Column
stat
mllib DataFrame
staticPageRank
GraphOps
staticPersonalizedPageRank
GraphOps
statistic
ChiSqTestResult KolmogorovSmirnovTestResult TestResult
stats
JavaDoubleRDD Node DoubleRDDFunctions
status
SparkJobInfo TaskInfo spark JobData StageData
statusTracker
SparkContext JavaSparkContext
std
NumericAttribute StandardScalerModel StandardScalerModel LogNormalGenerator
stdev
JavaDoubleRDD DoubleRDDFunctions StatCounter
stop
SparkContext JavaSparkContext BroadcastFactory HttpBroadcastFactory TorrentBroadcastFactory StreamingContext JavaStreamingContext ConstantInputDStream InputDStream ReceiverInputDStream Receiver
stopWords
StopWordsRemover
storage
spark ui
storageLevel
RDDPartitionInfo RDDStorageInfo BlockStatus BlockUpdatedInfo RDDInfo Receiver
storageStatusList
StorageStatusListener ExecutorsListener StorageListener
store
ActorHelper Receiver
strategies
SparkPlanner
streamId
StreamBlockId Receiver ReceiverInfo
streamIdToInputInfo
BatchInfo
streamIdToNumRecords
BatchInfo
streaming
examples spark
string
ColumnName
stringOrError
QueryExecution
stringResult
QueryExecution
stringToText
SparkContext
stringWritableConverter
SparkContext WritableConverter
stringWritableFactory
WritableFactory
stronglyConnectedComponents
GraphOps
struct
ColumnName functions
subgraph
Graph GraphImpl
submissionTime
SparkStageInfo StageInfo JobData BatchInfo
submitJob
SparkContext
subsamplingRate
Strategy
subsetAccuracy
MultilabelMetrics
substitutor
HiveContext
substr
Column
substring
functions
substring_index
functions
subtract
JavaDoubleRDD JavaPairRDD JavaRDD RDD Vector
subtractByKey
JavaPairRDD PairRDDFunctions
succeededTasks
ExecutorStageSummary
successful
TaskInfo
sum
JavaDoubleRDD DoubleRDDFunctions GroupedData functions StatCounter Vector
sumApprox
JavaDoubleRDD DoubleRDDFunctions
sumDistinct
functions
summary
LogisticRegressionModel LinearRegressionModel
supportedFeatureSubsetStrategies
RandomForestClassifier RandomForestRegressor RandomForest
supportedImpurities
DecisionTreeClassifier RandomForestClassifier DecisionTreeRegressor RandomForestRegressor
supportedLossTypes
GBTClassifier GBTRegressor
systemProperties
EnvironmentListener