org.apache.spark.sql.sources.v2.reader

Interface SupportsReportPartitioning

All Superinterfaces:

DataSourceReader

@InterfaceStability.Evolving
public interface SupportsReportPartitioning
extends DataSourceReader

A mix in interface for DataSourceReader. Data source readers can implement this interface to report data partitioning and try to avoid shuffle at Spark side. Note that, when the reader creates exactly one InputPartition, Spark may avoid adding a shuffle even if the reader does not implement this interface.

Method Summary

Modifier and Type	Method and Description
Partitioning	outputPartitioning() Returns the output data partitioning that this reader guarantees.

Methods inherited from interface org.apache.spark.sql.sources.v2.reader.DataSourceReader

planInputPartitions, readSchema

Method Detail

outputPartitioning

Partitioning outputPartitioning()

Returns the output data partitioning that this reader guarantees.