public class ColumnEncoderBin extends ColumnEncoder
ColumnEncoder.EncoderType| Modifier and Type | Field and Description |
|---|---|
static String |
MAX_PREFIX |
static String |
MIN_PREFIX |
static String |
NBINS_PREFIX |
BUILD_ROW_BLOCKS_PER_COLUMN| Constructor and Description |
|---|
ColumnEncoderBin() |
ColumnEncoderBin(int colID,
int numBin) |
ColumnEncoderBin(int colID,
int numBin,
double[] binMins,
double[] binMaxs) |
| Modifier and Type | Method and Description |
|---|---|
void |
build(CacheBlock in)
Build the transform meta data for the given block input.
|
void |
buildPartial(FrameBlock in)
Partial build of internal data structures (e.g., in distributed spark operations).
|
void |
computeBins(double min,
double max) |
double[] |
getBinMaxs() |
double[] |
getBinMins() |
Callable<Object> |
getBuildTask(CacheBlock in) |
double |
getColMaxs() |
double |
getColMins() |
FrameBlock |
getMetaData(FrameBlock meta)
Construct a frame block out of the transform meta data.
|
Callable<Object> |
getPartialBuildTask(CacheBlock in,
int startRow,
int blockSize,
HashMap<Integer,Object> ret) |
Callable<Object> |
getPartialMergeBuildTask(HashMap<Integer,?> ret) |
void |
initMetaData(FrameBlock meta)
Sets up the required meta data for a subsequent call to apply.
|
void |
mergeAt(ColumnEncoder other)
Merges another encoder, of a compatible type, in after a certain position.
|
void |
prepareBuildPartial()
Allocates internal data structures for partial build.
|
void |
readExternal(ObjectInput in)
Redirects the default java serialization via externalizable to our default hadoop writable serialization for
efficient broadcast/rdd deserialization.
|
void |
writeExternal(ObjectOutput out)
Redirects the default java serialization via externalizable to our default hadoop writable serialization for
efficient broadcast/rdd serialization.
|
apply, apply, compareTo, getApplyTasks, getBuildTasks, getColID, getColMapping, getSparseRowsWZeros, isApplicable, isApplicable, setColID, shiftCol, updateIndexRangespublic static final String MIN_PREFIX
public static final String MAX_PREFIX
public static final String NBINS_PREFIX
public ColumnEncoderBin()
public ColumnEncoderBin(int colID,
int numBin)
public ColumnEncoderBin(int colID,
int numBin,
double[] binMins,
double[] binMaxs)
public double getColMins()
public double getColMaxs()
public double[] getBinMins()
public double[] getBinMaxs()
public void build(CacheBlock in)
Encoderin - input frame blockpublic Callable<Object> getBuildTask(CacheBlock in)
getBuildTask in class ColumnEncoderpublic Callable<Object> getPartialBuildTask(CacheBlock in, int startRow, int blockSize, HashMap<Integer,Object> ret)
getPartialBuildTask in class ColumnEncoderpublic Callable<Object> getPartialMergeBuildTask(HashMap<Integer,?> ret)
getPartialMergeBuildTask in class ColumnEncoderpublic void computeBins(double min,
double max)
public void prepareBuildPartial()
ColumnEncoderprepareBuildPartial in interface EncoderprepareBuildPartial in class ColumnEncoderpublic void buildPartial(FrameBlock in)
ColumnEncoderbuildPartial in interface EncoderbuildPartial in class ColumnEncoderin - input frame blockpublic void mergeAt(ColumnEncoder other)
ColumnEncoderColumnEncoders are compatible with themselves and EncoderComposite is compatible with
every other ColumnEncoders. MultiColumnEncoders are compatible with every encodermergeAt in class ColumnEncoderother - the encoder that should be merged inpublic FrameBlock getMetaData(FrameBlock meta)
Encodermeta - output frame blockpublic void initMetaData(FrameBlock meta)
Encodermeta - frame blockpublic void writeExternal(ObjectOutput out) throws IOException
ColumnEncoderwriteExternal in interface ExternalizablewriteExternal in class ColumnEncoderout - object outputIOException - if IOException occurspublic void readExternal(ObjectInput in) throws IOException
ColumnEncoderreadExternal in interface ExternalizablereadExternal in class ColumnEncoderin - object inputIOException - if IOException occurCopyright © 2021 The Apache Software Foundation. All rights reserved.