public class ColumnEncoderBin extends ColumnEncoder
ColumnEncoder.EncoderType| Modifier and Type | Field and Description |
|---|---|
static String |
MAX_PREFIX |
static String |
MIN_PREFIX |
static String |
NBINS_PREFIX |
| Constructor and Description |
|---|
ColumnEncoderBin() |
ColumnEncoderBin(int colID,
int numBin) |
ColumnEncoderBin(int colID,
int numBin,
double[] binMins,
double[] binMaxs) |
| Modifier and Type | Method and Description |
|---|---|
MatrixBlock |
apply(FrameBlock in,
MatrixBlock out,
int outputCol)
Apply the generated metadata to the FrameBlock and saved the result in out.
|
MatrixBlock |
apply(FrameBlock in,
MatrixBlock out,
int outputCol,
int rowStart,
int blk) |
MatrixBlock |
apply(MatrixBlock in,
MatrixBlock out,
int outputCol) |
MatrixBlock |
apply(MatrixBlock in,
MatrixBlock out,
int outputCol,
int rowStart,
int blk) |
void |
build(FrameBlock in)
Build the transform meta data for the given block input.
|
void |
buildPartial(FrameBlock in)
Partial build of internal data structures (e.g., in distributed spark operations).
|
void |
computeBins(double min,
double max) |
double[] |
getBinMaxs() |
double[] |
getBinMins() |
Callable<Object> |
getBuildTask(FrameBlock in) |
double |
getColMaxs() |
double |
getColMins() |
FrameBlock |
getMetaData(FrameBlock meta)
Construct a frame block out of the transform meta data.
|
Callable<Object> |
getPartialBuildTask(FrameBlock in,
int startRow,
int blockSize,
HashMap<Integer,Object> ret) |
Callable<Object> |
getPartialMergeBuildTask(HashMap<Integer,?> ret) |
void |
initMetaData(FrameBlock meta)
Sets up the required meta data for a subsequent call to apply.
|
void |
mergeAt(ColumnEncoder other)
Merges another encoder, of a compatible type, in after a certain position.
|
void |
prepareBuildPartial()
Allocates internal data structures for partial build.
|
void |
readExternal(ObjectInput in)
Redirects the default java serialization via externalizable to our default hadoop writable serialization for
efficient broadcast/rdd deserialization.
|
void |
writeExternal(ObjectOutput out)
Redirects the default java serialization via externalizable to our default hadoop writable serialization for
efficient broadcast/rdd serialization.
|
compareTo, getApplyTasks, getApplyTasks, getBuildTasks, getColID, getColMapping, isApplicable, isApplicable, setColID, shiftCol, updateIndexRangespublic static final String MIN_PREFIX
public static final String MAX_PREFIX
public static final String NBINS_PREFIX
public ColumnEncoderBin()
public ColumnEncoderBin(int colID,
int numBin)
public ColumnEncoderBin(int colID,
int numBin,
double[] binMins,
double[] binMaxs)
public double getColMins()
public double getColMaxs()
public double[] getBinMins()
public double[] getBinMaxs()
public void build(FrameBlock in)
Encoderin - input frame blockpublic Callable<Object> getBuildTask(FrameBlock in)
getBuildTask in class ColumnEncoderpublic Callable<Object> getPartialBuildTask(FrameBlock in, int startRow, int blockSize, HashMap<Integer,Object> ret)
getPartialBuildTask in class ColumnEncoderpublic Callable<Object> getPartialMergeBuildTask(HashMap<Integer,?> ret)
getPartialMergeBuildTask in class ColumnEncoderpublic void computeBins(double min,
double max)
public void prepareBuildPartial()
ColumnEncoderprepareBuildPartial in interface EncoderprepareBuildPartial in class ColumnEncoderpublic void buildPartial(FrameBlock in)
ColumnEncoderbuildPartial in interface EncoderbuildPartial in class ColumnEncoderin - input frame blockpublic MatrixBlock apply(FrameBlock in, MatrixBlock out, int outputCol)
Encoderin - input frame blockout - output matrix blockoutputCol - is a offset in the output matrix. column in FrameBlock + outputCol = column in outpublic MatrixBlock apply(MatrixBlock in, MatrixBlock out, int outputCol)
apply in class ColumnEncoderpublic MatrixBlock apply(FrameBlock in, MatrixBlock out, int outputCol, int rowStart, int blk)
apply in class ColumnEncoderpublic MatrixBlock apply(MatrixBlock in, MatrixBlock out, int outputCol, int rowStart, int blk)
apply in class ColumnEncoderpublic void mergeAt(ColumnEncoder other)
ColumnEncoderColumnEncoders are compatible with themselves and EncoderComposite is compatible with
every other ColumnEncoders. MultiColumnEncoders are compatible with every encodermergeAt in class ColumnEncoderother - the encoder that should be merged inpublic FrameBlock getMetaData(FrameBlock meta)
Encodermeta - output frame blockpublic void initMetaData(FrameBlock meta)
Encodermeta - frame blockpublic void writeExternal(ObjectOutput out) throws IOException
ColumnEncoderwriteExternal in interface ExternalizablewriteExternal in class ColumnEncoderout - object outputIOException - if IOException occurspublic void readExternal(ObjectInput in) throws IOException
ColumnEncoderreadExternal in interface ExternalizablereadExternal in class ColumnEncoderin - object inputIOException - if IOException occurCopyright © 2021 The Apache Software Foundation. All rights reserved.