|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
public interface Slicer
Produces independent slices of data from a given location to be processed in parallel by Pig.
If a class implementing this interface is given as the LoadFunc in a Pig script, it will be used to make slices for that load statement.
Method Summary | |
---|---|
Slice[] |
slice(DataStorage store,
String location)
Creates slices of data from store at location . |
void |
validate(DataStorage store,
String location)
Checks that location is parsable by this Slicer, and that
if the DataStorage is used by the Slicer, it's readable from there. |
Method Detail |
---|
void validate(DataStorage store, String location) throws IOException
location
is parsable by this Slicer, and that
if the DataStorage is used by the Slicer, it's readable from there. If it
isn't, an IOException with a message explaining why will be thrown.
This does not ensure that all the data in location
is
valid. It's a preflight check that there's some chance of the Slicer
working before actual Slices are created and sent off for processing.
IOException
Slice[] slice(DataStorage store, String location) throws IOException
store
at location
.
IOException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |