|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Datum
to the external command managed by the
ExecutableManager
.
StreamingCommand.HandleSpec
to a given StreamingCommand.Handle
BinaryStorage
is a simple, as-is, serializer/deserializer pair.BinaryStorage
with default buffer size for reading
inputs.
BinaryStorage
with the given buffer-size for
reading inputs.
InputHandler
to the OutputStream
from which it reads input and sends it to the managed process.
OutputHandler
to the InputStream
from which to read the output data of the managed process.
ExecutableManager
.
InputHandler
since there is no more input
to be sent to the managed process.
OutputHandler
.
ExecutableManager
.
ExecutableManager
depending on the ExecType.
InputHandler
for the given input specification
of the StreamingCommand
.
OutputHandler
for the given output specification
of the StreamingCommand
.
DefaultInputHandler
handles the input for the Pig-Streaming
executable in a InputType#SYNCHRONOUS
manner by feeding it input
via its stdin
.FileOutputHandler
handles the output from the Pig-Streaming
executable in an OutputType#SYNCHRONOUS
manner by reading its output
via its stdout
.ExecutableManager
manages an external executable which processes data
in a Pig query.ExecutableManager
.
FileInputHandler
handles the input for the Pig-Streaming
executable in an InputType#ASYNCHRONOUS
manner by feeding it input
via an external file specified by the user.FileOutputHandler
handles the output from the Pig-Streaming
executable in an OutputType#ASYNCHRONOUS
manner by reading it from
an external file specified by the user.StreamingCommand
for this StreamSpec
.
StreamingCommand
for the given alias.
PigContext.getProperties()
instead
Handle
.
StreamingCommand
.
InputType
JobConf
of the current Map-Reduce job.
HandleSpec
.
Tuple
of the managed process.
StreamingCommand
.
OutputType
.
EvalSpec
.
HandleSpec
.
HadoopExecutableManager
is a specialization of
ExecutableManager
and provides HDFS-specific support for secondary
outputs, task-logs etc.InputHandler
or OutputHandler
depending on the specification of the StreamingCommand
.InputHandler
is responsible for handling the input to the
Pig-Streaming external command.LoadOptimizer
tries to optimize away the deserialization done by Pig
for the simple case of a LOAD followed by a STREAM operator; both with the
equivalent LoadFunc
specifications.value
.
LogicalPlan
if feasible and return status.
Optimizer
is a simple LogicalPlan
optimizer.OutputHandler
is responsible for handling the output of the
Pig-Streaming external command.Tuple
to the managed executable.
StreamingCommand
for this
StreamSpec
.
ExecutableManager
.
StreamingCommand
.
StreamingCommand
.
StreamingCommand
.
JobConf
of the current Map-Reduce job.
HandleSpec
.
StreamingCommand.HandleSpec
for the given StreamingCommand.Handle
of the
StreamSpec
.
StreamingCommand
.
HandleSpec
.
store
at location
.
Slice
in an InputSplit
so it's usable by hadoop.StoreOptimizer
tries to optimize away the deserialization done by Pig
for the simple case of a STREAM followed by a STORE operator; both with
equivalent StoreFunc
specifications.StreamingCommand
represents the specification of an external
command to be executed in a Pig Query.StreamingCommand
with the given command.
StreamingCommand.Handle
to communicate
with the external process.StreamingCommand.HandleSpec
with a given name using the default
PigStorage
serializer/deserializer.
StreamingCommand.HandleSpec
with a given name using the default
PigStorage
serializer/deserializer.
location
is parsable by this Slicer, and that
if the DataStorage is used by the Slicer, it's readable from there.
ExecType
of context
is LOCAL,
validation is not performed.
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |