|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||
| Packages that use BaseWork | |
|---|---|
| org.apache.hadoop.hive.ql.exec | Hive QL execution tasks, operators, functions and other handlers. |
| org.apache.hadoop.hive.ql.exec.tez | |
| org.apache.hadoop.hive.ql.io.rcfile.merge | |
| org.apache.hadoop.hive.ql.io.rcfile.stats | |
| org.apache.hadoop.hive.ql.io.rcfile.truncate | |
| org.apache.hadoop.hive.ql.parse | |
| org.apache.hadoop.hive.ql.plan | |
| Uses of BaseWork in org.apache.hadoop.hive.ql.exec |
|---|
| Methods in org.apache.hadoop.hive.ql.exec with parameters of type BaseWork | |
|---|---|
static void |
Utilities.setBaseWork(org.apache.hadoop.conf.Configuration conf,
String name,
BaseWork work)
Pushes work into the global work map |
| Uses of BaseWork in org.apache.hadoop.hive.ql.exec.tez |
|---|
| Methods in org.apache.hadoop.hive.ql.exec.tez with parameters of type BaseWork | |
|---|---|
void |
DagUtils.addCredentials(BaseWork work,
org.apache.tez.dag.api.DAG dag)
Set up credentials for the base work on secure clusters |
org.apache.tez.dag.api.Vertex |
DagUtils.createVertex(org.apache.hadoop.mapred.JobConf conf,
BaseWork work,
org.apache.hadoop.fs.Path scratchDir,
org.apache.hadoop.yarn.api.records.LocalResource appJarLr,
List<org.apache.hadoop.yarn.api.records.LocalResource> additionalLr,
org.apache.hadoop.fs.FileSystem fileSystem,
Context ctx,
boolean hasChildren,
TezWork tezWork)
Create a vertex from a given work object. |
org.apache.hadoop.mapred.JobConf |
DagUtils.initializeVertexConf(org.apache.hadoop.mapred.JobConf conf,
BaseWork work)
Creates and initializes the JobConf object for a given BaseWork object. |
| Uses of BaseWork in org.apache.hadoop.hive.ql.io.rcfile.merge |
|---|
| Subclasses of BaseWork in org.apache.hadoop.hive.ql.io.rcfile.merge | |
|---|---|
class |
MergeWork
|
| Uses of BaseWork in org.apache.hadoop.hive.ql.io.rcfile.stats |
|---|
| Subclasses of BaseWork in org.apache.hadoop.hive.ql.io.rcfile.stats | |
|---|---|
class |
PartialScanWork
Partial Scan Work. |
| Uses of BaseWork in org.apache.hadoop.hive.ql.io.rcfile.truncate |
|---|
| Subclasses of BaseWork in org.apache.hadoop.hive.ql.io.rcfile.truncate | |
|---|---|
class |
ColumnTruncateWork
|
| Uses of BaseWork in org.apache.hadoop.hive.ql.parse |
|---|
| Fields in org.apache.hadoop.hive.ql.parse declared as BaseWork | |
|---|---|
BaseWork |
GenTezProcContext.preceedingWork
|
| Fields in org.apache.hadoop.hive.ql.parse with type parameters of type BaseWork | |
|---|---|
Map<Operator<?>,List<BaseWork>> |
GenTezProcContext.childToWorkMap
|
Map<Operator<?>,BaseWork> |
GenTezProcContext.leafOperatorToFollowingWork
|
Map<Operator<?>,Map<BaseWork,TezEdgeProperty>> |
GenTezProcContext.linkOpWithWorkMap
|
Map<BaseWork,List<ReduceSinkOperator>> |
GenTezProcContext.linkWorkWithReduceSinkMap
|
Map<MapJoinOperator,List<BaseWork>> |
GenTezProcContext.mapJoinWorkMap
|
Map<Operator<?>,BaseWork> |
GenTezProcContext.rootToWorkMap
|
Map<Operator<?>,BaseWork> |
GenTezProcContext.unionWorkMap
|
Set<BaseWork> |
GenTezProcContext.workWithUnionOperators
|
| Methods in org.apache.hadoop.hive.ql.parse with parameters of type BaseWork | |
|---|---|
void |
GenTezUtils.removeUnionOperators(org.apache.hadoop.conf.Configuration conf,
GenTezProcContext context,
BaseWork work)
|
| Uses of BaseWork in org.apache.hadoop.hive.ql.plan |
|---|
| Subclasses of BaseWork in org.apache.hadoop.hive.ql.plan | |
|---|---|
class |
MapWork
MapWork represents all the information used to run a map task on the cluster. |
class |
ReduceWork
ReduceWork represents all the information used to run a reduce task on the cluster. |
class |
UnionWork
Simple wrapper for union all cases. |
| Fields in org.apache.hadoop.hive.ql.plan declared as BaseWork | |
|---|---|
BaseWork |
TezWork.Dependency.w
|
| Methods in org.apache.hadoop.hive.ql.plan that return types with arguments of type BaseWork | |
|---|---|
List<BaseWork> |
TezWork.getAllWork()
getAllWork returns a topologically sorted list of BaseWork |
Collection<BaseWork> |
TezWork.getAllWorkUnsorted()
|
List<BaseWork> |
TezWork.getChildren(BaseWork work)
getChildren returns all the nodes with edges leading out of work |
Set<BaseWork> |
TezWork.getLeaves()
getLeaves returns all nodes that do not have a child |
List<BaseWork> |
TezWork.getParents(BaseWork work)
getParents returns all the nodes with edges leading into work |
Set<BaseWork> |
TezWork.getRoots()
getRoots returns all nodes that do not have a parent. |
Map<String,BaseWork> |
TezWork.getWorkMap()
getWorkMap returns a map of "vertex name" to BaseWork |
| Methods in org.apache.hadoop.hive.ql.plan with parameters of type BaseWork | |
|---|---|
void |
TezWork.add(BaseWork w)
add creates a new node in the graph without any connections |
void |
TezWork.addAll(BaseWork[] bws)
add all nodes in the collection without any connections |
void |
TezWork.connect(BaseWork a,
BaseWork b,
TezEdgeProperty edgeProp)
connect adds an edge between a and b. |
void |
TezWork.disconnect(BaseWork a,
BaseWork b)
disconnect removes an edge between a and b. |
List<BaseWork> |
TezWork.getChildren(BaseWork work)
getChildren returns all the nodes with edges leading out of work |
TezEdgeProperty |
TezWork.getEdgeProperty(BaseWork a,
BaseWork b)
returns the edge type connecting work a and b |
TezEdgeProperty.EdgeType |
TezWork.getEdgeType(BaseWork a,
BaseWork b)
|
List<BaseWork> |
TezWork.getParents(BaseWork work)
getParents returns all the nodes with edges leading into work |
void |
TezWork.remove(BaseWork work)
remove removes a node from the graph and removes all edges with work as start or end point. |
| Method parameters in org.apache.hadoop.hive.ql.plan with type arguments of type BaseWork | |
|---|---|
void |
TezWork.addAll(Collection<BaseWork> c)
add all nodes in the collection without any connections |
|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||