A B C D E F G H I J K M N O P R S T U V W

A

addDataSink(String) - Method in class io.dstream.tez.TezDAGBuilder

addDependentTasksChain(List<TaskDescriptor>) - Method in class io.dstream.tez.TaskDescriptor

addResourceToClassPath(File) - Static method in class io.dstream.tez.utils.ClassPathUtils

addTask(TaskDescriptor) - Method in class io.dstream.tez.TezDAGBuilder

andThen(SerializableStreamAssets.SerFunction<Stream<?>, Stream<?>>) - Method in class io.dstream.tez.TaskDescriptor

B

build() - Method in interface io.dstream.tez.OutputStreamsBuilder

build() - Method in class io.dstream.tez.TezDAGBuilder

build() - Method in class io.dstream.tez.utils.SequenceFileOutputStreamsBuilder

C

checkAccess(Path, AccessMode...) - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

CLASSPATH_EXCLUSIONS - Static variable in interface io.dstream.tez.TezConstants

CLASSPATH_PATH - Static variable in interface io.dstream.tez.TezConstants

ClassPathUtils - Class in io.dstream.tez.utils

Utility class which contains methods related to generating JAR file and/or byte stream from passed directory.

ClassPathUtils() - Constructor for class io.dstream.tez.utils.ClassPathUtils

clean(String) - Static method in class dstream.tez.examples.SampleUtils

compareTo(KeyWritable) - Method in class io.dstream.tez.io.KeyWritable

compose(SerializableStreamAssets.SerFunction<Stream<?>, Stream<?>>) - Method in class io.dstream.tez.TaskDescriptor

copy(Path, Path, CopyOption...) - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

createDirectory(Path, FileAttribute<?>...) - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

createLocalResource(FileSystem, Path) - Static method in class io.dstream.tez.utils.HadoopUtils

Creates a single LocalResource for the provisioned resource identified with Path

createLocalResources(FileSystem, String) - Static method in class io.dstream.tez.utils.HadoopUtils

Creates LocalResources based on the current user's classpath

D

delete(Path) - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

deserialize(Path, FileSystem, Class<T>) - Static method in class io.dstream.tez.utils.HdfsSerializerUtils

doExecute(String, Properties, DStreamExecutionGraph...) - Method in class io.dstream.tez.TezExecutionDelegate

dstream.tez.examples - package dstream.tez.examples

E

ExecutionContextAwareTezClient - Class in io.dstream.tez

ExecutionContextAwareTezClient(String, TezConfiguration, Map<String, LocalResource>, Credentials, FileSystem) - Constructor for class io.dstream.tez.ExecutionContextAwareTezClient

F

FourWayJoin() - Constructor for class dstream.tez.examples.Join.FourWayJoin

G

GENERATE_JAR - Static variable in interface io.dstream.tez.TezConstants

generateJarFileName(String) - Static method in class io.dstream.tez.utils.ClassPathUtils

getClassifier() - Method in class io.dstream.tez.TaskDescriptor

getCloseHandler() - Method in class io.dstream.tez.TezExecutionDelegate

getCredentials() - Method in class io.dstream.tez.TezExecutionDelegate

getDependentTasksChains() - Method in class io.dstream.tez.TaskDescriptor

getFileAttributeView(Path, Class<V>, LinkOption...) - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

getFileStore(Path) - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

getFileSystem(URI) - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

getFileSystem() - Method in class io.dstream.tez.ExecutionContextAwareTezClient

getFileSystem(Configuration) - Static method in class io.dstream.tez.utils.HadoopUtils

getFunction() - Method in class io.dstream.tez.TaskDescriptor

getId() - Method in class io.dstream.tez.TaskDescriptor

getInputFormatClass() - Method in class io.dstream.tez.TaskDescriptor

getLocalResources() - Method in class io.dstream.tez.ExecutionContextAwareTezClient

getName() - Method in class io.dstream.tez.TaskDescriptor

getOperationName() - Method in class io.dstream.tez.TaskDescriptor

getParallelism() - Method in class io.dstream.tez.TaskDescriptor

getPartition(Object, Object, int) - Method in class io.dstream.tez.io.TezDelegatingPartitioner

getPath(URI) - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

getPreviousTaskDescriptor() - Method in class io.dstream.tez.TaskDescriptor

getScheme() - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

getSourceElementType() - Method in class io.dstream.tez.TaskDescriptor

getSourceSupplier() - Method in class io.dstream.tez.TaskDescriptor

getTezConfiguration() - Method in class io.dstream.tez.ExecutionContextAwareTezClient

current Tez configuration as TezConfiguration

getValue() - Method in interface io.dstream.tez.io.NewWritable

getValue() - Method in class io.dstream.tez.io.NewWritable.NewIntWritable

getValue() - Method in class io.dstream.tez.io.NewWritable.NewLongWritable

getValue() - Method in class io.dstream.tez.io.NewWritable.NewTextWritable

getValue() - Method in class io.dstream.tez.io.TypeAwareWritable

H

HadoopUtils - Class in io.dstream.tez.utils

Utility functions related to variety of tasks to be performed in HADOOP such as setting up LocalResource, provisioning classpath etc.

HadoopUtils() - Constructor for class io.dstream.tez.utils.HadoopUtils

hashCode() - Method in class io.dstream.tez.io.TypeAwareWritable

HdfsFileSystemProvider - Class in io.dstream.hadoop.fs.spi

HdfsFileSystemProvider() - Constructor for class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

HdfsSerializerUtils - Class in io.dstream.tez.utils

HdfsSerializerUtils() - Constructor for class io.dstream.tez.utils.HdfsSerializerUtils

I

initClasspathExclusions(String) - Static method in class io.dstream.tez.utils.ClassPathUtils

io.dstream.hadoop.fs.spi - package io.dstream.hadoop.fs.spi

io.dstream.tez - package io.dstream.tez

io.dstream.tez.io - package io.dstream.tez.io

io.dstream.tez.utils - package io.dstream.tez.utils

isHidden(Path) - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

isSameFile(Path, Path) - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

J

Join - Class in dstream.tez.examples

Join() - Constructor for class dstream.tez.examples.Join

Join.FourWayJoin - Class in dstream.tez.examples

This example shows a sample of joining more then two data sets with some transformation as well as multiple predicates

Join.TwoWayJoin - Class in dstream.tez.examples

This example demonstrates simple join between two streams.

K

KeyWritable - Class in io.dstream.tez.io

This class represents a universal Writable with the goal of recognizing and properly writing/reading multiple types of data.

KeyWritable() - Constructor for class io.dstream.tez.io.KeyWritable

M

main(String...) - Static method in class dstream.tez.examples.Join.FourWayJoin

main(String[]) - Static method in class dstream.tez.examples.Join

main(String...) - Static method in class dstream.tez.examples.Join.TwoWayJoin

main(String[]) - Static method in class dstream.tez.examples.Union

main(String...) - Static method in class dstream.tez.examples.Union.SimpleTwoWayUnion

main(String[]) - Static method in class dstream.tez.examples.WordCount

move(Path, Path, CopyOption...) - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

N

newByteChannel(Path, Set<? extends OpenOption>, FileAttribute<?>...) - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

newDirectoryStream(Path, DirectoryStream.Filter<? super Path>) - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

newFileSystem(URI, Map<String, ?>) - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

NewIntWritable() - Constructor for class io.dstream.tez.io.NewWritable.NewIntWritable

NewLongWritable() - Constructor for class io.dstream.tez.io.NewWritable.NewLongWritable

NewTextWritable() - Constructor for class io.dstream.tez.io.NewWritable.NewTextWritable

NewWritable<T> - Interface in io.dstream.tez.io

NewWritable.NewIntWritable - Class in io.dstream.tez.io

NewWritable.NewLongWritable - Class in io.dstream.tez.io

NewWritable.NewTextWritable - Class in io.dstream.tez.io

O

OutputStreamsBuilder<T> - Interface in io.dstream.tez

P

provisionResourceToFs(File, FileSystem, String) - Static method in class io.dstream.tez.utils.HadoopUtils

Provisions resource represented as File to the FileSystem for a given application

R

readAttributes(Path, Class<A>, LinkOption...) - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

readAttributes(Path, String, LinkOption...) - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

readFields(DataInput) - Method in class io.dstream.tez.io.TypeAwareWritable

run() - Method in class io.dstream.tez.TezDagExecutor

run() - Method in class io.dstream.tez.TezTaskProcessor

S

SampleUtils - Class in dstream.tez.examples

SampleUtils() - Constructor for class dstream.tez.examples.SampleUtils

SequenceFileOutputStreamsBuilder<T> - Class in io.dstream.tez.utils

SequenceFileOutputStreamsBuilder(FileSystem, String, TezConfiguration) - Constructor for class io.dstream.tez.utils.SequenceFileOutputStreamsBuilder

serialize(Object, FileSystem, Path) - Static method in class io.dstream.tez.utils.HdfsSerializerUtils

Will serialize object to HDFS returning its Path.

setAscending(boolean) - Static method in class io.dstream.tez.io.KeyWritable

setAttribute(Path, String, Object, LinkOption...) - Method in class io.dstream.hadoop.fs.spi.HdfsFileSystemProvider

setDelegator(Classifier) - Static method in class io.dstream.tez.io.TezDelegatingPartitioner

setInputFormatClass(Class<?>) - Method in class io.dstream.tez.TaskDescriptor

setValue(Object) - Method in class io.dstream.tez.io.KeyWritable

setValue(Integer) - Method in class io.dstream.tez.io.NewWritable.NewIntWritable

setValue(Long) - Method in class io.dstream.tez.io.NewWritable.NewLongWritable

setValue(Object) - Method in class io.dstream.tez.io.NewWritable.NewTextWritable

setValue(T) - Method in interface io.dstream.tez.io.NewWritable

setValue(T) - Method in class io.dstream.tez.io.TypeAwareWritable

SimpleTwoWayUnion() - Constructor for class dstream.tez.examples.Union.SimpleTwoWayUnion

StreamUtils - Class in io.dstream.tez.utils

StreamUtils() - Constructor for class io.dstream.tez.utils.StreamUtils

T

TaskDescriptor - Class in io.dstream.tez

TaskDescriptor(int, String, String, Properties, TaskDescriptor) - Constructor for class io.dstream.tez.TaskDescriptor

Will create description of a Task from which Tez Vertex is created.

TezConstants - Interface in io.dstream.tez

TezDAGBuilder - Class in io.dstream.tez

TezDAGBuilder(String, ExecutionContextAwareTezClient, Properties) - Constructor for class io.dstream.tez.TezDAGBuilder

TezDagExecutor - Class in io.dstream.tez

It implements Callable so it could be submitted to the Executor async.

TezDagExecutor(ExecutionContextAwareTezClient, DAG) - Constructor for class io.dstream.tez.TezDagExecutor

TezDelegatingPartitioner - Class in io.dstream.tez.io

TezDelegatingPartitioner() - Constructor for class io.dstream.tez.io.TezDelegatingPartitioner

TezExecutionDelegate - Class in io.dstream.tez

Implementation of DStreamExecutionDelegate for Apache Tez.

TezExecutionDelegate() - Constructor for class io.dstream.tez.TezExecutionDelegate

TezTaskProcessor - Class in io.dstream.tez

TezTaskProcessor(ProcessorContext) - Constructor for class io.dstream.tez.TezTaskProcessor

toJar(File, String) - Static method in class io.dstream.tez.utils.ClassPathUtils

Will create a JAR file from base dir

toStream(KeyValueReader) - Static method in class io.dstream.tez.utils.StreamUtils

toStream(KeyValuesReader) - Static method in class io.dstream.tez.utils.StreamUtils

toString() - Method in class io.dstream.tez.io.TypeAwareWritable

TwoWayJoin() - Constructor for class dstream.tez.examples.Join.TwoWayJoin

TypeAwareWritable<T> - Class in io.dstream.tez.io

TypeAwareWritable() - Constructor for class io.dstream.tez.io.TypeAwareWritable

U

Union - Class in dstream.tez.examples

Contains various examples of join operation

Union() - Constructor for class dstream.tez.examples.Union

Union.SimpleTwoWayUnion - Class in dstream.tez.examples

This example demonstrates simple join between two streams.

UPDATE_CLASSPATH - Static variable in interface io.dstream.tez.TezConstants

V

value - Variable in class io.dstream.tez.io.TypeAwareWritable

ValueWritable<T> - Class in io.dstream.tez.io

This class represents a universal Writable with the goal of recognizing and properly writing/reading multiple types of data.

ValueWritable() - Constructor for class io.dstream.tez.io.ValueWritable

W

WordCount - Class in dstream.tez.examples

A rudimentary WordCount

WordCount() - Constructor for class dstream.tez.examples.WordCount

write(DataOutput) - Method in class io.dstream.tez.io.TypeAwareWritable

A B C D E F G H I J K M N O P R S T U V W