org.apache.pulsar.io.hdfs2.sink.text

Class HdfsAbstractTextFileSink<K,V>

java.lang.Object

org.apache.pulsar.io.hdfs2.AbstractHdfsConnector

org.apache.pulsar.io.hdfs2.sink.HdfsAbstractSink<K,V>

org.apache.pulsar.io.hdfs2.sink.text.HdfsAbstractTextFileSink<K,V>

Type Parameters:

K -

V -

All Implemented Interfaces:

AutoCloseable, Sink<V>

Direct Known Subclasses:

HdfsStringSink

public abstract class HdfsAbstractTextFileSink<K,V>
extends HdfsAbstractSink<K,V>
implements Sink<V>

Base class for HDFS Sinks that writes there contents to HDFS as Text Files.

Field Summary

Fields

Modifier and Type	Field and Description
protected OutputStreamWriter	writer

Fields inherited from class org.apache.pulsar.io.hdfs2.sink.HdfsAbstractSink

hdfsSinkConfig, syncThread, unackedRecords

Fields inherited from class org.apache.pulsar.io.hdfs2.AbstractHdfsConnector

compressionCodecFactory, connectorConfig, hdfsResources

Constructor Summary

Constructors

Constructor and Description
HdfsAbstractTextFileSink()

Method Summary

Modifier and Type	Method and Description
void	close()
protected void	createWriter()
void	write(org.apache.pulsar.functions.api.Record<V> record)

Methods inherited from class org.apache.pulsar.io.hdfs2.sink.HdfsAbstractSink

connectToHdfs, extractKeyValue, getHdfsStream, getPath, launchSyncThread, open

Methods inherited from class org.apache.pulsar.io.hdfs2.AbstractHdfsConnector

checkHdfsUriForTimeout, getCompressionCodec, getCompressionCodecFactory, getConfiguration, getEncoding, getFileSystem, getFileSystem, getFileSystemAsUser, getUserGroupInformation, resetHDFSResources

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.pulsar.io.core.Sink

open

Field Detail

writer

protected OutputStreamWriter writer

Constructor Detail

HdfsAbstractTextFileSink

public HdfsAbstractTextFileSink()

Method Detail

createWriter

protected void createWriter()
                     throws IOException

Specified by:

createWriter in class HdfsAbstractSink<K,V>

Throws:

IOException

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Overrides:

close in class HdfsAbstractSink<K,V>

Throws:

Exception

write

public void write(org.apache.pulsar.functions.api.Record<V> record)

Specified by:

write in interface Sink<V>