Class HdfsAbstractTextFileSink<K,V>
- java.lang.Object
-
- org.apache.pulsar.io.hdfs2.AbstractHdfsConnector
-
- org.apache.pulsar.io.hdfs2.sink.HdfsAbstractSink<K,V>
-
- org.apache.pulsar.io.hdfs2.sink.text.HdfsAbstractTextFileSink<K,V>
-
- Type Parameters:
K-V-
- All Implemented Interfaces:
java.lang.AutoCloseable,org.apache.pulsar.io.core.Sink<V>
- Direct Known Subclasses:
HdfsStringSink
public abstract class HdfsAbstractTextFileSink<K,V> extends HdfsAbstractSink<K,V> implements org.apache.pulsar.io.core.Sink<V>
Base class for HDFS Sinks that writes there contents to HDFS as Text Files.
-
-
Field Summary
Fields Modifier and Type Field Description protected java.io.OutputStreamWriterwriter-
Fields inherited from class org.apache.pulsar.io.hdfs2.sink.HdfsAbstractSink
hdfsSinkConfig, syncThread, unackedRecords
-
Fields inherited from class org.apache.pulsar.io.hdfs2.AbstractHdfsConnector
compressionCodecFactory, connectorConfig, hdfsResources
-
-
Constructor Summary
Constructors Constructor Description HdfsAbstractTextFileSink()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description voidclose()protected voidcreateWriter()voidwrite(org.apache.pulsar.functions.api.Record<V> record)-
Methods inherited from class org.apache.pulsar.io.hdfs2.sink.HdfsAbstractSink
connectToHdfs, extractKeyValue, getHdfsStream, getPath, launchSyncThread, open
-
Methods inherited from class org.apache.pulsar.io.hdfs2.AbstractHdfsConnector
checkHdfsUriForTimeout, getCompressionCodec, getCompressionCodecFactory, getConfiguration, getEncoding, getFileSystem, getFileSystem, getFileSystemAsUser, getUserGroupInformation, resetHDFSResources
-
-
-
-
Method Detail
-
createWriter
protected void createWriter() throws java.io.IOException- Specified by:
createWriterin classHdfsAbstractSink<K,V>- Throws:
java.io.IOException
-
close
public void close() throws java.lang.Exception- Specified by:
closein interfacejava.lang.AutoCloseable- Overrides:
closein classHdfsAbstractSink<K,V>- Throws:
java.lang.Exception
-
-