Package org.apache.pulsar.io.hdfs3.sink.text

Class HdfsAbstractTextFileSink<K,V>

java.lang.Object

org.apache.pulsar.io.hdfs3.AbstractHdfsConnector

org.apache.pulsar.io.hdfs3.sink.HdfsAbstractSink<K,V>

org.apache.pulsar.io.hdfs3.sink.text.HdfsAbstractTextFileSink<K,V>

Type Parameters:

K -

V -

All Implemented Interfaces:

AutoCloseable, Sink<V>

Direct Known Subclasses:

HdfsStringSink

public abstract class HdfsAbstractTextFileSink<K,V>
extends HdfsAbstractSink<K,V>
implements Sink<V>

Base class for HDFS Sinks that writes there contents to HDFS as Text Files.

Field Summary

Fields

Modifier and Type	Field	Description
protected OutputStreamWriter	writer

Fields inherited from class org.apache.pulsar.io.hdfs3.sink.HdfsAbstractSink

hdfsSinkConfig, syncThread, unackedRecords

Fields inherited from class org.apache.pulsar.io.hdfs3.AbstractHdfsConnector

compressionCodecFactory, connectorConfig, hdfsResources

Constructor Summary

Constructors

Constructor	Description
HdfsAbstractTextFileSink()

Method Summary

Modifier and Type	Method	Description
void	close()
protected void	createWriter()
void	write(org.apache.pulsar.functions.api.Record<V> record)

Methods inherited from class org.apache.pulsar.io.hdfs3.sink.HdfsAbstractSink

connectToHdfs, extractKeyValue, getHdfsStream, getOutputStreamBuilder, getPath, launchSyncThread, open

Methods inherited from class org.apache.pulsar.io.hdfs3.AbstractHdfsConnector

checkHdfsUriForTimeout, getCompressionCodec, getCompressionCodecFactory, getConfiguration, getEncoding, getFileSystem, getFileSystem, getFileSystemAsUser, getUserGroupInformation, resetHDFSResources

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.pulsar.io.core.Sink

open

Field Details

writer

protected OutputStreamWriter writer

Constructor Details

HdfsAbstractTextFileSink

public HdfsAbstractTextFileSink()

Method Details

createWriter

protected void createWriter()
                     throws IOException

Specified by:

createWriter in class HdfsAbstractSink<K,V>

Throws:

IOException

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Overrides:

close in class HdfsAbstractSink<K,V>

Throws:

Exception

write

public void write(org.apache.pulsar.functions.api.Record<V> record)

Specified by:

write in interface Sink<K>