net.openhft.chronicle.queue.impl.single

Class SingleChronicleQueue

java.lang.Object

net.openhft.chronicle.queue.impl.single.SingleChronicleQueue

All Implemented Interfaces:

Closeable, AutoCloseable, ChronicleQueue, RollingChronicleQueue, StoreReleasable

public class SingleChronicleQueue
extends Object
implements RollingChronicleQueue

Field Summary

Fields

Modifier and Type	Field and Description
static String	DISK_SPACE_CHECKER_NAME
protected net.openhft.chronicle.core.threads.EventLoop	eventLoop
protected TableStore<SCQMeta>	metaStore
static String	QUEUE_METADATA_FILE
protected int	sourceId
protected ThreadLocal<ExcerptAppender>	strongExcerptAppenderThreadLocal
static String	SUFFIX
protected ThreadLocal<WeakReference<ExcerptAppender>>	weakExcerptAppenderThreadLocal

Fields inherited from interface net.openhft.chronicle.queue.ChronicleQueue

TEST_BLOCK_SIZE

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	SingleChronicleQueue(SingleChronicleQueueBuilder builder)

Method Summary

Modifier and Type	Method and Description
ExcerptAppender	acquireAppender() An Appender can be used to writeBytes new excerpts sequentially to the upper.
<T> void	addCloseListener(T key, Consumer<T> closer)
long	blockSize()
long	bufferCapacity()
boolean	buffered()
void	clear() Remove all the entries in the queue.
void	close()
long	countExcerpts(long fromIndex, long toIndex) Will give you the number of excerpts between 2 index?s ( as exists on the current file system ).
ExcerptTailer	createTailer() Tailers are NOT thread-safe, sharing the Tailer between threads will lead to errors and unpredictable behaviour.
ExcerptTailer	createTailer(String id) Tailers are NOT thread-safe, sharing the Tailer between threads will lead to errors and unpredictable behaviour.
int	cycle()
int	cycle(net.openhft.chronicle.core.time.TimeProvider timeProvider)
protected CycleCalculator	cycleCalculator(ZoneId zoneId)
int	deltaCheckpointInterval()
String	dump() Dump a Queue in YAML format.
void	dump(Writer writer, long fromIndex, long toIndex) Dump a range of entries to a Writer
long	entryCount() Counts the number of messages in this queue instance.
long	epoch()
net.openhft.chronicle.core.threads.EventLoop	eventLoop()
long	exceptsPerCycle(int cycle)
File	file()
String	fileAbsolutePath() Cache this value as getAbsolutePath is expensive
protected int	fileToCycle(File queueFile)
int	firstCycle()
long	firstIndex()
int	indexCount()
int	indexSpacing()
boolean	isClosed()
long	lastAcknowledgedIndexReplicated() when using replication to another host, this is the last index that has been confirmed to * have been read by the remote host.
void	lastAcknowledgedIndexReplicated(long newValue)
int	lastCycle()
long	lastIndexReplicated() when using replication to another host, this is the last index that has been sent to the remote host.
void	lastIndexReplicated(long indexReplicated)
NavigableSet<Long>	listCyclesBetween(int lowerCycle, int upperCycle)
protected ExcerptAppender	newAppender()
int	nextCycle(int cycle, TailerDirection direction) the next available cycle, no cycle will be created by this method, this method is typically used by a tailer to jump to the next cycle when the cycles are not adjacent.
Consumer<net.openhft.chronicle.bytes.BytesRingBufferStats>	onRingBufferStats()
long	overlapSize()
QueueLock	queueLock()
void	refreshDirectlyListing() call this method if you delete file from a chronicle-queue directory
void	release(CommonStore store)
RollCycle	rollCycle()
int	sourceId()
protected StoreFileListener	storeFileListener()
WireStore	storeForCycle(int cycle, long epoch, boolean createIfAbsent)
net.openhft.chronicle.core.time.TimeProvider	time()
String	toString()
net.openhft.chronicle.wire.WireType	wireType()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface net.openhft.chronicle.queue.ChronicleQueue

createAppender, dump, methodWriter, methodWriterBuilder, single, singleBuilder, singleBuilder, singleBuilder, singleBuilder

Methods inherited from interface net.openhft.chronicle.core.io.Closeable

closeQuietly, closeQuietly, notifyClosing

Field Detail

SUFFIX

public static final String SUFFIX

See Also:

Constant Field Values

QUEUE_METADATA_FILE

public static final String QUEUE_METADATA_FILE

See Also:

Constant Field Values

DISK_SPACE_CHECKER_NAME

public static final String DISK_SPACE_CHECKER_NAME

See Also:

Constant Field Values

weakExcerptAppenderThreadLocal

protected final ThreadLocal<WeakReference<ExcerptAppender>> weakExcerptAppenderThreadLocal

strongExcerptAppenderThreadLocal

protected final ThreadLocal<ExcerptAppender> strongExcerptAppenderThreadLocal

eventLoop

@NotNull
protected final net.openhft.chronicle.core.threads.EventLoop eventLoop

metaStore

@NotNull
protected final TableStore<SCQMeta> metaStore

sourceId

protected int sourceId

Constructor Detail

SingleChronicleQueue

protected SingleChronicleQueue(@NotNull
                               SingleChronicleQueueBuilder builder)

Method Detail

cycleCalculator

protected CycleCalculator cycleCalculator(ZoneId zoneId)

sourceId

public int sourceId()

Specified by:

sourceId in interface ChronicleQueue

lastAcknowledgedIndexReplicated

public long lastAcknowledgedIndexReplicated()

when using replication to another host, this is the last index that has been confirmed to * have been read by the remote host.

Specified by:

lastAcknowledgedIndexReplicated in interface ChronicleQueue

lastAcknowledgedIndexReplicated

public void lastAcknowledgedIndexReplicated(long newValue)

Specified by:

lastAcknowledgedIndexReplicated in interface ChronicleQueue

refreshDirectlyListing

public void refreshDirectlyListing()

Description copied from interface: ChronicleQueue

call this method if you delete file from a chronicle-queue directory

The problem that we have, is that we cache the structure of your directory, this is because hitting the file system adds latency. Call this method, if you delete .cq4 files, then it will update our caches accordingly,

Specified by:

refreshDirectlyListing in interface ChronicleQueue

lastIndexReplicated

public long lastIndexReplicated()

when using replication to another host, this is the last index that has been sent to the remote host.

Specified by:

lastIndexReplicated in interface ChronicleQueue

lastIndexReplicated

public void lastIndexReplicated(long indexReplicated)

Specified by:

lastIndexReplicated in interface ChronicleQueue

Parameters:

indexReplicated - last index that has been sent to the remote host.

clear

public void clear()

Description copied from interface: ChronicleQueue

Remove all the entries in the queue.

Specified by:

clear in interface ChronicleQueue

file

@NotNull
public File file()

Specified by:

file in interface ChronicleQueue

Returns:

the base file where ChronicleQueue stores its data.

fileAbsolutePath

@NotNull
public String fileAbsolutePath()

Description copied from interface: ChronicleQueue

Cache this value as getAbsolutePath is expensive

Specified by:

fileAbsolutePath in interface ChronicleQueue

Returns:

the absolute path of the file where ChronicleQueue stores its data.

dump

@NotNull
public String dump()

Description copied from interface: ChronicleQueue

Dump a Queue in YAML format.

Specified by:

dump in interface ChronicleQueue

Returns:

the contents of the Queue as YAML.

dump

public void dump(@NotNull
                 Writer writer,
                 long fromIndex,
                 long toIndex)

Description copied from interface: ChronicleQueue

Dump a range of entries to a Writer

Specified by:

dump in interface ChronicleQueue

Parameters:

writer - to write to

fromIndex - first index to include

toIndex - last index to include.

indexCount

public int indexCount()

Specified by:

indexCount in interface RollingChronicleQueue

Returns:

the number of entries in an index meta data entry

indexSpacing

public int indexSpacing()

Specified by:

indexSpacing in interface RollingChronicleQueue

Returns:

the spacing between indexed entries. If 1 then every entry is indexed.

epoch

public long epoch()

Specified by:

epoch in interface RollingChronicleQueue

rollCycle

@NotNull
public RollCycle rollCycle()

Specified by:

rollCycle in interface ChronicleQueue

Specified by:

rollCycle in interface RollingChronicleQueue

deltaCheckpointInterval

public int deltaCheckpointInterval()

Specified by:

deltaCheckpointInterval in interface ChronicleQueue

Specified by:

deltaCheckpointInterval in interface RollingChronicleQueue

Returns:

the checkpointInterval used by delta wire

buffered

public boolean buffered()

Returns:

if we uses a ring buffer to buffer the appends, the Excerpts are written to the Chronicle Queue using a background thread

eventLoop

@NotNull
public net.openhft.chronicle.core.threads.EventLoop eventLoop()

newAppender

@NotNull
protected ExcerptAppender newAppender()

storeFileListener

protected StoreFileListener storeFileListener()

acquireAppender

@NotNull
public ExcerptAppender acquireAppender()

Description copied from interface: ChronicleQueue

An Appender can be used to writeBytes new excerpts sequentially to the upper.

Appenders are NOT thread-safe, sharing the Appender between threads will lead to errors and unpredictable behaviour. This method returns ThreadLocal appender, so does not produce any garbage, hence it's safe to simply call this method every time an appender is needed.

Specified by:

acquireAppender in interface ChronicleQueue

Returns:

A thread local Appender for writing new entries to the end.

queueLock

@NotNull
public QueueLock queueLock()

Specified by:

queueLock in interface RollingChronicleQueue

createTailer

@NotNull
public ExcerptTailer createTailer(String id)

Description copied from interface: ChronicleQueue

Tailers are NOT thread-safe, sharing the Tailer between threads will lead to errors and unpredictable behaviour.

Specified by:

createTailer in interface ChronicleQueue

Parameters:

id - unique id for a tailer which uses to track where it was up to

Returns:

a new ExcerptTailer to read sequentially.

createTailer

@NotNull
public ExcerptTailer createTailer()

Description copied from interface: ChronicleQueue

Tailers are NOT thread-safe, sharing the Tailer between threads will lead to errors and unpredictable behaviour.

Specified by:

createTailer in interface ChronicleQueue

Returns:

a new ExcerptTailer to read sequentially.

storeForCycle

@Nullable
public final WireStore storeForCycle(int cycle,
                                               long epoch,
                                               boolean createIfAbsent)

Specified by:

storeForCycle in interface RollingChronicleQueue

Parameters:

cycle - the cycle

epoch - an epoch offset as the number of number of milliseconds since January 1, 1970, 00:00:00 GMT

createIfAbsent - create missing stores if true, or return null if missing

Returns:

the WireStore associated with this cycle, or null if !createIfAbsent is false and absent

nextCycle

public int nextCycle(int cycle,
                     @NotNull
                     TailerDirection direction)
              throws ParseException

Description copied from interface: RollingChronicleQueue

the next available cycle, no cycle will be created by this method, this method is typically used by a tailer to jump to the next cycle when the cycles are not adjacent.

Specified by:

nextCycle in interface RollingChronicleQueue

Parameters:

cycle - the current cycle

direction - the direction

Returns:

the next available cycle from the current cycle, or -1 if there is no next cycle

Throws:

ParseException

exceptsPerCycle

public long exceptsPerCycle(int cycle)

countExcerpts

public long countExcerpts(long fromIndex,
                          long toIndex)
                   throws IllegalStateException

Will give you the number of excerpts between 2 index?s ( as exists on the current file system ). If intermediate chronicle files are removed this will effect the result.

Specified by:

countExcerpts in interface RollingChronicleQueue

Parameters:

fromIndex - the lower index

toIndex - the higher index

Returns:

will give you the number of excerpts between 2 index?s. It?s not as simple as just subtracting one number from the other.

Throws:

IllegalStateException - if we are not able to read the chronicle files

listCyclesBetween

public NavigableSet<Long> listCyclesBetween(int lowerCycle,
                                            int upperCycle)
                                     throws ParseException

Throws:

ParseException

addCloseListener

public <T> void addCloseListener(T key,
                                 Consumer<T> closer)

isClosed

public boolean isClosed()

close

public void close()

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

release

public final void release(@Nullable
                          CommonStore store)

Specified by:

release in interface StoreReleasable

Parameters:

store - the store to release

cycle

public final int cycle()

Specified by:

cycle in interface RollingChronicleQueue

Returns:

the current cycle

cycle

public final int cycle(net.openhft.chronicle.core.time.TimeProvider timeProvider)

firstIndex

public long firstIndex()

Specified by:

firstIndex in interface ChronicleQueue

Returns:

the lowest valid index available, or Long.MAX_VALUE if none are found

entryCount

public long entryCount()

Description copied from interface: RollingChronicleQueue

Counts the number of messages in this queue instance.

Specified by:

entryCount in interface RollingChronicleQueue

Returns:

the number of document excerpts

firstCycle

public int firstCycle()

Specified by:

firstCycle in interface RollingChronicleQueue

Returns:

the first cycle number found, or Integer.MAX_VALUE is none found.

lastCycle

public int lastCycle()

Specified by:

lastCycle in interface RollingChronicleQueue

Returns:

the lastCycle available or Integer.MIN_VALUE if none is found.

fileToCycle

protected int fileToCycle(File queueFile)

onRingBufferStats

@NotNull
public Consumer<net.openhft.chronicle.bytes.BytesRingBufferStats> onRingBufferStats()

blockSize

public long blockSize()

overlapSize

public long overlapSize()

wireType

@NotNull
public net.openhft.chronicle.wire.WireType wireType()

Specified by:

wireType in interface ChronicleQueue

Returns:

the type of wire used, for example WireTypes.TEXT or WireTypes.BINARY

bufferCapacity

public long bufferCapacity()

toString

@NotNull
public String toString()

Overrides:

toString in class Object

time

@NotNull
public net.openhft.chronicle.core.time.TimeProvider time()

Specified by:

time in interface ChronicleQueue