com.gemstone.gemfire.cache.hdfs.internal

Class RegionWithHDFSBasicDUnitTest

java.lang.Object

junit.framework.Assert

junit.framework.TestCase

dunit.DistributedTestCase

com.gemstone.gemfire.cache30.CacheTestCase

com.gemstone.gemfire.cache.hdfs.internal.RegionWithHDFSTestBase

com.gemstone.gemfire.cache.hdfs.internal.RegionWithHDFSBasicDUnitTest

All Implemented Interfaces:

Serializable, junit.framework.Test

Direct Known Subclasses:

RegionWithHDFSOffHeapBasicDUnitTest, RegionWithHDFSPersistenceBasicDUnitTest

public class RegionWithHDFSBasicDUnitTest
extends RegionWithHDFSTestBase

A class for testing the basic HDFS functionality

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class dunit.DistributedTestCase

DistributedTestCase.ExpectedException, DistributedTestCase.WaitCriterion, DistributedTestCase.WaitCriterion2

Field Summary

Fields inherited from class com.gemstone.gemfire.cache.hdfs.internal.RegionWithHDFSTestBase

tmpDir

Fields inherited from class com.gemstone.gemfire.cache30.CacheTestCase

cache

Fields inherited from class dunit.DistributedTestCase

logPerTest, reconnect, system, testName

Constructor Summary

Constructors

Constructor and Description
RegionWithHDFSBasicDUnitTest(String name)

Method Summary

Modifier and Type	Method and Description
protected void	checkWithGet(String uniqueName, int start, int end, boolean expectValue)
protected void	checkWithGetAll(String uniqueName, ArrayList arrayl)
void	DISABLED_testLocalDestroy() Test that we can locally destroy a member, without causing problems with the data in HDFS
protected AsyncInvocation	doAsyncPuts(VM vm, String regionName, int start, int end, String suffix)
protected AsyncInvocation	doAsyncPuts(VM vm, String regionName, int start, int end, String suffix, String value)
protected void	doDestroys(String uniqueName, int start, int end)
protected void	doPutAll(String uniqueName, Map map)
protected void	doPuts(String uniqueName, int start, int end)
void	doTestClearRegion(int batchInterval, boolean waitForWriteToHDFS)
protected SerializableCallable	getCreateRegionCallable(int totalnumOfBuckets, int batchSizeMB, int maximumEntries, String folderPath, String uniqueName, int batchInterval, boolean queuePersistent, boolean writeonly, long timeForRollover, long maxFileSize)
protected void	setGfxdSystem(boolean isGfxd)
void	testBasicPutsForWriteOnlyHDFSStore() Does put for write only HDFS store
void	testByteArrays() Puts byte arrays and fetches them back to ensure that serialization of byte arrays is proper
void	testClearRegionDataInHDFS()
void	testClearRegionDataInQueue()
void	testDelta() Does put for write only HDFS store
void	testFlushQueue()
void	testFlushQueueWO()
void	testForceAsyncMajorCompaction()
void	testForceSyncMajorCompaction()
void	testGetOperationalData() verify that get on operational data does not read from HDFS
void	testGlobalDestroyFromAccessor()
void	testGlobalDestroyWithHDFSData() Test that doing a destroyRegion removes all data from HDFS.
void	testGlobalDestroyWithQueueData() Test that doing a destroyRegion removes all data from HDFS.
void	testHDFSQueueSizeTest()
void	testPRAccessor() verify that a PR accessor can be started
void	testPUTDMLBulkSupport()
void	testPUTDMLSupport() verify that PUT dml does not read from hdfs
void	testSizeEstimate()
void	testValueFetchedFromLocal() Tests if gets go to primary even if the value resides on secondary.
void	testWOFileSizeParam() create a server with maxfilesize as 2 MB.
void	testWOTimeForRollOverParam() create server with file rollover time as 2 secs.
protected void	verifyHDFSData(VM vm, String uniqueName)
void	verifyNoHDFSData(VM vm, String uniqueName) Make sure all of the data for a region in HDFS is destroyed
void	verifyNoQOrPR(VM vm) Make sure all async event queues and PRs a destroyed in a member
protected void	verifyTwoHDFSFiles(VM vm, String uniqueName)
protected void	verifyTwoHDFSFilesWithTwoEntries(VM vm, String uniqueName, String value)

Methods inherited from class com.gemstone.gemfire.cache.hdfs.internal.RegionWithHDFSTestBase

cacheClose, closeCache, createFilesAndEntriesMap, createServerRegion, createServerRegion, createServerRegionAsync, createServerRegionAsync, doPuts, dumpFiles, setUp, tearDown2, testGetAllForAsyncQueue, testGetForAsyncQueue, testGetFromHDFS, testPutAllAndGetFromHDFS, testPutAllForAsyncQueue, testWObasicClose, validate, validateEmpty, verifyDataInHDFS, verifyInEntriesMap

Methods inherited from class com.gemstone.gemfire.cache30.CacheTestCase

addExceptionTag1, basicGetCache, beginCacheXml, cleanDiskDirs, closeAllCache, closeCache, createLonerCache, createMcastCache, createMcastCache, createRegion, createRegion, createRootRegion, createRootRegion, disconnectFromDS, finishCacheXml, finishCacheXml, getCache, getCache, getCache, getCache, getClientCache, getDiskDirs, getGemfireCache, getInternalRegionArguments, getRootRegion, getRootRegion, hasCache, remoteTearDown, removeExceptionTag1, sendSerialMessageToAll, sendUnorderedMessageToAll

Methods inherited from class dunit.DistributedTestCase

addExpectedException, addExpectedException, addHydraProperties, attachDebugger, checkBBFlag, cleanupAllVms, clearBBFlag, crashDistributedSystem, crashDistributedSystem, createLogWriter, disconnectAllFromDS, dumpAllStacks, dumpMyThreads, dumpStack, dumpStack, dumpStack, dumpStackTrace, fail, getAllDistributedSystemProperties, getDistributedSystemProperties, getDUnitLocatorAddress, getDUnitLocatorPort, getDUnitLocatorString, getDUnitLogLevel, getIPLiteral, getLogWriter, getLonerSystem, getMcastSystem, getMcastSystem, getRepeatTimeoutMs, getServerHostName, getSystem, getSystem, getTestClass, getTestName, getUniqueName, getVMCount, incBBFlag, invokeInEveryVM, invokeInEveryVM, invokeInEveryVM, invokeInEveryVM, invokeInEveryVMRepeatingIfNecessary, invokeInLocator, invokeRepeatingIfNecessary, isConnectedToDS, join, noteTiming, pause, pause, perVMSetUp, realTearDown, setDiskStoreForGateway, setSystem, setTestName, staticPause, tearDown, unregisterAllDataSerializersFromAllVms, unregisterDataSerializerInThisVM, unregisterInstantiatorsInThisVM, waitForBBFlag, waitForCriterion, waitMutex

Methods inherited from class junit.framework.TestCase

assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertFalse, assertFalse, assertNotNull, assertNotNull, assertNotSame, assertNotSame, assertNull, assertNull, assertSame, assertSame, assertTrue, assertTrue, countTestCases, createResult, fail, fail, failNotEquals, failNotSame, failSame, format, getName, run, run, runBare, runTest, setName, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

RegionWithHDFSBasicDUnitTest

public RegionWithHDFSBasicDUnitTest(String name)

Method Detail

getCreateRegionCallable

protected SerializableCallable getCreateRegionCallable(int totalnumOfBuckets,
                                                       int batchSizeMB,
                                                       int maximumEntries,
                                                       String folderPath,
                                                       String uniqueName,
                                                       int batchInterval,
                                                       boolean queuePersistent,
                                                       boolean writeonly,
                                                       long timeForRollover,
                                                       long maxFileSize)

Specified by:

getCreateRegionCallable in class RegionWithHDFSTestBase

doPuts

protected void doPuts(String uniqueName,
                      int start,
                      int end)

Specified by:

doPuts in class RegionWithHDFSTestBase

doPutAll

protected void doPutAll(String uniqueName,
                        Map map)

Specified by:

doPutAll in class RegionWithHDFSTestBase

doDestroys

protected void doDestroys(String uniqueName,
                          int start,
                          int end)

Specified by:

doDestroys in class RegionWithHDFSTestBase

checkWithGet

protected void checkWithGet(String uniqueName,
                            int start,
                            int end,
                            boolean expectValue)

Specified by:

checkWithGet in class RegionWithHDFSTestBase

checkWithGetAll

protected void checkWithGetAll(String uniqueName,
                               ArrayList arrayl)

Specified by:

checkWithGetAll in class RegionWithHDFSTestBase

testValueFetchedFromLocal

public void testValueFetchedFromLocal()

Tests if gets go to primary even if the value resides on secondary.

testHDFSQueueSizeTest

public void testHDFSQueueSizeTest()

testBasicPutsForWriteOnlyHDFSStore

public void testBasicPutsForWriteOnlyHDFSStore()

Does put for write only HDFS store

testDelta

public void testDelta()

Does put for write only HDFS store

testByteArrays

public void testByteArrays()

Puts byte arrays and fetches them back to ensure that serialization of byte arrays is proper

testClearRegionDataInQueue

public void testClearRegionDataInQueue()
                                throws Throwable

Throws:

Throwable

testClearRegionDataInHDFS

public void testClearRegionDataInHDFS()
                               throws Throwable

Throws:

Throwable

doTestClearRegion

public void doTestClearRegion(int batchInterval,
                              boolean waitForWriteToHDFS)
                       throws Throwable

Throws:

Throwable

setGfxdSystem

protected void setGfxdSystem(boolean isGfxd)

DISABLED_testLocalDestroy

public void DISABLED_testLocalDestroy()
                               throws InterruptedException

Test that we can locally destroy a member, without causing problems with the data in HDFS

Throws:

InterruptedException - DISABLED until issues with PR primary failover are resolved - bug 47793. The line validate(vm1, uniqueName, numEntries) failing because new oplogs are not detected when the primary switches.

testGlobalDestroyWithHDFSData

public void testGlobalDestroyWithHDFSData()
                                   throws InterruptedException

Test that doing a destroyRegion removes all data from HDFS.

Throws:

InterruptedException

testGlobalDestroyWithQueueData

public void testGlobalDestroyWithQueueData()

Test that doing a destroyRegion removes all data from HDFS.

verifyNoQOrPR

public void verifyNoQOrPR(VM vm)

Make sure all async event queues and PRs a destroyed in a member

verifyNoHDFSData

public void verifyNoHDFSData(VM vm,
                             String uniqueName)

Make sure all of the data for a region in HDFS is destroyed

doAsyncPuts

protected AsyncInvocation doAsyncPuts(VM vm,
                                      String regionName,
                                      int start,
                                      int end,
                                      String suffix)
                               throws Exception

Specified by:

doAsyncPuts in class RegionWithHDFSTestBase

Throws:

Exception

doAsyncPuts

protected AsyncInvocation doAsyncPuts(VM vm,
                                      String regionName,
                                      int start,
                                      int end,
                                      String suffix,
                                      String value)
                               throws Exception

Throws:

Exception

testGlobalDestroyFromAccessor

public void testGlobalDestroyFromAccessor()

testWOFileSizeParam

public void testWOFileSizeParam()
                         throws Throwable

create a server with maxfilesize as 2 MB. Insert 4 entries of 1 MB each. There should be 2 files with 2 entries each.

Throws:

Throwable

testWOTimeForRollOverParam

public void testWOTimeForRollOverParam()
                                throws Throwable

create server with file rollover time as 2 secs. Insert few entries and then sleep for 2 sec. A file should be created. Do it again At th end, two files with inserted entries should be created.

Throws:

Throwable

verifyHDFSData

protected void verifyHDFSData(VM vm,
                              String uniqueName)
                       throws Exception

Specified by:

verifyHDFSData in class RegionWithHDFSTestBase

Throws:

Exception

verifyTwoHDFSFiles

protected void verifyTwoHDFSFiles(VM vm,
                                  String uniqueName)
                           throws Exception

Throws:

Exception

verifyTwoHDFSFilesWithTwoEntries

protected void verifyTwoHDFSFilesWithTwoEntries(VM vm,
                                                String uniqueName,
                                                String value)
                                         throws Exception

Throws:

Exception

testPRAccessor

public void testPRAccessor()

verify that a PR accessor can be started

testPUTDMLSupport

public void testPUTDMLSupport()

verify that PUT dml does not read from hdfs

testPUTDMLBulkSupport

public void testPUTDMLBulkSupport()

testGetOperationalData

public void testGetOperationalData()

verify that get on operational data does not read from HDFS

testSizeEstimate

public void testSizeEstimate()

testForceAsyncMajorCompaction

public void testForceAsyncMajorCompaction()
                                   throws Exception

Throws:

Exception

testForceSyncMajorCompaction

public void testForceSyncMajorCompaction()
                                  throws Exception

Throws:

Exception

testFlushQueue

public void testFlushQueue()
                    throws Exception

Throws:

Exception

testFlushQueueWO

public void testFlushQueueWO()
                      throws Exception

Throws:

Exception