com.gemstone.gemfire.cache.hdfs.internal

Class RegionWithHDFSTestBase

java.lang.Object

junit.framework.Assert

junit.framework.TestCase

dunit.DistributedTestCase

com.gemstone.gemfire.cache30.CacheTestCase

com.gemstone.gemfire.cache.hdfs.internal.RegionWithHDFSTestBase

All Implemented Interfaces:

Serializable, junit.framework.Test

Direct Known Subclasses:

ColocatedRegionWithHDFSDUnitTest, RegionWithHDFSBasicDUnitTest

public abstract class RegionWithHDFSTestBase
extends CacheTestCase

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class dunit.DistributedTestCase

DistributedTestCase.ExpectedException, DistributedTestCase.WaitCriterion, DistributedTestCase.WaitCriterion2

Field Summary

Fields

Modifier and Type	Field and Description
protected String	tmpDir

Fields inherited from class com.gemstone.gemfire.cache30.CacheTestCase

cache

Fields inherited from class dunit.DistributedTestCase

logPerTest, reconnect, system, testName

Constructor Summary

Constructors

Constructor and Description
RegionWithHDFSTestBase(String name)

Method Summary

Modifier and Type	Method and Description
protected void	cacheClose(VM vm, boolean sleep)
protected abstract void	checkWithGet(String uniqueName, int start, int end, boolean expectValue)
protected abstract void	checkWithGetAll(String uniqueName, ArrayList arrayl)
protected void	closeCache(VM vm0)
protected HashMap<String,HashMap<String,String>>	createFilesAndEntriesMap(VM vm0, String uniqueName, String regionName) Reads all the sequence files and returns the list of key value pairs persisted.
protected int	createServerRegion(VM vm, int totalnumOfBuckets, int batchSizeMB, int maximumEntries, String folderPath, String uniqueName, int batchInterval, boolean writeonly, boolean queuePersistent)
protected int	createServerRegion(VM vm, int totalnumOfBuckets, int batchSizeMB, int maximumEntries, String folderPath, String uniqueName, int batchInterval, boolean writeonly, boolean queuePersistent, long timeForRollover, long maxFileSize)
protected AsyncInvocation	createServerRegionAsync(VM vm, int totalnumOfBuckets, int batchSizeMB, int maximumEntries, String folderPath, String uniqueName, int batchInterval, boolean writeonly, boolean queuePersistent)
protected AsyncInvocation	createServerRegionAsync(VM vm, int totalnumOfBuckets, int batchSizeMB, int maximumEntries, String folderPath, String uniqueName, int batchInterval, boolean writeonly, boolean queuePersistent, long timeForRollover, long maxFileSize)
protected abstract AsyncInvocation	doAsyncPuts(VM vm, String regionName, int start, int end, String suffix)
protected abstract void	doDestroys(String uniqueName, int start, int end)
protected abstract void	doPutAll(String uniqueName, Map map)
protected abstract void	doPuts(String uniqueName, int start, int end)
protected void	doPuts(VM vm0, String uniqueName, int numEntries)
protected void	dumpFiles(VM vm0, String uniqueName)
protected abstract SerializableCallable	getCreateRegionCallable(int totalnumOfBuckets, int batchSizeMB, int maximumEntries, String folderPath, String uniqueName, int batchInterval, boolean queuePersistent, boolean writeonly, long timeForRollover, long maxFileSize)
void	setUp() Sets up the test (noop).
void	tearDown2() Tears down the test.
void	testGetAllForAsyncQueue() puts a few entries (keys with multiple updates ).
void	testGetForAsyncQueue() puts a few entries (keys with multiple updates ).
void	testGetFromHDFS() Does puts, gets, destroy and getAll.
void	testPutAllAndGetFromHDFS() Does putAll and get.
void	testPutAllForAsyncQueue() puts a few entries (keys with multiple updates ).
void	testWObasicClose()
protected void	validate(VM vm1, String uniqueName, int numEntries)
protected SerializableCallable	validateEmpty(VM vm0, int numEntries, String uniqueName)
protected void	verifyDataInHDFS(VM vm0, String uniqueName, boolean shouldHaveData, boolean wait, boolean waitForQueueToDrain, int numEntries)
protected abstract void	verifyHDFSData(VM vm, String uniqueName)
protected void	verifyInEntriesMap(HashMap<String,String> entriesMap, int start, int end, String suffix)

Methods inherited from class com.gemstone.gemfire.cache30.CacheTestCase

addExceptionTag1, basicGetCache, beginCacheXml, cleanDiskDirs, closeAllCache, closeCache, createLonerCache, createMcastCache, createMcastCache, createRegion, createRegion, createRootRegion, createRootRegion, disconnectFromDS, finishCacheXml, finishCacheXml, getCache, getCache, getCache, getCache, getClientCache, getDiskDirs, getGemfireCache, getInternalRegionArguments, getRootRegion, getRootRegion, hasCache, remoteTearDown, removeExceptionTag1, sendSerialMessageToAll, sendUnorderedMessageToAll

Methods inherited from class dunit.DistributedTestCase

addExpectedException, addExpectedException, addHydraProperties, attachDebugger, checkBBFlag, cleanupAllVms, clearBBFlag, crashDistributedSystem, crashDistributedSystem, createLogWriter, disconnectAllFromDS, dumpAllStacks, dumpMyThreads, dumpStack, dumpStack, dumpStack, dumpStackTrace, fail, getAllDistributedSystemProperties, getDistributedSystemProperties, getDUnitLocatorAddress, getDUnitLocatorPort, getDUnitLocatorString, getDUnitLogLevel, getIPLiteral, getLogWriter, getLonerSystem, getMcastSystem, getMcastSystem, getRepeatTimeoutMs, getServerHostName, getSystem, getSystem, getTestClass, getTestName, getUniqueName, getVMCount, incBBFlag, invokeInEveryVM, invokeInEveryVM, invokeInEveryVM, invokeInEveryVM, invokeInEveryVMRepeatingIfNecessary, invokeInLocator, invokeRepeatingIfNecessary, isConnectedToDS, join, noteTiming, pause, pause, perVMSetUp, realTearDown, setDiskStoreForGateway, setSystem, setTestName, staticPause, tearDown, unregisterAllDataSerializersFromAllVms, unregisterDataSerializerInThisVM, unregisterInstantiatorsInThisVM, waitForBBFlag, waitForCriterion, waitMutex

Methods inherited from class junit.framework.TestCase

assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertFalse, assertFalse, assertNotNull, assertNotNull, assertNotSame, assertNotSame, assertNull, assertNull, assertSame, assertSame, assertTrue, assertTrue, countTestCases, createResult, fail, fail, failNotEquals, failNotSame, failSame, format, getName, run, run, runBare, runTest, setName, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

tmpDir

protected String tmpDir

Constructor Detail

RegionWithHDFSTestBase

public RegionWithHDFSTestBase(String name)

Method Detail

checkWithGetAll

protected abstract void checkWithGetAll(String uniqueName,
                                        ArrayList arrayl)

checkWithGet

protected abstract void checkWithGet(String uniqueName,
                                     int start,
                                     int end,
                                     boolean expectValue)

doDestroys

protected abstract void doDestroys(String uniqueName,
                                   int start,
                                   int end)

doPutAll

protected abstract void doPutAll(String uniqueName,
                                 Map map)

doPuts

protected abstract void doPuts(String uniqueName,
                               int start,
                               int end)

getCreateRegionCallable

protected abstract SerializableCallable getCreateRegionCallable(int totalnumOfBuckets,
                                                                int batchSizeMB,
                                                                int maximumEntries,
                                                                String folderPath,
                                                                String uniqueName,
                                                                int batchInterval,
                                                                boolean queuePersistent,
                                                                boolean writeonly,
                                                                long timeForRollover,
                                                                long maxFileSize)

verifyHDFSData

protected abstract void verifyHDFSData(VM vm,
                                       String uniqueName)
                                throws Exception

Throws:

Exception

doAsyncPuts

protected abstract AsyncInvocation doAsyncPuts(VM vm,
                                               String regionName,
                                               int start,
                                               int end,
                                               String suffix)
                                        throws Exception

Throws:

Exception

tearDown2

public void tearDown2()
               throws Exception

Description copied from class: DistributedTestCase

Tears down the test. This method is called by the final DistributedTestCase.tearDown() method, and should be over ridden in its place.

Overrides:

tearDown2 in class CacheTestCase

Throws:

Exception

setUp

public void setUp()
           throws Exception

Description copied from class: DistributedTestCase

Sets up the test (noop).

Overrides:

setUp in class DistributedTestCase

Throws:

Exception

createServerRegion

protected int createServerRegion(VM vm,
                                 int totalnumOfBuckets,
                                 int batchSizeMB,
                                 int maximumEntries,
                                 String folderPath,
                                 String uniqueName,
                                 int batchInterval,
                                 boolean writeonly,
                                 boolean queuePersistent)

createServerRegion

protected int createServerRegion(VM vm,
                                 int totalnumOfBuckets,
                                 int batchSizeMB,
                                 int maximumEntries,
                                 String folderPath,
                                 String uniqueName,
                                 int batchInterval,
                                 boolean writeonly,
                                 boolean queuePersistent,
                                 long timeForRollover,
                                 long maxFileSize)

createServerRegionAsync

protected AsyncInvocation createServerRegionAsync(VM vm,
                                                  int totalnumOfBuckets,
                                                  int batchSizeMB,
                                                  int maximumEntries,
                                                  String folderPath,
                                                  String uniqueName,
                                                  int batchInterval,
                                                  boolean writeonly,
                                                  boolean queuePersistent)

createServerRegionAsync

protected AsyncInvocation createServerRegionAsync(VM vm,
                                                  int totalnumOfBuckets,
                                                  int batchSizeMB,
                                                  int maximumEntries,
                                                  String folderPath,
                                                  String uniqueName,
                                                  int batchInterval,
                                                  boolean writeonly,
                                                  boolean queuePersistent,
                                                  long timeForRollover,
                                                  long maxFileSize)

testGetFromHDFS

public void testGetFromHDFS()
                     throws Throwable

Does puts, gets, destroy and getAll. Since there are many updates most of the time the data is not found in memory and queue and is fetched from HDFS

Throws:

Throwable

testGetForAsyncQueue

public void testGetForAsyncQueue()

puts a few entries (keys with multiple updates ). Gets them immediately. High probability that it gets it from async queue.

testGetAllForAsyncQueue

public void testGetAllForAsyncQueue()

puts a few entries (keys with multiple updates ). Calls getAll immediately. High probability that it gets it from async queue.

testPutAllForAsyncQueue

public void testPutAllForAsyncQueue()

puts a few entries (keys with multiple updates ). Calls getAll immediately. High probability that it gets it from async queue.

testPutAllAndGetFromHDFS

public void testPutAllAndGetFromHDFS()

Does putAll and get. Since there are many updates most of the time the data is not found in memory and queue and is fetched from HDFS

testWObasicClose

public void testWObasicClose()
                      throws Throwable

Throws:

Throwable

cacheClose

protected void cacheClose(VM vm,
                          boolean sleep)

verifyInEntriesMap

protected void verifyInEntriesMap(HashMap<String,String> entriesMap,
                                  int start,
                                  int end,
                                  String suffix)

createFilesAndEntriesMap

protected HashMap<String,HashMap<String,String>> createFilesAndEntriesMap(VM vm0,
                                                                          String uniqueName,
                                                                          String regionName)
                                                                   throws Exception

Reads all the sequence files and returns the list of key value pairs persisted. Returns the key value pair as tuple as there can be multiple values for a key

Throws:

Exception

validateEmpty

protected SerializableCallable validateEmpty(VM vm0,
                                             int numEntries,
                                             String uniqueName)

closeCache

protected void closeCache(VM vm0)

verifyDataInHDFS

protected void verifyDataInHDFS(VM vm0,
                                String uniqueName,
                                boolean shouldHaveData,
                                boolean wait,
                                boolean waitForQueueToDrain,
                                int numEntries)

doPuts

protected void doPuts(VM vm0,
                      String uniqueName,
                      int numEntries)

validate

protected void validate(VM vm1,
                        String uniqueName,
                        int numEntries)

dumpFiles

protected void dumpFiles(VM vm0,
                         String uniqueName)