org.apache.hadoop.hbase

Class IntegrationTestIngest

java.lang.Object

AbstractHBaseTool

org.apache.hadoop.hbase.IntegrationTestBase

org.apache.hadoop.hbase.IntegrationTestIngest

Direct Known Subclasses:

IntegrationTestIngestStripeCompactions, IntegrationTestIngestWithACL, IntegrationTestIngestWithEncryption, IntegrationTestIngestWithMOB, IntegrationTestIngestWithTags, IntegrationTestIngestWithVisibilityLabels, IntegrationTestRegionReplicaReplication, IntegrationTestTimeBoundedRequestsWithRegionReplicas

public class IntegrationTestIngest
extends IntegrationTestBase

A base class for tests that do something with the cluster while running LoadTestTool to write and verify some data.

Field Summary

Fields

Modifier and Type	Field and Description
protected HBaseCluster	cluster
protected static long	DEFAULT_NUM_KEYS_PER_SERVER
protected static int	DEFAULT_NUM_READ_THREADS
protected static int	DEFAULT_NUM_WRITE_THREADS
protected static long	DEFAULT_RUN_TIME
static char	HIPHEN
protected static long	JUNIT_RUN_TIME
protected java.lang.String[]	LOAD_TEST_TOOL_INIT_ARGS
protected LoadTestTool	loadTool
protected static Logger	LOG
protected static java.lang.String	NUM_KEYS_PER_SERVER_KEY
protected static java.lang.String	NUM_READ_THREADS_KEY
protected static java.lang.String	NUM_WRITE_THREADS_KEY
protected static java.lang.String	RUN_TIME_KEY A soft limit on how long we should run
protected IntegrationTestingUtility	util

Fields inherited from class org.apache.hadoop.hbase.IntegrationTestBase

CHAOS_MONKEY_PROPS, monkey, MONKEY_LONG_OPT, monkeyProps, monkeyToUse, NO_CLUSTER_CLEANUP_LONG_OPT, noClusterCleanUp

Constructor Summary

Constructors

Constructor and Description
IntegrationTestIngest()

Method Summary

Modifier and Type	Method and Description
protected java.lang.String[]	getArgsForLoadTestTool(java.lang.String mode, java.lang.String modeSpecificArg, long startKey, long numKeys)
protected java.lang.String[]	getArgsForLoadTestToolInitTable()
protected java.util.Set<java.lang.String>	getColumnFamilies() Provides the name of the CFs that are protected from random Chaos monkey activity (alter)
protected int	getMinServerCount()
protected long	getNumKeys(long keysPerServer) Estimates a data size based on the cluster size
TableName	getTablename() Provides the name of the table that is protected from random Chaos monkey activity
protected void	initTable()
protected void	internalRunIngestTest(long runTime)
static void	main(java.lang.String[] args)
protected void	runIngestTest(long defaultRunTime, long keysPerServerPerIter, int colsPerKey, int recordSize, int writeThreads, int readThreads)
int	runTestFromCommandLine()
void	setUpCluster()
void	testIngest()

Methods inherited from class org.apache.hadoop.hbase.IntegrationTestBase

addOptions, cleanUp, cleanUpCluster, cleanUpMonkey, cleanUpMonkey, doWork, getConf, getDefaultMonkeyFactory, getTestingUtil, processBaseOptions, processOptions, setUp, setUpMonkey, startMonkey

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

HIPHEN

public static final char HIPHEN

See Also:

Constant Field Values

DEFAULT_RUN_TIME

protected static final long DEFAULT_RUN_TIME

See Also:

Constant Field Values

JUNIT_RUN_TIME

protected static final long JUNIT_RUN_TIME

See Also:

Constant Field Values

RUN_TIME_KEY

protected static final java.lang.String RUN_TIME_KEY

A soft limit on how long we should run

See Also:

Constant Field Values

NUM_KEYS_PER_SERVER_KEY

protected static final java.lang.String NUM_KEYS_PER_SERVER_KEY

See Also:

Constant Field Values

DEFAULT_NUM_KEYS_PER_SERVER

protected static final long DEFAULT_NUM_KEYS_PER_SERVER

See Also:

Constant Field Values

NUM_WRITE_THREADS_KEY

protected static final java.lang.String NUM_WRITE_THREADS_KEY

See Also:

Constant Field Values

DEFAULT_NUM_WRITE_THREADS

protected static final int DEFAULT_NUM_WRITE_THREADS

See Also:

Constant Field Values

NUM_READ_THREADS_KEY

protected static final java.lang.String NUM_READ_THREADS_KEY

See Also:

Constant Field Values

DEFAULT_NUM_READ_THREADS

protected static final int DEFAULT_NUM_READ_THREADS

See Also:

Constant Field Values

LOG

protected static final Logger LOG

util

protected IntegrationTestingUtility util

cluster

protected HBaseCluster cluster

loadTool

protected LoadTestTool loadTool

LOAD_TEST_TOOL_INIT_ARGS

protected java.lang.String[] LOAD_TEST_TOOL_INIT_ARGS

Constructor Detail

IntegrationTestIngest

public IntegrationTestIngest()

Method Detail

setUpCluster

public void setUpCluster()
                  throws java.lang.Exception

Specified by:

setUpCluster in class IntegrationTestBase

Throws:

java.lang.Exception

getMinServerCount

protected int getMinServerCount()

initTable

protected void initTable()
                  throws java.io.IOException

Throws:

java.io.IOException

runTestFromCommandLine

public int runTestFromCommandLine()
                           throws java.lang.Exception

Specified by:

runTestFromCommandLine in class IntegrationTestBase

Throws:

java.lang.Exception

testIngest

public void testIngest()
                throws java.lang.Exception

Throws:

java.lang.Exception

internalRunIngestTest

protected void internalRunIngestTest(long runTime)
                              throws java.lang.Exception

Throws:

java.lang.Exception

getTablename

public TableName getTablename()

Description copied from class: IntegrationTestBase

Provides the name of the table that is protected from random Chaos monkey activity

Specified by:

getTablename in class IntegrationTestBase

Returns:

table to not delete.

getColumnFamilies

protected java.util.Set<java.lang.String> getColumnFamilies()

Description copied from class: IntegrationTestBase

Provides the name of the CFs that are protected from random Chaos monkey activity (alter)

Specified by:

getColumnFamilies in class IntegrationTestBase

Returns:

set of cf names to protect.

runIngestTest

protected void runIngestTest(long defaultRunTime,
                             long keysPerServerPerIter,
                             int colsPerKey,
                             int recordSize,
                             int writeThreads,
                             int readThreads)
                      throws java.lang.Exception

Throws:

java.lang.Exception

getArgsForLoadTestToolInitTable

protected java.lang.String[] getArgsForLoadTestToolInitTable()

getArgsForLoadTestTool

protected java.lang.String[] getArgsForLoadTestTool(java.lang.String mode,
                                                    java.lang.String modeSpecificArg,
                                                    long startKey,
                                                    long numKeys)

getNumKeys

protected long getNumKeys(long keysPerServer)
                   throws java.io.IOException

Estimates a data size based on the cluster size

Throws:

java.io.IOException

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Throws:

java.lang.Exception