org.apache.hadoop.hbase.mapreduce

Class IntegrationTestTableSnapshotInputFormat

java.lang.Object

AbstractHBaseTool

org.apache.hadoop.hbase.IntegrationTestBase

org.apache.hadoop.hbase.mapreduce.IntegrationTestTableSnapshotInputFormat

public class IntegrationTestTableSnapshotInputFormat
extends IntegrationTestBase

An integration test to test TableSnapshotInputFormat which enables reading directly from snapshot files without going through hbase servers. This test creates a table and loads the table with the rows ranging from 'aaa' to 'zzz', and for each row, sets the columns f1:(null) and f2:(null) to be the the same as the row value.

 aaa, f1: => aaa
 aaa, f2: => aaa
 aab, f1: => aab
 ....
 zzz, f2: => zzz
 

Then the test creates a snapshot from this table, and overrides the values in the original table with values 'after_snapshot_value'. The test, then runs a mapreduce job over the snapshot with a scan start row 'bbb' and stop row 'yyy'. The data is saved in a single reduce output file, and inspected later to verify that the MR job has seen all the values from the snapshot.

These parameters can be used to configure the job:
"IntegrationTestTableSnapshotInputFormat.table" => the name of the table
"IntegrationTestTableSnapshotInputFormat.snapshot" => the name of the snapshot
"IntegrationTestTableSnapshotInputFormat.numRegions" => number of regions in the table to be created (default, 32).
"IntegrationTestTableSnapshotInputFormat.tableDir" => temporary directory to restore the snapshot files

Field Summary

Fields inherited from class org.apache.hadoop.hbase.IntegrationTestBase

CHAOS_MONKEY_PROPS, monkey, MONKEY_LONG_OPT, monkeyProps, monkeyToUse, NO_CLUSTER_CLEANUP_LONG_OPT, noClusterCleanUp

Constructor Summary

Constructors

Constructor and Description
IntegrationTestTableSnapshotInputFormat()

Method Summary

Modifier and Type	Method and Description
void	cleanUp()
protected java.util.Set<java.lang.String>	getColumnFamilies() Provides the name of the CFs that are protected from random Chaos monkey activity (alter)
TableName	getTablename() Provides the name of the table that is protected from random Chaos monkey activity
static void	main(java.lang.String[] args)
int	runTestFromCommandLine()
void	setConf(Configuration conf)
void	setUp()
void	setUpCluster()

Methods inherited from class org.apache.hadoop.hbase.IntegrationTestBase

addOptions, cleanUpCluster, cleanUpMonkey, cleanUpMonkey, doWork, getConf, getDefaultMonkeyFactory, getTestingUtil, processBaseOptions, processOptions, setUpMonkey, startMonkey

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

IntegrationTestTableSnapshotInputFormat

public IntegrationTestTableSnapshotInputFormat()

Method Detail

setConf

public void setConf(Configuration conf)

setUp

public void setUp()
           throws java.lang.Exception

Overrides:

setUp in class IntegrationTestBase

Throws:

java.lang.Exception

cleanUp

public void cleanUp()
             throws java.lang.Exception

Overrides:

cleanUp in class IntegrationTestBase

Throws:

java.lang.Exception

setUpCluster

public void setUpCluster()
                  throws java.lang.Exception

Specified by:

setUpCluster in class IntegrationTestBase

Throws:

java.lang.Exception

runTestFromCommandLine

public int runTestFromCommandLine()
                           throws java.lang.Exception

Specified by:

runTestFromCommandLine in class IntegrationTestBase

Throws:

java.lang.Exception

getTablename

public TableName getTablename()

Description copied from class: IntegrationTestBase

Provides the name of the table that is protected from random Chaos monkey activity

Specified by:

getTablename in class IntegrationTestBase

Returns:

table to not delete.

getColumnFamilies

protected java.util.Set<java.lang.String> getColumnFamilies()

Description copied from class: IntegrationTestBase

Provides the name of the CFs that are protected from random Chaos monkey activity (alter)

Specified by:

getColumnFamilies in class IntegrationTestBase

Returns:

set of cf names to protect.

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Throws:

java.lang.Exception