org.apache.hadoop.hbase.mapreduce

Class TestTableInputFormatScanBase

java.lang.Object

org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScanBase

Direct Known Subclasses:

TestTableInputFormatScan1, TestTableInputFormatScan2

public abstract class TestTableInputFormatScanBase
extends java.lang.Object

Tests various scan start and stop row scenarios. This is set in a scan and tested in a MapReduce job to see if that is handed over and done properly too.

This test is broken into two parts in order to side-step the test timeout period of 900, as documented in HBASE-8326.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TestTableInputFormatScanBase.ScanMapper Pass the key and value to reduce.
static class	TestTableInputFormatScanBase.ScanReducer Checks the last and first key seen against the scanner boundaries.

Constructor Summary

Constructors

Constructor and Description
TestTableInputFormatScanBase()

Method Summary

Modifier and Type	Method and Description
static void	setUpBeforeClass()
static void	tearDownAfterClass()
void	testAutobalanceNumOfSplit() Run MR job to test autobalance for setting number of mappers for TIF This does not run real MR job
void	testNumOfSplits(int splitsPerRegion, int expectedNumOfSplits) Tests Number of inputSplits for MR job when specify number of mappers for TableInputFormatXXX This test does not run MR job
void	testNumOfSplitsMR(int splitsPerRegion, int expectedNumOfSplits) Run MR job to check the number of mapper = expectedNumOfSplits
protected void	testScan(java.lang.String start, java.lang.String stop, java.lang.String last) Tests a MR scan using specific start and stop rows.
protected void	testScanFromConfiguration(java.lang.String start, java.lang.String stop, java.lang.String last) Tests an MR Scan initialized from properties set in the Configuration.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TestTableInputFormatScanBase

public TestTableInputFormatScanBase()

Method Detail

setUpBeforeClass

public static void setUpBeforeClass()
                             throws java.lang.Exception

Throws:

java.lang.Exception

tearDownAfterClass

public static void tearDownAfterClass()
                               throws java.lang.Exception

Throws:

java.lang.Exception

testScanFromConfiguration

protected void testScanFromConfiguration(java.lang.String start,
                                         java.lang.String stop,
                                         java.lang.String last)
                                  throws java.io.IOException,
                                         java.lang.InterruptedException,
                                         java.lang.ClassNotFoundException

Tests an MR Scan initialized from properties set in the Configuration.

Throws:

java.io.IOException

java.lang.ClassNotFoundException

java.lang.InterruptedException

testScan

protected void testScan(java.lang.String start,
                        java.lang.String stop,
                        java.lang.String last)
                 throws java.io.IOException,
                        java.lang.InterruptedException,
                        java.lang.ClassNotFoundException

Tests a MR scan using specific start and stop rows.

Throws:

java.io.IOException

java.lang.ClassNotFoundException

java.lang.InterruptedException

testNumOfSplits

public void testNumOfSplits(int splitsPerRegion,
                            int expectedNumOfSplits)
                     throws java.io.IOException,
                            java.lang.InterruptedException,
                            java.lang.ClassNotFoundException

Tests Number of inputSplits for MR job when specify number of mappers for TableInputFormatXXX This test does not run MR job

Throws:

java.io.IOException

java.lang.ClassNotFoundException

java.lang.InterruptedException

testNumOfSplitsMR

public void testNumOfSplitsMR(int splitsPerRegion,
                              int expectedNumOfSplits)
                       throws java.io.IOException,
                              java.lang.InterruptedException,
                              java.lang.ClassNotFoundException

Run MR job to check the number of mapper = expectedNumOfSplits

Throws:

java.io.IOException

java.lang.InterruptedException

java.lang.ClassNotFoundException

testAutobalanceNumOfSplit

public void testAutobalanceNumOfSplit()
                               throws java.io.IOException

Run MR job to test autobalance for setting number of mappers for TIF This does not run real MR job

Throws:

java.io.IOException