org.apache.hadoop.hbase

Class PerformanceEvaluation

java.lang.Object

Configured

org.apache.hadoop.hbase.PerformanceEvaluation

public class PerformanceEvaluation
extends Configured

Script used evaluating HBase performance and scalability. Runs a HBase client that steps through one of a set of hardcoded tests or 'experiments' (e.g. a random reads test, a random writes test, etc.). Pass on the command-line which test to run and how many clients are participating in this experiment. Run PerformanceEvaluation --help to obtain usage.

This class sets up and runs the evaluation programs described in Section 7, Performance Evaluation, of the Bigtable paper, pages 8-10.

By default, runs as a mapreduce job where each mapper runs a single test client. Can also run as a non-mapreduce, multithreaded application by specifying --nomapred. Each client does about 1GB of data, unless specified otherwise.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	PerformanceEvaluation.Counter Enum for map metrics.
static class	PerformanceEvaluation.EvaluationMapTask MapReduce job that runs a performance evaluation client in each map task.
protected static class	PerformanceEvaluation.RunResult

Field Summary

Fields

Modifier and Type	Field and Description
static byte[]	COLUMN_ZERO
static int	DEFAULT_VALUE_LENGTH
static java.lang.String	FAMILY_NAME_BASE
static byte[]	FAMILY_ZERO
static int	ROW_LENGTH
static java.lang.String	TABLE_NAME

Constructor Summary

Constructors

Constructor and Description
PerformanceEvaluation(Configuration conf) Constructor

Method Summary

Modifier and Type	Method and Description
protected static void	addCommandDescriptor(java.lang.Class<? extends org.apache.hadoop.hbase.PerformanceEvaluation.TestBase> cmdClass, java.lang.String name, java.lang.String description)
static byte[]	format(int number)
static byte[]	generateData(java.util.Random r, int length)
protected static byte[][]	getSplits(org.apache.hadoop.hbase.PerformanceEvaluation.TestOptions opts) generates splits based on total number of rows and specified split regions
protected static HTableDescriptor	getTableDescriptor(org.apache.hadoop.hbase.PerformanceEvaluation.TestOptions opts) Create an HTableDescriptor from provided TestOptions.
static void	main(java.lang.String[] args)
protected void	printUsage()
protected static void	printUsage(java.lang.String message)
protected static void	printUsage(java.lang.String className, java.lang.String message)
protected static void	printUsageAndExit(java.lang.String message, int exitCode)
int	run(java.lang.String[] args)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

TABLE_NAME

public static final java.lang.String TABLE_NAME

See Also:

Constant Field Values

FAMILY_NAME_BASE

public static final java.lang.String FAMILY_NAME_BASE

See Also:

Constant Field Values

FAMILY_ZERO

public static final byte[] FAMILY_ZERO

COLUMN_ZERO

public static final byte[] COLUMN_ZERO

DEFAULT_VALUE_LENGTH

public static final int DEFAULT_VALUE_LENGTH

See Also:

Constant Field Values

ROW_LENGTH

public static final int ROW_LENGTH

See Also:

Constant Field Values

Constructor Detail

PerformanceEvaluation

public PerformanceEvaluation(Configuration conf)

Constructor

Parameters:

conf - Configuration object

Method Detail

addCommandDescriptor

protected static void addCommandDescriptor(java.lang.Class<? extends org.apache.hadoop.hbase.PerformanceEvaluation.TestBase> cmdClass,
                                           java.lang.String name,
                                           java.lang.String description)

getTableDescriptor

protected static HTableDescriptor getTableDescriptor(org.apache.hadoop.hbase.PerformanceEvaluation.TestOptions opts)

Create an HTableDescriptor from provided TestOptions.

getSplits

protected static byte[][] getSplits(org.apache.hadoop.hbase.PerformanceEvaluation.TestOptions opts)

generates splits based on total number of rows and specified split regions

format

public static byte[] format(int number)

generateData

public static byte[] generateData(java.util.Random r,
                                  int length)

printUsage

protected void printUsage()

printUsage

protected static void printUsage(java.lang.String message)

printUsageAndExit

protected static void printUsageAndExit(java.lang.String message,
                                        int exitCode)

printUsage

protected static void printUsage(java.lang.String className,
                                 java.lang.String message)

run

public int run(java.lang.String[] args)
        throws java.lang.Exception

Throws:

java.lang.Exception

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Throws:

java.lang.Exception