org.apache.hadoop.hbase.mapreduce

Class MultiTableSnapshotInputFormatImpl

java.lang.Object

org.apache.hadoop.hbase.mapreduce.MultiTableSnapshotInputFormatImpl

public class MultiTableSnapshotInputFormatImpl
extends java.lang.Object

Shared implementation of mapreduce code over multiple table snapshots. Utilized by both mapreduce (.MultiTableSnapshotInputFormat and mapred (MultiTableSnapshotInputFormat implementations.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	RESTORE_DIRS_KEY
static java.lang.String	SNAPSHOT_TO_SCANS_KEY

Constructor Summary

Constructors

Constructor and Description
MultiTableSnapshotInputFormatImpl()

Method Summary

Modifier and Type	Method and Description
java.util.Map<java.lang.String,Path>	getSnapshotDirs(Configuration conf) Retrieve the directories into which snapshots have been restored from (RESTORE_DIRS_KEY)
java.util.Map<java.lang.String,java.util.Collection<Scan>>	getSnapshotsToScans(Configuration conf) Retrieve the snapshot name -> list<scan> mapping pushed to configuration by #setSnapshotToScans(org.apache.hadoop.conf.Configuration, java.util.Map)
java.util.List<TableSnapshotInputFormatImpl.InputSplit>	getSplits(Configuration conf) Return the list of splits extracted from the scans/snapshots pushed to conf by #setInput(org.apache.hadoop.conf.Configuration, java.util.Map, org.apache.hadoop.fs.Path)
void	restoreSnapshots(Configuration conf, java.util.Map<java.lang.String,Path> snapshotToDir, FileSystem fs) Restore each (snapshot name, restore directory) pair in snapshotToDir
void	setInput(Configuration conf, java.util.Map<java.lang.String,java.util.Collection<Scan>> snapshotScans, Path restoreDir) Configure conf to read from snapshotScans, with snapshots restored to a subdirectory of restoreDir.
void	setSnapshotDirs(Configuration conf, java.util.Map<java.lang.String,Path> snapshotDirs)
void	setSnapshotToScans(Configuration conf, java.util.Map<java.lang.String,java.util.Collection<Scan>> snapshotScans) Push snapshotScans to conf (under the key SNAPSHOT_TO_SCANS_KEY)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

RESTORE_DIRS_KEY

public static final java.lang.String RESTORE_DIRS_KEY

See Also:

Constant Field Values

SNAPSHOT_TO_SCANS_KEY

public static final java.lang.String SNAPSHOT_TO_SCANS_KEY

See Also:

Constant Field Values

Constructor Detail

MultiTableSnapshotInputFormatImpl

public MultiTableSnapshotInputFormatImpl()

Method Detail

setInput

public void setInput(Configuration conf,
                     java.util.Map<java.lang.String,java.util.Collection<Scan>> snapshotScans,
                     Path restoreDir)
              throws java.io.IOException

Configure conf to read from snapshotScans, with snapshots restored to a subdirectory of restoreDir. Sets: RESTORE_DIRS_KEY, SNAPSHOT_TO_SCANS_KEY

Parameters:

conf -

snapshotScans -

restoreDir -

Throws:

java.io.IOException

getSplits

public java.util.List<TableSnapshotInputFormatImpl.InputSplit> getSplits(Configuration conf)
                                                                  throws java.io.IOException

Return the list of splits extracted from the scans/snapshots pushed to conf by #setInput(org.apache.hadoop.conf.Configuration, java.util.Map, org.apache.hadoop.fs.Path)

Parameters:

conf - Configuration to determine splits from

Returns:

Return the list of splits extracted from the scans/snapshots pushed to conf

Throws:

java.io.IOException

getSnapshotsToScans

public java.util.Map<java.lang.String,java.util.Collection<Scan>> getSnapshotsToScans(Configuration conf)
                                                                               throws java.io.IOException

Retrieve the snapshot name -> list<scan> mapping pushed to configuration by #setSnapshotToScans(org.apache.hadoop.conf.Configuration, java.util.Map)

Parameters:

conf - Configuration to extract name -> list<scan> mappings from.

Returns:

the snapshot name -> list<scan> mapping pushed to configuration

Throws:

java.io.IOException

setSnapshotToScans

public void setSnapshotToScans(Configuration conf,
                               java.util.Map<java.lang.String,java.util.Collection<Scan>> snapshotScans)
                        throws java.io.IOException

Push snapshotScans to conf (under the key SNAPSHOT_TO_SCANS_KEY)

Parameters:

conf -

snapshotScans -

Throws:

java.io.IOException

getSnapshotDirs

public java.util.Map<java.lang.String,Path> getSnapshotDirs(Configuration conf)
                                                     throws java.io.IOException

Retrieve the directories into which snapshots have been restored from (RESTORE_DIRS_KEY)

Parameters:

conf - Configuration to extract restore directories from

Returns:

the directories into which snapshots have been restored from

Throws:

java.io.IOException

setSnapshotDirs

public void setSnapshotDirs(Configuration conf,
                            java.util.Map<java.lang.String,Path> snapshotDirs)

restoreSnapshots

public void restoreSnapshots(Configuration conf,
                             java.util.Map<java.lang.String,Path> snapshotToDir,
                             FileSystem fs)
                      throws java.io.IOException

Restore each (snapshot name, restore directory) pair in snapshotToDir

Parameters:

conf - configuration to restore with

snapshotToDir - mapping from snapshot names to restore directories

fs - filesystem to do snapshot restoration on

Throws:

java.io.IOException