io.archivesunleashed.mapreduce

Class WacWarcInputFormat.WarcRecordReader

java.lang.Object

org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,WarcRecordWritable>

io.archivesunleashed.mapreduce.WacWarcInputFormat.WarcRecordReader

All Implemented Interfaces:

Closeable, AutoCloseable

Enclosing class:

WacWarcInputFormat

public class WacWarcInputFormat.WarcRecordReader
extends org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,WarcRecordWritable>

Extends RecordReader for WARC Record Reader.

Constructor Summary

Constructors

Constructor and Description
WarcRecordReader()

Method Summary

Modifier and Type	Method and Description
void	close()
org.apache.hadoop.io.LongWritable	getCurrentKey()
WarcRecordWritable	getCurrentValue()
float	getProgress()
void	initialize(org.apache.hadoop.mapreduce.InputSplit genericSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context)
boolean	nextKeyValue()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WarcRecordReader

public WarcRecordReader()

Method Detail

initialize

public final void initialize(org.apache.hadoop.mapreduce.InputSplit genericSplit,
                             org.apache.hadoop.mapreduce.TaskAttemptContext context)
                      throws IOException

Specified by:

initialize in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,WarcRecordWritable>

Throws:

IOException

nextKeyValue

public final boolean nextKeyValue()
                           throws IOException

Specified by:

nextKeyValue in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,WarcRecordWritable>

Throws:

IOException

getCurrentKey

public final org.apache.hadoop.io.LongWritable getCurrentKey()

Specified by:

getCurrentKey in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,WarcRecordWritable>

getCurrentValue

public final WarcRecordWritable getCurrentValue()

Specified by:

getCurrentValue in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,WarcRecordWritable>

getProgress

public final float getProgress()
                        throws IOException

Specified by:

getProgress in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,WarcRecordWritable>

Throws:

IOException

close

public final void close()
                 throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Specified by:

close in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,WarcRecordWritable>

Throws:

IOException