Package

io

archivesunleashed

Permalink

package archivesunleashed

Package object which supplies implicits to augment generic RDDs with AUT-specific transformations.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. archivesunleashed
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. trait ArchiveRecord extends Serializable

    Permalink
  2. class ArchiveRecordImpl extends ArchiveRecord

    Permalink

    Used by RecordLoader to extract data from WARC and ARC files.

  3. implicit class CountableRDD[T] extends Serializable

    Permalink

    A Wrapper class around RDD to simplify counting.

  4. implicit class WARecordRDD extends Serializable

    Permalink

    A Wrapper class around RDD to allow RDDs of type ARCRecord and WARCRecord to be queried via a fluent API.

    A Wrapper class around RDD to allow RDDs of type ARCRecord and WARCRecord to be queried via a fluent API.

    To load such an RDD, please see RecordLoader.

Value Members

  1. object RecordLoader

    Permalink

    Loads records from either WARCs, ARCs or Twitter API data (JSON).

    Loads records from either WARCs, ARCs or Twitter API data (JSON). *

  2. package app

    Permalink
  3. package data

    Permalink
  4. package matchbox

    Permalink

    Package object which supplies implicits providing common UDF-related functionalities.

  5. package util

    Permalink

Inherited from AnyRef

Inherited from Any

Ungrouped