Package

io

archivesunleashed

Permalink

package archivesunleashed

Package object which supplies implicits to augment generic RDDs with AUT-specific transformations.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. archivesunleashed
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. trait ArchiveRecord extends Serializable

    Permalink

    Trait for a record in a web archive.

  2. class ArchiveRecordImpl extends ArchiveRecord

    Permalink

    Default implementation of a record in a web archive.

  3. implicit class CountableRDD[T] extends Serializable

    Permalink

    A Wrapper class around RDD to simplify counting.

  4. class DataFrameLoader extends AnyRef

    Permalink

  5. implicit class WARecordRDD extends Serializable

    Permalink

    A Wrapper class around RDD to allow RDDs of type ARCRecord and WARCRecord to be queried via a fluent API.

    A Wrapper class around RDD to allow RDDs of type ARCRecord and WARCRecord to be queried via a fluent API.

    To load such an RDD, please see RecordLoader.

Value Members

  1. object RecordLoader

    Permalink

    Loads records from either WARCs, ARCs or Twitter API data (JSON).

  2. package app

    Permalink

  3. package data

    Permalink

  4. package df

    Permalink

    UDFs for data frames.

  5. package matchbox

    Permalink

    Package object which supplies implicits providing common UDF-related functionalities.

  6. package util

    Permalink

Inherited from AnyRef

Inherited from Any

Ungrouped