Packages

o

io.archivesunleashed.app

ImageGraphExtractor

object ImageGraphExtractor

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ImageGraphExtractor
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. def apply(d: DataFrame): Dataset[Row]

    Extract image graph from web archive using DataFrame and Spark SQL.

    Extract image graph from web archive using DataFrame and Spark SQL.

    d

    DataFrame obtained from RecordLoader

    returns

    Dataset[Row], where the schema is (crawl date, src, image url, alt text)