Object

io.archivesunleashed.app

ExtractGraphX

Related Doc: package app

Permalink

object ExtractGraphX

Extracts a site link structure using Spark's GraphX utility.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ExtractGraphX
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. case class EdgeData(edgeCount: Int) extends Product with Serializable

    Permalink

  2. case class VertexData(url: String) extends Product with Serializable

    Permalink

  3. case class VertexDataPR(url: String, pageRank: Double, weak: Long, strong: Long) extends Product with Serializable

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. val DEF_NUMITER: Int

    Permalink

  5. val DEF_RESET: Double

    Permalink

  6. val DEF_TOLERANCE: Double

    Permalink

  7. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  8. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  9. val defaultComponent: Long

    Permalink

  10. val defaultPR: Double

    Permalink

  11. var dynamic: Boolean

    Permalink

  12. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  13. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  14. def extractGraphX(records: RDD[(String, String)]): Graph[VertexData, EdgeData]

    Permalink

    Creates a GraphX object

    Creates a GraphX object

    records

    an RDD of tuples (source, destination)

    returns

    a GraphX object

  15. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  16. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  17. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  18. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  19. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  20. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  21. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  22. var numIter: Int

    Permalink

  23. def pageHash(url: String): VertexId

    Permalink

    Creates a hashcode from a url to use as a unique id.

    Creates a hashcode from a url to use as a unique id.

    returns

    unique id as long integer.

  24. var resetProbability: Double

    Permalink

  25. def runPageRankAlgorithm(graph: Graph[VertexData, EdgeData]): Graph[VertexDataPR, EdgeData]

    Permalink

    calculates basic graph data (Page Rank, weak and strong components) for Graph

    calculates basic graph data (Page Rank, weak and strong components) for Graph

    graph

    GraphX object

    returns

    new graph object with additional attributes

  26. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  27. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  28. var tolerance: Double

    Permalink

  29. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  30. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  31. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped