matchbox

Value Members

1. object ComputeImageSize

   

   Created by youngbinkim on 7/7/16.

2. object ComputeMD5

   

   compute MD5 checksum..

3. object DetectLanguage

   

4. object DetectMimeTypeTika

   

   A UDF to detect mime types

5. object ExtractAtMentions

   

6. object ExtractBoilerpipeText

   

   UDF for extracting raw text content from an HTML page, minus "boilerplate" content (using boilerpipe).

7. object ExtractDate

   

   Simple wrapper for getting different parts of a date

8. object ExtractDomain

   

9. object ExtractEntities

   

   Extracts entities

10. object ExtractGraph

    

    e.g.

    e.g. when done: $ cat nodes.partjson/part-* > nodes.json && cat links.partjson/part-* > links.json $ jq -c -n --slurpfile nodes nodes.json --slurpfile links links.json '{nodes: $nodes, links: $links}' > graph.json

11. object ExtractHashtags

    

12. object ExtractImageLinks

    

    UDF for extracting image links from a webpage given the HTML content (using Jsoup).

13. object ExtractLinks

    

    UDF for extracting links from a webpage given the HTML content (using Jsoup).

14. object ExtractPopularImages

    

    Extract most popular images

    Extract most popular images

    limit: number of most popular images in the output timeoutVal: time allowed to connect to each image

15. object ExtractTextFromPDFs

    

16. object ExtractUrls

    

17. object NER3Classifier

    

    UDF which reads in a text string, and returns entities identified by the configured Stanford NER classifier

18. object RecordLoader

    

19. object RemoveHTML

    

20. object RemoveHttpHeader

    

    Created by youngbinkim on 7/9/16.

21. object StringUtils

    

22. object TupleFormatter

    

23. object TweetUtils

    

24. object WriteGEXF

    

    UDF for exporting an RDD representing a collection of links to a GDF file.

25. object WriteGraphML

    

    UDF for exporting an RDD representing a collection of links to a GDF file.