org.apache.any23.plugin.htmlscraper

Class HTMLScraperExtractor

java.lang.Object

org.apache.any23.plugin.htmlscraper.HTMLScraperExtractor

All Implemented Interfaces:

Extractor<InputStream>, Extractor.ContentExtractor

@MetaInfServices(value=org.apache.any23.extractor.Extractor.class)
public class HTMLScraperExtractor
extends Object
implements Extractor.ContentExtractor

Implementation of content extractor for performing HTML scraping.

Author:

Michele Mostarda (mostarda@fbk.eu)

See Also:

HTMLScraperPlugin

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.any23.extractor.Extractor

Extractor.BlindExtractor, Extractor.ContentExtractor, Extractor.TagSoupDOMExtractor

Field Summary

Fields

Modifier and Type	Field and Description
static org.openrdf.model.URI	PAGE_CONTENT_AE_PROPERTY
static org.openrdf.model.URI	PAGE_CONTENT_CE_PROPERTY
static org.openrdf.model.URI	PAGE_CONTENT_DE_PROPERTY
static org.openrdf.model.URI	PAGE_CONTENT_LCE_PROPERTY

Constructor Summary

Constructors

Constructor and Description
HTMLScraperExtractor()

Method Summary

Methods

Modifier and Type	Method and Description
void	addTextExtractor(String name, org.openrdf.model.URI property, de.l3s.boilerpipe.BoilerpipeExtractor extractor)
ExtractorDescription	getDescription()
String[]	getTextExtractors()
void	run(ExtractionParameters extractionParameters, ExtractionContext extractionContext, InputStream inputStream, ExtractionResult extractionResult)
void	setStopAtFirstError(boolean b)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PAGE_CONTENT_DE_PROPERTY

public static final org.openrdf.model.URI PAGE_CONTENT_DE_PROPERTY

PAGE_CONTENT_AE_PROPERTY

public static final org.openrdf.model.URI PAGE_CONTENT_AE_PROPERTY

PAGE_CONTENT_LCE_PROPERTY

public static final org.openrdf.model.URI PAGE_CONTENT_LCE_PROPERTY

PAGE_CONTENT_CE_PROPERTY

public static final org.openrdf.model.URI PAGE_CONTENT_CE_PROPERTY

Constructor Detail

HTMLScraperExtractor

public HTMLScraperExtractor()

Method Detail

addTextExtractor

public void addTextExtractor(String name,
                    org.openrdf.model.URI property,
                    de.l3s.boilerpipe.BoilerpipeExtractor extractor)

getTextExtractors

public String[] getTextExtractors()

run

public void run(ExtractionParameters extractionParameters,
       ExtractionContext extractionContext,
       InputStream inputStream,
       ExtractionResult extractionResult)
         throws IOException,
                ExtractionException

Specified by:

run in interface Extractor<InputStream>

Throws:

IOException

ExtractionException

getDescription

public ExtractorDescription getDescription()

Specified by:

getDescription in interface Extractor<InputStream>

setStopAtFirstError

public void setStopAtFirstError(boolean b)

Specified by:

setStopAtFirstError in interface Extractor.ContentExtractor