Class WiktionaryExtractor

java.lang.Object

org.getalp.dbnary.languages.AbstractWiktionaryExtractor

org.getalp.dbnary.languages.eng.WiktionaryExtractor

All Implemented Interfaces:

IWiktionaryExtractor

public class WiktionaryExtractor
extends AbstractWiktionaryExtractor

Author:

serasset, pantaleo

Field Summary

Fields

Modifier and Type	Field	Description
protected CombinedWikiModel	combinedExpander

Fields inherited from class AbstractWiktionaryExtractor

debutOrfinDecomPatternString, expander, NON_STANDARD_LANGUAGE_MAPPINGS, pageContent, wdh, wi, wiktionaryPageName, xmlCommentPattern

Constructor Summary

Constructors

Constructor	Description
WiktionaryExtractor(IWiktionaryDataHandler wdh)

Method Summary

Modifier and Type	Method	Description
Set<org.apache.commons.lang3.tuple.Pair<org.apache.jena.rdf.model.Property, org.apache.jena.rdf.model.RDFNode>>	expandCitation(String example)
Set<org.apache.commons.lang3.tuple.Pair<org.apache.jena.rdf.model.Property, org.apache.jena.rdf.model.RDFNode>>	expandExample(String example)
void	extractData()
org.apache.jena.rdf.model.Resource	extractDefinition(String definition, int defLevel)	Extract and register a new wordsense in the current lexical entry.
protected void	extractDerived(int blockStart, int end)
protected void	extractDescendants(int blockStart, int end)
protected void	extractEtymology(int blockStart, int end)
org.apache.jena.rdf.model.Resource	extractExample(String example)
protected void	extractLanguageData(ISO639_3.Lang lg, WikiText.WikiContent content)
protected void	extractNyms(String synRelation, WikiText.WikiContent blockContent)
protected void	extractOrthoAlt(WikiText.WikiContent blockContent)
protected void	extractPron(WikiText.WikiContent pronContent)
boolean	filterOutPage(String pagename)
void	postProcessData(String dumpFileVersion)
void	setWiktionaryIndex(WiktionaryPageSource wi)
protected void	setWiktionaryPageName(String wiktionaryPageName)

Methods inherited from class AbstractWiktionaryExtractor

cleanUpMarkup, cleanUpMarkup, computeRegionEnd, computeStatistics, convertToHumanReadableForm, extractData, extractDefinition, extractDefinitions, extractExample, extractNyms, extractOrthoAlt, getWiktionaryPageName, populateMetadata, postProcessModel, removeXMLComments, stripParentheses, validateAndStandardizeLanguageCode

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

combinedExpander

protected CombinedWikiModel combinedExpander

Constructor Details

WiktionaryExtractor

public WiktionaryExtractor(IWiktionaryDataHandler wdh)

Method Details

setWiktionaryIndex

public void setWiktionaryIndex(WiktionaryPageSource wi)

Specified by:

setWiktionaryIndex in interface IWiktionaryExtractor

Overrides:

setWiktionaryIndex in class AbstractWiktionaryExtractor

setWiktionaryPageName

protected void setWiktionaryPageName(String wiktionaryPageName)

Overrides:

setWiktionaryPageName in class AbstractWiktionaryExtractor

filterOutPage

public boolean filterOutPage(String pagename)

Overrides:

filterOutPage in class AbstractWiktionaryExtractor

Parameters:

pagename - the name of the page

Returns:

returns true iff the pagename should be ignored during extraction.

extractData

public void extractData()

Specified by:

extractData in class AbstractWiktionaryExtractor

extractLanguageData

protected void extractLanguageData(ISO639_3.Lang lg,
 WikiText.WikiContent content)

extractDefinition

public org.apache.jena.rdf.model.Resource extractDefinition(String definition,
 int defLevel)

Description copied from class: AbstractWiktionaryExtractor

Extract and register a new wordsense in the current lexical entry.

Overrides:

extractDefinition in class AbstractWiktionaryExtractor

Parameters:

definition - the definition string

defLevel - the level at which the word sense is defined (sub-senses vs senses)

Returns:

the resource representing the new word sense

extractExample

public org.apache.jena.rdf.model.Resource extractExample(String example)

Overrides:

extractExample in class AbstractWiktionaryExtractor

expandCitation

public Set<org.apache.commons.lang3.tuple.Pair<org.apache.jena.rdf.model.Property, org.apache.jena.rdf.model.RDFNode>> expandCitation(String example)

expandExample

public Set<org.apache.commons.lang3.tuple.Pair<org.apache.jena.rdf.model.Property, org.apache.jena.rdf.model.RDFNode>> expandExample(String example)

extractEtymology

protected void extractEtymology(int blockStart,
 int end)

extractDerived

protected void extractDerived(int blockStart,
 int end)

extractDescendants

protected void extractDescendants(int blockStart,
 int end)

extractNyms

protected void extractNyms(String synRelation,
 WikiText.WikiContent blockContent)

extractPron

protected void extractPron(WikiText.WikiContent pronContent)

extractOrthoAlt

protected void extractOrthoAlt(WikiText.WikiContent blockContent)

postProcessData

public void postProcessData(String dumpFileVersion)

Specified by:

postProcessData in interface IWiktionaryExtractor

Overrides:

postProcessData in class AbstractWiktionaryExtractor