Class WiktionaryExtractor

java.lang.Object

org.getalp.dbnary.languages.AbstractWiktionaryExtractor

org.getalp.dbnary.languages.deu.WiktionaryExtractor

All Implemented Interfaces:

IWiktionaryExtractor

public class WiktionaryExtractor
extends AbstractWiktionaryExtractor

Field Summary

Fields

Modifier and Type	Field	Description
protected static final HashMap<String, org.apache.jena.rdf.model.Resource>	definitionSenseLink
protected ExpandAllWikiModel	exampleExpander
protected static final Pattern	germanCitationPattern
protected static final String	germanCitationPatternString
protected static final Pattern	germanDefinitionPattern
protected static final String	germanDefinitionPatternString
protected static final Pattern	germanExamplePattern
protected static final String	germanExamplePatternString
protected static final String	germanExamplesuspectString
protected static final Pattern	germanNymLinePattern
protected static final String	germanNymLinePatternString
protected org.apache.jena.rdf.model.Resource	globalGloss
protected static final HashSet<String>	ignorableSectionMarkers
protected static final Pattern	languageSectionPattern
protected static final String	languageSectionPatternString
protected static final Pattern	macroOrPOSPattern
protected static final String	macroOrPOSPatternString
protected GermanMorphologyExtractor	morphologyExtractor
protected static final String	multilineMacroPatternString
protected static final HashSet<String>	nymMarkers
protected static final HashMap<String,String>	nymMarkerToNymName
protected static final String	partOfSpeechPatternString
protected static final Pattern	posHeaderElementsPattern
protected static final String	posHeaderElementsPatternString
protected static final Pattern	pronPattern
protected static final String	pronPatternString
protected static final String	senseNumberOrRangeRegExp
protected static final String	senseNumberRegExp
protected static final String	subSection4PatternString
protected static final Pattern	suspectline

Fields inherited from class AbstractWiktionaryExtractor

debutOrfinDecomPatternString, expander, NON_STANDARD_LANGUAGE_MAPPINGS, pageContent, wdh, wi, wiktionaryPageName, xmlCommentPattern

Constructor Summary

Constructors

Constructor	Description
WiktionaryExtractor(IWiktionaryDataHandler wdh)

Method Summary

Modifier and Type	Method	Description
void	extractData()
void	extractDataOld()
protected void	extractDefinitions(int startOffset, int endOffset)
protected void	extractExamples(int startOffset, int endOffset)
protected void	extractNyms(String synRelation, int startOffset, int endOffset)
protected void	extractPron(int startOffset, int endOffset)
String	getLanguageCode(WikiText.Token t)
void	setWiktionaryIndex(WiktionaryPageSource wi)
protected void	setWiktionaryPageName(String wiktionaryPageName)

Methods inherited from class AbstractWiktionaryExtractor

cleanUpMarkup, cleanUpMarkup, computeRegionEnd, computeStatistics, convertToHumanReadableForm, extractData, extractDefinition, extractDefinition, extractExample, extractExample, extractOrthoAlt, filterOutPage, getWiktionaryPageName, populateMetadata, postProcessData, postProcessModel, removeXMLComments, stripParentheses, validateAndStandardizeLanguageCode

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

senseNumberRegExp

protected static final String senseNumberRegExp

See Also:

• Constant Field Values

senseNumberOrRangeRegExp

protected static final String senseNumberOrRangeRegExp

See Also:

• Constant Field Values

languageSectionPatternString

protected static final String languageSectionPatternString

See Also:

• Constant Field Values

partOfSpeechPatternString

protected static final String partOfSpeechPatternString

See Also:

• Constant Field Values

subSection4PatternString

protected static final String subSection4PatternString

See Also:

• Constant Field Values

germanCitationPatternString

protected static final String germanCitationPatternString

See Also:

• Constant Field Values

germanExamplesuspectString

protected static final String germanExamplesuspectString

See Also:

• Constant Field Values

germanDefinitionPatternString

protected static final String germanDefinitionPatternString

See Also:

• Constant Field Values

germanExamplePatternString

protected static final String germanExamplePatternString

See Also:

• Constant Field Values

germanNymLinePatternString

protected static final String germanNymLinePatternString

See Also:

• Constant Field Values

pronPatternString

protected static final String pronPatternString

See Also:

• Constant Field Values

exampleExpander

protected ExpandAllWikiModel exampleExpander

morphologyExtractor

protected GermanMorphologyExtractor morphologyExtractor

macroOrPOSPatternString

protected static final String macroOrPOSPatternString

posHeaderElementsPatternString

protected static final String posHeaderElementsPatternString

languageSectionPattern

protected static final Pattern languageSectionPattern

germanDefinitionPattern

protected static final Pattern germanDefinitionPattern

germanExamplePattern

protected static final Pattern germanExamplePattern

germanCitationPattern

protected static final Pattern germanCitationPattern

germanNymLinePattern

protected static final Pattern germanNymLinePattern

suspectline

protected static final Pattern suspectline

multilineMacroPatternString

protected static final String multilineMacroPatternString

macroOrPOSPattern

protected static final Pattern macroOrPOSPattern

posHeaderElementsPattern

protected static final Pattern posHeaderElementsPattern

ignorableSectionMarkers

protected static final HashSet<String> ignorableSectionMarkers

nymMarkers

protected static final HashSet<String> nymMarkers

nymMarkerToNymName

protected static final HashMap<String,String> nymMarkerToNymName

definitionSenseLink

protected static final HashMap<String, org.apache.jena.rdf.model.Resource> definitionSenseLink

pronPattern

protected static final Pattern pronPattern

globalGloss

protected org.apache.jena.rdf.model.Resource globalGloss

Constructor Details

WiktionaryExtractor

public WiktionaryExtractor(IWiktionaryDataHandler wdh)

Method Details

setWiktionaryIndex

public void setWiktionaryIndex(WiktionaryPageSource wi)

Specified by:

setWiktionaryIndex in interface IWiktionaryExtractor

Overrides:

setWiktionaryIndex in class AbstractWiktionaryExtractor

setWiktionaryPageName

protected void setWiktionaryPageName(String wiktionaryPageName)

Overrides:

setWiktionaryPageName in class AbstractWiktionaryExtractor

extractData

public void extractData()

Specified by:

extractData in class AbstractWiktionaryExtractor

getLanguageCode

public String getLanguageCode(WikiText.Token t)

extractDataOld

public void extractDataOld()

extractNyms

protected void extractNyms(String synRelation,
 int startOffset,
 int endOffset)

Overrides:

extractNyms in class AbstractWiktionaryExtractor

extractPron

protected void extractPron(int startOffset,
 int endOffset)

extractDefinitions

protected void extractDefinitions(int startOffset,
 int endOffset)

Overrides:

extractDefinitions in class AbstractWiktionaryExtractor

extractExamples

protected void extractExamples(int startOffset,
 int endOffset)