Class WiktionaryExtractor

java.lang.Object

org.getalp.dbnary.languages.AbstractWiktionaryExtractor

org.getalp.dbnary.languages.gle.WiktionaryExtractor

All Implemented Interfaces:

IWiktionaryExtractor

public class WiktionaryExtractor
extends AbstractWiktionaryExtractor

Author:

Arnaud Alet 13/07/2023

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	WiktionaryExtractor.FormBuilder
protected static class	WiktionaryExtractor.LexicalBuilder

Field Summary

Fields

Modifier and Type	Field	Description
protected String	currentLanguage
protected ExpandAllWikiModel	templateRender

Fields inherited from class AbstractWiktionaryExtractor

debutOrfinDecomPatternString, expander, NON_STANDARD_LANGUAGE_MAPPINGS, pageContent, wdh, wi, wiktionaryPageName, xmlCommentPattern

Constructor Summary

Constructors

Constructor	Description
WiktionaryExtractor(IWiktionaryDataHandler wdh)

Method Summary

Modifier and Type	Method	Description
static void	addFieldExtractedT(String name)
static void	addFieldT(String temp)
static void	addIgnoredL(String lang)
static void	addIgnoredS(String ignored)
static void	addIgnoredT(String ignored)
void	extractData()
protected void	extractEtymology(PageIterator page)
protected void	extractLexicalField(PageIterator page)
protected void	extractNothing(PageIterator page)
protected void	extractPrononciation(PageIterator page)
protected void	extractSynonymes(WikiText.Template temp, WiktionaryExtractor.LexicalBuilder builder)
protected void	extractTranslation(PageIterator page)
protected boolean	insideField(PageIterator page)
protected void	pageAnalyzer(PageIterator page)
protected String	parseLanguageTemplate(WikiText.Template template)
protected String	render(String content)
protected void	saveCanonicalForm(WiktionaryExtractor.LexicalBuilder builder)
protected void	saveToDataHandler(WiktionaryExtractor.LexicalBuilder builder)
void	setWiktionaryIndex(WiktionaryPageSource wi)
protected void	setWiktionaryPageName(String wiktionaryPageName)
protected void	switchCurrentLanguage(String nextLanguage)
protected void	templateDispatcher(WikiText.Token token, PageIterator page)
protected static String	toText(WikiText.WikiContent content)
protected String	url()

Methods inherited from class AbstractWiktionaryExtractor

cleanUpMarkup, cleanUpMarkup, computeRegionEnd, computeStatistics, convertToHumanReadableForm, extractData, extractDefinition, extractDefinition, extractDefinitions, extractExample, extractExample, extractNyms, extractOrthoAlt, filterOutPage, getWiktionaryPageName, populateMetadata, postProcessData, postProcessModel, removeXMLComments, stripParentheses, validateAndStandardizeLanguageCode

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

currentLanguage

protected String currentLanguage

templateRender

protected ExpandAllWikiModel templateRender

Constructor Details

WiktionaryExtractor

public WiktionaryExtractor(IWiktionaryDataHandler wdh)

Method Details

setWiktionaryIndex

public void setWiktionaryIndex(WiktionaryPageSource wi)

Specified by:

setWiktionaryIndex in interface IWiktionaryExtractor

Overrides:

setWiktionaryIndex in class AbstractWiktionaryExtractor

setWiktionaryPageName

protected void setWiktionaryPageName(String wiktionaryPageName)

Overrides:

setWiktionaryPageName in class AbstractWiktionaryExtractor

extractData

public void extractData()

Specified by:

extractData in class AbstractWiktionaryExtractor

pageAnalyzer

protected void pageAnalyzer(PageIterator page)

switchCurrentLanguage

protected void switchCurrentLanguage(String nextLanguage)

templateDispatcher

protected void templateDispatcher(WikiText.Token token,
 PageIterator page)

extractLexicalField

protected void extractLexicalField(PageIterator page)

saveToDataHandler

protected void saveToDataHandler(WiktionaryExtractor.LexicalBuilder builder)

saveCanonicalForm

protected void saveCanonicalForm(WiktionaryExtractor.LexicalBuilder builder)

extractSynonymes

protected void extractSynonymes(WikiText.Template temp,
 WiktionaryExtractor.LexicalBuilder builder)

extractTranslation

protected void extractTranslation(PageIterator page)

extractEtymology

protected void extractEtymology(PageIterator page)

extractPrononciation

protected void extractPrononciation(PageIterator page)

extractNothing

protected void extractNothing(PageIterator page)

insideField

protected boolean insideField(PageIterator page)

toText

protected static String toText(WikiText.WikiContent content)

parseLanguageTemplate

protected String parseLanguageTemplate(WikiText.Template template)

render

protected String render(String content)

url

protected String url()

addIgnoredT

public static void addIgnoredT(String ignored)

addIgnoredS

public static void addIgnoredS(String ignored)

addFieldT

public static void addFieldT(String temp)

addFieldExtractedT

public static void addFieldExtractedT(String name)

addIgnoredL

public static void addIgnoredL(String lang)