Class WiktionaryExtractor

java.lang.Object

org.getalp.dbnary.languages.AbstractWiktionaryExtractor

org.getalp.dbnary.languages.cat.WiktionaryExtractor

All Implemented Interfaces:

IWiktionaryExtractor

public class WiktionaryExtractor
extends AbstractWiktionaryExtractor

Author:

Arnaud Alet 13/07/2023

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	WiktionaryExtractor.FormBuilder
static class	WiktionaryExtractor.PronBuilder

Field Summary

Fields

Modifier and Type	Field	Description
protected final WiktionaryDataHandler	catwdh
static final Set<String>	ignoredSection
static final Set<String>	ignoredTemplate
static final Set<String>	ignoredText
protected ExpandAllWikiModelCat	templateRender

Fields inherited from class AbstractWiktionaryExtractor

debutOrfinDecomPatternString, expander, NON_STANDARD_LANGUAGE_MAPPINGS, pageContent, wdh, wi, wiktionaryPageName, xmlCommentPattern

Constructor Summary

Constructors

Constructor	Description
WiktionaryExtractor(IWiktionaryDataHandler wdh)

Method Summary

Modifier and Type	Method	Description
static void	addIgnoredSec(String ignored)
static void	addIgnoredT(String ignored)
static void	addIgnoredText(String text)
void	extractData()
void	extractDefinitionField(PageIterator field)
void	extractDefinitionLine(WikiText.Token line)
void	extractExpressions(PageIterator section)
void	extractLanguageSection(String currentLanguage, PageIterator sec)
void	extractLexicalEntry(WikiText.WikiSection section)
void	extractNym(String relation, PageIterator field)
void	extractNymWithPage(PageIterator field)
void	extractPrononciation(WikiText.Template template)
void	extractTranslation(PageIterator section)
static String	getSectionTitle(WikiText.WikiSection section)
boolean	isIgnoredSection(WikiText.WikiSection section)
static boolean	isNameEquals(String name, WikiText.WikiSection section)
void	pageAnalyser(PageIterator page)
String	parseLanguage(WikiText.Heading heading)
protected String	render(String content)
void	setWiktionaryIndex(WiktionaryPageSource wi)
protected void	setWiktionaryPageName(String wiktionaryPageName)
void	skipSimpleText(PageIterator section)
void	skipUntilNextSection(PageIterator sec)
protected static String	toText(WikiText.WikiContent content)
protected String	url()

Methods inherited from class AbstractWiktionaryExtractor

cleanUpMarkup, cleanUpMarkup, computeRegionEnd, computeStatistics, convertToHumanReadableForm, extractData, extractDefinition, extractDefinition, extractDefinitions, extractExample, extractExample, extractNyms, extractOrthoAlt, filterOutPage, getWiktionaryPageName, populateMetadata, postProcessData, postProcessModel, removeXMLComments, stripParentheses, validateAndStandardizeLanguageCode

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

ignoredTemplate

public static final Set<String> ignoredTemplate

ignoredSection

public static final Set<String> ignoredSection

ignoredText

public static final Set<String> ignoredText

catwdh

protected final WiktionaryDataHandler catwdh

templateRender

protected ExpandAllWikiModelCat templateRender

Constructor Details

WiktionaryExtractor

public WiktionaryExtractor(IWiktionaryDataHandler wdh)

Method Details

setWiktionaryIndex

public void setWiktionaryIndex(WiktionaryPageSource wi)

Specified by:

setWiktionaryIndex in interface IWiktionaryExtractor

Overrides:

setWiktionaryIndex in class AbstractWiktionaryExtractor

setWiktionaryPageName

protected void setWiktionaryPageName(String wiktionaryPageName)

Overrides:

setWiktionaryPageName in class AbstractWiktionaryExtractor

extractData

public void extractData()

Specified by:

extractData in class AbstractWiktionaryExtractor

pageAnalyser

public void pageAnalyser(PageIterator page)

extractLanguageSection

public void extractLanguageSection(String currentLanguage,
 PageIterator sec)

extractLexicalEntry

public void extractLexicalEntry(WikiText.WikiSection section)

skipSimpleText

public void skipSimpleText(PageIterator section)

extractTranslation

public void extractTranslation(PageIterator section)

extractExpressions

public void extractExpressions(PageIterator section)

extractNymWithPage

public void extractNymWithPage(PageIterator field)

extractNym

public void extractNym(String relation,
 PageIterator field)

extractDefinitionField

public void extractDefinitionField(PageIterator field)

extractDefinitionLine

public void extractDefinitionLine(WikiText.Token line)

extractPrononciation

public void extractPrononciation(WikiText.Template template)

skipUntilNextSection

public void skipUntilNextSection(PageIterator sec)

parseLanguage

public String parseLanguage(WikiText.Heading heading)

render

protected String render(String content)

url

protected String url()

toText

protected static String toText(WikiText.WikiContent content)

addIgnoredT

public static void addIgnoredT(String ignored)

addIgnoredText

public static void addIgnoredText(String text)

addIgnoredSec

public static void addIgnoredSec(String ignored)

isIgnoredSection

public boolean isIgnoredSection(WikiText.WikiSection section)

getSectionTitle

public static String getSectionTitle(WikiText.WikiSection section)

isNameEquals

public static boolean isNameEquals(String name,
 WikiText.WikiSection section)