Usage examples are now extracted and attached to word senses

During the French “TALN” workshop, several French researchers asked me if I could add usage examples in the extracted data. This has been done in French, with the addition of a new property (named dbnary:exampleSource) that gives the source of the example when available. The French extractor still shows some problems when examples are splitter on several lines using te HTML br tag, but this is a minor issue (it appears a than sands times on a set of more than 252 thousands usage examples).

Read More

The Polish Language Extractor is now online

DBnary now contains extraction from 13 wiktionary language editions, with Polish being added today. Polish data is available in the very same format as other languages. The extraction work has been really tedious as the Polish language edition uses a rather different micro-structure for its pages. For instance, all lexical entries definitions are gathered in a unique definitions sections (with different part os speech gathered as sub sections). This leads to a more tricky extractor.

Read More

Setting up a virtuoso-opensource server to mirror DBnary data

This post details the steps necessary to install virtuoso server and bulk load wiktionary data. You’ll have to adapt for you own settings. Download and Compile virtuoso-opensource First, you’ll have to install several development libraries (this is for Debian): Copy sudo aptitude install autoconf autoheader automake bison flex gawk gperf libtool build-essential autotools-dev sudo aptitude install libssl-dev libxml2 libxml2-dev imagemagick libreadline-dev libldap-dev libmagickwand5 libmagickwand-dev libwbxml2-dev libwbxml2-0 Then, clone dbpedia and virtuoso-opensource git repo, setup the i18n version of dbpedia (not sure this is really useful…), configure, make, make install, pour coffee…

Read More

Translations are now connected to word senses

A translation is supposed to connect a source word sense to a target word sense. However, current DBnary data connects a lexical entry to a target string. By using available glosses, we are able to connect translations to their source word sense. We evaluate the accuracy of these relations to over 80%.

Read More

DBnary is now supporting 12 language editions

With the addition of Bulgarian and Spanish, the DBnary data now contains 12 language editions. More to come we hope !

Read More

Finnish translation extractor improved

The Finnish language edition recently used a new way to encode translations. Hence, the extractor’s performance was reduced (as may be seen in the Finnish Stats). The extrator has been adapted to deal with the new translation encoding and extraction rate is now back to normal.

Read More

Japanese extractor added

The Japanese wiktionary language edition is now added to dbnary. It took me quite some time to setup as the Japanese edition is quite inconsistent. As usual the data is available in the Download area. SPARQL access will be available later.

Read More

Several statistics available

Statistics are available in the “Dataset” page. They are currently displaying the number of elements, lexical relations and Translations from/to the extracted languages. These stats are updated daily to reflect new extracted dumps. More to come…

Read More

Turkish extractor added

With the introduction of the new Turkish extractor, dbnary now offers 9 language editions.

Read More

Portuguese extractor enhanced

The Portuguese wiktionary extractor has been considerably enhanced. After adapted it to a new architecture using GWT-Wiki library, I fixed several bugs in the translation extraction section. Moreover, homonymous entries were not extracted correctly. Hence since July 9th dump, the number of extracted entries and translations has increased.

Read More
Categories
Tags