Kaiko's going evasive

The recent failure of kaiko web server was due to a flow of SPARQL requests to DBnary. A client launched 46 Million requests (in less than a week) to the sparql server in a very brief delay, leading to an overflow of the log file that filled up the root partition and broke the server. May I remind everybody that the DBnary data is available easily by downloading turtle files that you may use either directly using adequate libraries (e.g. JENA in java or others in other programming languages) or upload in a local dbnary mirror.

Read More

Setting up a virtuoso-opensource server to mirror DBnary data

This post details the steps necessary to install virtuoso server and bulk load wiktionary data. You’ll have to adapt for you own settings. Download and Compile virtuoso-opensource First, you’ll have to install several development libraries (this is for Debian): Copy sudo aptitude install autoconf autoheader automake bison flex gawk gperf libtool build-essential autotools-dev sudo aptitude install libssl-dev libxml2 libxml2-dev imagemagick libreadline-dev libldap-dev libmagickwand5 libmagickwand-dev libwbxml2-dev libwbxml2-0 Then, clone dbpedia and virtuoso-opensource git repo, setup the i18n version of dbpedia (not sure this is really useful…), configure, make, make install, pour coffee…

Read More