[plug] importing a large text database for fast search

Carl Gherardi carl.gherardi at gmail.com
Mon Sep 5 11:11:40 WST 2011


On Sun, Sep 4, 2011 at 12:56 PM, Michael Holland
<michael.holland at gmail.com> wrote:
> Thanks folks. Perl frontend with SQL datbase it is then.
> I'll go look at DBD::SQLite and DBIx::Class  My PERL is rusty, but I like it.

For only 250k records you are probably ok, but SQLite DBs start to
become a bit unwieldy and slow once you hit the 2G mark.

My experience is with data mining rather than full test search so
ymmv, but i'd look at Lucene, MySQL or Postgres.

Carl G



More information about the plug mailing list