Has anyone got Ioda 1.3 fulltext search project working?

Every time I try version 1.3 it doesn't seem to find any words in a file that is indexed when I try a simple demo with it.

The project IODA is here: http://sourceforge.net/projects/ioda/files/

I make some sample files as follows:

words.txt:
test
the

file.txt:
This is a test file for joda to TEST. If the test works it should index these test words in this file.

And then I run the command:
joda -s myarchive words.txt file.txt

And then I run a query:
joda -q myarchive test

It returns no results of the word test. Any ideas? I compiled Ioda 1.3 it only after making some minor modifications to fix his procedure:=procedure assignment code.

Has anyone got Ioda 1.3 fulltext search project working?

I have it working.

fsb: >joda -q joda test
{test}
1
file.txt 128 0 499 0 0

It returns no results of the word test. Any ideas? I compiled Ioda 1.3 it only after making some minor modifications to fix his procedure:=procedure assignment code.

It took a little more than that with the latest fpc :-)

Meanwhile Darius Blaszijk and me created an own engine, which we hope to release soon. It will be used for the FPC docs (amongst other things). If you're interested and Darius agrees, I can send you a copy. It definitely works, I also use it in a commercial project to implement full-text-search on a firebird database. And it works with any FPC supported database as storage.

Michael.

It definitely works, I also use it in a commercial project to implement full-text-search on a firebird database.

Now that would be pretty awesome! :)

It is.
When I showed it to the customers, they were very impressed :-) (considering their question was 'we want to do like google search but on the database')

Michael.

It is. When I showed it to the customers, they were very impressed :-) (considering their question was 'we want to do like google search but on the database')

I've been wanting to improve the WebNews interface to the tiOPF and fpGUI news groups. I want to store the newsgroup archives in a firebird database, and allow web interface users to do full-text searches. I'll be eagerly waiting for the release of that FTS engine. ;-)

+1!!
I already talked about search text before, including JODA, but nobody had a complete solution... so, now I'm using a commercial lib do to this, but would be pretty awesome have this on Pascal code!

Marcos Douglas

Good. I got 1.2 working recently and had to edit the Config file and set fileref to 1 for it to work I think.

So you have 1.3 working? whereas only 1.2 worked for me. Hrm.

Interested!

L

I was reading recently that MySQL has fulltext on InnoDB built in.. don't know much about it but I came across that recently while googling. Firebird has no fulltext built in to it I guess, eh?

Also does the Ioda Joda have positions of your search words found? Or it just weighs the results and throws away any positions of the words. I.e. if the first instance of "searchterm" was found, does it record that position, or just throwaway position info? I was thinking of using it like google too, but having the positions of the search terms in the document would help to give a preview of the text like google. Or is there some other way joda does this? You could just parse the entire document without using Joda for that (separate utility) and use joda for the weighting only, but I wondered if joda had something built in to memorize where the search terms were located in the document.

No, it has not.

And if you look at the mysql implementation of fulltext, you'll know why. It's not very efficient.

I can't speak about joda features, but the solution I worked on with Darius saves the position and up to 500 bytes of 'context' (in the default configuration), so it can show a preview.

Michael.

I was reading recently that MySQL has fulltext on InnoDB built in.. don't know much about it but I came across that recently while googling. Firebird has no fulltext built in to it I guess, eh?

No, but there was an effort to enable Sphinx FTS for Firebird: http://www.firebirdsql.org/en/sphinx-full-text-search/

Have never looked at it though.