Java Mailing List Archive

http://www.java2.5341.com/

Home » java-user.lucene »

performance boost through multithreaded query processing?

pfaun

2008-10-22

Replies: Find Java Web Hosting

Author LoginPost Reply
Hello,

Currently we are facing the problem that some searches espacially fuzzy (term~0.6) wildcard searches (*term*) needs some time depending on the field-searchword combination (the more terms there are the more processing has to be done).
We improved the performance through caching the bitsets of the single fuzzy query/wildcard query.

Within our logs we can see that combined queries within a BooleanQuery are processed sequentially. So our question are: Does it make sense for you to parallelize the processing of the queries within a boolean query (with a restriction of the amount of prallel processed queries)? With the caches in mind it might be faster and the system is running on a multicore machine. Has anyone experience in prallelizing single query processing within a BooleanQuery?
Could there be drawbacks combining the results of the booelan clauses. At the end there should only be the bitsets connected to the terms, shouldn't it?

Thanks in advance

stephan



©2008 java2.5341.com - Jax Systems, LLC, U.S.A.