Omgili, forum search, forums search, search forums, discussion search,discussions search, search discussions, board search, boards search, search boards
  Advanced Search

Custom Payload Analyzer and Query

Anonymous Wrote:

I'm working on providing advanced searching for annotated Medical
Documents (using UIMA). In the context of an annotated document, I
identify relevant medical terms, as well as the negation of certain terms.
Following what I've read and seen in Lucene examples, I've been able to
provide a search that takes into account the metadata contained in the
payload. Although very primitive, I've implemented a search which returns
the payloads (using PayloadSpanUtil), and then excludes those terms where
the payload doesn't meet the criteria.

Is the use of payloads I've described appropriate? Can I exclude/filter
the matching terms based on the payload within a query itself ? Are
there any examples that do this?

Cheers,
Kyley



On Mon, 6 Feb 2012 13:54:56 +0000, Ian Lea <...@gmail.com

Not sure if you got an answer to this or not. Don't recall seeing one
and gmail threading says not.

Sounds OK to me, although I'm not sure why you can't store the
metadata as a Document Field.

I think not. Could if the metadata was an indexed Field.

--
Ian.

On Mon, Jan 30, 2012 at 10:24 PM, <...@mmm.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java...@lucene.apache.org
For additional commands, e-mail: java...@lucene.apache.org

On Tue, 7 Feb 2012 10:11:26 +0100, Tommaso Teofili <...@gmail.com

2012/2/6 Ian Lea <...@gmail.com

What you may do is initially put your metadata inside the token type, then
use the TypeTokenFilter to filter out some of them then "copy“ them inside
the payloads using TypeAsPayloadTokenFilter and search with
PayloadSpanUtil/PayloadTermQuery/etc.

HTH,
Tommaso


On Tue, 7 Feb 2012 10:53:03 +0000, Ian Lea <...@gmail.com

How does searching with PayloadSpanUtil/PayloadTermQuery/etc work to
exclude/filter the matching terms based on the payload within a query
itself, the original question?

The javadocs for PayloadSpanUtil say that the IndexReader should only
contain doc of interest so not much use for a general query on a
normal index. PayloadTermQuery and PayloadNearQuery factor in the
value of the payloads using Similarity.scorePayload(...). Can you
return 0 from that to exclude docs?

--
Ian.

On Tue, Feb 7, 2012 at 9:11 AM, Tommaso Teofili
<...@gmail.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java...@lucene.apache.org
For additional commands, e-mail: java...@lucene.apache.org

Discussion Title: Custom Payload Analyzer and Query
Title Keywords: Custom  Payload  Analyzer  Query