05 Dec 2006 00:52:44 UTC
- Distribution: KinoSearch
- Source (raw)
- Browse (raw)
- How to Contribute
- Issues (5)
- Testers (34 / 3 / 0)
- KwaliteeBus factor: 0
- License: perl_5
- Activity24 month
- Download (219.83KB)
- MetaCPAN Explorer
- Subscribe to distribution
- This version
- Latest versionCREAMYG Marvin Humphreyand 1 contributors
- Marvin Humphrey <marvin at rectangular dot com>
KinoSearch::Analysis::Analyzer - base class for analyzers
# abstract base class -- you probably want PolyAnalyzer, not this.
In KinoSearch, an Analyzer is a filter which processes text, transforming it from one form into another. For instance, an analyzer might break up a long text into smaller pieces (Tokenizer), or it might convert text to lowercase (LCNormalizer).
$token_batch = $analyzer->analyze($token_batch);
All Analyzer subclasses provide an
analyze()takes a single TokenBatch as input, and it returns a TokenBatch, either the same one (probably transformed in some way), or a new one.
Copyright 2005-2006 Marvin Humphrey
See KinoSearch version 0.15.