NAME

gen_word_break_data.pl - Generate word break table and tests

SYNOPSIS

    perl gen_word_break_data.pl [-c] UCD_SRC_DIR

DESCRIPTION

This script generates the tables to lookup Unicode word break properties for the StandardTokenizer. It also converts the word break test suite in the UCD to JSON.

UCD_SRC_DIR should point to a directory containing the files WordBreakProperty.txt, WordBreakTest.txt, and DerivedCoreProperties.txt from the Unicode Character Database available at http://www.unicode.org/Public/6.3.0/ucd/.

OUTPUT FILES

    modules/unicode/ucd/WordBreak.tab
    modules/unicode/ucd/WordBreakTest.json

OPTIONS

-c

Show total table size for different shift values

To install Lucy, copy and paste the appropriate command in to your terminal.

cpanm

cpanm Lucy

CPAN shell

perl -MCPAN -e shell
install Lucy

For more information on module installation, please visit the detailed CPAN module installation guide.

As a valued partner and proud supporter of MetaCPAN, StickerYou is happy to offer a 10% discount on all Custom Stickers, Business Labels, Roll Labels, Vinyl Lettering or Custom Decals. StickerYou.com is your one-stop shop to make your business stick. Use code METACPAN10 at checkout to apply your discount.

	Global
`s`	Focus search bar
`?`	Bring up this help dialog

	GitHub
`g` `p`	Go to pull requests
`g` `i`	go to github issues (only if github is preferred repository)

	POD
`g` `a`	Go to author
`g` `c`	Go to changes
`g` `i`	Go to issues
`g` `d`	Go to dist
`g` `r`	Go to repository/SCM
`g` `s`	Go to source
`g` `b`	Go to file browse

	Search terms
module: (e.g. module:Plugin)
distribution: (e.g. distribution:Dancer auth)
author: (e.g. author:SONGMU Redis)
version: (e.g. version:1.00)

NAME

SYNOPSIS

DESCRIPTION

OUTPUT FILES

OPTIONS

-c

Module Install Instructions