--lex_log

Switch

--lex_log

Description

Applies a log transformation (log(x + 1)) to the final lexicon/category value produced by --add_lex_table (or --add_corp_lex_table), as opposed to --log which transforms the underlying word/ngram frequencies that feed into that value.

Argument and Default Value

No argument. Boolean switch, default: False (no transform applied to the lexicon value).

Details

Verified: folds a suffix into the lexicon name portion of the table, joined with an underscore rather than a $, e.g. feat$cat_met_a30_2000_cp_w_16to2$msgs$user_id for a weighted lexicon. The number is int(log(16 + 1)) — truncated, not rounded — which is 2, not 3. See --lex_sqrt for the general naming mechanism.

Other Switches

Required Switches:

• --add_lex_table or --add_corp_lex_table

• -l LEX_TABLE

Optional Switches:

• --lex_sqrt, --lex_boolean, --lex_anscombe (mutually exclusive alternatives — only one lexicon value transform can be active at a time)

Example Commands

dlatkInterface.py -d dla_tutorial -t msgs -c user_id --add_lex_table -l met_a30_2000_cp --weighted_lexicon --lex_log