--no_unicode

Switch

--no_unicode

Description

If set then all CHAR, VARCHAR and TEXT fields in MySQL will be treated as plain strings rather than unicode. This applies both to reading from MySQL and to writing output (MySQL, csv, html, wordclouds). When printing wordclouds with this flag, all features with non-ASCII characters will be ignored.

Argument and Default Value

No argument. Sets useunicode to False; default (flag absent) is True. This flag also sets the encoding to latin1, which can be overridden with --encoding.

Details

Unicode is the default and no flag is needed for normal use — only use this flag to turn it off. If set during feature extraction, all non-ASCII characters will be removed from the extracted features.

Other Switches

Optional Switches:

• --encoding (to override the resulting latin1 encoding)

Example Commands

Using the packaged dla_tutorial dataset (see Differential Language Analysis (DLA) Tutorial): writes all output to HTML and CSV files as plain (non-unicode) strings.

dlatkInterface.py -d dla_tutorial -t msgs -c user_id -f 'feat$cat_LIWC2007$msgs$user_id$16to16' \
--outcome_table blog_outcomes --group_freq_thresh 500 \
--outcomes age gender --output_name xxx_output --rmatrix --sort --csv --no_unicode