--bert_layer_aggregation aggregation_method


Specifies the aggregation method to apply over bert layers to produce a single vector representation. The layers to aggregate over are specified with --bert_layers.

Argument and Default Value

Default: concatenate. Currently accepts only one aggregation method.


This option is interpreted as a numpy method name, applied to the 0th axis.

Other Switches

Required Switches:

Optional Switches:

Example Commands

Creates a BERT feature table summed over the last two layers.

dlatkInterface.py -d dla_tutorial -t msgs -c user_id --add_bert --bert_layers 10 11 --bert_layer_aggregation sum