udapi.block.ud.cs.addmwt module

Block ud.cs.AddMwt for heuristic detection of multi-word tokens.

class udapi.block.ud.cs.addmwt.AddMwt(zones='all', if_empty_tree='process', **kwargs)[source]

Bases: AddMwt

Detect and mark MWTs (split them into words and add the words to the tree).

multiword_analysis(node)[source]

Return a dict with MWT info or None if node does not represent a multiword token.

postprocess_mwt(mwt)[source]

Optional postprocessing of newly created MWTs.