udapi.block.ud.es.addmwt module

Block ud.es.AddMwt for heuristic detection of Spanish contractions.

According to the UD guidelines, contractions such as “del” = “de el” should be annotated using multi-word tokens.

Note that this block should be used only for converting legacy conllu files. Ideally a tokenizer should have already split the MWTs.

class udapi.block.ud.es.addmwt.AddMwt(verbpron=False, **kwargs)

Bases: AddMwt

Detect and mark MWTs (split them into words and add the words to the tree).

multiword_analysis(node)

Return a dict with MWT info or None if node does not represent a multiword token.

postprocess_mwt(mwt)

Optional postprocessing of newly created MWTs.