Language-specific tests in validator

[AngledLuffa]

For example: CCONJ allowed as advmod. I see it's very common in Basque, for example, but I would expect most languages would want that validated against.

[dan-zeman]

Various language-specific tests (level 5 validation) are on my long-term todo list. There is no deadline for this and other things had higher priority so far, but I definitely want to look into it at some point. In the meantime, various people including myself use their own language-specific validators on top of the official one; but the difference is that those validators are their own tools, passing the tests is optional and nothing will prevent people from releasing data that don't pass the tests.

[nschneid]

Are we sure that the CCONJ/advmod combination is correct for Basque? Could it be a conversion artifact?

I would expect most languages would want that validated against.

Nice prepositional passive BTW :)

[AngledLuffa]

This particular thing is not unique to Basque, that's just where my grep was when I hit ctrl-C

grep ".*CCONJ.*advmod" */* | cut -d ":" -f1 | uniq
UD_Abkhaz-AbNC
UD_Albanian-STAF
UD_Albanian-TSA
UD_Alemannic-UZH
UD_Ancient_Greek-Perseus
UD_Ancient_Greek-PROIEL
UD_Ancient_Greek-PTNK
UD_Arabic-PADT
UD_Armenian-ArmTDP
UD_Armenian-BSUT
UD_Basque-BDT
UD_Belarusian-HSE
UD_Bhojpuri-BHTB
UD_Buryat-BDT
UD_Cantonese-HK
UD_Catalan-AnCora
.....

It even happens in English-LinES when but is used in a way similar to however:

# sent_id = en_lines-ud-train-doc2-449
# text = But from the way the light was coming through the windows, it seemed to be almost noon.
1       But     but     CCONJ   _       _       4       advmod  _       _
2       from    from    ADP     _       _       4       case    _       _
3       the     the     DET     DEF     Definite=Def|PronType=Art       4       det     _       _
4       way     way     NOUN    SG-NOM  Number=Sing     14      obl     _       _
5       the     the     DET     DEF     Definite=Def|PronType=Art       6       det     _       _
6       light   light   NOUN    SG-NOM  Number=Sing     8       nsubj   _       _
7       was     be      AUX     PAST    Mood=Ind|Number=Sing|Person=1|Tense=Past|VerbForm=Fin   8       aux     _       _
8       coming  come    VERB    ING     Tense=Pres|VerbForm=Part        4       acl:relcl       _       _
9       through through ADP     _       _       11      case    _       _
10      the     the     DET     DEF     Definite=Def|PronType=Art       11      det     _       _
11      windows window  NOUN    PL-NOM  Number=Plur     8       obl     _       SpaceAfter=No

Nice prepositional passive BTW :)

We should make a treebank of "weird stuff John says" and see how that affects the AIs

[nschneid]

It even happens in English-LinES when but is used in a way similar to however:

Sentence-initial "and"/"but" should be cc: https://universaldependencies.org/u/dep/cc.html

[AngledLuffa]

We should make the validator catch that kind of thing! Here, let me file an issue about it: #117