h @ddlZddlmZGddejZdS)N)AnnotationTaskc0eZdZdZdZdZdZdZdZdS)TestDisagreementzN Class containing unit tests for nltk.metrics.agreement.Disagreement. c|gd}t|}||ddS)z} Simple test, based on https://github.com/foolswood/krippendorffs_alpha/raw/master/krippendorff.pdf. )coder1dress1YEScoder2r NOcoder3r r rdress2r r rr )rdress3r 燼1UUտNrassertAlmostEqualalphaselfdataannotation_tasks h/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/nltk/test/unit/test_disagreement.py test_easyzTestDisagreement.test_easy sJ    ).. 4466 CCCCCc|gd}t|}||ddS)z Same simple test with 1 rating removed. Removal of that rating should not matter: K-Apha ignores items with only 1 rating. )rr rrrrNrrs r test_easy2zTestDisagreement.test_easy2sJ    ).. 4466 CCCCCrcgd}t|}||dgd}t|}||ddS)zD If expected disagreement is 0, K-Apha should be 1. )r1r r#r$r2)r r'r(g?)r"r%r&Nrrs r test_easy3zTestDisagreement.test_easy3+s    ).. 4466<<<KKK(.. 4466<<<<rrrrsxDDD DDD ==="1H1H1Hf1H1H1H1H1Hrr)unittestnltk.metrics.agreementrTestCaserrCrrrGsk111111ZHZHZHZHZHx(ZHZHZHZHZHr