hu ddlZddlZddlmZddlmZmZmZddlZ ddl Z ddl m Z ddl mZddlmZddlmZmZddlmZdd lmZdd lmZmZmZmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.dd l/m0Z0dd l1m2Z2dd l3m4Z4m5Z5ddl6m7Z7ddl8m9Z9ddl:m;Z;mZ>m?Z?m@Z@ddlAmBZBddlCmDZDddZEdZFdZGe jHIdddde jJgdZKdZLdZMe@dZNe@dZOe@dZPd ZQe jHId!gd"e jRgd#gd$gd%gd&gfgd'gd(fgd)ZSe jHId!gd*e jRgd&gd&gd+gd+gd,gfgd-gd.fgd/ZTd0ZUd1ZVd2ZWd3ZXd4ZYd5ZZe jHId6gd7d8Z[d9Z\e jHId:e jRgd;e jRgd;d<d=fe jRgd>e jRgd>d<d?fe jRgd>e jRgd;d<d@fe jRgd>e jRgdAd<dBfe jRgd;e jRgd>d<dCfgdDZ]e jHIdEe jRgdFe jRgdGd<dHfgdIZ^dJZ_dKZ`dLZae jHIddde jJge jHIdMdgdgfggfge jHIdNe"ee#dOe,e-gdPZbe jHIdMdgdgfggfge jHIdNe"ee#dOe,e-gdQZcdRZddSZedTZfdUZge jHIdVdWdXgdYZhdZZie jHId[gd\d]Zjd^Zkd_Zld`Zme jHIdagdbfdcddgdefgdfdgghdiZne jHIdjdddggdkfgdlhdmZodnZpe jHIdogdpdqZqdrZrdsZsdtZtduZudvZvdwZwdxZxdyZydzZze@d{Z{d|Z|d}Z}d~Z~dZdZdZdZe jHIdddgdZe@dZe@dZe@e jHIdddde jJe jJfgdZe jHIddge jHId[gde jHIddde jJgdZe jHId[gddZe jHIddde jJgdZdZdZe jHIddde jJgdZe jHIdddde jJgdZe jHIdddde jJgdZe jHIdddde jJgdZdZdZdZdZdZdZdZdZdZdZdZdZdZdZdZdZe jHIdgdgdfgdgdfgdgdfgdZe jHIdNe&e"ee#dOe+e,e-ege jHIdgddZe jHIde(e"e jJe(e#de jJe(e,e jJe(e-e jJgdZdS)N)partial)chain permutationsproduct)linalg)hamming) bernoulli)datasetssvm)make_multilabel_classification)UndefinedMetricWarning)accuracy_scoreaverage_precision_scorebalanced_accuracy_scorebrier_score_lossclass_likelihood_ratiosclassification_reportcohen_kappa_scoreconfusion_matrixf1_score fbeta_score hamming_loss hinge_loss jaccard_scorelog_loss make_scorermatthews_corrcoefmultilabel_confusion_matrixprecision_recall_fscore_supportprecision_score recall_score zero_one_loss_check_targets)cross_val_score)LabelBinarizerlabel_binarize)DecisionTreeClassifier) MockDataFrame)assert_allcloseassert_almost_equalassert_array_almost_equalassert_array_equalassert_no_warningsignore_warnings) _nanaverage)check_random_stateFc|tj}|j}|j}|r||dk||dk}}|j\}}t j|}td}||||||}}t|dz }t j d}t j || |d|zf}tjddd} | |d||d|||d} |r | ddd f} | ||d} ||d} | | | fS) zMake some classification predictions on a toy dataset using a SVC If binary is True restrict to a binary classification problem instead of a multiclass classification problem N%rlinearT)kernel probability random_state)r load_irisdatatargetshapenparanger1shuffleintrandom RandomStatec_randnr SVCfit predict_probapredict) datasetbinaryXy n_samples n_featuresprnghalfclf probas_predy_predy_trues q/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/sklearn/metrics/tests/test_classification.pymake_predictionrY:sz$&& AA "Qx1q51GIz )A R CKKNNN Q41qA y1}  D )   " "C a9cJ&67778A 't! D D DC''!ETE(AeteH--;;AdeeHEEK ("!!!Q$' [[455 " "F tuuXF 6; &&c tj}t|d\}}}ddddddd d d dd d ddddddddddddddd}t||t jt |j|jd}||ksJ|D]}|dkr2t||tsJ||||ksJ:||||ksJ||D]*}t||||||+t|ddtsJt|ddtsJt|ddtsJt|ddtsJdS) NFrKrLg7Mo?gUUUUUU?ghQ?) precisionrecallf1-scoresupportUUUUUU?gc1Ƹ?g433333?g)k??$I$I?gCFQ?gc?gƢ?Kr`r^r_rag?gD~WG?g]3p?)setosa versicolor virginica macro avgaccuracy weighted avgT)labels target_names output_dictrmrir^rlra) r r;rYrr?r@lenrpkeys isinstancefloatr+rB)irisrWrV_expected_reportreportkeymetrics rX,test_classification_report_dictionary_outputr|jsd    D'UCCCFFA -)*   -*+   -)+   ++'   '++(   5  OD#yT.//00& F ;;==O0022 2 2 2 2WW *  fSk511 1 1 1#;/#"666666#;##%%)=)B)B)D)DDDDD)#. W W#OC$8$@&+fBUVVVV W oh/ >BBcFtjgdgdg}tjgdgdg}t||dksJt||dksJt||dksJt|tj|dksJt|tj|dksJt|tj|jdksJt|tj|jdksJdS)Nrr:r:r:rr:rrr:?r:r)r?arrayr logical_notzerosr>y1y2s rX.test_multilabel_accuracy_score_subset_accuracyrs) 999iii( ) )B 999iii( ) )B "b ! !S ( ( ( ( "b ! !Q & & & & "b ! !Q & & & & "bnR00 1 1Q 6 6 6 6 "bnR00 1 1Q 6 6 6 6 "bhrx00 1 1Q 6 6 6 6 "bhrx00 1 1Q 6 6 6 6 6 6rZcLtd\}}}t||d\}}}}t|ddgdt|ddgdt|d d gdt|d d gitfd d itffD]\}}|t ||fi|} t| dd|t ||fi|} t| dd|t||fi|} t| d dt|t||fddi|d| z| zd| z| zz ddS)NTrLaverageg\(\?g333333?r3g)\(?g(\?皙?gRQ?rrLbeta) rYrr,r-r.r r!rr+r) rWrVrwrQrfskwargs my_assertpsrsfss rX%test_precision_recall_f1_score_binaryrs't444FFA1NNNJAq!Qa$q111a$q111a$q111q2r(###  X  23   Y A A& A A!"dA... Y|VV > >v > >!"dA... Yx : :6 : :!"dA... Ik66 D D DV D D Ob D2IN 3       rZcfdtddgddgksJdtddgddgksJdtddgddgksJdtddgddgdksJdtddgddgksJdtddgddgksJdtddgddgksJdtddgddgt dksJtddgddgt dt jtddgddgdksJdS) N?r:rrr~infgj@)r r!rrrupytestapproxrZrX+test_precision_recall_f_binary_single_classr s /1a&1a&11 1 1 1 1 ,1v1v.. . . . . (Aq6Aq6** * * * * +q!fq!f1555 5 5 5 5 /2r(RH55 5 5 5 5 ,Bx"b22 2 2 2 2 (B8b"X.. . . . . +r2hRuU||DDD D D D D Bx"be = = =RHr2hS111BB      rZc gd}gd}t|tjd}t|tjd}||f||fg}t|D]\}\}}t ||gdd}t gd|t ||gdd}t tjgd|d D]C}|d kr|d krtt ||gd|t ||d|Dd D]}tj t5t ||tjd |dddn #1swxYwYtj t5t ||tjdd|dddn #1swxYwYtj gdgdg}tj gdgdg}t||d d dg\}} } } ttj || | gtj gddS)N)r:rr3)r:r:rr3rclasses)rr:r3rrror)r~rrrr~macro)microweightedsamplesrr)Nrrrrrrr:rrr:r:r:rr:rro)?r:竪?) r'r?r@ enumerater!r,meanr+rraises ValueErrorrr) rWrV y_true_bin y_pred_binr<iactualrrQrrrws rX$test_precision_recall_f_extra_labelsrs.\\F \\F ! ===J ! ===J V z:6 7D( FFff___dSSS!";";";VDDDff___gVVV!"'*C*C*C"D"DfMMM8  G)##Q VVOOOWUUUVVD'JJJ     7 ]: & & W W Z ! g V V V V W W W W W W W W W W W W W W W ]: & &   JryQ/?/?                    Xyyy))), - -F Xyyy))), - -F0 1a&JAq!Q!Q++RX6G6G6G-H-HIIIIIs$2&E$$E( +E( 'F;;F? F? c\gd}gd}t|tjd}t|tjd}||f||fg}t|D]\}\}}t t ||ddg}t t ||d}t dd g|d td |d td |d td |d dD]}|| || ksJdS)N)r:r:r3r)r:rrrrrr:rrorrrrrUUUUUU?rr)rrr)r'r?r@rrr!r,r+) rWrVrrr<r recall_13 recall_allrs rX&test_precision_recall_f_ignored_labelsrJs{\\F \\F ! ===J ! ===J V z:6 7D( M M FFL&&!QHHH \66$GGG !3*ii.E.E.EFFFOYYw-G-G-GHHH3YYz5R5R5RSSSGYYw%?%?%?@@@6 M MG9W---G1L1L1LLLLLL M M MrZc .tjgdgdgdgdgdgdg}tjgdgdgdgd gd gd g}d }tjt| 5t ||dddddS#1swxYwYdS)z:Test multiclass-multiouptut for `average_precision_score`.)r3r3r:r:r3rrr:r3r:r3r:)r3rr:ffffff?皙?皙?皙?333333?rrrrrrr)rrr)rrrz.multiclass-multioutput format is not supportedmatchr3 pos_labelN)r?rrrrr)rWy_scoreerr_msgs rX-test_average_precision_score_non_binary_classras X II II II II II II    Fh OO OO OO OO OO OO    G?G z 1 1 1>>1====>>>>>>>>>>>>>>>>>>s*B  BBzy_true, y_scorerrr:r3rrrr) rrrrr:r:r:r:r:r:r:) rrrrr333333?rrdrdr:r:c2t||dksJdS)a( Duplicate values with precision-recall require a different processing than when computing the AUC of a ROC, because the precision-recall curve is a decreasing curve The following situation corresponds to a perfect test statistic, the average_precision_score should be 1. r:NrrWrs rX-test_average_precision_score_duplicate_valuesr|s%8 #67 3 3q 8 8 8 8 8 8rZ)r3r3r:r:r)rrr)rrrr)rrrc2t||dksJdS)Nrrrs rX(test_average_precision_score_tied_valuesrs%: #67 3 3s : : : : : :rZcd}tjt|5tgdgdddddddS#1swxYwYdS)NzNote that pos_label \(set to 2\) is ignored when average != 'binary' \(got 'macro'\). You may use labels=\[pos_label\] to specify a single positive class.rrr:r3r3r3rrr)rwarns UserWarningrrs rX(test_precision_recall_f_unused_pos_labelrs   k - - -  ' IIyyyAw                      sAA Actd\}}}d}||||d|Dd|DdS)NTrcnt||}t|ddgddgg|\}}}}||z||zz }tj||z||zz||zz||zz}|dkrdn||z } t ||} t | | dt | dddS) Nrrr3decimal= ףp=?)rr-flattenr?sqrtrr,) rWrVcmtpfpfntnnumdentrue_mccmccs rXtestz*test_confusion_matrix_binary..tests ff - -2Q!R1222BB2gRgrBw27+rBw727CDDq11cCi//!#x;;;;!#tQ777777rZc,g|]}t|Srr.0rNs rX z0test_confusion_matrix_binary.. ! ! !Q#a&& ! ! !rZc,g|]}t|Srrrs rXrz0test_confusion_matrix_binary..#;#;#;qCFF#;#;#;rZrYrWrVrwrs rXtest_confusion_matrix_binaryrsr't444FFA 8 8 8 DD ! !& ! ! !#;#;F#;#;#;<<<<.testsF ( 8 82"a1b' 2b!Wq"g4FGHHHHHrZc,g|]}t|Srrrs rXrz;test_multilabel_confusion_matrix_binary..rrZc,g|]}t|Srrrs rXrz;test_multilabel_confusion_matrix_binary..rrZrrs rX'test_multilabel_confusion_matrix_binaryrsu't444FFAIII DD ! !& ! ! !#;#;F#;#;#;<<<<.tests[ ( 8 8 2q'Ar7#r1gAw%72r(QG9LM   %0>YYY ( G G G 2q'Ar7#r2hB%8B7RG:LM   *5F%%%%,,, ( G G G a1b'"bAr7#a2q'"a1a&!       rZc,g|]}t|Srrrs rXrz?test_multilabel_confusion_matrix_multiclass.. rrZc,g|]}t|Srrrs rXrz?test_multilabel_confusion_matrix_multiclass.. rrZT)r-)Frrs rX+test_multilabel_confusion_matrix_multiclassr0s|'u555FFA    6 DD ! !& ! ! !#;#;F#;#;#;NNNNNNrZcZddlm}m}tjgdgdgdg}tjgdgdgdg}||}||}||}||}tjgd }d dgd d ggd dgd d ggdd gd dggg} |||g} |||g} | D]'} | D]"} t | | }t || #(t ||d }t |d dgd d ggd d gdd ggdd gd dgggt ||d dg}t |dd gd dggd dgd d gggt ||d dgd }t |ddgd d ggd d gddggdd gd dgggt |||d }t |d dgd d ggd d gdd ggddgddgggdS)Nr) csc_matrix csr_matrixrrr:rr:r:rrrr)r3r:rr:r3T samplewiser)ror7) sample_weightr7rr) scipy.sparser2r3r?rrr-)r2r3rWrV y_true_csr y_pred_csr y_true_csc y_pred_cscr8real_cmtruespreds y_true_tmp y_pred_tmprs rX+test_multilabel_confusion_matrix_multilabelrCs33333333 Xyyy)))YYY7 8 8F Xyyy)))YYY7 8 8FF##JF##JF##JF##JHYYY''MAA1a&1a&!1QFQF3CDG Z ,E Z ,E,,  , ,J,ZDDB r7 + + + + , %VV E E EBraVaV,1v1v.>!Q!Q@PQRRR %VVQF C C CBraVaV,1v1v.>?@@@ %VVQFt T T TBraVaV,1v1v.>!Q!Q@PQRRR %m   BraVaV,1v1v.>!Q!Q@PQRRRRRrZc tjgdgdgdg}tjgdgdgdg}tjtd5t ||d d g dddn #1swxYwYtjtd 5t ||gd gdgdg dddn #1swxYwYd}tjt|5t ||dgdddn #1swxYwYd}tjt|5t ||dgdddn #1swxYwYtjtd5t gdgdddddn #1swxYwYd}tjt|5t gdgdggdgdgddddS#1swxYwYdS)Nrr4r5rrrzinconsistent numbers of samplesrr:r3r8zshould be a 1d arrayr:r3r)r3rr)rrrz%All labels must be in \[0, n labels\)rrrzSamplewise metricsrrTr6z'multiclass-multioutput is not supported)r3r:rr:rr3)r?rrrrr)rWrVrs rX'test_multilabel_confusion_matrix_errorsrH8s Xyyy)))YYY7 8 8F Xyyy)))YYY7 8 8F z)J K K KJJ#FF1a&IIIIJJJJJJJJJJJJJJJ z)? @ @ @  # F999iii*K                   7G z 1 1 1AA#FFB4@@@@AAAAAAAAAAAAAAA6G z 1 1 1@@#FFA3????@@@@@@@@@@@@@@@ z)= > > >KK#IIIyyyTJJJJKKKKKKKKKKKKKKK8G z 1 1 1TT#YYY $:YYY A;CC  C -D  DD5EEE;FF"%F"G00G47G4z%normalize, cm_dtype, expected_results))truerTUU?)predrrJ)allrgeq?)Nrr3cgddz}tttgd}t|||}t |||jj|ksJdS)Nrr normalize)listrrrr*dtypekind)rOcm_dtypeexpected_resultsy_testrVrs rXtest_confusion_matrix_normalizerVVsoYY]F %iii001 2 2F &&I > > >BB())) 8=H $ $ $ $ $ $rZcHgd}gd}t||d}|tjdksJt j5t jdtt||d}dddn #1swxYwY|tjdksJt j5t jdtt||dddddS#1swxYwYdS) N)rrrrr:r:r:r:)rrrrrrrrrIrN@errorrKr)rsumrrrr simplefilterRuntimeWarning)rUrVcm_truecm_preds rX,test_confusion_matrix_normalize_single_classr_gs % % %F % % %Fvv@@@G ;;==FM#.. . . . .  " "EEg~666"66VDDDEEEEEEEEEEEEEEE ;;==FM#.. . . . .  " ";;g~6666::::;;;;;;;;;;;;;;;;;;s$-BBB-DDDzparams, warn_msg)rrrrrrrWrVz2samples of only one class were seen during testing)r:r:r:rrrz:positive_likelihood_ratio ill-defined and being set to nanz+no samples predicted for the positive class)rrrr:r:r:z:negative_likelihood_ratio ill-defined and being set to nanz@no samples of the positive class were present in the testing setctjt|5tdi|ddddS#1swxYwYdSNrr)rrrr)paramswarn_msgs rXtest_likelihood_ratios_warningsrezsb k 2 2 2**))&)))****************** 6::zparams, err_msg)rr:rr:rr:r:rrr3zeclass_likelihood_ratios only supports binary classification problems, got targets of type: multiclassctjt|5tdi|ddddS#1swxYwYdSrb)rrrr)rcrs rXtest_likelihood_ratios_errorsris$ z 1 1 1**))&)))******************rfcFtjdgdzdgdzz}tjdgdzdgdzzdgdzz}t||\}}t|dt|d t||\}}t |tjdzt|tjdd tjd gd zdgdzz}t|||\}}t|dt|ddS)Nr:rrrr3 rg?g_B{ %?g-q=)rtolrr~rrEgUUUUUU@gqq?)r?rrr*r-rr)rWrVposnegr8s rXtest_likelihood_ratiosrps*XqcAgb( ) )F XqcAgb(A372 3 3F&vv66HCC!!!C!!!'vv66HCsBFQJ'''C!51111 HcURZ3%!)344M&vv]SSSHCC   C!!!!!rZctjdgdzdgdzz}tjdgdzdgdzzdgdzzdgdzz}t||}t|dd |t||ksJtj|d gd z}tj|d gd z}t||ddg |ksJtt||dtjdgdzdgdzzd gdzz}tjdgdzdgdzzd gdzz}tt||dd tjdgdzdgdzzd gdzz}tjdgdzdgdzzd gdzz}tt||dd tt||ddd tt||ddd dS)Nr(r:<rfrk2gʡE?rrr3rrr.,4 g??g+?r6weightsg_vO? quadraticg#?)r?rrr+append)rrkappas rXtest_cohen_kapparsV 1#(aS2X% & &B 1#(aS2X%b0A38; < >f===>>>>>>>>>>>>>>> S======s 599ctjd}|ddd}|ddd}t t ||tj||dddS)Nrr3rfsizerr:rk)r?rCrDrandintr+rcorrcoef)rRrWrVs rX-test_matthews_corrcoef_against_numpy_corrcoefr.s )   " "C [[AB[ ' 'F [[AB[ ' 'F&&))2;vv+F+Ft+LbrZc tjd}|ddd}|ddd}|d}t ||| t  t fdt D}t fdt D}tj fdt D}|tj ||zz }t|||}t||d dS) Nrr3rfrrEc g|]Q}tD]?}tD]-}||f||fz||f||fzz .@RSrrange)rkmlCNs rXrz9test_matthews_corrcoef_against_jurman..Ds   1XX  1XX    adGa1g !Q$!AqD' 1 1     rZc g|]PddftjfdtDzQS)NcTg|]$}tD]}|k||f%Srrrrgrrrs rXrzDtest_matthews_corrcoef_against_jurman...N8LLL!qLLAQ!VVa1gVVVVrZrZr?rrrrrs @rXrz9test_matthews_corrcoef_against_jurman..Lst    aaadGKKMMfLLLLLLuQxxLLLMM N   rZc g|]PddftjfdtDzQS)NcTg|]$}tD]}|k||f%Srrrs rXrzDtest_matthews_corrcoef_against_jurman...UrrZrrs @rXrz9test_matthews_corrcoef_against_jurman..Sst    adGKKMMfLLLLLLuQxxLLLMM N   rZrk) r?rCrDrrandrrrrZrrrr+) rRrWrVr8cov_ytypcov_ytytcov_ypyp mcc_jurmanmcc_oursrrs @@rX%test_matthews_corrcoef_against_jurmanr8s )   " "C [[AB[ ' 'F [[AB[ ' 'FHHRLLM}EEEA AA     1XX   H     1XX   Hv     1XX   HBGHx$7888J }MMMH*b11111rZc Rtjd}d|dddD}t t ||dd|D}t t ||dt |d d g }tj|d d }t t ||dt t gd gd d t t |d gt|zd gd}gd}t t ||d dgdzdgdzz}tj t5t t |||d ddddS#1swxYwYdS)Nrc"g|] }|dkrdnd S)rrrrrrs rXrz*test_matthews_corrcoef..as$ I I IQ!VVcc I I IrZr3rfrrc"g|] }|dkrdnd S)rrrrs rXrz*test_matthews_corrcoef..gs$;;;qc##s;;;rZrrrrrrrrr~)r:rr:r:rr:r:r:rr:r:r:r:r:r:r:rr:r:r:)r:r:r:rrr:r:r:r:rr:r:r:rr:r:r:rr:r:r:rkrE) r?rCrDrr+rr'whererrrrAssertionError)rRrW y_true_inv y_true_inv2y_1y_2masks rXtest_matthews_corrcoefr_s )   " "C I Ickk!QRk.H.H I I IF)&&993???<;F;;;J)&*==rBBB #s<<>CCC),,, EEsKKK)&3%#f++2EFFLLL G F FC F F FC)#s33S999 38qcBh D ~ & &RR-c3dKKKSQQQRRRRRRRRRRRRRRRRRRs.!FF #F cB tjd}td d} fd|d|dD}t t ||dgd}gd }t t ||d gd}gd }t t ||d tjd z gd}gd}t t ||dgd}gd}t t ||dgd}gd}t t ||dgd}gd}gd}t t |||dgd}gd}gd}t t |||ddS)Nrrrc4g|]}t|zSr)chr)rrord_as rXrz5test_matthews_corrcoef_multiclass..s# I I Ic%!)nn I I IrZrfrr)rrr:r:r3r3)r3r3rrr:r:g)r:r:rrrriir)rrrr~ rr:r3rr:r3rr:r3) r:r:r:r3r3r3rrr)rrr:r:r3rgr:r:r:r:rrErrr:r:rr)r?rCrDordrr+rr) rR n_classesrW y_pred_bad y_pred_minrVrrr8rs @rX!test_matthews_corrcoef_multiclassrs )   " "C HHEI I I I Ickk!YRk&H&H I I IF)&&993???  F###J)&*==tDDD  F###J)&*==sRWWEUEU?UVVVYYF YYF)&&993???YYF YYF)&&993??? & % %C % % %C)#s33S999 __F __F#OOM&& FFF \\F \\F LLM&& FFFrZn_pointsdi'ctjdd}fd}tjddg|}t t ||dtjgd|}t t ||d||\}}t t ||dt t |||||dS)Ni3ct||}|d}|d}|d}t|}||z|z }||z|z }||z ||zz } ||zd|z zd|z z} | tj| z S)Nr:r:)r:rrr:)rrrr?r) rWrV conf_matrixtrue_pos false_pos false_negrpos_rateactivity mcc_numeratormcc_denominators rXmcc_safez1test_matthews_corrcoef_overflow..mcc_safes&vv66 t$% % v;;y(H4y(H4 8+h.AA "X-X>!h,Orw7777rZc|}|d|dz zz}|dk}|dk}||fS)Nrr) random_sample)rx_truex_predrWrVrRs rX random_ysz2test_matthews_corrcoef_overflow..random_yssT""8,,#!2!28!>>>>>rZrQ)Int64Float64booleanctjd}tjgd}|||}|gdd}t ||}t ||}t ||dS)zkChecks that confusion_matrix works with pandas nullable dtypes. Non-regression test for gh-25635. pandas) r:rrr:rr:r:rr:r) rrr:r:rr:r:r:r:rN)r importorskipr?rSeriesrr-)rQpd y_ndarrayrW y_predictedoutputexpected_outputs rX%test_confusion_matrix_pandas_nullablers  X & &B44455I YYyY . .F))777w)GGK fk 2 2F&y+>>Ov/////rZc tj}t|d\}}}d}t||t jt |j|j}||ksJdS)NFr\a| precision recall f1-score support setosa 0.83 0.79 0.81 24 versicolor 0.33 0.10 0.15 31 virginica 0.42 0.90 0.57 20 accuracy 0.53 75 macro avg 0.53 0.60 0.51 75 weighted avg 0.51 0.53 0.47 75 rorpr r;rYrr?r@rrrprvrWrVrwrxrys rX%test_classification_report_multiclassrs    D'UCCCFFA O#yT.//00& F _ $ $ $ $ $ $rZcJgdgd}}d}t||}||ksJdS)N) rrrr:r:r:r3r3r3ra| precision recall f1-score support 0 0.33 0.33 0.33 3 1 0.33 0.33 0.33 3 2 0.33 0.33 0.33 3 accuracy 0.33 9 macro avg 0.33 0.33 0.33 9 weighted avg 0.33 0.33 0.33 9 )r)rWrVrxrys rX.test_classification_report_multiclass_balancedrsG0002M2M2MFF O#66 2 2F _ $ $ $ $ $ $rZctj}t|d\}}}d}t||}||ksJdS)NFr\a| precision recall f1-score support 0 0.83 0.79 0.81 24 1 0.33 0.10 0.15 31 2 0.42 0.90 0.57 20 accuracy 0.53 75 macro avg 0.53 0.60 0.51 75 weighted avg 0.51 0.53 0.47 75 )r r;rYrrs rX:test_classification_report_multiclass_with_label_detectionr!sX    D'UCCCFFA O#66 2 2F _ $ $ $ $ $ $rZc tj}t|d\}}}d}t||t jt |j|jd}||ksJdS)NFr\a| precision recall f1-score support setosa 0.82609 0.79167 0.80851 24 versicolor 0.33333 0.09677 0.15000 31 virginica 0.41860 0.90000 0.57143 20 accuracy 0.53333 75 macro avg 0.52601 0.59615 0.50998 75 weighted avg 0.51375 0.53333 0.47310 75 r)rorpdigitsrrs rX1test_classification_report_multiclass_with_digitsr$s    D'UCCCFFA O#yT.//00& F _ $ $ $ $ $ $rZctd\}}}tjgd|}tjgd|}d}t||}||ksJd}t||gd}||ksJdS)NFr)bluegreenreda| precision recall f1-score support blue 0.83 0.79 0.81 24 green 0.33 0.10 0.15 31 red 0.42 0.90 0.57 20 accuracy 0.53 75 macro avg 0.53 0.60 0.51 75 weighted avg 0.51 0.53 0.47 75 a| precision recall f1-score support a 0.83 0.79 0.81 24 b 0.33 0.10 0.15 31 c 0.42 0.90 0.57 20 accuracy 0.53 75 macro avg 0.53 0.60 0.51 75 weighted avg 0.51 0.53 0.47 75 rrprYr?rr)rWrVrwrxrys rX7test_classification_report_multiclass_with_string_labelr+s'u555FFA X... / / 7F X... / / 7F O#66 2 2F _ $ $ $ $ O#66 P P PF _ $ $ $ $ $ $rZctd\}}}tjgd}||}||}d}t||}||ksJdS)NFr)ublue¢ugreen¢ured¢u precision recall f1-score support blue¢ 0.83 0.79 0.81 24 green¢ 0.33 0.10 0.15 31 red¢ 0.42 0.90 0.57 20 accuracy 0.53 75 macro avg 0.53 0.60 0.51 75 weighted avg 0.51 0.53 0.47 75 r*rWrVrwrorxrys rX8test_classification_report_multiclass_with_unicode_labelr.sp'u555FFA X::: ; ;F F^F F^F O#66 2 2F _ $ $ $ $ $ $rZctd\}}}tjgd}||}||}d}t||}||ksJdS)NFr)r&greengreengreengreengreenr(a precision recall f1-score support blue 0.83 0.79 0.81 24 greengreengreengreengreen 0.33 0.10 0.15 31 red 0.42 0.90 0.57 20 accuracy 0.53 75 macro avg 0.53 0.60 0.51 75 weighted avg 0.51 0.53 0.47 75 r*r-s rXrs rX$test_multilabel_zero_one_loss_subsetr<s) 999iii( ) )B 999iii( ) )B R C ' ' ' ' R A % % % % R A % % % % R^B// 0 0A 5 5 5 5 R^B// 0 0A 5 5 5 5 RXbh// 0 0A 5 5 5 5 RXbh// 0 0A 5 5 5 5 5 5rZchtjgdgdg}tjgdgdg}tjddg}t||dksJt||dksJt||dksJt|d|z dksJt|d|z dksJt|tj|jdksJt|tj|jd ksJt||| d ksJt|d|z | d ksJt|tj|| dksJt|d|dt |d|dksJdS) Nrrrr:rUUUUUU?rrrrEgUUUUUU?gUUUUUU?)r?rrrr> zeros_like sp_hamming)rrws rXtest_multilabel_hamming_lossrBs 999iii( ) )B 999iii( ) )B !QA B  5 ( ( ( ( B  1 $ $ $ $ B  1 $ $ $ $ AF # #q ( ( ( ( AF # #q ( ( ( ( BHRX.. / /5 8 8 8 8 BHRX.. / /3 6 6 6 6 Ba 0 0 0H < < < < AF! 4 4 4 A A A A BM"--Q ? ? ?7 J J J J 1r!u % %BqE2a5)A)A A A A A A ArZctjgd}tjgd}d}tjt|5t ||dddddn #1swxYwYtjgdgdg}tjgd gd g}d }tjt|5t ||dd dddn #1swxYwYtjgd }tjgd}d}tjt|5t ||ddddn #1swxYwYd}tjt|5t ||ddddn #1swxYwYd}tjt|5t ||ddddddS#1swxYwYdS)N)rr:rr:r:z>pos_label=2 is not a valid label. It should be one of \[0, 1\]rrLr3rrrrrrTarget is multilabel-indicator but average='binary'. Please choose another average setting, one of \[None, 'micro', 'macro', 'weighted', 'samples'\].r)rr:r:rr3rTarget is multiclass but average='binary'. Please choose another average setting, one of \[None, 'micro', 'macro', 'weighted'\].rzJSamplewise metrics are not available outside of multilabel classification.rzNote that pos_label \(set to 3\) is ignored when average != 'binary' \(got 'micro'\). You may use labels=\[pos_label\] to specify a single positive class.rr)r?rrrrrrr)rWrVrmsg1msg2msg3rs rXtest_jaccard_score_validationrJs~ Xooo & &F Xooo & &FOG z 1 1 1EEffh!DDDDEEEEEEEEEEEEEEEXyyy))), - -F Xyyy))), - -F 6 z . . .FFffh"EEEEFFFFFFFFFFFFFFFXooo & &F Xooo & &F  z . . .88ffh7777888888888888888 WD z . . .99ffi8888999999999999999  k - - -DDffgCCCCDDDDDDDDDDDDDDDDDDsZ A**A.1A.C&&C*-C*:EE EF  F$'F$G))G-0G-c tjgdgdg}tjgdgdg}t||ddksJt||ddksJt||ddksJt|tj|ddksJt|tj|ddksJt|tj|jddksJt|tj|jddksJtjgdgd g}tjgd gdg}t t||d d t t||d dt t||ddt t||dddgdt t||dddgdtt||dtjgdtjgdgdg}tjgd gdg}t t||d dt t||ddd}tj t|5t||dgd dddn #1swxYwYd}tj t|5t||dgd dddn #1swxYwYd}tj t|5ttjddggtjddggd dksJ dddn #1swxYwYd}tj t|5ttjddgddggtjddgddggddksJ dddn #1swxYwYt|rJdS)Nrrrrrrr:rrrrrrrg?r3rr)rrrrrg?z Got 4 > 2rrrz Got -1 < 0rzXJaccard is ill-defined and being set to 0.0 in labels with no true or predicted samples.zXJaccard is ill-defined and being set to 0.0 in samples with no true or predicted labels.)r?rrrrr>r+r-rrrrr rP)recwarnrrrWrVrHrIrs rXtest_multilabel_jaccard_scorerMs 999iii( ) )B 999iii( ) )B R 3 3 3t ; ; ; ; R 3 3 3q 8 8 8 8 R 3 3 3q 8 8 8 8 R^B// C C Cq H H H H R^B// C C Cq H H H H RXbh// C C Cq H H H H RXbh// C C Cq H H H H Xyyy))), - -F Xyyy))), - -F ffgFFFPPP ffgFFFPPP ffiHHH(SSSffiAGGGffiAGGGffd333RX>U>U>U5V5VXyyy))), - -F Xyyy))), - -F ffgFFFPPP ffjIII7SSS D z . . .CCffaS'BBBBCCCCCCCCCCCCCCC D z . . .DDffbT7CCCCDDDDDDDDDDDDDDD - ,C 8 8 8  "(QF8,,bhAx.@.@' R R R                     , ,C 8 8 8  1a&1a&)**1a&1a&)**!                         G}}sJK//K36K3L88L<?L< AN00N47N4A P..P25P2c gd}gd}gd}t}||||}||}tt||}tt||}ddgddgddgdgdgdgdg} ddgdd gd dgdgdgd gdg} d D]>} t | | D]+\} } t || | || | ,?tjddgddgddgg}tjddgddgddgg}t5t ||d dksJ dddn #1swxYwYt|rJdS)N)antrOcatrPrOrPbirdrQ)rPrOrPrPrOrQrQrP)rOrQrPrOrQrPrr:r3)rrrNrrr) r&rH transformrrzipr+r?rr/rP)rLrWrVrolbrrmulti_jaccard_scorebin_jaccard_scoremulti_labels_listbin_labels_listrm_labelb_labels rXtest_multiclass_jaccard_scorer[sA G G GF G G GF # # #F   BFF6NNNf%%Jf%%J!-@@ z:FF       1v1v1vsQC!dCO8 #$5 G G   GW ##GGDDD!!''BBB      X1v1v1v. / /F X1v1v1v. / /F   FFVVZ@@@AEEEEEFFFFFFFFFFFFFFFG}}s3EE EctdgdgddksJd}tjt|5tddgddgddksJ dddn #1swxYwYtdgdgddd ksJt jgd }t jgd }t t||dd t t||dd dt|rJdS)Nr:rrLrr~zOJaccard is ill-defined and being set to 0.0 due to no true or predicted samplesrrr)r:rr:r:r)r:rr:r:r:rrDr)rrrr r?rr+rP)rLrrWrVs rX!test_average_binary_jaccard_scorer]=s !qc8 4 4 4 ; ; ; ; ' ,C 8 8 8FFaVaVX>>>#EEEEEFFFFFFFFFFFFFFF !qcQ A A AS H H H H Xooo & &F Xooo & &F ffhGGGQQQffh!DDDgG}}sA""A&)A&c6tjgdgdg}tjgdgdg}d}tjt|5t ||dd}|tjdksJ ddddS#1swxYwYdS) NrrrrzJaccard is ill-defined and being set to 0.0 in samples with no true or predicted labels. Use `zero_division` parameter to control this behavior.rrrrrr~)r?rrrr rr)rWrVrscores rX(test_jaccard_score_zero_division_warningrbTsXyyy))), - -F Xyyy))), - -F C ,C 8 8 8++ffivVVV c*******++++++++++++++++++s.BBBzzero_division, expected_scorer)r:rcRtjgdgdg}tjgdgdg}tj5tjdt t ||d|}dddn #1swxYwY|tj|ksJdS)Nrr_rYrr`) r?rrrr[r rrr)rexpected_scorerWrVras rX*test_jaccard_score_zero_division_set_valuerecsXyyy))), - -F Xyyy))), - -F  " "  g'=>>> FI]                  FM.11 1 1 1 1 1 1s.BB BcZtjgdgdgdg}tjgdgdgdg}t||d\}}}}t|gddt|gddt|gd dt|gd dt ||dd }|}t|gd dt||d \}}}}t |dt |dt |d|Jt t ||dd tj|t||d\}}}}t |dt |dt |d|Jt t ||dd d|z|zd|z|zz t||d\}}}}t |dt |dt |d|Jt t ||dd tj||t||d\}}}}t |dt |dt |d|Jt t ||dd ddS)Nr:rrrrr:rrr)r:rr:rr)r~rrr~r3)r~rrr~)r~rr:r~)r:r:r:r:rr)rrr:rrg?rg?rrrrrzrr?rrr,rr+rrrWrVrQrrrf2ras rX+test_precision_recall_f1_score_multilabel_1rmps$ X|||\\\<<<@ A AF X|||\\\<<<@ A AF0NNNJAq!Qa!5!5!5q999a!5!5!5q999a!7!7!7;;;aq111 VV!T : : :BGb///15551QQQJAq!Q7###3+,,, 999FFG<<rrrbrzrg&S?rjrks rX+test_precision_recall_f1_score_multilabel_2rss/X|||\\\<<<@ A AF X|||\\\<<<@ A AF 1NNNJAq!Qa!5!5!5q999a!5!5!5q999a!6!6!6:::aq111 VV!T : : :BGb///15550QQQJAq!Q4   4   0111 999FFG<<< ! a1q519% 1QQQJAq!Q4   5!!!6""" 999FFG<<>>rZz%zero_division, zero_division_expected)rrrc tjgdgdgdg}tjgdgdgdg}t||d|\}}}}t||dddgd t|dd d|gd tj|sd n tj}t||d d |gd t|gdd t ||d d|} |} t| |dd |gd t||d|\}}}}tj|rd n|} dtj| z} t|d | z| z t|d| z| z dtj|sdnd z }t|||Jtt ||d d|t| dt||d|\}}}}t|d t|d t|d|Jtt ||d d|d|z|zd|z|zz t||d|\}}}}t||d krdndt|d tj|sdnd} t|d| z |Jtt ||d d|t| | t||d\}}}}t|dt|dt|d|Jd d tjdi} tt ||d d|| |d!d dS)"Nrhrgrrror`rr~r3rrrr:rprrrrqrr?g?rrzrrerrrg@rrrbgZd;O?gZd;O?) r?rrr,rrrr+r0get)rzero_division_expectedrWrVrQrrr expected_frlra value_to_sumvalues_to_averageexpected_results rX7test_precision_recall_f1_score_with_an_empty_predictionr}sqX|||\\\<<<@ A AF X|||\\\<<<@ A AF 1MJAq!Qa"8#sC!H!LLLa#sC1G!H!LLL(#9::FJa*gq*!EqIIIaq111 VV!T W W WBGb:tQ "CQGGG0}JAq!Q!788T11>TL*@!A!AABA ,0AABBBC,.2CCDDD2H)I)I PqQJ:&&& 999  '     B%%%   1}JAq!Q5!!!30111 999 FG=    ! a1q519% 1 -JAq!Q$:a$?$?55SIII3!#*@!A!AHqM->>??? 999 FJm    B((( 1SSSJAq!Q5!!!5!!!5!!! 999%-O FI]    M511 rZr)rrrrctjd}tj|}tt|||||\}}}}tt |||||} |Jtj|r!|||| fD]} tj| sJdSt|}t||t||t||t| t|dS)Nrfrrrrru) r?rr?r.rrrrur+) rrrrWrVrQrrrfbetar{s rX"test_precision_recall_f1_no_labelsrWs(Xg  F ]6 " "F#' # JAq!Q  #    E 999 x !Q& $ $F8F## # # # #-((M=)))=)))=)))u]3344444rZctjd}tj|}t}t jt 5||||d\}}}}dddn #1swxYwYt|dt|dt|d|Jt jt 5t|||d}dddn #1swxYwYt|ddS)Nrrrr) r?rr?rrrr r+r) rrWrVfuncrQrrrrs rX1test_precision_recall_f1_no_labels_check_warningsr~s Xg  F ]6 " "F *D , - -EET&&'DDD 1aEEEEEEEEEEEEEEE111 999 , - -GGFFG#FFFGGGGGGGGGGGGGGGq!!!!!s$ A**A.1A.C""C&)C&ctjd}tj|}tt||dd|\}}}}tt ||dd|}tj|}t||||gdt||||gdt||||gdt|gddt||||gddS)Nrrrrur3r_)r?rr?r.rrrr,)rrWrVrQrrrrs rX/test_precision_recall_f1_no_labels_average_noners Xg  F ]6 " "F$' # JAq!Q VV#t=   EJ}--Ma- !NPQRRRa- !NPQRRRa- !NPQRRRaA...em]M%RTUVVVVVrZc.tjd}tj|}tjt 5t ||dd\}}}}dddn #1swxYwYt|gddt|gddt|gddt|gddtjt 5t||dd}dddn #1swxYwYt|gdddS)Nrr:rr_r3ri) r?rr?rrr rr,r)rWrVrQrrrrs rX4test_precision_recall_f1_no_labels_average_none_warnrs Xg  F ]6 " "F , - -  4 FDq   1a               aA...aA...aA...aA... , - -BBFFDAAABBBBBBBBBBBBBBBeYYY22222s$A''A+.A+C77C;>C;c tt}}dD]}d}tj||5|gdgd|dddn #1swxYwYd}tj||5|gdgd|dddn #1swxYwYd}tj||5|t jd d gd d ggt jd d gd d ggd dddn #1swxYwYd }tj||5|t jd d gd d ggt jd d gd d ggd dddn #1swxYwYd }tj||5|t jd d gd d ggt jd d gd d ggddddn #1swxYwYd}tj||5|t jd d gd d ggt jd d gd d ggddddn #1swxYwYd }tj||5|d d gddgddddn #1swxYwYd}tj||5|ddgd d gddddn #1swxYwYt jd5}t jdtd d gd d gdd}t| j |ksJd }t| j |ksJ ddddS#1swxYwYdS)NNrrzPrecision and F-score are ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.rrr:r:r3rzRecall and F-score are ill-defined and being set to 0.0 in labels with no true samples. Use `zero_division` parameter to control this behavior.zPrecision and F-score are ill-defined and being set to 0.0 in samples with no predicted labels. Use `zero_division` parameter to control this behavior.r:rrzRecall and F-score are ill-defined and being set to 0.0 in samples with no true labels. Use `zero_division` parameter to control this behavior.zPrecision and F-score are ill-defined and being set to 0.0 due to no predicted samples. Use `zero_division` parameter to control this behavior.rzRecall and F-score are ill-defined and being set to 0.0 due to no true samples. Use `zero_division` parameter to control this behavior.rrLTralways) rr rrr?rrrr[rpopr)rrArrrs rXtest_prf_warningsrs *,BqA.55  \!3 ' ' ' 5 5 AiiiG 4 4 4 4 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5  \!3 ' ' ' 5 5 AiiiG 4 4 4 4 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5   as # # #UU "(QFQF# $ $bhAA/?&@&@)TTTTUUUUUUUUUUUUUUU  as # # #UU "(QFQF# $ $bhAA/?&@&@)TTTTUUUUUUUUUUUUUUU   as # # #SS "(QFQF# $ $bhAA/?&@&@'RRRRSSSSSSSSSSSSSSS  as # # #SS "(QFQF# $ $bhAA/?&@&@'RRRRSSSSSSSSSSSSSSS   as # # #.. 1a&2r(H----...............  as # # #.. 2r(QFH----...............   - - -0h''''AAIIII  6::<<'((C////  6::<<'((C/////!000000000000000000sA  A A -B  B B 0?C;;C?C??E))E-0E- ?GGG:?II  I (JJ J *K  K K )BM>>NNc t}dD]2}t|gdgd||t|gdgd||3t|tjddgddggtjddgddggd|t|tjddgddggtjddgddggd|t|tjddgddggtjddgddggd|t|tjddgddggtjddgddggd|t|ddgd d gd |t|d d gddgd |t jd 5}t jd tddgddgd |t|dksJ ddddS#1swxYwYdS)Nrrrr`r:rrrrrLTrr)rr.r?rrrr[rr)rrrrs rX)test_prf_no_warnings_if_zero_division_setr1s (A.   yyy)))WM      yyy)))WM       1a&1a&!"" 1a&1a&!""#   1a&1a&!"" 1a&1a&!""#   1a&1a&!"" 1a&1a&!""#   1a&1a&!"" 1a&1a&!""#  Aq6B8X] B8aVX]   - - - h'''' FQFHM    6{{a                   sAG!!G%(G%c tttjddgddggtjddgddggd|t jd5}t jdttjddgddggtjddgddggd||dkr-t|j d ksJnt|dksJtddgddg|dkr,t|j d ksJddddS#1swxYwYdS) Nr:rrr`TrrrzzRecall is ill-defined and being set to 0.0 due to no true samples. Use `zero_division` parameter to control this behavior.) r.r!r?rrrr[rrrrrrrs rXtest_recall_warningsrqs 1a&1a&!"" 1a&1a&!""#    - - -h''' Hq!fq!f% & & Hq!fq!f% & &'     F " "FJJLL())""""""v;;!####aVaV$$$ F " "FJJLL())"""""-sC&EEEc tjd5}tjdtt jddgddggt jddgddggd||dkr-t |jd ksJnt|dksJtddgddg|dkr,t |jd ksJdddn #1swxYwYttt jddgddggt jddgddggd|dS) NTrrr:rrr`rzPrecision is ill-defined and being set to 0.0 due to no predicted samples. Use `zero_division` parameter to control this behavior.) rrr[r r?rrrrrrr.rs rXtest_precision_warningsrs   - - -h''' Hq!fq!f% & & Hq!fq!f% & &'     F " "FJJLL())""""""v;;!####AA''' F " "FJJLL())"""""-: 1a&1a&!"" 1a&1a&!""# sC&DD D c 0tjd5}tjdtt t dfD]3}|t jddgddggt jddgddggd| t|dksJ|t jddgddggt jddgddggd| t|dksJ|t jddgddggt jddgddggd| |d kr.t| j d ksJt|dksJ5 ddddS#1swxYwYdS) NTrrr3rr:rrr`rzF-score is ill-defined and being set to 0.0 due to no true nor predicted samples. Use `zero_division` parameter to control this behavior.) rrr[rrrr?rrrrrr)rrras rXtest_fscore_warningsrs7   - - -#(h''' ! < < <= ( (E E1a&1a&)**1a&1a&)**+      v;;!#### E1a&1a&)**1a&1a&)**+      v;;!#### E1a&1a&)**1a&1a&)**+      && ,--------6{{a'''''A (#(#(#(#(#(#(#(#(#(#(#(#(#(#(#(#(#(#(sE'F  FFcgd}gd}d}tjgdgdgdg}tjgdgdgdg}d}|||f|||ffD]q\}}}tttt t d fD]A} tjt| 5| ||dddn #1swxYwYBrdS) N)r:r3rr)r:r3rr:rFrrrr4rEr3rr) r?rr r!rrrrrr) y_true_mc y_pred_mcmsg_mc y_true_ind y_pred_indmsg_indrWrVrr{s rX'test_prf_average_binary_data_non_binaryrsV I I 1 999iii;<(> %K(****%%l33 :|u,,,,|u,,,,,"5"*R..999"5"*R..999z** , ,r#2#w+++ , , , , , , , , , , , , , , , ) B B 3 z - - -r2sl. E99FF/G  G G H++H/ 2H/ .J  J J M&&M* -M* N66N:=N:cNddg}ddg}t||ddksJdS)Nrr:rrr#r`s rXAtest__check_targets_multiclass_with_both_y_true_and_y_pred_binaryri s:VFWF && ) )! , < < < < < >>>???????????????Hq!fq!fq!fq!fq!fq!fqRSfUVVM YYF  z=)A)A B B BNN& fMMMMNNNNNNNNNNNNNNNNNNs$A::A>A>!DDDc tjgdgdgdgdgdg}tjgd}tjgd}tjd|ddz |ddzd|ddz |ddzd|ddz |dd zd|d dz |d dzd|d dz |d d zg}tj|dd| tj|}t ||| |ksJdS) Nr皙rrrr)rr:r3r:r3)rr:r3rr:rr3rrrrrrrWrorrs rX.test_hinge_loss_multiclass_with_missing_labelsr szH ( ( ( ( ( ( ( ( ( ( ( ( ( ( (  MXooo & &F Xlll # #F8 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9  LGL!T|4444w|,, fmF ; ; ;?O O O O O O OrZc tjgdgdgdgdgdg}tjgd}tjgd}tjd|ddz |ddzd|dd z |ddzd|d d z |d dzd|d dz |d d zd|d d z |d dzg}tj|dd| tj|}t t ||| |dS)N)rrr)g333333ÿrr)rrr)rg(\gzGڿ)rr3r3rr3rr:rr3rrrr)r?rrrr+rrs rX@test_hinge_loss_multiclass_missing_labels_only_two_unq_in_y_truer s H ! ! ! ! ! ! ! ! ! ! ! ! ! ! !  MXooo & &F Xiii F8 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9  LGL!T|4444w|,,6=888:JrZc Vgd}gdgdgdgdgdgdg}tjd|ddz |ddzd|ddz |ddzd|ddz |dd zd|d dz |d dzd|d d z |d dzd|d dz |d d zg}tj|dd| tj|}t |||ksJdS) N)r&r'r(r'whiter(rrrrr:rr3rrrrr)rWrrrs rX+test_hinge_loss_multiclass_invariance_listsr sw? > >F$$$$$$$$$$$$$$$$$$ M8 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9    LGL!T|4444w|,, fm , ,0@ @ @ @ @ @ @rZc  gd}tjddgddgddgddgddgd d gg}t||}tjt jtj|d k|ddd f }t ||gd }gdgdgdg}t||d}t |d|dz}|dz}t||d}t |ddd}tj|dk}tj t5t||dd}dddn #1swxYwYtj t|5t |t|tj |dddddn #1swxYwYtj t5tdd gdd gddksJ dddn #1swxYwYtj t5tdd gddgdtj ksJ dddn #1swxYwYtj t5tdd gd d gdtj ksJ dddn #1swxYwYtj t5tgdgdgd gd!gddksJ dddn #1swxYwYtj t5tgdgd"gd gd!gdtj ksJ dddn #1swxYwYgd }d#d$gd%dgd&dgg}tjt5t||dddn #1swxYwYgd'}d#d$gd%dgd&dgd$d#gg}tj t|5t||}dddn #1swxYwYt |d(dddg}d#d$gd%dgg}tjddgddgg}d)}tjt|5t||dddn #1swxYwYd#d$gd%dgd#d*gg}d+}t|t||ftjtj|ddd f }t||d dg,}t ||gd-}gd.gd/gd0g} tj t|5t|| gd1,}dddn #1swxYwYt |d2ddS)3N)norryesrrrrrdg{Gz?gGz?rrrgMbP?g+?rr:rG)rrr)rrr)rrrTrNg躕ʀ?r3Fg.L`@rry_pred values do not sum to one)rOepsrrrrrr4r)rrrrrrrhamspamrrL7?zly_true contains only one label \(2\). Please provide the true labels explicitly through the labels argument.rzBFound input variables with inconsistent numbers of samples: [3, 2]rr)rrr)rrr)rrdrrFgPv0?)r?rrrr logpmfr+asarrayrr FutureWarningrrrrrlog) rWrVloss loss_trueuser_warning_msgr error_str true_log_losscalculated_log_lossy_score2s rX test_log_lossr s 4 4 4F X sc3Z$SzD$<%QVXF FF # #D)"(6*:*:e*CVAAAqD\RRSSSIi(((YYFoo @F FFd 3 3 3Di((( aKF aKF FFe 4 4 4DmQ77778 Z  # %F m $ $AA$C@@@AAAAAAAAAAAAAAA k)9 : : :OOD(627633L3L"M"MNNNOOOOOOOOOOOOOOO m $ $44AAA...!33333444444444444444 m $ $99AAA..."&88888999999999999999 m $ $99AAA..."&88888999999999999999 m $ $RR IIIyyy)))#D!LLLPQQQQQQRRRRRRRRRRRRRRR m $ $  YYY 999 E1 M M MQSQW W W W W W               YYFCj3*sCj 1F z " "!!   !!!!!!!!!!!!!!!, + +FCj3*sCj3* =F k)9 : : :((''(((((((((((((((i3333VFCj3* %Fhc S#J/00G C z 3 3 3!!   !!!!!!!!!!!!!!!Cj3*sCj 1FTIHff55WRVGAAAqDM22333M"67Aq6BBB+];;;YYF///BH k)9 : : :<<;;;<<<<<<<<<<<<<<<i333333s%EE  E +3F**F.1F.G88G<?G<'III4'J((J,/J, $K==LL!.MM #M N,,N03N0$PPP!Q>>RR&UU U ctjddg|}|}t||d}tj|sJdS)zCheck the behaviour of `eps="auto"` that changes depending on the input array dtype. Non-regression test for: https://github.com/scikit-learn/scikit-learn/issues/24315 rr:rautorN)r?rrrisfinite) global_dtyperWrVrs rXtest_log_loss_eps_autorr sY Xq!fL 1 1 1F [[]]F FF / / /D ;t  rZctjddgtj}|}t ||d}tj|sJdS)z2Check the behaviour of `eps="auto"` for np.float16rr:rrrN)r?rfloat16rrr)rWrVrs rXtest_log_loss_eps_auto_float16r sY Xq!fBJ / / /F [[]]F FF / / /D ;t  rZctjgd}tjddgddgddgddgg}ttfg} dd lm}m}|||fn#t$rYnwxYw|D]p\}}||||}}tj td 5t||} dddn #1swxYwYt| d d qdS)Nrrrrrrrr) DataFramerrrrrr) r?rr)rrrr} ImportErrorrrrrr+) y_try_prtypesrr TrueInputType PredInputTyperWrVrs rXtest_log_loss_pandas_inputr sq 8222 3 3D 8c3Z#sc3Z#sD E ED] + ,E ,,,,,,,, fi())))      (-88$ }&t,,mmD.A.A \+-N O O O , ,FF++D , , , , , , , , , , , , , , ,D)Q77777 88s$A'' A43A4/C  C C ctjgd}tjgd}tj||z dzt |z }t t ||dt t |||t t d|z||t t d|zdz ||tjt5t ||dddddn #1swxYwYtjt5t ||dzdddn #1swxYwYtjt5t ||dz dddn #1swxYwYtjgd}tjgd}d }tjt| 5t ||dddn #1swxYwYt t d gd gd t t dgd gd t t dgd gdt t dgd gdd t t dgd gdddS)N)rr:r:rr:r:)rrrdrrgffffff?r3r~rr:)rr:r3r)rrrrzMOnly binary classification is supported. The type of the target is multiclassrrrg{Gz?rrfoobarr) r?rrnormrrr+rrrr)rWrV true_scorers rXtest_brier_score_lossr  s X((( ) )F X555 6 6FVf_--2S[[@J(88#>>>(88*EEE(vv>> KKK(Va@@*MMM z " "--,,,--------------- z " "//#.../////////////// z " "//#...///////////////Xlll # #F X*** + +FW z 7 7 7))((()))))))))))))))("u55t<<<(!se44d;;;(!se44d;;;(%3%5III4PPP(%3%5III4PPPPPsH1DDD:EE!E>FF"%F"2HHHcd}tjt|5tgdgdddddS#1swxYwYdS)Nz%y_pred contains classes not in y_truerr_r)rrrrrs rX#test_balanced_accuracy_score_unseenr s 1C k - - -66 999555666666666666666666sAAAz y_true,y_pred)rrrr)rrrr)rrrrct||dtj|}t5t ||}dddn #1swxYwY|t j|ksJt ||d}t |tj||d}|||z d|z z ksJdS)NrrT)adjustedrr:)r!r?uniquer/rrr full_like)rWrV macro_recallbalancedrchances rXtest_balanced_accuracy_scorer s  &0A0AL   ;;*66::;;;;;;;;;;;;;;; v}\22 2 2 2 2&vvEEEH $VR\&&)-L-L M MF 6)a&j9 9 9 9 9 9 9sAAArr))FTr)r~r)zeroonec\tjd}d|d}}|||d}|tur||}n|}||||}tjtj|rJdS) zCheck that the metric works with different types of `pos_label`. We can expect `pos_label` to be a bool, an integer, a float, a string. No error should be raised for those types. *rkrT)rreplacerrN) r?rCrDchoiceruniformranyr)r{rrRrOrrWrVrs rX*test_classification_metric_pos_label_typesr s* )   # #Cwr{yI ZZiZ > >F !!!),, VFFi 8 8 8Fvbhv&&'''''''rZscoringrr3)rrctjd\}}tdd||}t ||||dddS) aZCheck that we validate `np.nan` properly for classification metrics. With `n_jobs=2` in cross-validation, the `np.nan` used for the singleton will be different in the sub-process and we should not use the `is` operator but `math.isnan`. Non-regression test for: https://github.com/scikit-learn/scikit-learn/issues/27563 r)r9r) max_depthr9r3r)r n_jobs error_scoreN)r make_classificationr(rHr%)r rMrN classifiers rX9test_classification_metric_division_by_zero_nan_validatonr' s^&  'Q 7 7 7DAq'!!DDDHHANNJJ1gaWUUUUUUrZ)NF)rr functoolsr itertoolsrrrnumpyr?rscipyrscipy.spatial.distancerr@ scipy.statsr sklearnr r sklearn.datasetsr sklearn.exceptionsr sklearn.metricsrrrrrrrrrrrrrrrrrrr r!r"sklearn.metrics._classificationr$sklearn.model_selectionr%sklearn.preprocessingr&r' sklearn.treer(sklearn.utils._mockingr)sklearn.utils._testingr*r+r,r-r.r/sklearn.utils.extmathr0sklearn.utils.validationr1rYr|rmark parametrizerrrrrrrrrrrrrrr0rCrHrVr_rerirprrrrrrrrrrrrrrrrr rrrr!r$r+r.r1r6r8r:r<rBrJrMr[r]rbrermrsr}rrrrrrrrrrrrrrrrrrrrrrrr rrrr'rrZrXr<s 2222222222 888888!!!!!!!!!!!!!!;;;;;;555555.;:::::333333@@@@@@@@//////000000.-----777777 )')')')'`>D>D>DBWWW<61a*@AA  BA  7 7 7   D$*J*J*JZMMM,>>>6 LL BH#OO#OO#OO#OO     . - - = = = (99)(9 OO BH#OO#OO#OO#OO#OO     II OO *;;+*;    ===* = = = O O OF&S&S&SRTTT<+%%%;;;& #"(#5#5#566""(#5#5#566   A  #"(#5#5#566""(#5#5#566   I  #"(#5#5#566""(#5#5#566   :  #"(#5#5#566""(#5#5#566   I  #"(#5#5#566""(#5#5#566   O  E),,Z**[,,Z*#"(???33""(???33   <  ***"""2>444 1a.99)aS1#JR+ABB  !$$$  ' 'CB:9 ')aS1#JR+ABB  !$$$ CB$2$2$2N R R RF555pc5\22UU32UB7(7(7(t$S$S$STT , ,UT ,000"((("...& ;< QAB '( 888  taVYYY'-M-M-M%%%6"A"A"ABB00CB0"%%%4%%%$%%%(%%%6 % % %F%%%,%%%.XXX I I I%%%< 6 6 6BBB(%D%D%DPJJJZ"""J. + + +868:LMM 2 2NM 2?U?U?UD===@+&&2626"23[[  [|!%%$M$M$MNN1a.99!5!5:9ON&%!5H$M$M$MNN""ON"&1a.99WW:9W@3338_0_0_0D1a.99< < :9< ~61a*@AA##BA#L61a*@AA$$BA$N61a*@AA$($(BA$(N'''>___D===888AAA6***"NNN8PPP4@AAA8W4W4W4t   888& Q Q QF666    3334   3334   3334 : : :  #&&&'   CCC((  ($  HBF333 Karv>>> O26::: L777  V V V V VrZ