ޘh= d dl Z d dlZd dlZd dlmZ d dlmZ ddlm Z ddl
m Z m Z d Z
ddZd Z G d
d Z G d d
e Z G d de ZdS ) N)Optional )TrainerCallback)IntervalStrategy
has_lengthc z t | } | dz | dz dz | dz }}}|dk r | d|dd|dn|dd|dS )z$Format `t` (in seconds) to (h):mm:ssi < r :02d)int)thmss c/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/transformers/utils/notebook.py format_timer sm AA4i!r'R R!qA%&!VVa ! !! ! ! !! ! ! ! !A1C1C1CA1C1C1CC , c & d| d| d| d| d| d S )Nz
)valuetotalprefixlabelwidths r html_progress_barr ! s[
', =B
r c d}|dz
}| d D ] }|d| dz
} |dz
}| dd D ]B}|d z
}|D ]3}t |t r|d
nt | }|d | d z
}4|d
z
}C|dz
}|S )z*Put the texts in `items` in an HTML table.z%
z*
r z
| z |
z
Nz
z.6fz
| z |
z
z
)
isinstancefloatstr)items html_codeilineelts r text_to_html_tabler' , s n>n5n5n !## A% 9;;L ,t >D t'''-1->%$JZBZ-[**-1*
""
+/(z !JJLLL+7+/+EV[I[+\( OOE " " " #DO )DN*28RVW8W8W !
#C(9D\>>DJ>>>DJJ
%
-Y\YYDJYYTEV9W9WYYDJJ e Zd ZdZd fd Zd Zd Zd
dZd Z xZ S ) r- a
An object tracking the updates of an ongoing training with progress bars and a nice table reporting metrics.
Args:
num_steps (`int`): The number of steps during training. column_names (`list[str]`, *optional*):
The list of column names for the metrics table (will be inferred from the first call to
[`~utils.notebook.NotebookTrainingTracker.write_line`] if not set).
Nc p t | |d n|g| _ d | _ d S r[ )superr8 inner_table child_bar)r7 num_steps column_names __class__s r r8 z NotebookTrainingTracker.__init__ s9
####/#744l^ r c t | j | j | j | j | j | _ | j "| xj t | j z
c_ | j | xj | j j z
c_ | j
4t j t j
| j d | _
d S | j
t j
| j d S rU )r r r r r r r# rd r' re r3 rW rR rX rJ rY s r rR z NotebookTrainingTracker.display s *4:tz4;PTPZ\`\fgg ' NN 01A B B BNN > % NNdn 6 6NN ; ,ty '@'@TRRRDKKK K ty 8 8 9 9 9 9 9r c | j It t g| _ dS | j d }D ]}||vr| | || j d< t | j dk r| j d }| j d d }|d | k r(| j fd|D dS |D ]$}|vr || | |< %fd|D | j d< dS | j fd|D dS )z
Write the values in the inner table.
Args:
values (`dict[str, float]`): The values to display.
Nr r c < g | ]} |d S )zNo Log)get.0cvaluess r
z6NotebookTrainingTracker.write_line.. s' ,V,V,VVZZ8-D-D,V,V,Vr c g | ]
}| S r r )ro rp
new_valuess r rr z6NotebookTrainingTracker.write_line.. s +K+K+KaJqM+K+K+Kr c g | ]
}| S r r rn s r rr z6NotebookTrainingTracker.write_line.. s (D(D(Dq(D(D(Dr )rd listkeysrq appendrQ index)r7 rq columnskey last_values first_columnrp rt s ` @r
write_linez"NotebookTrainingTracker.write_line s # $V[[]] 3 3T&--//5J5J KD &q)G
(
(g%%NN3'''")D Q 4#$$q(( " .r 2 # / 21 5 q>VL%999$++,V,V,V,Vg,V,V,VWWWWW "(J $ J J J..,7
a8H8H,IJqM+K+K+K+K7+K+K+KD$R((( ''(D(D(D(DG(D(D(DEEEEEr r c @ t ||| | | _ | j S )a
Add a child progress bar displayed under the table of metrics. The child progress bar is returned (so it can be
easily updated).
Args:
total (`int`): The number of iterations for the child progress bar.
prefix (`str`, *optional*): A prefix to write on the left of the progress bar.
width (`int`, *optional*, defaults to 300): The width (in pixels) of the progress bar.
)r r, r )r) re )r7 r r r s r add_childz!NotebookTrainingTracker.add_child s% -U6$V[\\\~ r c < d| _ | dS )z0
Closes the child progress bar.
N)re rR rY s r remove_childz$NotebookTrainingTracker.remove_child s r r[ )Nr )
r\ r] r^ r_ r8 rR r~ r r
__classcell__)rh s @r r- r- s
: : : F F F> r r- c H e Zd ZdZd Zd Zd Zd dZd Zd dZ d d Z
d
Z dS ) NotebookProgressCallbackz
A [`TrainerCallback`] that displays the progress of training or evaluation, optimized for Jupyter Notebooks or
Google colab.
c 0 d | _ d | _ d| _ d S )NF)training_trackerprediction_bar_force_next_updaterY s r r8 z!NotebookProgressCallback.__init__& s $ ""' r c |j t j k rdnd| _ d| _ d| _ | j gdgz }|j t j k r| d t |j | | _
d S )NEpochStepr
Training LossValidation Loss)
eval_strategyr EPOCHr}
training_losslast_logNOrx r- max_stepsr )r7 argsstatecontrolkwargsrg s r on_train_beginz'NotebookProgressCallback.on_train_begin+ s '+'9=M=S'S'SGGY_
)*o->> !1!4 4 4 1 2 2 2 7 V V r c t |j |j k rt |j n|j d}| j |j dz d| d|j | j d| _ d S )NrO r Epoch rN r2 r9 F)r epochr rJ global_stepnum_train_epochsr )r7 r r r r r s r on_step_endz$NotebookProgressCallback.on_step_end4 s $' $4$4 $C$CEK EKI]I] $$ !=U==U%;== 0 %
#( r Nc f t | sd S | j q| j -| j t | | _ n!t t | | _ | j d d S | j | j j dz d S )Nr )r r r r rQ r) rJ r )r7 r r r eval_dataloaderr s r on_prediction_stepz+NotebookProgressCallback.on_prediction_step= s /** F &$0&*&;&E&Ec/FZFZ&[&[##&9#o:N:N&O&O# & &q ) ) ) ) ) & &t':'@1'D E E E E Er c T | j | j d | _ d S r[ )r rG r7 r r r r s r
on_predictz#NotebookProgressCallback.on_predictI s. * % % ' ' ' "r c |j t j k r4d|v r2d|d i}|j |d< | j | d S d S d S )Nlossr r )r r r r r r~ )r7 r r r logsr rq s r on_logz NotebookProgressCallback.on_logN s_ !1!4 4 44 %tF|4F " .F6N ! , ,V 4 4 4 4 4 5 4 r c | j ddd}t |j D ]}d|v r
|d |d< n| j dk rt |j |d< n
|j |d< d}|D ]-} | d rt j d d
| }.|
d d }
|
d d }
|
| d
d }
|
| dd }
|
| dd }
|
| dd }
| D ]N\ } } | d } d
d | dd D }
|
dk rd}
| ||
< O| j | | j d | _ d| _ d S d S )NzNo log)r r r r r r eval_lossz\_loss$r/
total_flosr _runtime_samples_per_second_steps_per_second_jit_compilation_time_rL c 6 g | ]}| S r )
capitalize)ro parts r rr z8NotebookProgressCallback.on_evaluate..n s" J J Jt !2!2 J J Jr r Lossr T)r reversed log_historyr} r r r endswithresubpopr" splitjoinr~ r r r )r7 r r r metricsr rq logmetric_key_prefixkr vsplitsnames r on_evaluatez$NotebookProgressCallback.on_evaluateV s ,'/HMMF 122
S==.1&kF?+E ! G++"%ek"2"2w!&!2v &
B
B::g&& B(*z2q(A(A% L$//A GT**A 0 : : :DAAA 0 E E EtLLA 0 C C CTJJA 0 G G GNNA
!
!1 xx J Jvabbz J J JKK6>>,D t ! , ,V 4 4 4 ! . . 0 0 0"&D &*D # # #A - ,r c | j |j dt |j d|j d d | _ d S )Nr rN Tr )r rJ r r r r r s r on_train_endz%NotebookProgressCallback.on_train_endy s[ $$ HS - -HH0FHH %
!% r r[ ) r\ r] r^ r_ r8 r r r r r r r r r r r r s
( ( (
W W W( ( (
F
F
F
F# # #
5 5 5 5!+ !+ !+ !+F% % % % %r r )r )r4 r r; typingr IPython.displayrR rW trainer_callbackr
trainer_utilsr r r r r' r) r- r r r r r sH
. . . . . . 8 8 8 8 8 8 8 8D D D "R. R. R. R. R. R. R. R.jK K K K K 1 K K K\_% _% _% _% _% _% _% _% _% _%r