昺h >dZddlZddlmZmZmZddlmZddlm Z iddddd dd d d d d d dddddd dd dd ddddddddddddiddddddd dd!d"d#d"d$d%d&d%d'd%d(d%d)d%d*d+d,d+d-dd.dd/dd0did1d"d2d"d3d%d4d%d5d%d6d%d7d+d8d+d9d:d;d:dd=d?d%d@d%dAdBdCdBdDdBidEdFdGdHdIdHdJdHdKdFdLdHdMdNdOdNdPd:dQd%dRddSd:dTd%dUd%dVdFdWdXdYdHdZdiZ ddd\e d]e d^e fd_Z ddd\e d`ed]e d^efdaZGdbdceZdS)ez(Callback Handler that prints to std out.N)AnyDictList)BaseCallbackHandler) LLMResultgpt-4gQ?z gpt-4-0314z gpt-4-0613z gpt-4-32kgQ?zgpt-4-32k-0314zgpt-4-32k-0613zgpt-4-vision-previewg{Gz?zgpt-4-1106-previewzgpt-4-completionzgpt-4-0314-completionzgpt-4-0613-completionzgpt-4-32k-completiongQ?zgpt-4-32k-0314-completionzgpt-4-32k-0613-completionzgpt-4-vision-preview-completionzgpt-4-1106-preview-completionz gpt-3.5-turbog~jtX?zgpt-3.5-turbo-0301zgpt-3.5-turbo-0613zgpt-3.5-turbo-1106gMbP?zgpt-3.5-turbo-instructzgpt-3.5-turbo-16kg~jth?zgpt-3.5-turbo-16k-0613zgpt-3.5-turbo-completiongMb`?zgpt-3.5-turbo-0301-completionzgpt-3.5-turbo-0613-completionzgpt-3.5-turbo-1106-completionz!gpt-3.5-turbo-instruct-completionzgpt-3.5-turbo-16k-completiongMbp?z!gpt-3.5-turbo-16k-0613-completionz gpt-35-turbozgpt-35-turbo-0301zgpt-35-turbo-0613zgpt-35-turbo-instructzgpt-35-turbo-16kzgpt-35-turbo-16k-0613zgpt-35-turbo-completionzgpt-35-turbo-0301-completionzgpt-35-turbo-0613-completionz gpt-35-turbo-instruct-completionzgpt-35-turbo-16k-completionz gpt-35-turbo-16k-0613-completionz text-ada-001g-C6:?adaztext-babbage-001gMb@?babbageztext-curie-001curieztext-davinci-003g{Gz?ztext-davinci-002zcode-davinci-002zbabbage-002-finetunedg-C6Z?zdavinci-002-finetunedg~jt?zgpt-3.5-turbo-0613-finetunedzgpt-3.5-turbo-1106-finetunedz babbage-002-finetuned-completionz davinci-002-finetuned-completionz'gpt-3.5-turbo-0613-finetuned-completiongMb?z'gpt-3.5-turbo-1106-finetuned-completionzbabbage-002-azure-finetunedzdavinci-002-azure-finetunedz!gpt-35-turbo-0613-azure-finetunedz&babbage-002-azure-finetuned-completionz&davinci-002-azure-finetuned-completionz,gpt-35-turbo-0613-azure-finetuned-completionzada-finetuned-legacyzbabbage-finetuned-legacyga2U0*c?zcurie-finetuned-legacyzdavinci-finetuned-legacyF model_name is_completionreturnc|}d|vr|dddz}d|vr|dddz}d|vr|ddd z}|rL|d s2|d s|d sd |vr d|vr|dzS|S)a% Standardize the model name to a format that can be used in the OpenAI API. Args: model_name: Model name to standardize. is_completion: Whether the model is used for completion or not. Defaults to False. Returns: Standardized model name. z.ft-rz-azure-finetunedz:ft-:z-finetuned-legacyzft:z -finetunedrzgpt-3.5zgpt-35 finetunedlegacyz -completion)lowersplit startswith)r r s q/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/langchain_community/callbacks/openai_info.pystandardize_model_namer]s !!##J %%f--a03EE  %%c**1-0CC  %%c**1- < g&&   + +   * * : % %(**D*DM)) num_tokensct||}|tvr@td|ddtzt||dz zS)a& Get the cost in USD for a given model and number of tokens. Args: model_name: Name of the model num_tokens: Number of tokens. is_completion: Whether the model is used for completion or not. Defaults to False. Returns: Cost in USD. r zUnknown model: z=. Please provide a valid OpenAI model name.Known models are: z, i)rMODEL_COST_PER_1K_TOKENS ValueErrorjoinkeys)r rr s rget_openai_token_cost_for_modelr!s( -PPPJ111 !j ! ! !#'99-E-J-J-L-L#M#M N    $J /:3D EErceZdZUdZdZeed<dZeed<dZeed<dZ eed<dZ e ed<dfd Z d e fd Zed efd Zdee efdee ded d fdZde ded d fdZdeded d fdZddZded dfdZxZS)OpenAICallbackHandlerz)Callback Handler that tracks OpenAI info.r total_tokens prompt_tokenscompletion_tokenssuccessful_requestsg total_costrNcxttj|_dS)N)super__init__ threadingLock_lock)self __class__s rr+zOpenAICallbackHandler.__init__s, ^%% rc Vd|jd|jd|jd|jd|j S)Nz Tokens Used: z Prompt Tokens: z Completion Tokens: z Successful Requests: z Total Cost (USD): $)r$r%r&r'r(r/s r__repr__zOpenAICallbackHandler.__repr__s^ 4D- 4 4 $ 2 4 4$($: 4 4%)$< 4 4#'/  4 4 rcdS)z;Whether to call verbose callbacks even if verbose is False.Tr2s ralways_verbosez$OpenAICallbackHandler.always_verboses tr serializedpromptskwargsc dS)zPrint out the prompts.Nr5)r/r7r8r9s r on_llm_startz"OpenAICallbackHandler.on_llm_starts  rtokenc dS)zPrint out the token.Nr5)r/r<r9s ron_llm_new_tokenz&OpenAICallbackHandler.on_llm_new_tokens rresponsec |jdSd|jvr1|j5|xjdz c_dddn #1swxYwYdS|jd}|dd}|dd}t |jdd}|t vr#t ||d }t ||}nd}d}|j5|xj||zz c_|xj|d dz c_|xj |z c_ |xj |z c_ |xjdz c_ddddS#1swxYwYdS) zCollect token usage.N token_usagerr&rr%r Trr$) llm_outputr.r'getrrr!r(r$r%r&) r/r?r9rAr&r%r completion_cost prompt_costs r on_llm_endz OpenAICallbackHandler.on_llm_ends   &4  3 3 3 . .((A-(( . . . . . . . . . . . . . . .4)-8 'OO,?CC#;; +H,?,C,CLRT,U,UVV 1 1 1=-TO:*mTTKKOKZ * * OO{_< rrGrIrM __classcell__)r0s@rr#r#s33L#M3s    J&&&&&& #    X sCx. 379 HK      c S T    *9******@)@rr#)F)rQr,typingrrrlangchain_core.callbacksrlangchain_core.outputsrrrUrWrrRrTr!r#r5rrr\s ..""""""""""888888,,,,,,R TR$R$ R  R d RdRDR$RRTRTRDR R  !R"&t#R$$T%R(V)RR*&+R,&-R.%/R0f1R23R4e5R89R:$U;R<$U=R>$U?R@(ARB#ECRD(ERHFIRJKRLMRNVORRRPQRRUSRVuWRX#EYRZ#E[R\']R^"5_R`'aRdFeRf 6gRhiRjvkRlemRn UoRpqRrsRtuRRRxVyRzU{R|#E}R~#ERB'CRD'ERF.uGRH.uIRL"6MRN"5ORP(QRT-fURV-eWRX3EYR\F]R^_R`eaRRbcRRn  F=BFFF!$F59F FFFF0KKKKK/KKKKKr