昺hJdZddlmZddlZddlmZmZmZmZm Z m Z m Z m Z m Z ddlmZddlmZerddlmZddlmZdd lmZddlmZd ZddZGddZGdde ZGddeZdS)zBA Tracer Implementation that records activity to Weights & Biases.) annotationsN) TYPE_CHECKINGAnyDictListOptionalSequenceTuple TypedDictUnion) BaseTracer)Run)Settings)Span)StrPathT run_inputsOptional[dict]returndictc |siSddlm}ddlm}i}|D]\\}}t ||r||||<$|dkr-|dt|DW|||<]|S)Nr) MessageToJson)Messageinput_documentscDi|]\}}d||S)input_document_)json).0idocs s/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/langchain_community/callbacks/tracers/wandb.py z!_serialize_io..*s/RRRvq#&1&& RRR)google.protobuf.json_formatrgoogle.protobuf.messageritems isinstanceupdate enumerate)rrrserialized_inputskeyvalues r _serialize_ior,s  999999////// &&((++ U eW % % +%2]5%9%9 c " " % % %  $ $RR5AQAQRRR    &+ c " " r"c|eZdZdZd dZd!d Zd"d Zd"d Zd"dZd"dZ d"dZ d#dZ d$dZ d%d&dZ d'd(dZd)dZdS)* RunProcessorz>Handles the conversion of a LangChain Runs into a WBTraceTree. wandb_moduler trace_modulec"||_||_dSN)wandb trace_tree)selfr/r0s r __init__zRunProcessor.__init__4s! &r"runrrOptional['Span']c ||}|S#t$r/}tr|jd|Yd}~dSd}~wwxYw)zConverts a LangChain Run into a W&B Trace Span. :param run: The LangChain Run to convert. :return: The converted W&B Trace Span. zVSkipping trace saving - unable to safely convert LangChain Run into W&B Trace due to: N)_convert_lc_run_to_wb_span ExceptionPRINT_WARNINGSr3termwarn)r5r7spanes r process_spanzRunProcessor.process_span8s 22377DK     ##2./2244444  s A$A  A'Span'c |jr i|jni}|j|d<|j|jt |jnd|jt|j dz|j )t|j dznd|j |jj j n|jj j|j |S)zBase utility to create a span from a run. :param run: The run to convert. :return: The converted Span. execution_orderNi)span_idname start_time_ms end_time_ms status_codestatus_message attributes)extrarCr4ridstrrEint start_time timestampend_timeerror StatusCodeSUCCESSERROR)r5r7rJs r _convert_run_to_wb_spanz$RunProcessor._convert_run_to_wb_spanHs '*i7] ]]R (+(; $%###&6#5CKKK4cn66884?@@|'CL2244t;<<<y 2::+19!$   r"c"}|ji|_jpidi|jd<fdt jdpgD|_jjj |_ |S)zConverts a LangChain LLM Run into a W&B Trace Span. :param run: The LangChain LLM Run to convert. :return: The converted W&B Trace Span. N llm_outputc 8g|]\}}jd|ijltjd|krNtjd|dkr*dt jd|DndS)promptN generationsrc,i|]\}}d||dS)gen_text)rg_igens r r!zGRunProcessor._convert_llm_run_to_wb_span...ks8 S!3LL#f+r"inputsoutputs)r4Resultrdlenr()rndxrZr7r5s r z.hs   V O " " &) K+CK 677#==CK 6s;<)D"EE    #o6: r"cr|}jt|jt|jg|_fd|jD|_d|j vrjj j njj j |_|S)zConverts a LangChain Chain Run into a W&B Trace Span. :param run: The LangChain Chain Run to convert. :return: The converted W&B Trace Span. rbc:g|]}|Sr_r:r child_runr5s r rhz>RunProcessor._convert_chain_run_to_wb_span..4! ! ! ;DD + +I 6 6! ! ! r"agent)rVr4rer,rcrdrk child_runs child_spansrElowerrlAGENTCHAINrnros` r _convert_chain_run_to_wb_spanz*RunProcessor._convert_chain_run_to_wb_span|s 0055  O " "$SZ00- :T:T #    ! ! ! ! HK! ! !  #(..**** O $ * *)/  r"c|}jt|jt|jg|_fd|jD|_jj j |_ |S)zConverts a LangChain Tool Run into a W&B Trace Span. :param run: The LangChain Tool Run to convert. :return: The converted W&B Trace Span. rbc:g|]}|Sr_rtrus r rhz=RunProcessor._convert_tool_run_to_wb_span..rwr") rVr4rer,rcrdrkryrzrlTOOLrnros` r _convert_tool_run_to_wb_spanz)RunProcessor._convert_tool_run_to_wb_spans 0055 O " "$SZ00- :T:T #    ! ! ! ! HK! ! ! #o6; r"c|jdkr||S|jdkr||S|jdkr||S||S)zUtility to convert any generic LangChain Run into a W&B Trace Span. :param run: The LangChain Run to convert. :return: The converted W&B Trace Span. llmchaintool)run_typerqr~rrVr5r7s r r:z'RunProcessor._convert_lc_run_to_wb_spans{ <5 33C88 8 \W $ $55c:: : \V # #44S99 9//44 4r"Optional[Dict[str, Any]]c tj|}||}d}|||}d\}}||||}||}|S#t $r/}tr|j d|Yd}~dSd}~wwxYw)zUtility to process a run for wandb model_dict serialization. :param run: The run to process. :return: The convert model_dict to pass to WBTraceTree. )rLrE serializedrcrd parent_run_idrC) keep_keys))lctype)api_key) exact_keys partial_keysz$WARNING: Failed to serialize model: N) rloads flatten_runtruncate_run_iterativemodify_serialized_iterative build_treer;r<r3r=) r5r7data processedrrroutputr?s r process_modelzRunProcessor.process_models  :chhjj))D((..II33I3SSI'C $J 88j|9I__Y//FM    P ##$N1$N$NOOO44444 sBB C$B>>CDict[str, Any]List[Dict[str, Any]]c(dfd |gS)zUtility to flatten a nest run object into a list of runs. :param run: The base run to flatten. :return: The flattened list of runs. ryrrc|gSg}|D]K}|dg}||||L|S)zUtility to recursively flatten a list of child runs in a run. :param child_runs: The list of child runs to flatten. :return: The flattened list of runs. Nry)popappendextend)ryresultitemflattens r rz)RunProcessor.flatten_run..flattensm ! F" 3 3!XXlB77  d### ggj112222Mr")ryrrrr_)r5r7rs @r rzRunProcessor.flatten_runs3        wu~~r"r_runsrTuple[str, ...]cJdfd }tt||S)a Utility to truncate a list of runs dictionaries to only keep the specified keys in each run. :param runs: The list of runs to truncate. :param keep_keys: The keys to keep in each run. :return: The truncated list of runs. r7rrcNi}|D]}|vr||||<|S)zUtility to truncate a single run dictionary to only keep the specified keys. :param run: The run dictionary to truncate. :return: The truncated run dictionary )rj)r7new_dictr*rs r truncate_singlez.truncate_singles= H 1 1)##$'GGCLLHSMOr"r7rrrlistmap)r5rrrs ` r rz#RunProcessor.truncate_run_iteratives;      C..///r"rrcd fd  ddfd dfd dfd }tt||S)aUtility to modify the serialized field of a list of runs dictionaries. removes any keys that match the exact_keys and any keys that contain any of the partial_keys. recursively moves the dictionaries under the kwargs key to the top level. changes the "id" field to a string "_kind" field that tells WBTraceTree how to visualize the run. promotes the "serialized" field to the top level. :param runs: The list of runs to modify. :param exact_keys: A tuple of keys to remove from the serialized field. :param partial_keys: A tuple of partial keys to remove from the serialized field. :return: The modified list of runs. objrrc t|trJfd|D}|D]\}}|||<n#t|trfd|D}|S)zRecursively removes exact and partial keys from a dictionary. :param obj: The dictionary to remove keys from. :return: The modified dictionary. c\i|]'\}v tfdD$|(S)c3 K|]}|vV dSr2r_)rpartialks r zmRunProcessor.modify_serialized_iterative..remove_exact_and_partial_keys...s'II1 IIIIIIr")any)rvrrrs @r r!zcRunProcessor.modify_serialized_iterative..remove_exact_and_partial_keys..sZ1 **IIIILIIIII+q***r"c&g|] }|Sr_r_)rxremove_exact_and_partial_keyss r rhzcRunProcessor.modify_serialized_iterative..remove_exact_and_partial_keys..#s%EEEA44Q77EEEr")r&rr%r)rrrrrrs r rzORunProcessor.modify_serialized_iterative..remove_exact_and_partial_keyss #t$$ F #   IIKK>>DAq::1==CFF>C&& FEEEEEEEJr"Frootboolct|trd|vsd|vr|s|d}|s|dg}|d|d<|dd|ddd|vr4|d}|D] \}}|||< |D]\}}|||<n#t|t rfd|D}|S)aRecursively handles the id and kwargs fields of a dictionary. changes the id field to a string "_kind" field that tells WBTraceTree how to visualize the run. recursively moves the dictionaries under the kwargs key to the top level. :param obj: a run dictionary with id and kwargs fields. :param root: whether this is the root dictionary or the serialized dictionary. :return: The modified dictionary. rLrE_kindNkwargsc&g|] }|Sr_r_)rrhandle_id_and_kwargss r rhzZRunProcessor.modify_serialized_iterative..handle_id_and_kwargs..As%<<<1++A..<<.handle_id_and_kwargs&s0#t$$ =CKK6S==$=GGDMME 2!$ 1#(9CLGGD$'''GGFD)))3!$!2!2$*LLNN''DAq%&CFFIIKK55DAq11!44CFF5C&& =<<<<<<<Jr"rc8|d}|}|S)zTransforms the serialized field of a run dictionary to be compatible with WBTraceTree. :param serialized: The serialized field of a run dictionary. :return: The transformed serialized field. T)rr_)rrrs r transform_serializedzFRunProcessor.modify_serialized_iterative..transform_serializedDs0 .-jtDDDJ66zBBJ r"r7c$ |}|d}|D] \}}|||< |dd}|dd}|dd}|s|}|d||i}|S)zTransforms a run dictionary to be compatible with WBTraceTree. :param run: The run dictionary to transform. :return: The transformed run dictionary. rrNrErC_)rr%rj) r7transformed_dictrrrrrEexec_ord output_dictrs r transform_runz?RunProcessor.modify_serialized_iterative..transform_runNs 43C88 )--l;;J"((** ( (1&' ##$(($77E#''55D'++,=tDDH $$d$$&6K r")rrrrF)rrrrrr)rrrrrr)r5rrrrrrrs `` @@@r rz(RunProcessor.modify_serialized_iteratives(        &/4       <             .C t,,---r"c B i}i |D]V}|D]?\}}|dd}|dd}||i||<|r| |<@W D]~\}} || } ||tt||| tt| tt||<t fd|D} | S)zBuilds a nested dictionary from a list of runs. :param runs: The list of runs to build the tree from. :return: The nested dictionary representing the langchain Run in a tree structure compatible with WBTraceTree. rLNrc3*K|] \}}|v |VdSr2r_)rid_valrchild_to_parents r rz*RunProcessor.build_tree..~s:  !VT6;X;XD;X;X;X;X  r")r%rnextiter) r5r id_to_dataentityr*rrrchild_id parent_id parent_dict root_dictrs @r rzRunProcessor.build_treegs^   < >>)$+t7GHHs ' AAAc8|jdS)zpWaits for all asynchronous processes to finish and data to upload. Proxy for `wandb.finish()`. N)rfinish)r5s r rzWandbTracer.finishs r"r7rc4||j|}|j|}|dS|j||}|jj#|jjd|idSdS)z+Logs a LangChain Run to W*B as a W&B Trace.N) root_span model_dictlangchain_trace) rrr@rr WBTraceTreerr7log)r5r7r r  model_traces r _log_trace_from_runzWandbTracer._log_trace_from_runs &33C88 '55c::   F&22!3   ;? & KO  !2K @ A A A A A ' &r"Frrc:|jj*|jpi}i|}d|vrddi|d<|jjd i||jjX|r4|jjjj}|jd|d|jjddSdS) zlEnsures an active W&B run exists. If not, will start a new run with the provided run_args. NrsilentTz'Streaming LangChain activity to W&B at z `WandbTracer` is currently in beta. Please report any issues to https://github.com/wandb/wandb/issues with the tag `langchain`. langchain)repor_)rr7rinitrrun_urltermlog_label)r5rrrs r rzWandbTracer._ensure_runs ;? "~+H)\H))(0$'7$ DK  ( (x ( ( ( ;? & +/2: ###g### KO " " " 4 4 4 4 4 ' &r"'Run'c0||dS)zPersist a run.N)rrs r _persist_runzWandbTracer._persist_runs   %%%%%r"r2)rrrrrr)rr)r7rrrr)rrrr)r7rrr) rrrrrrrr6rrrr __classcell__)rs@r rrs !D    (,I,,,, I I I I I I IDBBBB"555554&&&&&&&&r"r)rrrr) r __future__rrtypingrrrrrr r r r langchain_core.tracers.baser langchain_core.tracers.schemasrr3r WBSettingswandb.sdk.data_types.trace_treerwandb.sdk.lib.pathsrwandb.wandb_runWBRunr<r,r.rrr_r"r r&sHH""""""                       322222......-,,,,,,444444++++++,,,,,,&QQQQQQQQh 666669666:`&`&`&`&`&*`&`&`&`&`&r"