昺hC+dZddlZddlmZddlmZmZmZmZddl m Z m Z ddl m Z mZddlmZddlmZdd lmZmZmZdd lmZmZejeZGd d eZGd deZGddeZdS)z.Tools for interacting with a Power BI dataset.N) perf_counter)AnyDictOptionalTuple)AsyncCallbackManagerForToolRunCallbackManagerForToolRun)Field validator)BaseTool)_import_tiktoken)BAD_REQUEST_RESPONSEDEFAULT_FEWSHOT_EXAMPLESRETRY_RESPONSE)PowerBIDataset json_to_mdc eZdZUdZdZeed<dZeed<eed<e dZ e ed <e Z eeed <e ed Zeeefed <d Zeed<dZeed<dZeeed<GddZeddedefdZdedeefdZ d!dedeededefdZ d!dedeededefdZdeeefdeeeeeffdZdedee effd Z!dS)"QueryPowerBIToolz%Tool for querying a Power BI Dataset. query_powerbinamea Input to this tool is a detailed question about the dataset, output is a result from the dataset. It will try to answer the question using the dataset, and if it cannot, it will ask for clarification. Example Input: "How many rows are in table1?" description llm_chainTexcludepowerbiexamples)default_factoryr session_cachemax_iterationsioutput_token_limitNtiktoken_model_nameceZdZdZdZdS)QueryPowerBITool.Config'Configuration for this pydantic object.TN__name__ __module__ __qualname____doc__arbitrary_types_allowedn/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/langchain_community/tools/powerbi/tool.pyConfigr$)55"&r-r/returnc`|jjD] }|dvrtd|jj!|S)z8Make sure the LLM chain has the correct input variables.) tool_inputtablesschemasrzrLLM chain for QueryPowerBITool must have input variables ['tool_input', 'tables', 'schemas', 'examples'], found %s)promptinput_variables ValueError)clsrvars r."validate_llm_chain_input_variablesz3QueryPowerBITool.validate_llm_chain_input_variables.sT #3  CIII I$4J r-r3c2||jvrdS|j|S)zCheck if the input is present in the cache. If the value is a bad request, overwrite with the escalated version, if not present return None.N)r)selfr3s r. _check_cachezQueryPowerBITool._check_cache;s% T/ / /4!*--r- run_managerkwargsc ||x}rtd|||S td||j||j|j|j |r| nd}n1#t$r$}d||j |<|j |cYd}~Sd}~wwxYw|dkr||j |<|j |Std|t}|j|}t} td |td | |z d ||\} } | d | vrd |j |<|j |S|dd} | r;| |jkr0|t'j||| || dzS| r| nt+j| |j |<|j |S):Execute the query, return the results or an error message.Found cached result for %s: %s%Running PBI Query Tool with input: %sNr3r4r5r callbacksError on call to LLM: I cannot answer thisz PBI Query: %scommandPBI Result: %sPBI Query duration: 0.6f TokenExpiredzCAuthentication token expired or invalid, please try reauthenticate. iterationsrr3queryerrorr3r?rOrR)r>loggerdebuginforpredictrget_table_names get_schemasr get_child Exceptionrrrun _parse_outputgetr _runrformatr r=r3r?r@cacherQexc start_time pbi_resultend_timeresultrRrOs r.razQueryPowerBITool._runDs%%j11 15  LL9:u M M ML 2 KK? L L LN**%|3355 00225@J+//111d +EE 2 2 2-Kc-K-KD z *%j1 1 1 1 1 1 1 2 * * *-2D z *%j1 1 $e,,,!^^ \%%e%44 >> %z222 HHz,AHHHIII**:66   5!8!8V   %j1 1ZZ a00  Z$"55599)0)e(%>   JFF"6"=E"J"J"J :&!*--sBB;; C)C$C)$C)cK||x}r!td|||dS td||j||j|j|j |r| ndd{V}n1#t$r$}d||j |<|j |cYd}~Sd}~wwxYw|dkr||j |<|j |Std|t}|j| d{V}t} td |td | |z d ||\} } | d | vsd| vrd|j |<|j |S|dd} | rA| |jkr6|t'j||| || dzd{VS| r| nt+j| |j |<|j |S)rBrCz3, from cache, you have already asked this question.rDNrErGrHz PBI Query: %srIrKrLrMrN TokenErrorzkAuthentication token expired or invalid, please try to reauthenticate or check the scope of the credential.rOrrPrSrTrU)r>rVrWrXrapredictrrZr[rr\r]rrarunr_r`r _arunrrbrrcs r.rnzQueryPowerBITool._arunzs%%j11 15 Q LL9:u M M MPPP P 2 KK? L L L.11%|3355 00225@J+//111d 2EE 2 2 2-Kc-K-KD z *%j1 1 1 1 1 1 1 2 * * *-2D z *%j1 1 OU+++!^^ <,,U,;;;;;;;; >> %z222 HHz,AHHHIII**:66   .E"9"9\U=R=R~   %j1 1ZZ a00  Z$"555)0)e(%> $  JFF"6"=E"J"J"J :&!*--sB C C4C/)C4/C4rgcd|vr|ddddd}t|dkrtddSt|}||\}}|rd|d|jd d fS|d fSd |vrFd |d vr2d |d d vr"d |d d d ddfSd |d fSd |fS)z2Parse the output of the query to a markdown table.resultsrr4rowsz%0 records in result, query was valid.)Nz^0 rows returned, this might be correct, but please validate if all filter values were correct?z[Result too large, please try to be more specific or use the `TOPN` function. The result is z tokens long, the limit is z tokens.NrRz pbi.errordetailsdetail)lenrVrXr_result_too_larger!)r=rgrqritoo_longlengths r.r_zQueryPowerBITool._parse_outputsE  " "i(+H5a8@D4yyA~~ CDDD %%F#55f== Hf wrxwwVZVmwww4<  j z'222G!4[!AAAZ0=iHKHUUUG,, ,Zr-ric|jrrt}||j}t||}t d|||jk|fSdS)z!Tokenize the output of the query.zResult length: %s)Fr)r"r encoding_for_modelrtencoderVrXr!)r=ri tiktoken_encodingrws r.ruz"QueryPowerBITool._result_too_largest  # <(**I 33D4LMMH0011F KK+V 4 4 4D33V; ;xr-N)"r'r(r)r*rstr__annotations__rrr rrrrrdictrrr intr!r"r/r r;r>r rarrnrr_boolrur,r-r.rrsh//D#K NNN#eD111G^1116Hhsm666$)E$$M$M$MM4S>MMMNC"""")-#---'''''''' Y{       .s.x}....<@4.4.4.784. 4. 4.4.4.4.rAE4.4.4.<=4. 4. 4.4.4.4.l sCx. x}hsm+ ,    <dCi0@r-rceZdZUdZdZeed<dZeed<edZ e ed<Gd d Z dd ed e e defdZ dd ed e edefdZd S)InfoPowerBIToolz2Tool for getting metadata about a PowerBI Dataset.schema_powerbirz Input to this tool is a comma-separated list of tables, output is the schema and sample rows for those tables. Be sure that the tables actually exist by calling list_tables_powerbi first! Example Input: "table1, table2, table3" rTrrceZdZdZdZdS)InfoPowerBITool.Configr%TNr&r,r-r.r/rr0r-r/Nr3r?r1c\|j|dS)z4Get the schema for tables in a comma-separated list., )rget_table_infosplitr=r3r?s r.razInfoPowerBITool._runs( |**:+;+;D+A+ABBBr-clK|j|dd{VS)Nr)raget_table_inforrs r.rnzInfoPowerBITool._aruns> \11*2B2B42H2HIIIIIIIIIr-r}r'r(r)r*rr~rrr rrr/rr rarrnr,r-r.rrs << D#   K $eD111G^111''''''''<@CCC78C CCCCAEJJJ<=J JJJJJJr-rceZdZUdZdZeed<dZeed<edZ e ed<Gd d Z dd e ed e e defdZ dd e ed e edefdZd S)ListPowerBIToolzTool for getting tables names.list_tables_powerbirzUInput is an empty string, output is a comma separated list of tables in the database.rTrrceZdZdZdZdS)ListPowerBITool.Configr%TNr&r,r-r.r/rr0r-r/Nr3r?r1cZd|jSzGet the names of the tables.rjoinrrZrs r.razListPowerBITool._runs$ yy5577888r-c^Kd|jSrrrs r.rnzListPowerBITool._aruns( yy5577888r-)NNrr,r-r.rrs((%D#%%%nKnnn#eD111G^111''''''''%);?99SM9789 9999%)@D99SM9<=9 999999r-r) r*loggingtimertypingrrrrlangchain_core.callbacksrr langchain_core.pydantic_v1r r langchain_core.toolsr &langchain_community.chat_models.openair (langchain_community.tools.powerbi.promptrrr%langchain_community.utilities.powerbirr getLoggerr'rVrrrr,r-r.rs44------------87777777))))))CCCCCC MLLLLLLL  8 $ $~~~~~x~~~BJJJJJhJJJB99999h99999r-