昺h(MdZddlmZddlZddlmZmZmZmZm Z m Z m Z ddl Z ddl mZddl mZmZmZmZmZmZddlmZddlmZmZdd lmZdd lmZddZddddZGddZ dS)%SQLAlchemy wrapper around a database.) annotationsN)AnyDictIterableListLiteralOptionalSequence) get_from_env)MetaDataTable create_engineinspectselecttext)Engine)ProgrammingErrorSQLAlchemyError) CreateTable)NullTypeindex+sqlalchemy.engine.interfaces.ReflectedIndexreturnstrc Vd|dd|ddt|dS)NzName: namez , Unique: uniquez , Columns: column_namesr)rs r/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/langchain_community/utilities/sql_database.py _format_indexr"sF 2v 2 2%/ 2 2~.// 2 2z...)suffixcontentrlengthintr$ct|tr|dkr|St||kr|S|d|t|z ddd|zS)z] Truncate a string to a certain number of words, based on the max string length. rN ) isinstancerlenrsplit)r%r&r$s r! truncate_wordr.so gs # #v{{ 7||v )Vc&kk)) * 1 1#q 9 9! K|]}|v|j|fVdSN)_custom_table_info).0table intersectionselfs r! z'SQLDatabase.__init__..esG++L((/67((((++r#)viewsbindonlyr4N)_engine_schema ValueErrorr _inspectorsetget_table_namesget_view_names _all_tables_include_tables_ignore_tablesget_usable_table_names_usable_tablesr+r' TypeError_sample_rows_in_table_info_indexes_in_table_inforFdictrI_max_string_lengthr _metadatareflectlist)rJr3r4r6r8r:r;r<r>r@rAmissing_tables usable_tablesrIs` @r!__init__zSQLDatabase.__init__)s   Um USTT T!$,// O + +6 + : :@LTt--V-<<222#%%   !1D4DDN  LnLLL5BLc-000suu   !043CCN  K^KKK3355 4AWc-000tGW3S99 LJKK K*C'&;#"3  " d5t<< 3 t677DDTEUVVL&*+++++!4+++''D # #4!/XZZ d)**<      r# database_urir engine_argskwargsrrc 2|pi}|t|fi|fi|S)z'Construct a SQLAlchemy engine from URI.)r)clsrfrgrh _engine_argss r!from_urizSQLDatabase.from_urivs6 #(b s=>>>>II&IIIr#cataloghost api_token warehouse_id cluster_idc  ddlm} n#t$rtdwxYwd} ddlm} | } n#t$rYnwxYw| r| jnd} |tdd| }| r| jnd} |tdd | }||| r| j }ntd |r|rtd |rd |}nd |}d|d|d|d|d| }|j d||d|S)a Class method to create an SQLDatabase instance from a Databricks connection. This method requires the 'databricks-sql-connector' package. If not installed, it can be added using `pip install databricks-sql-connector`. Args: catalog (str): The catalog name in the Databricks database. schema (str): The schema name in the catalog. host (Optional[str]): The Databricks workspace hostname, excluding 'https://' part. If not provided, it attempts to fetch from the environment variable 'DATABRICKS_HOST'. If still unavailable and if running in a Databricks notebook, it defaults to the current workspace hostname. Defaults to None. api_token (Optional[str]): The Databricks personal access token for accessing the Databricks SQL warehouse or the cluster. If not provided, it attempts to fetch from 'DATABRICKS_TOKEN'. If still unavailable and running in a Databricks notebook, a temporary token for the current user is generated. Defaults to None. warehouse_id (Optional[str]): The warehouse ID in the Databricks SQL. If provided, the method configures the connection to use this warehouse. Cannot be used with 'cluster_id'. Defaults to None. cluster_id (Optional[str]): The cluster ID in the Databricks Runtime. If provided, the method configures the connection to use this cluster. Cannot be used with 'warehouse_id'. If running in a Databricks notebook and both 'warehouse_id' and 'cluster_id' are None, it uses the ID of the cluster the notebook is attached to. Defaults to None. engine_args (Optional[dict]): The arguments to be used when connecting Databricks. Defaults to None. **kwargs (Any): Additional keyword arguments for the `from_uri` method. Returns: SQLDatabase: An instance of SQLDatabase configured with the provided Databricks connection details. Raises: ValueError: If 'databricks-sql-connector' is not found, or if both 'warehouse_id' and 'cluster_id' are provided, or if neither 'warehouse_id' nor 'cluster_id' are provided and it's not executing inside a Databricks notebook. r)sqlzfdatabricks-sql-connector package not found, please install with `pip install databricks-sql-connector`N) get_contextrnDATABRICKS_HOSTroDATABRICKS_TOKENz6Need to provide either 'warehouse_id' or 'cluster_id'.z/Can't have both 'warehouse_id' or 'cluster_id'.z/sql/1.0/warehouses/z/sql/protocolv1/o/0/zdatabricks://token:@z ?http_path=z &catalog=z&schema=)rfrg) databricksrs ImportErrorrQ!dbruntime.databricks_repl_contextrtbrowserHostNamer apiToken clusterIdrl)rjrmr4rnrorprqrgrhrscontextrt default_hostdefault_api_token http_pathuris r!from_databrickszSQLDatabase.from_databricks~sh  & & & & & & &   :     E E E E E E!kmmGG    D 3:Cw..t <(9<HHD07AG,,T  $[2DFWXXI  J$6 $.  L  PJ PNOO O  <=|==II;z;;I G) G Gd G G" G G-4 G G>D G G s|P+PPPPPs #: AA127.0.0.1:8902rootcnosdbpublicurluserpasswordtenantdatabasec ddlm}||||||}||S#t$rt dwxYw)a Class method to create an SQLDatabase instance from a CnosDB connection. This method requires the 'cnos-connector' package. If not installed, it can be added using `pip install cnos-connector`. Args: url (str): The HTTP connection host name and port number of the CnosDB service, excluding "http://" or "https://", with a default value of "127.0.0.1:8902". user (str): The username used to connect to the CnosDB service, with a default value of "root". password (str): The password of the user connecting to the CnosDB service, with a default value of "". tenant (str): The name of the tenant used to connect to the CnosDB service, with a default value of "cnosdb". database (str): The name of the database in the CnosDB tenant. Returns: SQLDatabase: An instance of SQLDatabase configured with the provided CnosDB connection details. r)make_cnosdb_langchain_uri)rfzRcnos-connector package not found, please install with `pip install cnos-connector`)cnosdb_connectorrrlrzrQ)rjrrrrrrrs r! from_cnosdbzSQLDatabase.from_cnosdbsw<  B B B B B B++CxRRC<|j D]:\}}t|j tur|j |;tt!|j}|} jpj} | r| dz } jr| d|dz } jr| d|dz } | r| dz } || T|d|} | S) fGet information about specified tables. Follows best practices as specified in: Rajkumar et al, 2022 (https://arxiv.org/abs/2204.00498) If `sample_rows_in_table_info`, the specified number of sample rows will be appended to each table description. This can increase performance as demonstrated in the paper. Nz table_names rCcg|]?}|jtvr'jdkr|jd=|@S)sqlitesqlite_)rrSr startswith)rGtblall_table_namesrJs r! z.SQLDatabase.get_table_info..0s\   x3////\X--#(2E2Ei2P2P- .--r#z /* z*/z )rYrS differencerQr` sorted_tablesrFrappendcolumnsitemstyper_columnsremoverrcompilerOrstripr]r\_get_table_indexes_get_sample_rowssortjoin) rJrrc meta_tablestablesrHkv create_tablerhas_extra_info final_strrs ` @r!rzSQLDatabase.get_table_infos;5577  " --88IIN X !V!V!V!VWWW)O     ~3     & &E& 5:9P+P+P d5ejABBB ++-- - -1<<8++N))!,,,{51199$,GGHHL(//113J+Nt/N  'h& * FE4#:#:5#A#AEEEE . DC4#8#8#?#?CCCC  #d" MM* % % % % KK'' r#rHrc|j|j}dt t |}d|S)NrzTable Indexes: )rR get_indexesrrmapr")rJrHindexesindexes_formatteds r!rzSQLDatabase._get_table_indexesUsD/--ej99 IIc-&A&ABB5"3555r#ct||j}dd|jD} |j5}||}ttd|}dddn #1swxYwYdd|D}n#t$rd}YnwxYw|jd|j d|d|S) N cg|] }|j Srx)r)rGcols r!rz0SQLDatabase._get_sample_rows.._s C C Cc C C Cr#cd|DS)Nc<g|]}t|ddS)Ndr )rGis r!rzBSQLDatabase._get_sample_rows....gs&#=#=#=QCFF4C4L#=#=#=r#rx)lss r!z.SQLDatabase._get_sample_rows..gs#=#="#=#=#=r#rc8g|]}d|S)r)rrGrows r!rz0SQLDatabase._get_sample_rows..ks"(O(O(OC3(O(O(Or#rz rows from z table: ) rlimitr\rrrOconnectexecuterbrrr)rJrHcommand columns_str connectionsample_rows_result sample_rowssample_rows_strs r!rzSQLDatabase._get_sample_rowsZsk--%%d&EFFii C CU] C C CDD  !%%'' :%/%7%7%@%@""==?QRR                #ii(O(O;(O(O(OPPOO  ! ! ! OOO !. ! !5: ! ! ! ! ! ! s6 C&4B& C&B**C-B*."C C C allrfetchLiteral['all', 'one']Sequence[Dict[str, Any]]c|j5}|j|jdkr|d|jfn|jdkr|d|jfn|jdkrn|jdkr|d|jfnz|jd kr|d |jnQ|jd kr|d |jn(|jd krn|d|jf|t |}|jrv|dkrd|D}nC|dkr.| }|gn| g}ntd|cdddS dddn #1swxYwYgS)z Executes SQL command through underlying engine. If the statement returns no rows, an empty list is returned. N snowflakez"ALTER SESSION SET search_path = %sbigqueryzSET @@dataset_id=?mssqltrinozUSE ?duckdbzSET search_path TO oraclez#ALTER SESSION SET CURRENT_SCHEMA = sqlanyzSET search_path TO %src6g|]}|Srx)_asdict)rGxs r!rz(SQLDatabase._execute..s EEEaaiikkEEEr#onez-Fetch parameter must be either 'one' or 'all') rObeginrPrexec_driver_sqlrr returns_rowsfetchallfetchonerrQ)rJrrrcursorresult first_results r!_executezSQLDatabase._executexsn\   ! !% Z|'<;....>EE6??3D3DEEEFFe^^#)??#4#4L#/#7RRl>R>R>T>T=UFF$%TUUUK% % % % % % % % : ;% % % % % % % % % % % % % % % L sFG  GGinclude_columnsc||}fd|D}|s d|D}|sdSt|S)zExecute a SQL command and return a string representing the results. If the statement returns rows, a string of the results is returned. If the statement returns no rows, an empty string is returned. cPg|]"}fd|D#S)cDi|]\}}|t|jS))r&)r.r_)rGcolumnvaluerJs r! z.SQLDatabase.run...s?   !FE eD4KLLL   r#)r)rGrrJs r!rz#SQLDatabase.run..sT        %&WWYY      r#cPg|]#}t|$Srx)tuplevaluesrs r!rz#SQLDatabase.run..s(66635&&666r#r)rr)rJrrrrress` r!runzSQLDatabase.runsww..         766#666C 2s88Or#ch ||S#t$r} d|cYd}~Sd}~wwxYw)rError: N)rrQ)rJres r!get_table_info_no_throwz#SQLDatabase.get_table_info_no_throwsX !&&{33 3 ! ! ! * Q==  !s 1,11cl ||||S#t$r} d|cYd}~Sd}~wwxYw)a*Execute a SQL command and return a string representing the results. If the statement returns rows, a string of the results is returned. If the statement returns no rows, an empty string is returned. If the statement throws an error, the error message is returned. rN)rr)rJrrrrs r! run_no_throwzSQLDatabase.run_no_throwsZ !88GUO<< < ! ! ! * Q==  !s 3.33) NNNNr1FNFr2)r3rr4r5r6r7r8r9r:r9r;r'r<r=r>r?r@r=rAr'rE)rfrrgr?rhrrr0)NNNNN)rmrr4rrnr5ror5rpr5rqr5rgr?rhrrr0)rrrrr) rrrrrrrrrrrr0)rr)rr)rr9rr)rHrrr)r)rrrrrr)rF)rrrrrr=rr)__name__ __module__ __qualname____doc__re classmethodrlrrpropertyrrYrTrrrrrrrrrxr#r!r0r0&s // !%'+-1.2)*&+,0"!$K K K K K Z>BJJJJ[J ##'&*$(&*^Q^Q^Q^Q[^Q@$ &&&&[&P)))X)>>>> ----%%%X%44444l6666     B(-00000j(- % :!!!!!&(- % !!!!!!!r#r0)rrrr)r%rr&r'r$rrr)!r  __future__rrtypingrrrrr r r sqlalchemylangchain_core.utilsr r rrrrrsqlalchemy.enginersqlalchemy.excrrsqlalchemy.schemarsqlalchemy.typesrr"r.r0rxr#r!rsr++""""""IIIIIIIIIIIIIIIIII------LLLLLLLLLLLLLLLL$$$$$$<<<<<<<<))))))%%%%%%?D F F F F F FB!B!B!B!B!B!B!B!B!B!r#