昺h"ddlmZddlZddlmZmZmZmZmZddl m Z m Z ddl m Z ddlmZddlmZmZmZddlmZdd lmZmZmZmZmZdd lmZejeZ ddZ!ddZ"ddZ#GddeZ$Gdd e e$Z%dS)) annotationsN)AnyCallableDictListOptional)AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun)LLM) Serializable)ExtraFieldroot_validator)get_from_dict_or_env)before_sleep_logretryretry_if_exception_typestop_after_attemptwait_exponential)enforce_stop_tokensllmCoherereturnCallable[[Any], Any]c ddl}d}d}tdt|jt d||t |jjtttj S)Nr T) multiplierminmax)reraisestopwaitr before_sleep) cohererr max_retriesrrerror CohereErrorrloggerloggingWARNING)rr& min_seconds max_secondss g/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/langchain_community/llms/cohere.py_create_retry_decoratorr0soMMMKK   0 0   M M M&v|'?@@%fgo>>    kwargsrc Nt}|dfd }|di|S)*Use tenacity to retry the completion call.r2rrc(jjdi|SN)clientgenerater2rs r/_completion_with_retryz5completion_with_retry.._completion_with_retry/s"sz",,V,,,r1r2rrrr7r0rr2retry_decoratorr;s` r/completion_with_retryr@+sQ-c22O-----_- " ! + +F + ++r1c Nt}|dfd }|di|S)r4r2rrc8Kjjdi|d{VSr6) async_clientr9r:s r/r;z6acompletion_with_retry.._completion_with_retry:s5.S%.88888888888r1r<r7r=r>s` r/acompletion_with_retryrD6sQ-c22O99999_9 " ! + +F + ++r1ceZdZUdZded<ded<edZded< d Zd ed < dZded <dZ d ed<edZ ded< dZ ded< e ddZ dS) BaseCoherezBase class for Cohere models.rr8rCN)default Optional[str]modelg?float temperaturecohere_api_keyOptional[List[str]]r#Fbool streaming langchainstr user_agentvaluesrrc ddl}t|dd}|d}||||d<||||d<n#t$rt d wxYw|S) z?Validate that api key and python package exists in environment.rNrLCOHERE_API_KEYrR) client_namer8rCzTCould not import cohere python package. Please install it with `pip install cohere`.)r&rClient AsyncClient ImportError)clsrSr&rLrVs r/validate_environmentzBaseCohere.validate_environmentVs  MMM2(*:N!.K%}}^}UUF8 %+%7%7K&8&&F> " "   ?   s AA.)rSrrr)__name__ __module__ __qualname____doc____annotations__rrIrKrLr#rOrRrr[r7r1r/rFrFAs''KKK 5...E....KQ$(N(((( $D$$$$eE***I****(!J!!!!<^r1rFc*eZdZUdZdZded< dZded< dZded< d Zd ed < d Z d ed < d Z ded< dZ ded< GddZ e d*dZe d+dZe d*dZe d,dZd-d!Zd.d#Z d/d0d'Z d/d1d)Zd S)2raCohere large language models. To use, you should have the ``cohere`` python package installed, and the environment variable ``COHERE_API_KEY`` set with your API key, or pass it as a named parameter to the constructor. Example: .. code-block:: python from langchain_community.llms import Cohere cohere = Cohere(model="gptd-instruct-tft", cohere_api_key="my-api-key") int max_tokensrkrpgrJfrequency_penaltypresence_penaltyNrHtruncaterr'c eZdZdZejZdS) Cohere.Configz'Configuration for this pydantic object.N)r\r]r^r_r forbidextrar7r1r/Configrks55 r1rnrDict[str, Any]c\|j|j|j|j|j|j|jdS)z2Get the default parameters for calling Cohere API.rdrKrerfrgrhrirqselfs r/_default_paramszCohere._default_paramss9/+!%!7 $ 5    r1Dict[str, str]c ddiS)NrLrUr7rrs r/ lc_secretszCohere.lc_secretss "233r1c&id|ji|jS)zGet the identifying parameters.rI)rIrtrrs r/_identifying_paramszCohere._identifying_paramssA7DJ'@4+?@@r1rQcdS)zReturn type of llm.r&r7rrs r/ _llm_typezCohere._llm_types xr1r#rMr2rdictc z|j}|j|td|j |j|d<n||d<i||S)Nz2`stop` found in both the input and default params.stop_sequences)rtr# ValueError)rsr#r2paramss r/_invocation_paramszCohere._invocation_paramssY% 9 T%5QRR R Y "'+yF# $ $'+F# $#&#F##r1responsecN|jdj}|rt||}|S)Nr) generationstextr)rsrr#rs r/_process_responsezCohere._process_responses0#A&+  3&tT22D r1prompt run_manager"Optional[CallbackManagerForLLMRun]c |j|fi|}t|f|j|d|}|d}|||S)ahCall out to Cohere's generate endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = cohere("Tell me a joke.") rIrr~)rr@rIgetrrsrr#rr2rr_stops r/_callz Cohere._callss*)(8888(   6  5;   +,,%%h666r1'Optional[AsyncCallbackManagerForLLMRun]cK|j|fi|}t|f|j|d|d{V}|d}|||S)atAsync call out to Cohere's generate endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = await cohere("Tell me a joke.") rNr~)rrDrIrrrs r/_acallz Cohere._acalls*)(8888/   6  5;         +,,%%h666r1)rro)rru)rrQ)r#rMr2rrr|)rrr#rMrrQ)NN) rrQr#rMrrr2rrrQ) rrQr#rMrrr2rrrQ)r\r]r^r_rdr`rerfrgrhrir'rnpropertyrtrwryr{rrrrr7r1r/rrls  JA AJJJJ@ AJJJJD"""""L!!!!!5"H""""0K<     X  444X4AAAXAX$$$$%):> 77777>%)?C 7777777r1)rrrr)rrr2rrr)& __future__rr+typingrrrrrlangchain_core.callbacksr r #langchain_core.language_models.llmsr langchain_core.load.serializabler langchain_core.pydantic_v1r rrlangchain_core.utilsrtenacityrrrrrlangchain_community.llms.utilsr getLoggerr\r*r0r@rDrFrr7r1r/rs""""""66666666666666433333999999CCCCCCCCCC555555?>>>>>  8 $ $     ,,,,,,,,((((((((VM7M7M7M7M7S*M7M7M7M7M7r1