昺hddlmZmZmZmZmZddlZddlmZddl m Z ddl m Z m Z ddlmZddlmZdZGd d e ZdS) )AnyDictListMappingOptionalN)CallbackManagerForLLMRun)LLM)Extraroot_validator)get_from_dict_or_env)enforce_stop_tokens)text2text-generationtext-generation summarizationc NeZdZUdZdZeed< dZeeed< dZ ee ed< dZ eeed<Gdd Z e d ed efd Zed eeeffd Zed efdZ ddedeeedeeded ef dZdS)HuggingFaceEndpointaHuggingFace Endpoint models. To use, you should have the ``huggingface_hub`` python package installed, and the environment variable ``HUGGINGFACEHUB_API_TOKEN`` set with your API token, or pass it as a named parameter to the constructor. Only supports `text-generation` and `text2text-generation` for now. Example: .. code-block:: python from langchain_community.llms import HuggingFaceEndpoint endpoint_url = ( "https://abcdefghijklmnop.us-east-1.aws.endpoints.huggingface.cloud" ) hf = HuggingFaceEndpoint( endpoint_url=endpoint_url, huggingfacehub_api_token="my-api-key" ) endpoint_urlNtask model_kwargshuggingfacehub_api_tokenc eZdZdZejZdS)HuggingFaceEndpoint.Configz'Configuration for this pydantic object.N)__name__ __module__ __qualname____doc__r forbidextrau/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/langchain_community/llms/huggingface_endpoint.pyConfigr.s55 r!r#valuesreturnct|dd} ddlm} |d|n"#t$r}t d|d}~wwxYwn#t $rt d wxYw||d<|S) z?Validate that api key and python package exists in environment.rHUGGINGFACEHUB_API_TOKENr)HfApizhttps://huggingface.co)endpointtokenzICould not authenticate with huggingface_hub. Please check your API token.NzfCould not import huggingface_hub python package. Please install it with `pip install huggingface_hub`.)r huggingface_hub.hf_apir(whoami Exception ValueError ImportError)clsr$rr(es r"validate_environmentz(HuggingFaceEndpoint.validate_environment3s$8 .0J$ $    4 4 4 4 4 4 52&((((    3    H   .F)* s+A:A AAAAA7c>|jpi}i|j|jdd|iS)zGet the identifying parameters.)rrr)rrr)self _model_kwargss r"_identifying_paramsz'HuggingFaceEndpoint._identifying_paramsOs=)/R  #0$)DD }-  r!cdS)zReturn type of llm.huggingface_endpointr )r4s r" _llm_typezHuggingFaceEndpoint._llm_typeXs &%r!promptstop run_managerkwargsc |jpi}i||}||d}d|jdd} tj|j||} n.#tjj$r} td| d} ~ wwxYw| } d| vrtd | d|j d kr;| d d } | |r| t|d} nT|j d kr| d d } n:|j dkr| d d} n td|j dtd|t| |} | S)anCall out to HuggingFace Hub's inference endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = hf("Tell me a joke.") )inputs parameterszBearer zapplication/json) Authorizationz Content-Type)headersjsonz$Error raised by inference endpoint: NerrorzError raised by inference API: rrgenerated_textrr summary_textzGot invalid task z, currently only z are supported)rrrequestspostr exceptionsRequestExceptionr.rCr startswithlen VALID_TASKSr ) r4r:r;r<r=r5paramsparameter_payloadrBresponser1rEtexts r"_callzHuggingFaceEndpoint._call]s*)/R -M,V,'-VDDGt'DFF.    I}!79JHH"3 I I IGAGGHH H I! n $ $K.2IKK  9) ) )!!$%56Dv&& +CKKMM* Y0 0 0!!$%56DD Y/ ) )!!$^4DD>DI>>"->>>   'tT22D sAA+A&&A+)NN)rrrrrstr__annotations__rrrdictrr#r rr2propertyrrr6r9rrrRr r!r"rrs*L#D(3-I#'L(4.'''1.2hsm222 ^$46 WS#X%6   X &3&&&X&%):> ???tCy!?67 ?  ? ??????r!r)typingrrrrrrGlangchain_core.callbacksr#langchain_core.language_models.llmsr langchain_core.pydantic_v1r r langchain_core.utilsr langchain_community.llms.utilsr rMrr r!r"r]s55555555555555======333333<<<<<<<<555555>>>>>>J NNNNN#NNNNNr!