昺hzddlmZmZmZmZmZddlmZddlm Z ddl m Z m Z m Z ddlmZmZGdde ZdS) )AnyDictListMappingOptional)CallbackManagerForLLMRun)LLM)Extra SecretStrroot_validator)convert_to_secret_strget_from_dict_or_envc (eZdZUdZeed<dZeed< dZe ed< dZ eed< d Z e ed < d Z eed < dZe ed < dZe ed< dZe ed< gZeeed< dZe ed< dZeed< dZe ed< dZeed< dZeed< dZeeed<GddZededefdZe de!eeffd Z"e de!eeffd!Z#e defd"Z$ d(d#ed$eeed%ee%d&edef d'Z&dS))NLPCloudaaNLPCloud large language models. To use, you should have the ``nlpcloud`` python package installed, and the environment variable ``NLPCLOUD_API_KEY`` set with your API key. Example: .. code-block:: python from langchain_community.llms import NLPCloud nlpcloud = NLPCloud(model="finetuned-gpt-neox-20b") clientzfinetuned-gpt-neox-20b model_nameTgpuenlanggffffff? temperature max_lengthlength_no_input remove_inputremove_end_sequence bad_wordsg?top_p2top_krepetition_penalty num_beamsnum_return_sequencesNnlpcloud_api_keyc eZdZdZejZdS)NLPCloud.Configz'Configuration for this pydantic object.N)__name__ __module__ __qualname____doc__r forbidextrai/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/langchain_community/llms/nlpcloud.pyConfigr&6s55 r.r0valuesreturnctt|dd|d< ddl}||d|d|d|d|d <n#t $rt d wxYw|S) z?Validate that api key and python package exists in environment.r$NLPCLOUD_API_KEYrNrrr)rrrzXCould not import nlpcloud python package. Please install it with `pip install nlpcloud`.)r rnlpcloudClientget_secret_value ImportError)clsr1r5s r/validate_environmentzNLPCloud.validate_environment;s&; );=O P P& & !"  OOO'|$)*;;==5MF^ /  F8      A    s A A..Bc |j|j|j|j|j|j|j|j|j|j |j d S)z4Get the default parameters for calling NLPCloud API. rrrrrrrrr r"r#r<selfs r/_default_paramszNLPCloud._default_paramsQsP +/#3 -#'#;ZZ"&"9$($=   r.cJid|jid|jid|ji|jS)zGet the identifying parameters.rrr)rrrr?r=s r/_identifying_paramszNLPCloud._identifying_paramsbsH T_- dh ty! "   r.cdS)zReturn type of llm.r5r-r=s r/ _llm_typezNLPCloud._llm_typels zr.promptstop run_managerkwargsc |r"t|dkrtd|rt|dkr |d}nd}i|j|}|jj|fd|i|}|dS)alCall out to NLPCloud's create endpoint. Args: prompt: The prompt to pass into the model. stop: Not supported by this interface (pass in init method) Returns: The string generated by the model. Example: .. code-block:: python response = nlpcloud("Tell me a joke.") r!zXNLPCloud only supports a single stop sequence per generation.Pass in a list of length 1.rN end_sequencegenerated_text)len ValueErrorr?r generation)r>rDrErFrGrIparamsresponses r/_callzNLPCloud._callqs*  CIIMM.  c$ii1nn7LLL3D(3F3)4;)&VV|VvVV())r.)NN)'r'r(r)r*r__annotations__rstrrboolrrfloatrintrrrrrrrr r"r#r$rr r0r rr:propertyrr?rArCrrPr-r.r/rr s   KKK.J...C%D#.K+JE OT   SL$- $$$$:ItCy5E5DE3OOOO ####:Is* !#!!!;,0hy)000 ^$4* c!2   X  WS#X%6   X 3X%):> * * *tCy! *67 *  * * * * * * *r.rN)typingrrrrrlangchain_core.callbacksr#langchain_core.language_models.llmsr langchain_core.pydantic_v1r r r langchain_core.utilsr rrr-r.r/r\s55555555555555======333333GGGGGGGGGGLLLLLLLLH*H*H*H*H*sH*H*H*H*H*r.