昺h FdZddlmZmZmZddlmZGddeZdS)z+Wrapper around Xinference embedding models.)AnyListOptional) EmbeddingsceZdZUdZeed<eeed< eeed< d deedeeffd Zde ede e e fd Z d ede e fd Z xZ S) XinferenceEmbeddingsaXinference embedding models. To use, you should have the xinference library installed: .. code-block:: bash pip install xinference Check out: https://github.com/xorbitsai/inference To run, you need to start a Xinference supervisor on one server and Xinference workers on the other servers. Example: To start a local instance of Xinference, run .. code-block:: bash $ xinference You can also deploy Xinference in a distributed cluster. Here are the steps: Starting the supervisor: .. code-block:: bash $ xinference-supervisor Starting the worker: .. code-block:: bash $ xinference-worker Then, launch a model using command line interface (CLI). Example: .. code-block:: bash $ xinference launch -n orca -s 3 -q q4_0 It will return a model UID. Then you can use Xinference Embedding with LangChain. Example: .. code-block:: python from langchain_community.embeddings import XinferenceEmbeddings xinference = XinferenceEmbeddings( server_url="http://0.0.0.0:9997", model_uid = {model_uid} # replace model_uid with the model UID return from launching the model ) client server_url model_uidNc ddlm}n"#t$r}td|d}~wwxYwt|t d|t d||_||_|||_dS)Nr) RESTfulClientz`Could not import RESTfulClient from xinference. Please install it with `pip install xinference`.zPlease provide server URLzPlease provide the model UID) xinference.clientr ImportErrorsuper__init__ ValueErrorr r r )selfr r r e __class__s q/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/langchain_community/embeddings/xinference.pyrzXinferenceEmbeddings.__init__Fs  7 7 7 7 7 7 7   2     899 9  ;<< <$"#mJ// s )$)textsreturncv|j|jfd|D}d|DS)zEmbed a list of documents using Xinference. Args: texts: The list of texts to embed. Returns: List of embeddings, one for each text. c^g|])}|ddd*S)datar embedding)create_embedding).0textmodels r z8XinferenceEmbeddings.embed_documents..isC   EIE " "4 ( ( 0 3K @   cRg|]$}ttt|%S)listmapfloat)rrs rr!z8XinferenceEmbeddings.embed_documents..ls(888S]]##888r")r get_modelr )rr embeddingsr s @rembed_documentsz$XinferenceEmbeddings.embed_documents_sZ %%dn55    MR   98Z8888r"rc|j|j}||}|ddd}t t t |S)zEmbed a query of documents using Xinference. Args: text: The text to embed. Returns: Embeddings for the text. rrr)r r(r rr%r&r')rrr embedding_resrs r embed_queryz XinferenceEmbeddings.embed_querynsZ %%dn55..t44 !&)!,[9 Cy))***r")NN)__name__ __module__ __qualname____doc__r__annotations__rstrrrr'r*r- __classcell__)rs@rrrs55n KKK &}#LP00"3-0;CC=0000002 9T#Y 94U 3D 9 9 9 9++U ++++++++r"rN)r1typingrrrlangchain_core.embeddingsrrr$r"rr7sy11&&&&&&&&&&000000u+u+u+u+u+:u+u+u+u+u+r"