昺h/ ddlmZddlZddlZddlmZmZmZmZm Z m Z m Z m Z m Z mZddlmZddlmZmZmZmZddlmZmZddlmZmZmZmZmZmZej e!Z"dd Z#ddZ$ddZ%ddZ&ddZ'Gdd eeZ(dS)) annotationsN) AnyCallableDictListLiteralOptionalSequenceSetTupleUnion) Embeddings) BaseModelExtraFieldroot_validator)get_from_dict_or_envget_pydantic_field_names) AsyncRetryingbefore_sleep_logretryretry_if_exception_typestop_after_attemptwait_exponential embeddingsLocalAIEmbeddingsreturnCallable[[Any], Any]c ddl}d}d}tdt|jt d||t |jjt |jjzt |jj zt |jj zt |jj ztttjS)Nr T multiplierminmaxreraisestopwaitr before_sleep)openairr max_retriesrrerrorTimeoutAPIErrorAPIConnectionErrorRateLimitErrorServiceUnavailableErrorrloggerloggingWARNING)rr, min_seconds max_secondss n/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/langchain_community/embeddings/localai.py_create_retry_decoratorr:!sMMMKK   6 7 7   M M M #FL$8 9 9%fl&;<< =%fl&EFF G&fl&ABB C&fl&JKK  L &fgo>>    rc ddl}d}d}tdt|jt d||t |jjt |jjzt |jj zt |jj zt |jj ztttjd fd }|S) Nrr r!Tr"r#r'funcrrcdfd }|S)NargsrkwargsrrcZK23d{V}|i|d{VcS6td)Nzthis is unreachable)AssertionError)r?r@_async_retryingr=s r9 wrapped_fz7_async_retry_decorator..wrap..wrapped_fMsp) 3 3 3 3 3 3 3a!T42622222222222* !677 7s)r?rr@rrr)r=rErDs` r9wrapz$_async_retry_decorator..wrapLs/ 8 8 8 8 8 8 8 r;)r=rrr)r,rrr-rrr.r/r0r1r2r3rr4r5r6)rr,r7r8rGrDs @r9_async_retry_decoratorrH7sMMMKK#  6 7 7   M M M #FL$8 9 9%fl&;<< =%fl&EFF G&fl&ABB C&fl&JKK  L &fgo>>   N Kr;responsedictctd|dDrddl}|jd|S)Nc3HK|]}t|ddkVdS) embeddingr"N)len).0ds r9 z"_check_response..Ys3 > >3q~  ! # > > > > > >r;datarz'LocalAI API returned an empty embedding)anyr,r.r0)rIr,s r9_check_responserTXsL > >Xf-= > > >>>O l##$MNNN Or;r@c Nt}|dfd }|di|S))Use tenacity to retry the embedding call.r@rrcFjjdi|}t|SNrF)clientcreaterTr@rIrs r9_embed_with_retryz+embed_with_retry.._embed_with_retryds,+:$+55f55x(((r;r@rrrrF)r:)rr@retry_decoratorr\s` r9embed_with_retryr_`sQ-j99O)))))_)   & &v & &&r;cZKtdfd }|di|d{VS)rVr@rrcVKjjdi|d{V}t|SrX)rYacreaterTr[s r9_async_embed_with_retryz7async_embed_with_retry.._async_embed_with_retryosB2*2<d-Zd?d1Zd?d2Z d@dAd8Z d@dAd9Z!dBd:Z"dBd;Z#dS)CraLocalAI embedding models. Since LocalAI and OpenAI have 1:1 compatibility between APIs, this class uses the ``openai`` Python package's ``openai.Embedding`` as its client. Thus, you should have the ``openai`` python package installed, and defeat the environment variable ``OPENAI_API_KEY`` by setting to a random string. You also need to specify ``OPENAI_API_BASE`` to point to your LocalAI service endpoint. Example: .. code-block:: python from langchain_community.embeddings import LocalAIEmbeddings openai = LocalAIEmbeddings( openai_api_key="random-string", openai_api_base="http://localhost:8080" ) rrYztext-embedding-ada-002strmodel deploymentNz Optional[str]openai_api_versionopenai_api_base openai_proxyiintembedding_ctx_lengthopenai_api_keyopenai_organizationzUnion[Literal['all'], Set[str]]allowed_specialallz.Union[Literal['all'], Set[str], Sequence[str]]disallowed_speciali chunk_sizer-z+Optional[Union[float, Tuple[float, float]]]request_timeoutheadersFboolshow_progress_bar)default_factoryDict[str, Any] model_kwargsc eZdZdZejZdS)LocalAIEmbeddings.Configz'Configuration for this pydantic object.N)__name__ __module__ __qualname____doc__rforbidextrarFr;r9Configr}s55 r;rT)prevaluesrc t|}|di}t|D]S}||vrtd|d||vr6t jd|d|d|d||||<T||}|rtd|d ||d<|S) z>Build extra kwargs from additional params that were passed in.r{zFound z supplied twice.z WARNING! z/ is not default parameter. zJ was transferred to model_kwargs. Please confirm that z is what you intended.z Parameters za should be specified explicitly. Instead they were passed in as part of `model_kwargs` parameter.) rgetlist ValueErrorwarningswarnpop intersectionkeys)clsrall_required_field_namesr field_nameinvalid_model_kwargss r9 build_extrazLocalAIEmbeddings.build_extras2$2..v,, ; ;JU"" !F*!F!F!FGGG!999 N*NNNN)3NNN %+JJz$:$:j!7DDUZZ\\RR  T2TTT  "'~ r;rc<t|dd|d<t|ddd|d<t|ddd|d<d}t|d d ||d <t|d d d|d < d dl}|j|d<n#t$rtdwxYw|S)z?Validate that api key and python package exists in environment.rnOPENAI_API_KEYrjOPENAI_API_BASE)defaultrk OPENAI_PROXYriOPENAI_API_VERSIONroOPENAI_ORGANIZATIONrNrYzTCould not import openai python package. Please install it with `pip install openai`.)rr, Embedding ImportError)rrdefault_api_versionr,s r9validate_environmentz&LocalAIEmbeddings.validate_environments$8 $&6$ $  %9    % % %  ! "6    " " " ~!';  ' ( ( ( #$ )=  ! ! ) ) ) $%   MMM%/F8     ?    s 0A??Bc|j|j|j|j|j|j|jd|j}|jrddl }|j|jd|_ |S)N)rgrurvapi_key organizationapi_base api_versionr)httphttps) rgrurvrnrorjrir{rkr,proxy)self openai_argsr,s r9_invocation_paramsz$LocalAIEmbeddings._invocation_paramssZ#3|* 4,2         MMM)*FLr;textengine List[float]c|jdr|dd}t|fd|gi|jdddS))Call out to LocalAI's embedding endpoint.001  inputrRrrM)rgendswithreplacer_rrrrs r9_embedding_funcz!LocalAIEmbeddings._embedding_funcs :  u % % +<<c**D   & %     ! " "r;cK|jdr|dd}t|fd|gi|jd{VdddS) rrrrrNrRrrM)rgrrrdrrs r9_aembedding_funcz"LocalAIEmbeddings._aembedding_funcs :  u % % +<<c**D(f)           ! " "r;rtexts List[str] Optional[int]List[List[float]]c fd|DS)aNCall out to LocalAI's embedding endpoint for embedding search docs. Args: texts: The list of texts to embed. chunk_size: The chunk size of embeddings. If None, will use the chunk size specified by the class. Returns: List of embeddings, one for each text. cHg|]}|jS)rrrh)rOrrs r9 z5LocalAIEmbeddings.embed_documents...s.UUUt$$T$/$BBUUUr;rF)rrrss` r9embed_documentsz!LocalAIEmbeddings.embed_documents s VUUUuUUUUr;cKg}|D]9}|||jd{V}||:|S)aTCall out to LocalAI's embedding endpoint async for embedding search docs. Args: texts: The list of texts to embed. chunk_size: The chunk size of embeddings. If None, will use the chunk size specified by the class. Returns: List of embeddings, one for each text. rN)rrhappend)rrrsrrrIs r9aembed_documentsz"LocalAIEmbeddings.aembed_documents0se  ( (D!2242PPPPPPPPH   h ' ' ' 'r;c>|||j}|S)zCall out to LocalAI's embedding endpoint for embedding query text. Args: text: The text to embed. Returns: Embedding for the text. rrrrrMs r9 embed_queryzLocalAIEmbeddings.embed_queryCs$((do(FF r;cNK|||jd{V}|S)zCall out to LocalAI's embedding endpoint async for embedding query text. Args: text: The text to embed. Returns: Embedding for the text. rN)rrhrs r9 aembed_queryzLocalAIEmbeddings.aembed_queryOs://T_/MMMMMMMM r;)rrzrrz)rrrr)rr)rrfrrfrr)r)rrrsrrr)rrfrr)$r~rrr__annotations__rgrhrirjrkrmrnrosetrprrrsr-rurvrxrrJr{rrrrpropertyrrrrrrrrFr;r9rrws(KKK)E))))J(,,,,,%)O))))"&L&&&& $$$$$8$(N(((()-----7:suuO<<<#>#>L>>>>V ^2^((((TX( " " " " " " " " =>VVVVV"=>&          r;)rrrr)rrrr)rIrJrrJ)rrr@rrr)) __future__rr5rtypingrrrrrr r r r r langchain_core.embeddingsrlangchain_core.pydantic_v1rrrrlangchain_core.utilsrrtenacityrrrrrr getLoggerr~r4r:rHrTr_rdrrFr;r9rs""""""                        100000NNNNNNNNNNNNOOOOOOOO  8 $ $,B ' ' ' '3333bbbbb :bbbbbr;