h> .UdZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z ddl m Z mZmZmZmZmZmZmZmZmZmZmZmZmZddlmZddlmZmZm Z m!Z!m"Z"m#Z#d d l$m%Z%m&Z&m'Z'm(Z(d d l)m*Z*m+Z+e rdd l,m-Z-m.Z.ddl/m0Z0e1Z2ee1e fZ3ee4efZ5ee5e3e2dfZ6ddhZ7ej8e9Z:e GddZ;e GddZdZ?ede6dee5fdZ@ededdeedfdZ@edee6deee5ddffdZ@de6de1fdZAde6de1de1fd ZBd!e1ddfd"ZCde4defd#ZDde4defd$ZEde4ddfd%ZFd&ee4efdefd'ZGd(ee4d)eHdeee1ee+ffd*ZId(ee4d)eHdeee1ee+ffd+ZJd,e4d)eHdeee1e+ffd-ZKd.ee4dee*fd/ZLd.ee4dee*fd0ZMd,e4dee*fd1ZNd2d3d&d4dee4fd5ZOiZPeee1ee1feQd6<d7ee1d8ee1ddfd9ZRd7ee1dee1fd:ZSd;edefd<ZTd=ee1d>ee1de!fd?ZUdS)@zEContains utilities used by both the sync and async inference clients.N)contextmanager) dataclass)Path) TYPE_CHECKINGAny AsyncIterableBinaryIOContextManagerDict GeneratorIterableListLiteralNoReturnOptionalUnionoverload) HTTPError)GenerationErrorIncompleteGenerationErrorOverloadedErrorTextGenerationError UnknownErrorValidationError) get_sessionis_aiohttp_availableis_numpy_availableis_pillow_available)ChatCompletionStreamOutputTextGenerationStreamOutput)ClientResponse ClientSessionImager&z text-to-imagezimage-to-imageceZdZUeed<eed<eeed<eeeeefed<ee ed<eee fed<dS)RequestParametersurltaskmodeljsondataheadersN) __name__ __module__ __qualname__str__annotations__rrr rContentTri/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/huggingface_hub/inference/_common.pyr(r(Isu HHH III C= 5dD) **** 8  #s(^r6r(c<eZdZUdZeed<eed<eed<eed<dS) ModelStatusas This Dataclass represents the model status in the HF Inference API. Args: loaded (`bool`): If the model is currently loaded into HF's Inference API. Models are loaded on-demand, leading to the user's first request taking longer. If a model is loaded, you can be assured that it is in a healthy state. state (`str`): The current state of the model. This can be 'Loaded', 'Loadable', 'TooBig'. If a model's state is 'Loadable', it's not too big and has a supported backend. Loadable models are automatically loaded when the user first requests inference on the endpoint. This means it is transparent for the user to load a model, except that the first call takes longer to complete. compute_type (`Dict`): Information about the compute resource the model is using or will use, such as 'gpu' type and number of replicas. framework (`str`): The name of the framework that the model was built with, such as 'transformers' or 'text-generation-inference'. loadedstate compute_type frameworkN)r/r0r1__doc__boolr3r2r r5r6r7r9r9TsC, LLL JJJNNNNNr6r9cHtstdddl}|S)NzMPlease install aiohttp to use `AsyncInferenceClient` (`pip install aiohttp`).r)r ImportErroraiohttp)rBs r7_import_aiohttprCus.  ! !kijjjNNN Nr6cHtstdddl}|S)z.Make sure `numpy` is installed on the machine.zGPlease install numpy to use deal with embeddings (`pip install numpy`).rN)rrAnumpy)rEs r7 _import_numpyrF~s.   ecdddLLL Lr6cLtstdddlm}|S)z,Make sure `PIL` is installed on the machine.zPlease install Pillow to use deal with images (`pip install Pillow`). If you don't want the image to be post-processed, use `client.post(...)` and get the raw response from the server.rr%)rrAPILr&r%s r7_import_pil_imagerIsA    `    Lr6contentreturncdSNr5rJs r7_open_as_binaryrOs "cr6cdSrMr5rNs r7rOrOs %(Cr6c#lKt|tr|ds|drGtd|t |jVdSt|}| std|dt|trPtd|| d5}|Vdddn #1swxYwYdStr~d d l m}t||jrctd tj}|||jpd |VdS|VdS)zOpen `content` as a binary file, either from a URL, a local path, raw bytes, or a PIL Image. Do nothing if `content` is None. TODO: handle base64 as input https://http://zDownloading content from NzFile not found at z. If `data` is a string, it must either be a URL or a path to a local file. To pass raw content, please encode it as bytes first.zOpening content from rbrr%zConverting PIL Image to bytesPNG)format) isinstancer2 startswithloggerdebugrgetrJrexistsFileNotFoundErroropenrrHr&ioBytesIOsaverVgetvalue)rJfr&buffers r7rOrOs '3    j ) ) W-?-? -J-J  LL>W>> ? ? ?--##G,,4 4 4 4 Fw--~~ #OWOOO  '4   6W66777 \\$   1GGG                gu{ + +  LL8 9 9 9Z\\F LL(?%L @ @ @//## # # # F MMMMMsDDDct|5}t|tr|n|}t j|cdddS#1swxYwYdS)z\Encode a raw file (image, audio) into base64. Can be bytes, an opened file, a path or a URL.N)rOrWbytesreadbase64 b64encodedecode)rJr- data_as_bytess r7 _b64_encoderls  ! !8T *4 7 7HTYY[[  ..5577888888888888888888sAA..A25A2default_mime_typect|tr,|ds|dr|Sd}t|ttfrt j|dd}nGt r9ddlm}t||jrd|j pd }|p|}t|}d |d |S) NrRrSF)strictrr%zimage/rUdata:z;base64,) rWr2rXr mimetypes guess_typerrHr&rVlowerrl)rJrm mime_typer& encoded_datas r7_as_urlrvs'3W%7%7 %C%CwGYGYZcGdGdI'C;''E(???B   E gu{ + + ED'."9E!@!@!B!BDDI..Iw''L 49 4 4l 4 44r6 encoded_imagect}|jtjt j|S)z/Parse a base64-encoded string into a PIL Image.)rIr^r_r`rh b64decode)rwr&s r7 _b64_to_imagerzs4   E 5:bj!1-!@!@AA B BBr6cNtj|S)acParse bytes from a Response object into a Python list. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_dict` and will not complain if the returned data is a dictionary. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. r,loadsrjrNs r7_bytes_to_listr~ :gnn&& ' ''r6cNtj|S)acParse bytes from a Response object into a Python dictionary. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_list` and will not complain if the returned data is a list. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. r|rNs r7_bytes_to_dictrrr6cbt}|jtj|S)zParse bytes from a Response object into a PIL Image. Expects the response body to be raw bytes. To deal with b64 encoded images, use `_b64_to_image` instead. )rIr^r_r`)rJr&s r7_bytes_to_imagers+   E 5:bj)) * **r6responsecXt|trtj|n|SrM)rWrfr,r})rs r7_as_dictr s&#-h#>#> L4:h   HLr6bytes_output_as_linesdetailsc#hK|D],} t||}n#t$rYdSwxYw||V-dS)z*Used in `InferenceClient.text_generation`.N%_format_text_generation_stream_output StopIterationrr byte_payloadoutputs r7 _stream_text_generation_responsersk .  :<QQFF    EEE   LLL s  ((cvK|23d{V} t||}n#t$rYdSwxYw||WV36dS)z/Used in `AsyncInferenceClient.text_generation`.Nrrs r7&_async_stream_text_generation_responser%s 4l :<QQFF    EEE   LLLL 433s8 --rc|dsdS|dkrtd|d}t j|dd}|d)t|d|dtj |}|s |j j n|S Nsdata:s data: [DONE]z[DONE] signal received.zutf-8rpz/nerror error_type)rXstriprrjr,r}lstriprstripr[_parse_text_generation_errorr"parse_obj_as_instancetokentext)rrpayload json_payloadrs r7rr3s  " "8 , ,t..5666!!'**G:gnnW55<EEcI\IaIaIcIc G$$[[.. 0 CC Z' s AA A$rrc|dkrt|S|dkrt|S|dkrt|S|dkrt|St |S)N generationincomplete_generation overloaded validation)rrrrr)rrs r7rrsu\!!u%%%,,,(///\!!u%%%\!!u%%%   r6)Vr>rhr_r,loggingrq contextlibr dataclassesrpathlibrtypingrrrr r r r r rrrrrrrequestsrhuggingface_hub.errorsrrrrrrutilsrrrr_generated.typesr!r"rBr#r$ PIL.Imager&r2UrlTPathTrfBinaryTr4TASKS_EXPECTING_IMAGES getLoggerr/rYr(r9rCrFrIrOrlrvrzr~rrrr?rrrrrrrrr3rrrrr5r6r7rs LKK %%%%%%!!!!!!"_^^^^^^^^^^^TTTTTTTT 55555555  c4i x  %w. /*+;<  8 $ $    @    " "G""" "  ( T](GDM"((( ( 'Xh/'Ihw>OQUW[>[4\''''T88c88885X5#5#5555(CCCCCC (E(d(((((E(d((((+U+w++++MuUD[)MdMMMM #E? 59  8C=(#=> >?     (/ :>  = }-GH HI    88"&8 eC33458888, %  ()     u% -.    JJ ()JJJJ*O?OTabgTh6GI#T(3-c*B%CHHHY8C=YVZ[^V_YdhYYYY>8C=>T#Y>>>>I(6  8C= Uh      r6