hhddlmZddlmZddlmZmZddlZddlm Z ddlm Z m Z m Z Gd d e eZed Gd dZed GddZ d"dejdee deefdZdee e fdeefdZe dedee e fdefdZe dddddede de dee dee e fdee deee e fdefdZe d"d e dee e fdeee e fdefd!ZdS)#) dataclass)Enum)DictOptionalN) constants) get_sessionhf_raise_for_statusvalidate_hf_hub_argsceZdZdZdZdS) XetTokenTypereadwriteN)__name__ __module__ __qualname__READWRITEb/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/huggingface_hub/utils/_xet.pyrr s D EEErrT)frozenc$eZdZUeed<eed<dS) XetFileData file_hash refresh_routeN)rrrstr__annotations__rrrrrs'NNNrrc.eZdZUeed<eed<eed<dS)XetConnectionInfo access_tokenexpiration_unix_epochendpointN)rrrrrintrrrr!r!s1MMMMMrr!responser$returnc|dS |jtj}tj|jvr|jtjd}n|jtj}n#t $rYdSwxYw||n tj}|tj rF| tj d| d}t||S)aa Parse XET file metadata from an HTTP response. This function extracts XET file metadata from the HTTP headers or HTTP links of a given response object. If the required metadata is not found, it returns `None`. Args: response (`requests.Response`): The HTTP response object containing headers dict and links dict to extract the XET metadata from. Returns: `Optional[XetFileData]`: An instance of `XetFileData` containing the file hash and refresh route if the metadata is found. Returns `None` if the required metadata is missing. Nurl/)rr) headersrHUGGINGFACE_HEADER_X_XET_HASH$HUGGINGFACE_HEADER_LINK_XET_AUTH_KEYlinks&HUGGINGFACE_HEADER_X_XET_REFRESH_ROUTEKeyErrorENDPOINT startswithHUGGINGFACE_CO_URL_HOMEreplacerstripr)r&r$rrs r!parse_xet_file_data_from_responser6s"t$Y%LM  9X^ K K$N9+YZ[`aMM$,Y-]^M tt#/xxY5GH ABBs%--i.O.V.VWZ.[.[]e]l]lmp]q]qrr #   sAA&& A43A4r+c |tj}|tj}t|tj}n#t t tf$rYdSwxYwt|||S)a Parse XET connection info from the HTTP headers or return None if not found. Args: headers (`Dict`): HTTP headers to extract the XET metadata from. Returns: `XetConnectionInfo` or `None`: The information needed to connect to the XET storage service. Returns `None` if the headers do not contain the XET connection info. N)r$r"r#) r!HUGGINGFACE_HEADER_X_XET_ENDPOINT%HUGGINGFACE_HEADER_X_XET_ACCESS_TOKENr%#HUGGINGFACE_HEADER_X_XET_EXPIRATIONr0 ValueError TypeErrorr!)r+r$r"r#s r&parse_xet_connection_info_from_headersr=Bs9FGyNO #GI,Y$Z [ [ j) ,tt !3   sAAA! A! file_datacX|jtdt|j|S)a Utilizes the information in the parsed metadata to request the Hub xet connection information. This includes the access token, expiration, and XET service URL. Args: file_data: (`XetFileData`): The file data needed to refresh the xet connection information. headers (`Dict[str, str]`): Headers to use for the request, including authorization headers and user agent. Returns: `XetConnectionInfo`: The connection information needed to make the request to the xet storage service. Raises: [`~utils.HfHubHTTPError`] If the Hub API returned an error. [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) If the Hub API response is improperly formatted. Nz>The provided xet metadata does not contain a refresh endpoint.)rr;#_fetch_xet_connection_info_with_url)r>r+s rrefresh_xet_connection_inforA[s/.&YZZZ .y/F P PPr)revisionr$params token_typerepo_id repo_typerBrCc n||n tj}|d|d|d|jd| }t|||S)a Uses the repo info to request a xet access token from Hub. Args: token_type (`XetTokenType`): Type of the token to request: `"read"` or `"write"`. repo_id (`str`): A namespace (user or an organization) and a repo name separated by a `/`. repo_type (`str`): Type of the repo to upload to: `"model"`, `"dataset"` or `"space"`. revision (`str`, `optional`): The revision of the repo to get the token for. headers (`Dict[str, str]`): Headers to use for the request, including authorization headers and user agent. endpoint (`str`, `optional`): The endpoint to use for the request. Defaults to the Hub endpoint. params (`Dict[str, str]`, `optional`): Additional parameters to pass with the request. Returns: `XetConnectionInfo`: The connection information needed to make the request to the xet storage service. Raises: [`~utils.HfHubHTTPError`] If the Hub API returned an error. [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) If the Hub API response is improperly formatted. Nz/api/zs/z/xet-z-token/)rr1valuer@)rDrErFrBr+r$rCr)s r(fetch_xet_connection_info_from_repo_inforIwsWJ$/xxY5GH  Z ZI Z Z Z Zz7G Z ZPX Z ZC .sGV D DDrr)ct|||}t|t|j}|t d|S)aS Requests the xet connection info from the supplied URL. This includes the access token, expiration time, and endpoint to use for the xet storage service. Args: url: (`str`): The access token endpoint URL. headers (`Dict[str, str]`): Headers to use for the request, including authorization headers and user agent. params (`Dict[str, str]`, `optional`): Additional parameters to pass with the request. Returns: `XetConnectionInfo`: The connection information needed to make the request to the xet storage service. Raises: [`~utils.HfHubHTTPError`] If the Hub API returned an error. [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) If the Hub API response is improperly formatted. )r+r)rCNz6Xet headers have not been correctly set by the server.)r getr r=r+r;)r)r+rCrespmetadatas rr@r@sY2 ==  W#f  E ED5dlCCHQRRR Or)N) dataclassesrenumrtypingrrrequestsrr r r rrrr!Responser6r=rArIr@rrrrTs!!!!!!!!!!!!!!DDDDDDDDDD3  $  $<@"""+3C=" k""""JDcNxPaGb2QQ#s(^Q QQQQ6 #"'+&E&E&E&E&E &E sm &E #s(^ &Esm&E T#s(^ $&E&E&E&E&ER(,  #s(^ T#s(^ $ r