hA(ddlmZddlmZddlZddlmZddlmZmZm Z m Z m Z gdZ dd ee eejfd efd Zd eefd Z dd ed ee eejfd dfdZdeed dfdZde d dfdZde d dfdZddZddZd e fdZdS))Iterable)UnionN)Tensor) _lazy_call _lazy_initcurrent_device device_countis_initialized) get_rng_stateget_rng_state_all set_rng_stateset_rng_state_all manual_seedmanual_seed_allseedseed_all initial_seedcudadevicereturncJtt|trtj|}n*t|t rtjd|}|j}|t}tjj |}| S)aRReturn the random number generator state of the specified GPU as a ByteTensor. Args: device (torch.device or int, optional): The device to return the RNG state of. Default: ``'cuda'`` (i.e., ``torch.device('cuda')``, the current CUDA device). .. warning:: This function eagerly initializes CUDA. r) r isinstancestrtorchrintindexr rdefault_generators get_state)ridxdefault_generators Y/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/torch/cuda/random.pyr r sLLL&#.f%% FC .ff-- ,C { 5c:  & & ( ((cPdttD}|S)zQReturn a list of ByteTensor representing the random number states of all devices.c,g|]}t|S)r ).0is r" z%get_rng_state_all..0s ???A}Q???r#)ranger )resultss r"r r .s&??|~~)>)>???G Nr# new_statectsVtj5tjdddn #1swxYwYt trtjn*t trtjdfd}t|dS)a/Set the random number generator state of the specified GPU. Args: new_state (torch.ByteTensor): The desired state device (torch.device or int, optional): The device to set the RNG state. Default: ``'cuda'`` (i.e., ``torch.device('cuda')``, the current CUDA device). ) memory_formatNrcj}|t}tjj|}|dSN)rr rrr set_state)r r!rr,s r"cbzset_rng_state..cbHsDl ; ""C!J9#>##I.....r#) r r_C_DisableFuncTorchclonecontiguous_formatrrrrr)r,rr2s`` r"rr4s   O X ' ' ) ) O O"e6MNNI O O O O O O O O O O O O O O O&#.f%% FC .ff--//////rNNNNNs!AA #A  new_statescPt|D]\}}t||dS)zSet the random number generator state of all devices. Args: new_states (Iterable of torch.ByteTensor): The desired state for each device. N) enumerater)r7r(states r"rrRs< j))  5eQ  r#rcRtfd}t|ddS)aSet the seed for generating random numbers for the current GPU. It's safe to call this function if CUDA is not available; in that case, it is silently ignored. Args: seed (int): The desired seed. .. warning:: If you are working with a multi-GPU model, this function is insufficient to get determinism. To seed all GPUs, use :func:`manual_seed_all`. c|t}tjj|}|dSr0)r rrrr)r r!rs r"r2zmanual_seed..cbks8!J9#>%%d+++++r#T)rNrrrr2s` r"rr\sD t99D,,,,, rr#cRtfd}t|ddS)zSet the seed for generating random numbers on all GPUs. It's safe to call this function if CUDA is not available; in that case, it is silently ignored. Args: seed (int): The desired seed. cttD].}tjj|}|/dSr0)r*r rrrr)r(r!rs r"r2zmanual_seed_all..cb~sO|~~&& 0 0A % =a @   ) )$ / / / / 0 0r#T)rNr=r>s` r"rrssD t99D00000 rD!!!!!!r#c*d}t|dS)atSet the seed for generating random numbers to a random number for the current GPU. It's safe to call this function if CUDA is not available; in that case, it is silently ignored. .. warning:: If you are working with a multi-GPU model, this function will only initialize the seed on one GPU. To initialize all GPUs, use :func:`seed_all`. cxt}tjj|}|dSr0)r rrrrr r!s r"r2zseed..cbs5!J9#>     r#Nrr2s r"rrs"!!! rNNNNNr#c*d}t|dS)zSet the seed for generating random numbers to a random number on all GPUs. It's safe to call this function if CUDA is not available; in that case, it is silently ignored. cd}d}ttD][}tjj|}|s+||}d}F||\dS)NrFT)r*r rrrrrr) random_seedseededr(r!s r"r2zseed_all..cbs |~~&& ; ;A % =a @  ;!&&(((/<<>> !--k:::: ; ;r#NrDrEs r"rrs" ; ; ;rNNNNNr#ctt}tjj|}|S)zyReturn the current random seed of the current GPU. .. warning:: This function eagerly initializes CUDA. )rr rrrrrCs r"rrs: LLL   C 5c:  ) ) + ++r#)r)rN)collections.abcrtypingrrrrrr r r __all__rrrr listr rrrrrrrr&r#r"rPs$$$$$$ RRRRRRRRRRRRRR   ))%S%, 67)V)))),4<@F$S#u|%;< < (6"2 t    cd."#"$""""&&, ,c , , , , , ,r#