hUddlZddlZddlmZmZddlZddlmZgdZe e e d<de defdZ e ejd se ejd rJe ejd rJe ejd rJe ejd rJe ejdrJe d ejjd <e d ejjd <e d ejjd <e d ejjd <e d ejjd <e dejjd<deddfdZdeddfdZGddZdS)N)CallableOptional)Storage)gds_register_buffergds_deregister_bufferGdsFile__all__namereturncfd}|S)Nc*tdd)Nz torch._C.z" is not supported on this platform) RuntimeError)argskwargsr s V/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/torch/cuda/gds.pyfnz_dummy_fn..fnsOtOOOPPP)r rs` r _dummy_fnrs(QQQQQ Ir_gds_register_buffer_gds_deregister_buffer_gds_register_handle_gds_deregister_handle_gds_load_storage_gds_save_storagescDtj|dS)a:Registers a storage on a CUDA device as a cufile buffer. Example:: >>> # xdoctest: +SKIP("gds filesystem requirements") >>> src = torch.randn(1024, device="cuda") >>> s = src.untyped_storage() >>> gds_register_buffer(s) Args: s (Storage): Buffer to register. N)torch_Crrs rrr&s  H!!!$$$$$rcDtj|dS)awDeregisters a previously registered storage on a CUDA device as a cufile buffer. Example:: >>> # xdoctest: +SKIP("gds filesystem requirements") >>> src = torch.randn(1024, device="cuda") >>> s = src.untyped_storage() >>> gds_register_buffer(s) >>> gds_deregister_buffer(s) Args: s (Storage): Buffer to register. N)rrrr s rrr6s  H##A&&&&&rcfeZdZdZdedefdZddZddZdd Z dd e d eddfd Z dd e d eddfdZ dS)raWrapper around cuFile. cuFile is a file-like interface to the GPUDirect Storage (GDS) API. See the `cufile docs `_ for more details. Args: filename (str): Name of the file to open. flags (int): Flags to pass to ``os.open`` when opening the file. ``os.O_DIRECT`` will be added automatically. Example:: >>> # xdoctest: +SKIP("gds filesystem requirements") >>> src1 = torch.randn(1024, device="cuda") >>> src2 = torch.randn(2, 1024, device="cuda") >>> file = torch.cuda.gds.GdsFile(f, os.O_CREAT | os.O_RDWR) >>> file.save_storage(src1.untyped_storage(), offset=0) >>> file.save_storage(src2.untyped_storage(), offset=src1.nbytes) >>> dest1 = torch.empty(1024, device="cuda") >>> dest2 = torch.empty(2, 1024, device="cuda") >>> file.load_storage(dest1.untyped_storage(), offset=0) >>> file.load_storage(dest2.untyped_storage(), offset=src1.nbytes) >>> torch.equal(src1, dest1) True >>> torch.equal(src2, dest2) True filenameflagsctjdkrtd||_||_t j||t jz|_d|_ | dS)Nwin32z*GdsFile is not supported on this platform.) sysplatformrr#r$osopenO_DIRECTfdhandleregister_handle)selfr#r$s r__init__zGdsFile.__init__gse <7 " "KLL L   '(EBK$788%)  rr Ncn|j|tj|jdS)N)r-deregister_handler)closer,r/s r__del__zGdsFile.__del__ps4 ; "  " " $ $ $ rcz|j Jdtj|j|_dS)zpRegisters file descriptor to cuFile Driver. This is a wrapper around ``cuFileHandleRegister``. Nz4Cannot register a handle that is already registered.)r-rrrr,r4s rr.zGdsFile.register_handleus: K   A  h33DG<< rc~|j Jdtj|jd|_dS)zvDeregisters file descriptor from cuFile Driver. This is a wrapper around ``cuFileHandleDeregister``. Nz2Cannot deregister a handle that is not registered.)r-rrrr4s rr2zGdsFile.deregister_handles@ K # # ? $ # # '' 444 rrstorageoffsetct|j Jdtj|j||dS)amLoads data from the file into the storage. This is a wrapper around ``cuFileRead``. ``storage.nbytes()`` of data will be loaded from the file at ``offset`` into the storage. Args: storage (Storage): Storage to load data into. offset (int, optional): Offset into the file to start loading from. (Default: 0) Nz4Cannot load data from a file that is not registered.)r-rrrr/r8r9s r load_storagezGdsFile.load_storages? K # # A $ # # ""4;@@@@@rct|j Jdtj|j||dS)aUSaves data from the storage into the file. This is a wrapper around ``cuFileWrite``. All bytes of the storage will be written to the file at ``offset``. Args: storage (Storage): Storage to save data from. offset (int, optional): Offset into the file to start saving to. (Default: 0) Nz2Cannot save data to a file that is not registered.)r-rrrr;s r save_storagezGdsFile.save_storages? K # # ? $ # # ""4;@@@@@r)r N)r) __name__ __module__ __qualname____doc__strintr0r5r.r2rr<r>rrrrrGs>S ====     A AG AS A A A A A A AG AS A A A A A A Arr)r)r'typingrrr torch.typesrr listrC__annotations__rhasattrr__dict__rrrrrrrKsa %%%%%%%% cCHwux/00 Lwux!9:::::wux!788888wux!9:::::wux!455555wux!45555509 :P0Q0QEH,-2;)