ӘhdZddlmZmZddlZddlmZmZddlm Z d deede e effd Z d deede fd Zd deeddfd Zgd ZdS)zKThis package adds support for device memory management implemented in MTIA.)AnyOptionalN) _device_tis_initialized)_get_device_indexdevicereturnc~tsiStjt |dS)aReturn a dictionary of MTIA memory allocator statistics for a given device. Args: device (torch.device, str, or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). Toptional)rtorch_C_mtia_memoryStatsrr s Y/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/torch/mtia/memory.py memory_statsr s;    8 % %&7&N&N&N O OOctsdSt|ddddS)aReturn the maximum memory allocated in bytes for a given device. Args: device (torch.device, str, or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). rdram peak_bytes)rrgetrs rmax_memory_allocatedrsE   q    # #FA . . 2 2< C CCrctsdStjt |ddS)aReset the peak memory stats for a given device. Args: device (torch.device, str, or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). NTr )rrr_mtia_resetPeakMemoryStatsrrs rreset_peak_memory_statsr'sA    H''(9&4(P(P(PQQQQQr)rrr)N)__doc__typingrrrrr_utilsrdictstrrintrr__all__rrr&sSR ''''''''%%%%%% P P), PS#X P P P P D D)!4 D D D D D R RHY$7 R4 R R R R   r