9h 2ddlZddlZddlZddlZddlmZddlmZddlm Z m Z ddl m Z m Z mZddlmZdZd efd Zd ed efd Zd ed dfd Z dddddddeedeedeed eedeef dZddeed dfdZddeed dfdZd deeded dfdZ d!deedeedeed eedeef dZ ddddddddeedeedeed eedeef dZdS)"N)knobs)proton)register_triton_hookunregister_triton_hook)set_profiling_offset_profiling_onis_command_line)Optionalrreturnctjjjj}|dkrdS|dkrdSt d)Ncudacuptihip roctracerz/No backend is available for the current target.)tritonruntimedriveractiveget_current_targetbackend ValueError)rs _/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/triton/profiler/profile.py_select_backendrsMn#*==??GG&w E  {JKKKrcd}|dkratjj}|Ntt jt jjdz dz dz dz }|S)Nrbackendsnvidialib) rr cupti_dirstrpathlibPath__file__parentabsolute)rlib_paths r_get_backend_default_pathr)siH'<)  7<118?HHJJZWZbbejjmttuuH Orcx|dkr1ddg}|D],}tj|dtd|d+dSdS)NrHIP_VISIBLE_DEVICESCUDA_VISIBLE_DEVICESz3Proton does not work when the environment variable zK is set on AMD GPUs. Please unset it and use `ROCR_VISIBLE_DEVICES` instead)osgetenvr)rhip_device_envsenvs r _check_envr1%s|+02HI"  Cyd##/ [#[[[0  rshadowtreecontextdatarhooknamer5r6r7ctrdS|t}|t}t|t |}t |r|dkrt tj|||||S)a Start profiling with the given name and backend. Usage: ```python proton.start("my_profile") # do something proton.finalize() ``` Args: name (str, optional): The name (with path) of the profiling session. If not provided, the default name is "~/proton.hatchet". backend (str, optional): The backend to use for profiling. Available options are [None, "cupti", "cupti_pcsampling", "roctracer"]. Defaults to None, which automatically selects the backend matching the current active runtime. context (str, optional): The context to use for profiling. Available options are ["shadow", "python"]. Defaults to "shadow". data (str, optional): The data structure to use for profiling. Available options are ["tree"]. Defaults to "tree". hook (str, optional): The hook to use for profiling. Available options are [None, "triton"]. Defaults to None. Returns: session (int): The session ID of the profiling session. Nr) r DEFAULT_PROFILE_NAMErr1r)r r libprotonstart)r8r5r6rr7 backend_paths rr<r</sJ |#!##w,W55L    ?4$ F FFrsessionctr|dkrtd|tjdStj|dS)z Activate the specified session. The profiling session will be active and data will be recorded. Args: session (int): The session ID of the profiling session. Defaults to None (all sessions) Returns: None rzEOnly one session can be activated when running from the command line.N)r rr; activate_allactivater>s rrArAhs[bW\\`aaa     7#####rctr|dkrtd|tjdStj|dS)a  Stop the specified session. The profiling session's data will still be in the memory, but no more data will be recorded. Args: session (int): The session ID of the profiling session. Defaults to None (all sessions) Returns: None rzGOnly one session can be deactivated when running from the command line.N)r rr;deactivate_all deactivaterBs rrErE{s[dW\\bccc """""W%%%%%rhatchet output_formatc|2ttj|tdSt r|dkrt dtj||dS)a Finalizes a profiling session. Flush and write the profiling data to the file specified by the session name. Args: session (int, optional): The session ID to finalize. If None, all sessions are finalized. Defaults to None. output_format (str, optional): The output format for the profiling results. Aavailable options are ["hatchet"]. Returns: None NrzEOnly one session can be finalized when running from the command line.)rr; finalize_allrr rfinalize)r>rGs rrJrJsw}---        fAdee e7M22222rcZtjfd}|S)z Context manager for profiling. Internally use only. Args: See start() for the arguments. Returns: wrapper (function): The wrapped function. c^t }|i|}t||S)Nr4)r<rE) argskwargsr>retrr5r6funcr7r8s rwrapperz_profiling..wrappersCgD'PTUUUdD#F##7 r) functoolswraps)rPr8r5r6rr7rQs`````` r _profilingrTsX$_T Nrr8r5r6rr7cP| fd}|St|S)z Decorator for profiling. Usage: ```python @proton.profile def foo(): pass ``` Args: See start() for the arguments. Returns: decorator (function): The decorator function. Nc.t|S)NrUrT)frr5r6r7r8s r decoratorzprofile..decorators adG$PW^bccc crrUrX)rPr8r5r6rr7rZs ````` rprofiler[sj4 | d d d d d d d d d$T7w]abbbbr)N)NrF)Nr2r3NN)rRrr-r#rtriton._C.libprotonrr;r7rrflagsrr r typingr r:r"rr)r1r<intrArErJrTr[rrras 333333>>>>>>>>GGGGGGGGGGLLLLL s s    6G& ! 6G6G6G 3-6Gc]6G 3- 6G c] 6G 3- 6G6G6G6Gr$$hsm$t$$$$&&& &&&&&&33hsm333t33332% !  3-c] 3-  c]  3- : "c% !"c"c"c 3-"cc] "c 3- "c c] "c 3-"c"c"c"c"c"cr