ޘh0UddlmZmZmZmZddlmZmZddlm Z ddl m Z m Z ddl mZe r ddlmZdd lmZeed efZeed <ed eed ZedeeedZdedeeefdZGddeZdS))AnySequence TypedDictUnion) TypeAliasoverload) is_pil_image)is_vision_availablerequires_backends)Pipeline)Image load_imagez Image.Image ImagePairKeypointxyMatchkeypoint_image_0keypoint_image_1scoreimagesreturncd}dt|trNt|dkrtfd|Dr|gStfd|Dr|St |)N)z-Input images must be a one of the following :z - A pair of images.z - A list of pairs of images.cJt|pt|tS)z"images is a PIL Image or a string.)r isinstancestr)images p/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/transformers/pipelines/keypoint_matching.py_is_valid_imagez-validate_image_pairs.._is_valid_image+sE""z'validate_image_pairs..0s-#Q#Q__U%;%;#Q#Q#Q#Q#Q#Qr%c3K|]G}t|to-t|dkotfd|DVHdS)r c3.K|]}|VdSr'r(r)s r#r+z1validate_image_pairs...5s-CCuOOE**CCCCCCr%N)r rlenall)r* image_pairr$s r#r+z'validate_image_pairs..2s}   z8 , , DJ1$ DCCCC CCCCC      r%)r rr.r/ ValueError)r error_messager$s @r#validate_image_pairsr3$sM ===&(##  v;;!  #Q#Q#Q#Q&#Q#Q#Q Q Q 8O     %        M ] # ##r%c VeZdZdZdZdZdZdZfdZddZ e dde d e d e d eefd Ze ddee d e d e d eeefd Z ddeee e fd e d e d eeeeeefffd ZddZdZdd eefdZxZS)KeypointMatchingPipelinez Keypoint matching pipeline using any `AutoModelForKeypointMatching`. This pipeline matches keypoints between two images. FTctj|i|t|d|jdkrt ddS)NvisionptzBKeypoint matching pipeline only supports PyTorch (framework='pt').)super__init__r frameworkr1)selfargskwargs __class__s r#r:z!KeypointMatchingPipeline.__init__FsS$)&)))$))) >T ! !abb b " !r%Nc0i}|||d<i}|||d<|i|fS)Ntimeout thresholdr()r<rBrApreprocess_paramspostprocess_paramss r#_sanitize_parametersz-KeypointMatchingPipeline._sanitize_parametersLs>  +2 i (  .7 { + "&888r%inputsrBr>rc dSr'r(r<rGrBr>s r#__call__z!KeypointMatchingPipeline.__call__Usadadr%c dSr'r(rIs r#rJz!KeypointMatchingPipeline.__call__Xsmpmpr%c |tdt|}tj|fd|i|}t |dkr|dS|S)a Find matches between keypoints in two images. Args: inputs (`str`, `list[str]`, `PIL.Image` or `list[PIL.Image]`): The pipeline handles three types of images: - A string containing a http link pointing to an image - A string containing a local path to an image - An image loaded in PIL directly The pipeline accepts either a single pair of images or a batch of image pairs, which must then be passed as a string. Images in a batch must all be in the same format: all as http links, all as local paths, or all as PIL images. threshold (`float`, *optional*, defaults to 0.0): The threshold to use for keypoint matching. Keypoints matched with a lower matching score will be filtered out. A value of 0 means that all matched keypoints will be returned. kwargs: `timeout (`float`, *optional*, defaults to None)` The maximum time in seconds to wait for fetching images from the web. If None, no timeout is set and the call may block forever. Return: Union[list[Match], list[list[Match]]]: A list of matches or a list if a single image pair is provided, or of lists of matches if a batch of image pairs is provided. Each match is a dictionary containing the following keys: - **keypoint_image_0** (`Keypoint`): The keypoint in the first image (x, y coordinates). - **keypoint_image_1** (`Keypoint`): The keypoint in the second image (x, y coordinates). - **score** (`float`): The matching score between the two keypoints. NzFCannot call the keypoint-matching pipeline without an inputs argument!rBr r)r1r3r9rJr.)r<rGrBr>formatted_inputsoutputsr?s r#rJz!KeypointMatchingPipeline.__call__[soN >eff f/77"%''"#3SSySFSS  A % %1: r%cfd|D}|||j}||j}d|D}||d}|S)Nc2g|]}t|S))rAr)r*r"rAs r# z7KeypointMatchingPipeline.preprocess..s&III*UG444IIIr%)rreturn_tensorscg|] }|j Sr()size)r*r"s r#rQz7KeypointMatchingPipeline.preprocess..s777u 777r%) model_inputs target_sizes)image_processorr;to torch_dtype)r<rrArUrVpreprocess_outputss ` r# preprocessz#KeypointMatchingPipeline.preprocesssqIIII&III++6$.+YY #t'788 77777 .:LYY!!r%cH|d}|jdi|}||dgd}|S)NrUrV) model_outputsrVr()model)r<rZrUr]forward_outputss r#_forwardz!KeypointMatchingPipeline._forwards@).9 " 22\22 ,9L^_mLnKoppr%c `|d}|d}|j|||}|d}g}t|d|d|dD]\}}} t|d|d }t|d|d }|t |||  t|d d }|S)Nr]rV)rVrBr keypoints0 keypoints1matching_scoresr rrc|dS)Nrr()rs r#z6KeypointMatchingPipeline.postprocess..s ' r%T)keyreverse)rWpost_process_keypoint_matchingzipritemappendrsorted) r<r_rBr]rVpostprocess_outputs pair_resultkp_0kp_1rs r# postprocessz$KeypointMatchingPipeline.postprocesss0'8 &~6 "2QQ  R  2!4 !$  -  -  1 2" "  h h D$ d1gllnnQ ???Dd1gllnnQ ???D   udTY^YcYcYeYefff g g g g[.B.BDQQQ r%)NN)rFr')__name__ __module__ __qualname____doc___load_processor_load_image_processor_load_feature_extractor_load_tokenizerr:rErrfloatrlistrrJrr[r`rr __classcell__)r?s@r#r5r5<sO #Occccc 9999ddydUdCdTXY^T_dddXd pptIp5pRUpZ^_cdi_jZkpppXp --d9oy01-- - tE{De-- . ------^"""" T%[r%r5N)typingrrrrtyping_extensionsrr image_utilsr utilsr r baserPILrrr!r__annotations__r{rrr3r5r(r%r#rsy322222222222211111111&&&&&&::::::::)(((((( mS&8 9: 9::: 9Zu5!9!9 : : 'hafgghh$$(92E)F$$$$0mmmmmxmmmmmr%