ݘhZdZddlmZer ddlmZddlmZddlmZdefdZdS) zFP-Quant integration file)is_fp_quant_available) FPQuantConfig) FPQuantDtypeconfigc |jdkr tj}ntd|j|jdkr tj}ntd|jt ||j||j|j |j |j S)Nmxfp4zUnsupported forward dtype: bf16zUnsupported backward dtype: ) forward_dtypeforward_methodbackward_dtypestore_master_weightshadamard_group_sizepseudoquantizationmodules_to_not_convert) r rMXFP4 ValueErrorr BF16FPQuantLinearConfigr rrrr)rr r s j/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/transformers/integrations/fp_quant.pyadapt_fp_quant_configrs w&&$* Mv7KMMNNN &&%*O8MOOPPP #,%#8"6!4%<   N) __doc__utilsrfp_quantrrr&transformers.utils.quantization_configrrrrs &======%%%%%%@@@@@@-r