昺h( ddlZddlZddlZddlZddlmZddlmZmZm Z m Z ddl m Z ddl mZmZddlmZejeZGddeZdS) N)Path)DictIteratorListUnion) ChatSession) AIMessage HumanMessage)BaseChatLoaderceZdZdZdeeeffdZdee de fdZ de j dedeefd Zdee fd Zd S) SlackChatLoaderz0Load `Slack` conversations from a dump zip file.pathct|tr|nt||_|jst d|jddS)z Initialize the chat loader with the path to the exported Slack dump zip file. :param path: Path to the exported Slack dump zip file. zFile z not foundN) isinstancerzip_pathexistsFileNotFoundError)selfrs n/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/langchain_community/chat_loaders/slack.py__init__zSlackChatLoader.__init__sc!+4 6 6FDJJ }##%% G#$EDM$E$E$EFF F G Gmessagesreturnc Dg}d}|D] }t|ts|dd}|dd}|dd}|s^tjdtj}||r||krB|dxjd|zz c_|djd  d |in+| t|||d |igd  |} t| S)Ntexttsuserz<@U\d+> has joined the channel)flagsz events message_time)senderr!)rolecontentadditional_kwargs)r) rdictgetrecompile IGNORECASEmatchr%r&appendr r) rrresultsprevious_sendermessager timestampr# skip_patterns r_load_single_chat_sessionz)SlackChatLoader._load_single_chat_session sf8: % %Ggt,, ;;vr**D D"--I[[,,F :1L!!$'' (( ##v}4## -h7>>#Y/ # $&,(6 'B&C++   %OOG,,,,rzip_file file_pathc||d5}tj|}dddn #1swxYwYt|tst dt ||S)z"Read JSON data from a zip subfile.rNz#Expected list of dictionaries, got )openjsonloadrlist ValueErrortype)rr4r5fdatas r _read_jsonzSlackChatLoader._read_jsonCs ]]9c * * a9Q<Ktjt|jd5}|D]D}|dr-|||}||VE ddddS#1swxYwYdS)z Lazy load the chat sessions from the Slack dump file and yield them in the required format. :return: Iterator of chat sessions containing messages. r7z.jsonN)zipfileZipFilestrrnamelistendswithr@r3)rr4r5rs r lazy_loadzSlackChatLoader.lazy_loadKs_S// 5 5 C%..00 C C %%g..C#xCCH88BBBBB C C C C C C C C C C C C C C C C C C CsABBBN)__name__ __module__ __qualname____doc__rrDrrrrrr3rBrCr'r@rrGrrr r s:: GCI G G G G!-$t*!-!-!-!-!-F7?stDz C8K0 C C C C C Crr )r9loggingr)rBpathlibrtypingrrrrlangchain_core.chat_sessionsrlangchain_core.messagesr r %langchain_community.chat_loaders.baser getLoggerrHloggerr rLrrrUs  ............444444;;;;;;;;@@@@@@  8 $ $FCFCFCFCFCnFCFCFCFCFCr