昺hg dZddlmZddlmZmZddlmZmZm Z m Z ddl m Z ddl mZerddlmZGdd eZGd d eZd S) z7Abstract interface for document loader implementations.) annotations)ABCabstractmethod) TYPE_CHECKINGIteratorListOptional)Document)Blob) TextSplitterc>eZdZdZed dZ d d dZdd ZdS) BaseLoadera4Interface for Document Loader. Implementations should implement the lazy-loading method using generators to avoid loading all Documents into memory at once. The `load` method will remain as is for backwards compatibility, but its implementation should be just `list(self.lazy_load())`. returnList[Document]cdS)z Load data into Document objects.Nselfs q/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/langchain_community/document_loaders/base.pyloadzBaseLoader.loadN text_splitterOptional[TextSplitter]c~ddlm}| |}n|}|}||S)aLoad Documents and split into chunks. Chunks are returned as Documents. Args: text_splitter: TextSplitter instance to use for splitting documents. Defaults to RecursiveCharacterTextSplitter. Returns: List of Documents. r)RecursiveCharacterTextSplitter)langchain.text_splitterrrsplit_documents)rrr_text_splitterdocss rload_and_splitzBaseLoader.load_and_split sS KJJJJJ  +I+I+K+KNN*Nyy{{--d333rIterator[Document]c:t|jjd)zA lazy loader for Documents.z does not implement lazy_load())NotImplementedError __class____name__rs r lazy_loadzBaseLoader.lazy_load7s'"~& G G G   r)rr)N)rrrr)rr")r& __module__ __qualname____doc__rrr!r'rrrrrsp///^/7;44444.      rrc2eZdZdZed dZd dZd S) BaseBlobParseraAbstract interface for blob parsers. A blob parser provides a way to parse raw data stored in a blob into one or more documents. The parser can be composed with blob loaders, making it easy to reuse a parser independent of how the blob was originally loaded. blobr rr"cdS)zLazy parsing interface. Subclasses are required to implement this method. Args: blob: Blob instance Returns: Generator of documents Nrrr-s r lazy_parsezBaseBlobParser.lazy_parseJrrrcFt||S)a~Eagerly parse the blob into a document or documents. This is a convenience method for interactive development environment. Production applications should favor the lazy_parse method instead. Subclasses should generally not over-ride this parse method. Args: blob: Blob instance Returns: List of documents )listr0r/s rparsezBaseBlobParser.parseWsDOOD))***rN)r-r rr")r-r rr)r&r(r)r*rr0r3rrrr,r,@sR    ^  ++++++rr,N)r* __future__rabcrrtypingrrrr langchain_core.documentsr 1langchain_community.document_loaders.blob_loadersr rr rr,rrrr9s==""""""########::::::::::::------BBBBBB5444444. . . . . . . . b&+&+&+&+&+S&+&+&+&+&+r