昺h@ddlZddlmZmZmZmZmZmZmZddl Z ddl Z ddl m Z m Z ddlmZddlmZddlmZmZddlmZded efd ZGd d eZGd deZGddeeZdS)N)Any AsyncIteratorDictIteratorListMappingOptional)AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun)BaseLanguageModel)BaseLLM)GenerationChunk LLMResult)Extrastream_responsereturnctj|}|ddur|nd}t|dd|S)z0Convert a stream response to a generation chunk.doneTNresponse)textgeneration_info)jsonloadsgetr)rparsed_responsers g/var/www/html/services/rag-service/venv/lib/python3.11/site-packages/langchain_community/llms/ollama.py$_stream_response_to_generation_chunkrsaj11O)8)<)>W$BVWWrpromptimageskwargsc+RK||d}|jd|||jdd|Ed{VdSNrErFz/api/generate/)payloadr5api_urlr&)_create_streamr))rArEr5rFrGrKs r_create_generate_streamz%_OllamaCommon._create_generate_streams|$v66&4& }444              rc bK||d}|jd|||jdd|23d{V}|WV 6dSrI)_acreate_streamr))rArEr5rFrGrKitems r_acreate_generate_streamz&_OllamaCommon._acreate_generate_streams$v66.$. }444            $ JJJJJ    s.rLrKc vj|tdjj}n|g}j}jD]}||vr ||||<d|vr |d|d<n1i|dd|ifd|D|d<|drd|dgi|}n.|d|dgd|}t j|d d itjtrjni|d j }d |_ |j dkrd|j dkrtdjd|d} td|j d| |d S)N2`stop` found in both the input and default params.r?r5c.i|]\}}|jv||Sr&rB.0kvrAs r z0_OllamaCommon._create_stream..,TTTDAqat?S6S6S1a6S6S6SrmessagesrErFrJ Content-Typeapplication/jsonT)urlr=rstreamr<utf-8zwOllama call failed with status code 404. Maybe your model is not found and you should pull the model with `ollama pull z`.error$Ollama call failed with status code . Details: )decode_unicode)r5 ValueErrorrBitemsrrequestspost isinstancer=dictr<encoding status_coder!r+r iter_lines) rArLrKr5rGparamskeyrequest_payloadroptional_details ` rrMz_OllamaCommon._create_streamsV 9 T%5QRR R Y "9DD \D%' * *Cf}}$Sks    &y 1F9  !#!!!UTTTFLLNNTTT!F9  ;;z " " )7;;z2+F+FQ&QOO"++h//!++h33O = 2#-dlD#A#AI4<"> 38;O33!033""$"777rc Kj|tdjj}n|g}j}jD]}||vr ||||<d|vr |d|d<n1i|dd|ifd|D|d<|drd|dgi|}n.|d|dgd|}t j4d{V}||d d i|j 4d{V } | j d kra| j d krtd| dd{V} td| j d| | j 23d{V} | dWV 6 dddd{Vn#1d{VswxYwYdddd{VdS#1d{VswxYwYdS)NrTr?r5c.i|]\}}|jv||Sr&rVrWs rr[z1_OllamaCommon._acreate_stream.. r\rr]rErFrJr^r_)r`r=rr<rcrdz(Ollama call failed with status code 404.rerfrgrb)r5rirBrjraiohttp ClientSessionrlr<statusr!rcontentdecode) rArLrKr5rGrrrsrtsessionrrulines ` rrPz_OllamaCommon._acreate_streams 9 T%5QRR R Y "9DD \D%' * *Cf}}$Sks    &y 1F9  !#!!!UTTTFLLNNTTT!F9  ;;z " " )7;;z2+F+FQ&QOO"++h//!++h33O (** / / / / / / /g||');<$ $ / / / / / / / / ?c))#--9F19 0C0CG0L0L*L*L*L*L*L*L(;8?;;)8;;#+"2///////$++g.......#3"2# / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / /sC'G;/A4G#G)GG; G! !G;$G! %G;; HHF run_managerverbosec d}|j||fi|D];}|r7t|}||}n||z }|r||j|<|t d|SNrz$No data received from Ollama stream.)rNron_llm_new_tokenrri rArEr5rrrG final_chunk stream_respchunks r_stream_with_aggregationz&_OllamaCommon._stream_with_aggregation,s26 747OOOO  K <[II&"'KK5(K00 '1  CDD DrcKd}|j||fi|23d{V}|r=t|}||}n||z }|r"||j|d{VG6|t d|Sr)rRrrrrirs r_astream_with_aggregationz'_OllamaCommon._astream_with_aggregationFs26 !>!>vt!V!Vv!V!V       + <[II&"'KK5(K%66 '7"W  CDD DsANN)N)NNF)0r"r#r$r)str__annotations__r+r,r intr-floatr.r/r0r1r2r3r4r5rr6r7r8r9r:r;r<r=rnpropertyrrrBrrDrrNrrRrMrPr boolrrr rr&rrr(r(s,Hc,,,-E3"Hhsm"""B%)L(5/(((5 %)L(5/(((%"GXc]!!!$"GXc]!!!+!%J $$$N $(M8C='''='+NHUO***,$(K%'''=!%D(49 $$$&!E8E?!!!M E8C=0"E8E?!!!C!FHSM   D"Hhsm"""U FHSM   7!GXc]!!!("GXd^"""  c3h   X 0XWS#X%6XXXXX%)&*     tCy!  c#    #     $%)&* tCy!c#    s  (%) >8>8>8>8tCy! >8  >8 # >8>8>8>8H%) 9/9/9/9/tCy! 9/  9/ s  9/9/9/9/|%):> tCy!67      :%)?C tCy!;<      rr(c eZdZdZGddZedefdZ ddeede eed e eed e e d e de f fd Z ddeede eed e eed e e d e de f fd Z ddede eed e e d e deef dZ ddede eed e ed e deef dZxZS)OllamazOllama locally runs large language models. To use, follow the instructions at https://ollama.ai/. Example: .. code-block:: python from langchain_community.llms import Ollama ollama = Ollama(model="llama2") c eZdZdZejZdS) Ollama.Configz'Configuration for this pydantic object.N)r"r#r$r%rforbidextrar&rrConfigrms55 rrrcdS)zReturn type of llm.z ollama-llmr&r@s r _llm_typezOllama._llm_typers |rNpromptsr5rFrrGc g}|D]<}tj|f||||jd|}||g=t |S)hCall out to Ollama's generate endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = ollama("Tell me a joke.") r5rFrr generations)superrrappendr rArr5rFrrGrrEr __class__s r _generatezOllama._generatews.  . .F:%'':'   K    } - - - -[1111rc Kg}|D]B}tj|f||||jd|d{V}||gCt |S)rrNr)rrrrrrs r _ageneratezOllama._agenerates.  . .F A A!' !!  !!K    } - - - -[1111rrEc+K|j||fi|D]:}|r6t|}|V|r!||j|j;dSNr)rNrrrrrArEr5rrGrrs r_streamzOllama._streams847OOOO  K <[II 00 $ 1   rc K|j||fi|23d{V}|r=t|}|WV|r'||j|jd{VG6dSr)rPrrrrrs r_astreamzOllama._astreams"6!5fd!M!Mf!M!M       + <[II %66 $ 7 "N!M!MsA)NNNr)r"r#r$r%rrrrrr r rrrrrrrr rr __classcell__)rs@rrrasL   3X%)&*:> "2"2c"2tCy!"2c# "2 67 "2  "2 "2"2"2"2"2"2N%)&*:> "2"2c"2tCy!"2c# "2 67 "2  "2 "2"2"2"2"2"2N%):> tCy!67    / " (%)?C tCy!;<     ' rr)rtypingrrrrrrr rxrklangchain_core.callbacksr r langchain_core.language_modelsr #langchain_core.language_models.llmsr langchain_core.outputsrrlangchain_core.pydantic_v1rrr Exceptionr!r(rr&rrrs NNNNNNNNNNNNNNNNNN=<<<<<777777========,,,,,,88888)888%D ~~~~~Wm~~~~~r