a _ h@sddlZddlZddlZddlZddlmZmZmZmZddl m Z ddl m Z ddl mZmZmZddlmZddlmZddlmZdd l mZdd lmZd d lmZmZd dZeeeeeeffdddZ ddZ!eeeeeefdddZ"eedddZ#dS)N)ListTupleDictAny)Image)BytesIO)VectorStoreIndexSimpleDirectoryReaderDocument)SimpleNodeParser) OpenRouter)OpenAIEmbedding)Settings)settings) MedicalRecord ChatSessioncCs:ttdddd}ttddd}|t_|t_||fS)NOPENROUTER_API_KEYzdeepseek/deepseek-chatgffffff?)api_keymodelZ temperatureZOPENAI_API_KEYztext-embedding-3-small)rr)r osgetenvr rllmZ embed_model)rZ embeddingr0/home/qiu/health_record_app/backend/api/utils.pyinit_llmsr) image_pathreturnc CsTzt|d(}|}t|d}Wdn1s<0Yt|}|j|j|j|j d}dt ddd}dd d d d d dd|idgdgd}t j d||d}|jdkr|} | dddd} d|d<d|d<| |fWSd|d<|j|d<d|fWSWn8tyN} zddt| d fWYd} ~ Sd} ~ 00dS)!Nrbzutf-8)widthheightformatmodezBearer rzapplication/json) Authorizationz Content-Typezgoogle/gemini-flash-1.5-8busertextzExtract all text from this medical document image. Include all details like patient information, dates, test results, medications, diagnoses, and any other relevant medical information. Format the output clearly.)typer% image_urlurlzdata:image/jpeg;base64,)r&r'rolecontent)rmessagesz-https://openrouter.ai/api/v1/chat/completions)headersjsonchoicesrmessager+Zextraction_modelsuccessextraction_statusfailederror)r3r5)openreadbase64 b64encodedecoderrr r!r"rrrequestspost status_coder.r% Exceptionstr) rZimg_fileZ image_dataZ base64_imageimgmetadatar-dataresponseresultextracted_texterrrextract_text_from_image%sZ .      rHcCsg}tjj|d}|D]}d|jd}|d|d7}|d|jdd7}|jrl|d|jd7}|jr|d|jd7}t ||j |j |j |j d d }||q|sdStt|}|S) N)r$zTitle:  zType: zDate: z%Y-%m-%dz Description: z Extracted Content: ) record_id record_type file_type created_at)r%rB)robjectsfiltertitleget_record_type_displayrMstrftime descriptionrFr idrKrL isoformatappendrrZfrom_documents)r$ documentsrecordsrecordr+docindexrrrcreate_user_indexis0  r\)r1sessionrc Cszt|}|sdgfWS|jddd}dddt|D}d|d|d }|}||}g} t|d r|jD]J} d | j vr|| j d } zt j j | d } | | Wq|t jyYq|0q|t|| fWSty } zd t| gfWYd} ~ Sd} ~ 00dS)Nz[I don't have access to any of your medical records yet. Please upload some documents first.z -created_atrIcSsg|]}|jd|jqS)z: r)).0msgrrr sz(process_chat_message..zMBased on the user's medical records and the following conversation history: z User's new question: z Please provide a helpful response based on the medical records available. If you reference specific records, mention them clearly. source_nodesrJ)rTz0I encountered an error processing your request: )r\r,order_byjoinreversedZas_query_enginequeryhasattrrbrBrrNgetrV DoesNotExistr@r?)r1r]r$r[Zrecent_messagesZ chat_historyrfZ query_enginerDreferenced_recordsnoderJrYrGrrrprocess_chat_messages8        rl)pdf_pathrcCsdS)Nz'PDF text extraction not yet implementedr)rmrrrextract_text_from_pdfsrn)$rr.r9r<typingrrrrPILriorZllama_index.corerr r Zllama_index.core.node_parserr Zllama_index.llms.openrouterr Zllama_index.embeddings.openair r django.confrdjango_settingsmodelsrrrr@rHr\rlrnrrrrs*        D' 3