A Chinese Question and Answer System for Liver Cancer based on Knowledge Graph and Large Language Mode

Haoqi Wu¹Min Zhang²Hailing Wang^1*Xiaoyan Jiang¹Yongbin Gao¹Rong Huang¹Zhijun Fang¹Xiaojun Hu³Yingfang Fan^3*

• ¹Shanghai University of Engineering Sciences, Shanghai, China
• ²Ninth Hospital of Xi'an Department of Endocrinology, Xi'an, China
• ³The Third Affiliated Hospital of Southern Medical University, Guangzhou, China

Introduction: The liver cancer question-and-answer (Q\&A) system is primarily intended to help patients access disease-related information more conveniently. However, there is currently no Q\&A system specifically developed for liver cancer. Additionally, most existing Q\&A systems lack real clinical data and have limited capability in understanding Chinese questions. Methods: This paper proposes a Chinese liver cancer question-answering system based on knowledge graphs and Large Language Models (LLMs). To unify information from diverse sources, the system employs a knowledge graph to store entities and inter-entity relationships extracted from patients' clinical electronic medical records and the professional medical website xywy.com, which serves as the foundation for the system's responses. Specifically, ChatGLM3.5 is utilized to extract entity information from questions, while BERT is applied to understand users' intent. Subsequently, the system retrieves corresponding information from the knowledge graph. Finally, the retrieved information is integrated, and a natural language response is generated as the answer to the question. Results:The experimental results indicate that in terms of intent classification, our system achieves a precision of 92.34\%, representing an improvement of 1.38\% over the BERT model and 4.32\% over the GEBERT model. In terms of response relevance, the system's outputs are more aligned with patients' daily speech patterns and exhibit higher relevance to the target questions.