ORIGINAL RESEARCH article

Front. Earth Sci., 10 September 2025

Sec. Geohazards and Georisks

Volume 13 - 2025 | https://doi.org/10.3389/feart.2025.1664477

An evaluation model for the dissemination of earthquake emergency information and decision-making based on user demand

  • YZ

    Yi Zhang †

  • YZ

    Yan Zhou *

  • QZ

    Qi Zhou

  • YZ

    Yi Zheng

  • ST

    Shuya Tang

  • JY

    Jinxu Yan

  • Sichuan Earthquake Administration, Chengdu, China

Abstract

Introduction:

To reduce the risks associated with earthquake relief decision-making and improve the efficiency of earthquake information services, this paper proposes a seismic emergency decision-making utility evaluation process and emergency information utility evaluation method based on the perception of user demand, starting from user needs.

Materials and Methods:

An evaluation model is constructed based on user preferences, information volume, and decision effectiveness. This article explores the quantification of earthquake emergency information utility and the decision-making utility evaluation process. It establishes a user preference model using Bayesian methods, introduces information entropy into it, and constructs a quadratic polynomial function linking demand probability, information quantity, and utility to quantify the decision-making utility of information products. Based on the threshold, effective information products were selected.

Results:

The reliability was tested, and the results showed that the correlation coefficient (R2), root mean square error (RMSE), and bias of the modeling set were 0.8955, 0.6492, and 0.0033, respectively. In addition, a 5-fold cross-validation was conducted to confirm the model's robustness and stability across different data partitions. The 6.0-magnitude earthquake that occurred in Luxian County, Sichuan Province, in 2021 was used as an example to test the feasibility of the evaluation process, demonstrating the rationality and effectiveness of the model.

Conclusion:

This method provides a new approach for evaluating information utility in a set scenario, which is beneficial for improving the decision-making ability of earthquake resistance and disaster-relief management, and effectively reducing the losses caused by earthquakes.

1 Introduction

After an earthquake, relief departments need to rapidly make decisions in highly complex and multi-dimensional demand scenarios, making information the lifeline of earthquake emergency decision-making (; ).The government-affiliated earthquake relief command centers and research institutions process and refine massive volumes of information to generate diverse forms of emergency information products, including written reports, maps, and tables, thereby providing decision-making support for rescue departments(). There are two main requirements for information products. First, due to the harm caused by earthquakes, effectively providing information for decision-making according to the requirements of the affected population is the key to effective earthquake relief and reduction of losses. Second, there is a need to evaluate the effectiveness of emergency information dissemination and screen the resulting information products to provide timely feedback according to the requirements of the demand side, as well as to promote continuous optimization of such information products. Based on these requirements, this study considers the combined optimization and development of earthquake emergency information products regarding the effectiveness of decision-making from the perspective of user demand. The main goals are to promote development through evaluation, thereby forming a virtuous cycle, and developing targeted information products that effectively promote decision-making during earthquake relief efforts.

In the existing literature, there is little in-depth discussion concerning the evaluation of the utility of information products. The evaluation of decision utility for emergency information is based on simple numerical comparisons (e.g., the deviation between estimates of the numbers of casualties, the size of the disaster area, and estimates of earthquake intensity and the actual situation). Due to the limited evaluation of these forms of information, the current methods perhaps rely too heavily on simple indicator analyses, ignoring the dynamic and uncertain nature of information dissemination and making it difficult to fully reflect the actual effects of decisions. The existing methods are mostly post-evaluation approaches that are difficult to adapt to the real-time needs of emergency decision-making and are not conducive to feedback and optimization from the perspective of product development (; ). Subjective factors may not be fully considered, and the impact of factors such as decision-makers’ experience and psychological state on information utility has not been fully incorporated into the present evaluation systems.

Based on the above considerations, this article explores the quantification of the utility of earthquake emergency information and the evaluation of decision processes using the decision-making scenario of provincial-level emergency command institutions after a moderate earthquake. By introducing a multidimensional evaluation system and implementing dynamic real-time evaluation, the utility of information products is continuously quantified and optimized to improve the level of information processing and decision support. Taking the 6.0-magnitude earthquake in Luxian County, Sichuan Province, China, in 2021 as an example, the rationality and effectiveness of the evaluation model are verified, ultimately providing a more effective information product development process and an evaluation method for enhancing earthquake emergency decision-making capabilities.

2 Materials and methods: construction of a seismic emergency information decision-making utility evaluation model based on user demand

2.1 Research hypothesis

In the dissemination of earthquake emergency information, each earthquake will have unique characteristics, and thus specific information is needed to support decision-making. Earthquake emergency information needs to be continuously updated and optimized according to decision-makers’ demands to assess the disaster situation as soon as possible and reduce casualties. Therefore, taking moderate-to-strong earthquakes as the application scenario, we propose the following three hypotheses.

Assumption 1After a moderate earthquake () emergency information can be used to make advance judgments concerning disaster relief decisions.

Assumption 2The decision-making utility of information products increases with the number of user preferences, and within a specific range, the utility increases with the volume of information.

Assumption 3Knowledge-intensive information products (e.g., rapid assessment reports and disaster briefings) and specialized products related to human factors (e.g., population casualty distribution maps, personnel search and rescue distribution maps, the status of high-intensity buildings, and key target distribution maps) have higher decision-making value than other products.

2.2 Development, use, and evaluation of the decision-making effectiveness of earthquake emergency information products

2.2.1 The necessity of developing earthquake emergency information products

Within 2 hours or less after an earthquake, responsible parties need to use earthquake emergency information for decision-making in highly uncertain situations. Since 2000, China has continuously developed various types of earthquake emergency information decision-making products, but only a few products can effectively aid in emergency decision-making. Therefore, it is necessary to establish a dynamic optimization information product and an evaluation model that considers the needs of the users.

2.2.2 Application scenarios and sources of earthquake emergency information

After a moderate to strong earthquake () occurs in China, within an hour (also known as the decision-making time window), decision-makers in earthquake emergency response scenarios will employ their subjective judgments, emotional experiences, and personal preferences to choose suitable information products, transparently forming an estimation standard for the effectiveness of information (). This assumes that the utility value obtained through an expert scoring method in several typical earthquake disaster events is equivalent to the actual utility value.

The earthquake emergency information selected in this article was obtained from government-affiliated earthquake relief command centers and research institutions. The classification of metadata was based on more than 10 years of earthquake emergency information system services, and this study does not consider the technical investment and economic costs of information in the production and circulation processes.

The 34 selected earthquake disaster events have a spatial range of Sichuan and Yunnan Provinces, a time range of 2010–2021, and a magnitude range of 5.0–7.0. Products with the same name repeatedly appearing in multiple earthquake disasters and from multiple sources were recorded as one product. For products with different names but highly similar content, those with the most recent product were retained. Products produced 24 h after the earthquake were excluded. A total of 100 information products were obtained for statistical analysis.

2.2.3 Development and evaluation process of earthquake emergency information products based on perceptions of user demand

Based on the theory of utility as a subdivision of information theory (), we propose that in earthquake emergency decision-making, an evaluation of the decision utility of information involves evaluating the degree to which information flows from the production department to the decision-making scenario and meets the needs of the user. This includes one batch of earthquake emergency information products (hereafter referred to as information products), one production department, one earthquake relief command organization and commander (hereinafter referred to as users), one decision-making scenario, and one set of evaluation methods. Therefore, the evaluation process of information decision utility designed in this study differs from existing evaluation methods by incorporating user needs and the perception of utility. Evaluation is a dynamic, cyclic process that comprises three modes (Figure 1). One is to construct a utility evaluation model, the focus of this article and the foundation of the evaluation process. The second is the “product demand” iterative mode, which is suitable for the emergency preparedness stage. Based on the model, the utility value of information products is quickly evaluated and tested to form a product utility list. The median principle method () is used to determine the utility threshold. Products with utility values not lower than the threshold are considered effective products, and the production department uses feedback information to update product information. This process is repeatedly optimized to obtain information products that approximate user preferences. The third is the parameter correction mode. After an earthquake event occurs, users will receive the latest effective information products by obtaining the decision utility value of the information product in the decision-making scenario, expanding the sample size, further correcting the utility parameters, updating the utility evaluation model, and feeding back the information to the production department.

FIGURE 1

2.3 Construction of an earthquake emergency information utility evaluation model based on user demand

Using the three indicators of information H, user demand preference P, and decision utility U, the relationship between the three modes is shown by the construction of the earthquake emergency information utility evaluation model based on user demand.

2.3.1 Calculation of model parameters

First, information entropy calculation formulas and user demand preferences are separately established, after which user utility values are obtained through expert ratings. Then, data on the three variables is used to establish a regression model. The specific process is as follows.

  • 1 Calculation of information entropy

The information content of a product is the leading indicator for evaluating its utility. The Shannon information entropy is used as a quantitative measure of information in mathematics (). This study introduces the concept of information entropy to quantitatively measure the information content of products. To accurately measure the content of emergency information products, information is segmented into the smallest effective units, namely, metadata, based on content features.

The Shannon information entropy is calculated by multiplying the various possible amounts of information by their probabilities of occurrence, then summing the results to represent the expected value of the information in the entire data set (Equation 1).

Here, x represents a random variable; p(x) represents the set of all possible outputs, the output probability function, and H measures the information content of the product. The previous text assumed that the probability of meta information appearing in information products is the same, and each type of meta information corresponds to different content features. Therefore, the meta information contained in each information product is positively correlated with the amount of information. Thus, the amount of information in each product can be determined only by the number of such information products, and then calculated using information entropy, i.e., the meta information in the product is exponentially calculated (Equation 2):where is the number of types of meta information contained in the information product i.

The original information classification was based on relevant research in the field of earthquakes (; ; ). Emergency information products were divided into eight categories: preparation information, earthquake situational information, basic information of the earthquake zone, assessment information, disaster situation, public opinion, emergency action, and intensity of investigation. Feature elements were extracted for each category of products to construct an earthquake emergency metadata table based on 210 categories (Table 1).

TABLE 1

First-level indexSecond-level indexMeta information numberSecond-level indexMeta information numberSecond-level indexMeta information number
Preparedness informationAdministrative region2 (Administrative map, administrative region distribution)Building3 (Kilometer grid for local building, Local seismic intensity level, Local building structure)Goods and materials in stock2 (Local goods and materials distribution graph, description of local goods and materials in stock)
Topography4Economy3Disaster shelter for evacuation3
Geological structure4Climate1Pre-assessment3
Traffic3Hidden risk or key target4——
Population3Rescue force2——
Earthquake informationEarthquake information11Quick report on seismic intensity5Early warning information8
Basic information of the quake-stricken regionBasic information of the quake-stricken region8Goods and materials in stock1Remote sensing image1
Distance1Hidden geological disaster1Tourist attractions1
Population7School5Cultural relic1
Seismic precautionary intensity2Hospital3Monitoring ability2
Building2Disaster shelter for evacuation1Weather1
Traffic4Reservoir1——
Rescue force1Key target1——
Assessment informationEarthquake disaster (assessment) area3Personnel emergency resettlement (assessment)4Secondary disaster (assessment)2
Worst-hit earthquake disaster (assessment) area distribution1Building damage (assessment)3Goods and material demand (assessment)2
Casualty (assessment)4Lifeline engineering damage (assessment)3Rescue force demand (assessment)2
The injured (assessment)4Key target damage (assessment)2Economic loss (assessment)1
Key rescue area (assessment)2Traffic damage (assessment))3——
Disaster situation informationQuick report on disaster situation9Disaster situation of communication4Allocation and delivery of goods and materials4
Casualty4Disaster situation of traffic8Transfer and resettlement4
Building damage4Disaster situation of geological disasters2——
Electricity damage3Emergency rescue4——
Public sentiment informationFelt tremor1Public attention5——
Emergency responseEmergency response4————
Seismic intensity surveySeismic intensity map5Earthquake disaster and analysis7——

Earthquake emergency meta information.

In accordance with the above, this study compiled the number of meta information products contained in 100 earthquake information product samples and measured the information content of the product samples using the information entropy H calculation method (

Table 2

).

  • 2 Calculation of user demand preference

TABLE 2

Information productPreference PInformation quantity HDecision-making utility value ULuxian M6.0 earthquakeInformation productPreference PInformation quantity HDecision-making utility value ULuxian M6.0 earthquake
Assessed utility value u*Utility value in practice U*Assessed utility value u*Utility value in practice U*
Distribution chart of geology in earthquake region*0.0911.5852.3422.5062.700Distribution chart of highway network in high seismic intensity area0.9113.0007.680——
Regional administrative map *0.0942.0002.9302.5492.600Earthquake emergency handling situation1.0003.8079.020——
Source mechanism diagram0.0271.5851.980——Distribution chart of aftershock0.8512.0005.725——
Source rupture process0.1821.5852.950——Distribution chart of earthquakes in history*0.8532.5855.4426.8385.675
Thematic report on seismogenic structure0.8712.5857.530——Distribution chart of epicenter location*0.8542.0005.6176.3895.800
Basic information Tab. of disaster-affected objects in regional rural area0.4471.5853.680——Dynamic distribution chart of aftershock0.5002.0005.250——
Distribution chart of regional GDP0.1632.0002.650——Distribution chart of buildings near epicenter*0.8552.3226.4256.6486.825
Distribution chart of disaster-affected objects in regional rural area0.2271.5852.800——Distribution chart of building kilometer grid near epicenter*0.8581.5855.5506.0936.450
Regional population density map*0.1891.0003.7202.6732.950Distribution chart of seismic precautionary level in seismic area0.8602.3226.650——
Administrative map of seismic peak acceleration*0.2001.5853.1132.8073.150Chart of initial assessment on seismic precautionary level of regional buildings based on remote sensing images*0.8602.8076.9257.6086.425
Distribution chart of regional building*0.2171.0003.0502.7453.820Analysis of earthquake disaster characteristics0.0902.8071.750——
Regional risk ranking chart0.3491.0003.070——Distribution chart of seismaesthesia*0.8621.5856.4756.1205.350
Regional remote sensing background image0.2001.0003.010——Distribution chart of disaster inquiry*0.8622.0005.8386.4484.525
Distribution chart of anti-lethal level of regional town0.1331.5852.750——Distribution chart of geological disasters0.8803.1707.450——
Disaster information announcement to provincial institutions*0.3283.4593.8253.8093.975Thematic report on earthquake information*0.8653.0007.7257.2617.925
Distribution chart of GDP in seismic area*0.3682.0003.0503.5472.950Thematic report on seismotectonics*0.8712.3227.8006.7707.800
Distribution chart of predicted seismic intensity0.9371.5857.225——Distribution chart of hospitals near the seismic area*0.8712.3226.3256.7705.725
Needs assessment report on refugee resettlement0.9003.1708.100——Distribution chart of schools near seismic area*0.8712.3226.6176.7705.725
Distribution chart of cultural relic institutes near the epicenter*0.4241.5852.2503.6443.050Distribution chart of hazards*0.8712.8076.6257.1576.400
Advice on the aerial photograph area0.4342.5855.030——Distribution chart of key targets in a high seismic intensity area0.9282.3227.920——
Distribution chart of minorities near seismic area*0.4931.5852.3253.9603.950Distribution chart of highway damage0.8403.0007.330——
Catalogue of aftershock*0.5081.5854.6004.0324.065Distribution chart of potential geological disasters in seismic area*0.8643.1706.8587.3875.975
Report on regional seismic loss prediction and key points in emergency handling0.9533.9079.110——Distribution chart of predicted severely damaged region*0.8922.0006.9506.6697.050
Distribution of regional key targets0.5202.0004.980——Distribution chart of instrument intensities*0.9091.5857.0256.4527.010
Distribution chart of tourist attractions near the epicenter*0.5492.0003.3004.4453.900Distribution chart of the predicted key rescue area0.9013.0007.886——
Distribution chart of regional earthquake network*0.6011.5852.8674.5103.175Thematic chart of traffic control*0.9112.3226.7887.0816.875
Thematic report on seismic monitoring ability*0.6252.3226.8505.0636.570Distribution chart of predicted influence field*0.9232.0007.5776.9046.866
Distribution chart of communication status0.6722.0004.490——Thematic report on public opinion in disaster-affected areas*0.9722.8076.4357.7826.550
Distribution chart of dams near seismic area*0.6392.5854.1005.3054.725Chart of landslide risk assessment*0.9281.5856.8136.5906.850
Distribution chart of seismic monitoring ability in a seismic area0.3811.5853.423——Distribution chart of materials reserve in a seismic area0.4382.5854.310——
Thematic map of predicted material requirement*0.6701.5855.4384.8985.875Distribution chart of predicted death toll at district and county level1.0002.3228.460——
Report on auxiliary decision-making*0.6964.0877.9006.6607.675Spatial distribution chart of casualties*0.9402.3227.9307.4397.950
Assessment on lifeline engineering damage0.8502.8076.950——Distribution chart of predicted buried people*0.9442.0007.9427.0667.075
Statistical Tab. of distance between epicenter and major cities0.6792.0005.219——Basic information in seismic area*0.9473.9078.8258.7418.950
Distribution chart of distance between epicenter and major cities*0.7272.0006.6425.5145.800Thematic report on earthquake early warning*0.9503.5858.6258.4908.725
Distribution chart of active faults*0.7282.0005.8585.5215.325Tab. of dynamic disaster situation*0.9502.8078.3257.8148.025
Distribution chart of disasters in history in seismic area*0.7382.3225.7606.5366.700Distribution chart of key targets near epicenter*0.9632.0006.7287.2156.860
Emergency handling strategies for rumors about earthquake0.7303.0006.300——Distribution chart of rescue force in seismic area*0.9671.5856.6756.8806.983
Distribution chart of urban shelter for evacuation*0.7382.0005.8005.5865.870Quick report on information of villages and towns in seismic area*0.9673.3229.0758.4169.075
Assessment on key target damage0.8612.5856.425——Thematic report on comprehensive assessment on disaster situation*0.9675.2099.22510.0859.205
Thematic report on aftershock*0.8822.0006.6716.9336.950Distribution chart of dynamic disaster situation*0.9702.5857.5507.7897.850
Regional basic information*0.7713.7007.0507.0067.300Distribution chart of population in seismic area*0.9732.0007.2677.2947.275
Remote sensing images of epicenter0.8332.0006.153——Distribution chart of population kilometer grid in seismic area*0.9741.5856.0006.9336.950
Judgement on the cause and status of earthquake0.9811.5857.430——Distribution chart of traffic in seismic area*0.9772.8076.8258.0477.340
Distribution chart of building damage0.9742.8077.934——Thematic report on quick report on seismic intensity*0.9912.5859.2007.9689.200
Distribution chart of residences near epicenter*0.8291.5855.2925.8955.975Thematic report on earthquake disaster quick assessment*1.0004.4599.7259.7609.725
Distribution chart of key target damage0.8613.0007.350——Thematic map of predicted rescue force requirement*1.0002.0007.3007.5116.750
Distribution chart of key districts for people evacuation in high seismic intensity area0.8402.3226.700——Brief report on disaster situation*1.0004.0879.2259.429.200
Assessment chart of highway network damage in high seismic intensity area0.9743.3228.720——Distribution chart of casualties*1.0002.3227.9507.8058.325
Assessment on building damage0.9301.5856.872——Thematic report on dynamic disaster information*1.0002.0007.0757.5117.375

Information product list and parameters.

Product with * mark belongs to the category of Luxian M6.0 earthquake information product.

To accurately calculate customer demand preference P, it is necessary to collect user demand preference information and then calculate the corresponding probability based on a Bayesian formula.

Previous studies on the characteristics of earthquake emergency information have been conducted from multiple perspectives, and it is believed that earthquake emergency information products not only possess basic attributes such as nonindependence and sharing of general information but also unique attributes such as content complexity, timeliness, and polymorphic transmission (). Based on the above analysis, in this article, we consider three elements: content, form, and time; we use Bayesian methods to construct a model for calculating user demand preferences.

In the model, the user’s demand for product content is taken as a prior probability, and the formal and temporal probabilities are considered as sample information. The posterior probability of the product is obtained after two rounds of Bayesian inference. The first round of computation is combined with formal probability sample information to produce a posterior probability that then serves as the prior probability for the new round of computation. The second round of computation is combined with the time probability sample information to generate the posterior probability under the product in the earthquake emergency response decision-making scenario.

We collected user preference information through a questionnaire. The valid sample data for this study were provided by 99 member units of the earthquake relief command headquarters in Sichuan and Yunnan provinces. Regarding the 100 information products mentioned earlier, we investigated whether the necessary information and preference for presentation forms such as documents, images, tables, and dynamic images, and preference for obtaining information in the time intervals of 0–2, 2–8, 8–12, and 12–72 h.

Applying the Bayesian formula to obtain the demand probability of products under formal and temporal conditions , constructing a user preference model, the specific calculation process is as follows (Equations 3, 4):

Here, i is the sample space of information products, i = 1, 2, 3, … , 100; k indicates various forms of products, including documents, images, tables, and dynamic images. For the demand time, including the 0–2, 2–8, 8–12, and 12–72 h periods; j is taken as the 0–2 h period in the scenario studied in this article. is the probability of user demand for the product i; is the probability of demand for products i that are unnecessary; is the probability of demand for products presented in form; is the probability of a demand for form k presentation that does not require a product i; is the probability of demand when presenting the product i in form k; is the probability of demand when the product i is not required to be presented in form k; is the probability of demand for products in the required form within a time period, and is the probability of a demand for information within a time period j for product i that does not require a formal form k.

The specific preference values of users for the product in earthquake emergency response decision-making scenarios are shown in

Table 2

.

  • 3 Obtaining the decision utility value U

To obtain the decision utility values of the 100 earthquake emergency information products mentioned above, we adopted the indirect evaluation method (). Twelve experts evaluated the comprehensive decision utility of the information products in the given historical earthquake disaster response decision-making scenarios based on their own experience. The experts gave the products a value of 0–10 points, and the average value was calculated. An expert product utility rating table was then formed after integrating the scenarios of 16 earthquake events in Sichuan and Yunnan. The formula for calculating utility value is as follows (Equation 5):where l is the set of scoring experts, l = 1, 2, 3, … , M = 12; i is an index of the sample space of information products, i = 1, 2, 3, … , N = 100. The decision utility value is the average rating given by expert l to the product i in 16 earthquake events, and the decision utility value is the average rating given by all experts to the product. The specific values are listed in Table 2.

2.3.2 Polynomial model fitting

This study prioritizes parametric simplicity and high interpretability. Similar to the empirical calibration approach employed by for model frictional losses and turbulent dissipation in pipelines, our polynomial model enables scenario-driven utility estimation and optimization without requiring the construction of a fully mechanistic framework.

Polynomial-fitting model was adopted to capture the statistical relationships between decision utility and influencing factors. It is a commonly used method for building models of the relationship between independent and dependent variables. According to the number of independent variables, the fitting process can be divided into univariate and multivariate fitting. This process can be further classified as linear and nonlinear fitting (; ). Here, we construct a univariate polynomial model by analyzing the correlation between product decision utility and user preference, and then add information to conduct a bivariate polynomial model analysis, aiming to obtain a more accurate model that simulates the statistical relationships between decision utility (U), user preference (P), and information (H). Therefore, in this study, the following general formulas for univariate and bivariate polynomials are as follows (Equations 6, 7):where i is the order of the polynomial. When the order of a univariate polynomial is 1, the function is linear.

To quantitatively evaluate the effectiveness of the model, this study used three statistical factors: the correlation coefficient (R2), the root mean square error (RMSE), and bias to evaluate the relationship between actual utility and assessed utility. The formulas are as follows (Equations 8–10):where i = 1, 2, 3,. ., N is the quantity of products; ui is the simulated utility value estimated using the model, and Ui is the decision utility value of the product. The closer R2 is to 1, and the closer the absolute values of RMSE and bias are to 0, the better the evaluation performance of the model.

In the model, the dependent variables are the user’s preference for the product (P) and the information content of the product (H), and the independent variable is the decision utility of the product (U). The model was evaluated using the software MATLAB, and the descriptive statistics of each variable are shown in Table 3.

TABLE 3

Variable nameSample number (N)MeanMinMax
P1000.73440.02701
H1002.341415.2095
U1006.10271.75009.7250

Descriptive statistics of the variables.

The maximum, minimum, and average values of P are 1, 0.7344, and 0.0270, respectively; The maximum, minimum, and average values of H are 5.2095, 2.3414, and 1, respectively; The maximum, minimum, and average values of U are 9.7230, 1.7500, and 6.1027, respectively.

  • 1 The U-P Model

To find the relationship between U and P, we use scatter plot data for polynomial regression fitting and establish a U-P model. The scatter plot (Figure 2a) of product decision utility U and user preference P shows that there was a significant positive correlation between product decision utility and user preference. Therefore, in this study, we attempted to establish a model using a univariate polynomial fitting method, and selected the first-order polynomial (linear) model and the second-order polynomial (nonlinear) model with relatively good performance.

FIGURE 2

Further analysis shows that the residual distribution of the second-order polynomial model was between −2.44 and 1.92, with 45% of the residuals distributed between −0.5 and 0.5 (Figures 2b,c), which can better reflect the relationship between product utility and user preferences. Therefore, the model relationship can be represented by the following equation (Equation 11):

In the formula, c1 and c2 are constant coefficients, and c3 is a constant.

When fitting with a polynomial, the model and statistical factor are as follows (Equation 12):

Meanwhile, when fitting with a second-order polynomial, the model and statistical factors are as follows (Equation 13):

Comparing two models, the second model has a smaller RMSE, it was concluded that expressing the

model using a second-order polynomial was more appropriate.

  • 2 The U-P-H Model

Based on the U-P model, with the addition of information content H, due to the scattered distribution of information content and product decision utility U not being concentrated, the correlation between the two is not as strong (Figure 3a). Therefore, the information content H was taken as the joint action term of user preferences P, forming the following model relationship (Equation 14):

FIGURE 3

In the formula, c1, c2, and c3 are constant coefficients, and c4 is a constant.

When constructing the utility evaluation model with added information, the model and statistical factor are as follows (Equation 15):

The coefficient of determination of the model was 0.8955, the root mean square error RMSE was 0.6492, and the bias was 0.0033, indicating that it exhibited better performance than the U-P model. The evaluation of the U-P-H model indicated that the simulated utility and decision utility of the evaluation were evenly distributed around a straight line with a slope of 1 (

Figures 3b,c

), with residuals ranging from −1.7868 to 1.6434, and more than 60% of the residuals were distributed between −0.5 and 0.5. The evaluation model results showed no significant overestimation or underestimation, indicating that the model was effective.

  • 3 The Applicability of Polynomial Regression

The objective of this study is to support product prioritization by estimating decision utility. Compared to models like logistic regression that require binarization and incorporate scenario-specific thresholds during training, our method preserves the full resolution of utility scores, enhancing adaptability. Due to the limited sample size and low-dimensional feature space, complex models such as Random Forests or Support Vector Machines carry a higher risk of overfitting and tend to obscure the contributions and monotonic relationships of individual factors, thereby reducing interpretability in time-critical decision-making. In contrast, polynomial regression provides an explicit and interpretable mapping. Empirical results show a clear curvature in the U–P–H relationship, with decision utility (U) increasing as information (H) rises, and the effect becoming more sensitive with higher preference (P), reflecting a monotonic trend rather than absolute magnitude.

2.3.3 K-fold cross validation for databases

To verify that the utility prediction model does not suffer from overfitting and possesses robust generalization capability, a 5-fold cross-validation (CV) procedure was employed. Compared with conventional train–test splitting, k-fold cross-validation effectively reduces data selection bias and makes more efficient use of limited datasets. In this study, the entire dataset was randomly partitioned into ten equally sized subsets. In each fold, one subset was used as the validation set while the remaining nine served as the training set. Importantly, the fixed-structure polynomial regression model was directly applied without re-fitting or parameter tuning; the coefficients used were those previously derived from the empirical fitting process. Three key performance metrics—coefficient of determination (R2), root mean square error (RMSE), and bias—were calculated in each fold to evaluate both the fitting accuracy and generalization ability. The results demonstrate consistent performance across folds, confirming that the proposed model maintains stability and avoids overfitting.

The detailed evaluation results are illustrated in Figure 4, which consists of three subplots:

FIGURE 4

Figure 4a presents the R2 values of both training and validation sets across the five folds. It is observed that the model maintains a consistently high degree of explanatory power, with all training folds yielding R2 values between 0.88 and 0.91, and validation folds remaining above 0.88 in most cases. Although slight fluctuations are visible, particularly in fold two and fold four for the validation set, the overall trend suggests that the model does not rely excessively on any specific data subset and performs robustly across different data partitions.

Figure 4b shows the RMSE for each fold, reflecting the prediction error magnitude. The training RMSE ranges mostly from 0.62 to 0.66 while the validation RMSE shows a similar but slightly wider distribution, from approximately 0.42–0.73. Notably, folds one and two demonstrate relatively higher validation RMSE, which might be attributed to local data variability. However, no fold displays extreme deviation, and most errors stay within a reasonable range, suggesting adequate model precision on unseen samples.

Figure 4c analyzes the bias—i.e., the mean signed error—between predicted and actual utility values. The training bias fluctuates narrowly around zero (mostly within ±0.05), while the validation bias exhibits more pronounced deviations in certain folds, such as fold 2 (approx. −0.10) and fold 5 (approx. +0.08). These variations reflect some degree of asymmetry in prediction, yet the overall magnitude remains small, indicating no systematic overestimation or underestimation across folds.

Together, the cross-validation results demonstrate that the model maintains high generalization capability with minimal overfitting. The use of K-fold cross-validation provides an objective and rigorous measure of model robustness. These findings further confirm that the model’s performance is not confined to specific sample partitions.

3 Results: application of the earthquake emergency information decision-making utility evaluation model based on perception of user demand: the 2021 6.0 Luxian earthquake in Sichuan Province

The model for evaluating the decision-making utility of earthquake emergency information products was verified based on the 2021 magnitude 6.0 Luxian earthquake in Sichuan Province. The evaluation model was based on user demand perception, with dynamically optimizing iterations; we used the models to evaluate information products, effectively connecting the supply and demand sides of earthquake emergency information products, and promoting continuous product optimization.

3.1 Information decision products and utility calculations for the magnitude 6.0 2021 Luxian earthquake in Sichuan Province

According to the data from the China Earthquake Networks Center, a magnitude 6.0 earthquake occurred in Luxian County, Luzhou City, Sichuan Province at 04:33:31 on 16 September 2021. After the earthquake, the government received 61 information products (indicated by the * products in Table 2) during the response and decision-making process. We used the model to calculate the corresponding estimated utility values (Table 2). We adopted the same strategy as in the modeling to obtain the actual utility value of information products (Table 2), the process that assigns utility values to the products through expert ratings.

Comparing the actual utility value U* with the estimated utility value u* of the model, the validation parameter indices (the coefficient of determination R2, the root mean square error RMSE, and the bias), and the residuals Res of the model were 0.8597, 0.6893, 0.0553, and −1.9226 to 1.5068, respectively (Figure 5), indicating a relatively small error. The results indicate that the utility value estimated through user preferences and product information has a good match with the true utility value of the product, and the model results are reliable.

FIGURE 5

3.2 Application of the decision utility evaluation model to the magnitude 6.0 2021 Luxian earthquake and evaluation of the information product

To verify the rationality of the utility evaluation process, the threshold values for the estimated utility u* and the actual utility U* of 61 products were selected using the median principle method, being 6.770 and 6.700, respectively. Two sets of effective product lists were obtained, consisting of 32 and 31 items. After comparison, there were 25 overlapping products in both lists (Figure 6), with a coincidence rate of 66%. Among these, the products with higher utility values and higher rankings were mostly comprehensive special reports or thematic maps related to personnel and disaster situations. The results suggest that the evaluation process can quickly screen out effective information products and that the method is feasible.

FIGURE 6

The earthquake emergency information decision-making utility evaluation model based on user demand perception can effectively bridge the gap between the earthquake emergency information product supply side (i.e., developers) and the demand side (i.e., the earthquake relief command center) and effectively screen out information products that meet the demand side. While the current evaluation model relies on expert-rated utility and Bayesian-derived preference scores, future iterations could incorporate data-driven learning algorithms to identify patterns in effective product use during emergency responses. Similar artificial intelligence-based predictive frameworks have proven effective under uncertain conditions (). Thus, the method has strong application and promotion value.

4 Conclusion

Starting from the theory of user demand perception, this study developed an innovative earthquake emergency information development process and decision utility evaluation model based on user demand perception. In particular, The proposed model demonstrates strong applicability under small-sample and low-dimensional feature conditions. It organically links the demand and supply ends, which can effectively evaluate and screen the developed earthquake emergency information products, promote the optimization and iteration of earthquake response information products, enhance the decision-making ability of earthquake relief, and reduce the post-disaster losses caused by earthquakes. The application of earthquake emergency information products in the 6.0 magnitude earthquake in Luxian County shows that the model is effective and has promotional value. Based on the above research results, the following conclusions are drawn.

  • 1. The evaluation model effectively supports earthquake relief decision-making. The present study provides a new risk transfer method and an information decision-making utility evaluation process for dynamically recognizing user needs and calculating utility. The earthquake emergency information product developed from this approach has played an effective decision-making support role in the evaluation of decision-making utility for earthquakes of medium to strong intensity and above. The case of the 6.0 magnitude earthquake in Tonglu County has verified hypothesis one.

  • 2. The earthquake emergency information decision-making utility evaluation model established in the present study has application and promotional value. There was a significant positive correlation between product decision utility and user preference. Evaluation of the relationship between user preference P, information content H, and product utility U showed that the simulated utility and decision utility of the evaluation model were evenly distributed, and the overall goodness of fit of the model was high. The model results verify hypothesis two.

  • 3. The practical application demonstrates that the earthquake emergency information decision-making utility evaluation model is reliable, and knowledge-intensive and human-related products in information products have higher user perception. Taking the 2021 6.0-magnitude earthquake in Luxian County, Sichuan Province as an example, the present study has shown that the utility values estimated by user preferences and product information have a good match with the true utility values of the product, and the evaluation model results are reliable. In addition, knowledge-intensive products and two types of products related to people had higher user demand and decision value, verifying hypotheses two and three.

Although the current model provides good interpretability and practical value, it still has limitations due to its fixed polynomial structure, regional data coverage, and static thresholding strategy. In the future, research in this field will focus on expanding the sample size of earthquake emergency information, building a more comprehensive database, optimizing model structures and parameters, and improving the relevance of product development based on user demand perception. At the same time, more expressive models will be explored to improve applicability across different disaster types, and multimodal data and adaptive strategies (such as graph neural networks and reinforcement learning) will be integrated to enhance the model’s generalization and decision-making flexibility under dynamic constraints.

Statements

Data availability statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.

Author contributions

YZa: Conceptualization, Formal Analysis, Investigation, Methodology, Writing – original draft. YZo: Conceptualization, Resources, Supervision, Writing – review and editing. QZ: Data curation, Writing – original draft. YZe: Investigation, Visualization, Writing – review and editing. ST: Resources, Supervision, Writing – review and editing. JY: Visualization, Writing – review and editing.

Funding

The author(s) declare that financial support was received for the research and/or publication of this article. The authors declare that financial support was received for the research and/or publication of this article. This study was funded by the National Key R&D Program for “Comprehensive assessment on the demonstration of devices for communication and perception” (Grant No. 2020YFC1511705-02).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Generative AI statement

The author(s) declare that no Generative AI was used in the creation of this manuscript.

Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Summary

Keywords

earthquake emergency information, user demand perception, utility evaluation model, decision-making, effective information products, earthquake disaster relief

Citation

Zhang Y, Zhou Y, Zhou Q, Zheng Y, Tang S and Yan J (2025) An evaluation model for the dissemination of earthquake emergency information and decision-making based on user demand. Front. Earth Sci. 13:1664477. doi: 10.3389/feart.2025.1664477

Received

12 July 2025

Accepted

11 August 2025

Published

10 September 2025

Volume

13 - 2025

Edited by

Hans-Balder Havenith, University of Liège, Belgium

Reviewed by

Zarghaam Rizvi, GeoAnalysis Engineering GmbH, Germany

Gang Cheng, North China Institute of Science and Technology, China

Updates

Copyright

*Correspondence: Yan Zhou,

†

ORCID: Yi Zhang, orcid.org/0000-0002-0795-4451

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics