|
1.INTRODUCTIONGovernment performance evaluation is an indispensable measure for the government’s own construction. It is not only conducive to understanding the performance of policy implementation, but also able to timely obtain public opinions, so as to improve the level of government governance. It is the internal driving force of administrative system reform1. It is also the internal requirement and guarantee of building the government by law2. The key point of the value chain of government performance evaluation lies in the evaluation of the people’s satisfaction3. Satisfaction is a person’s feeling state, is people’s feeling after comparing the expected value with the actual gain. People’s satisfaction with government can be simplified as Public Satisfaction Index (PSI) of government service level. PSI refers to a psychological experience that the public measures and compares the satisfaction degree of its goals, expectations and needs when experiencing public administration, also known as Public Satisfaction Index. Although the government strategy cannot be fully projected on the experience of the masses, it can reflect the effect of government governance on the whole. The core of the evaluation lies in the construction of the indicator system. Xu et al. believe that the indicator system should be composed of two major modules: decision-making performance and executive management performance4. However, administrative performance and management performance are limited to the long and inconsistent transmission cycle of policy implementation effects, which are often different from the actual performance. In this paper, the main contributions are as follows: we build a complete evaluation index system covering different groups based on multiple rounds of Delphi method, and calculate the weight based on entropy method on the basis of excluding expert scoring and AHP. On this basis, we evaluate the satisfaction of different regions and groups in the investigated cities, and finally give the satisfaction structure analysis. 2.RELATED WORKThis paper argues that the construction of evaluation index system should include both decision-making performance and effect refraction performance. In terms of data collection, online public opinion analysis can partially reflect public satisfaction5, which is related to the research group. After all, the online public is still not representative in a statistical sense. A large number of domestic literatures and practical experience are available for reference in the study of satisfaction index6. In terms of specific evaluation models, rough set theory7 and fuzzy comprehensive evaluation8 have been widely applied. Some researchers also evaluate satisfaction based on data statistics and comparative analysis, and have achieved good practical results in some fields9: On the whole, due to the multi-dimensional compound characteristics of government evaluation, there are both subjectivity and objectivity, both subjectivity and the consideration of audience response, so there are certain requirements for evaluation methods. Some scholars believe that entropy method has unique advantages due to its objectivity of index weight10. Other scholars believe that the grey correlation method can more accurately analyze the structural satisfaction11-12, In this paper, on the basis of the above research, entropy value method and grey correlation method are combined to conduct a comprehensive analysis of the satisfaction of a city’s portfolio policy. The rest of this paper is organized as follows: The third part introduces evaluation model, the fourth part introduces the empirical analysis and our Satisfaction evaluation scheme, the fifth part introduces data analysis, and the last part introduces the conclusion and future work. 3.EVALUATION MODEL3.1Entropy methodThe key to evaluate system design is to the establishment of evaluation index weight, the widely-used weight establishment method is the expert scoring method and the analytic hierarchy process; However, due to too many indicators involved in this paper, there are nearly 60 third-level indicators, which makes it extremely difficult for experts to score, and the hierarchical analysis is also difficult to carry out. In information theory, information entropy is a measure of the disorder degree of a system. The greater the variation of the index value of an index is, the smaller the entropy of information will be, the more information the index provides, and the greater the weight of the index should be. On the contrary, the less the variation of the index value of an index is, the greater the information entropy will be, the less the information provided by the index is, and the smaller the weight of the index will be. Therefore, the method of index weight in this paper is based on the variation degree of variable value. 3.2Grey correlation modelA measure of the degree of association between two systems that varies from time to time or from object to object is called the degree of association. In the process of system development, if the trend of the two factors is consistent, that is, the degree of synchronous change is high, that is, the degree of correlation between the two is high; On the contrary, it’s lower. Therefore, the grey correlation analysis method is a method to measure the correlation degree of factors according to the degree of similarity or dissimilarity of the development trend between factors, namely “grey correlation degree”. The solving steps are as follows:
4.THE EMPIRICAL ANALYSIS: INDEX SYSTEM AND DATA PRE-PROCESSINGGovernance according to law, the government efficiency, government credit and government action are standards of government behaviours. Our assessment system forms four first-level indicators including specification, integrity, efficiency and deed, covers 18 secondary indexes, including the rule of law, administrative transparency, accountability, public supervision, free from corruption, credibility of government commitment system, civil servants credit, ethical government environment, government cost, government efficiency, business environment, investment in basic public services, consumer confidence and basic education strength, culture, body and health, public services, public transportation ability, social security, public safety, environmental protection and management, covering 65 third-level indicators. A city with developed economy is selected as the evaluation object. There are five districts in A city with developed private economy. The economic volume and structure of each district are quite different, with a large number of external population. In view of these characteristics of city A, we adopt the field sampling method in data acquisition. Due to the GDP and population size of each district is roughly balanced, targeted at urban residents within the municipal units and five districts, rural residents, enterprise staff, civil servants, migrant workers, etc. To five groups mentioned above, we distribute nearly 20,000 copies of the questionnaire, among which more than 15,000 copies is recycled, including nearly 15,000 valid questionnaires. In the questionnaire, there are five choices, respectively very satisfied (5 points), relatively satisfied (4points), basically satisfied (3 points), not very satisfied (2 points) and not satisfied (1 point). Through the analysis of the questionnaire, the analysis results of the public’s satisfaction with the government work of all levels and departments in A city were obtained. 5.DATA ANALYSIS5.1Satisfaction based on entropy methodUrban residents were selected to analyze the impact of demographic factors such as gender, age, education level, annual income, occupation and local residence time on government satisfaction. In order to better measure the influence rule of each attribute factor on satisfaction, this paper selects the option percentage of each factor as its variable value, so as to quantify each attribute factor. We calculate the proportion of the number of people surveyed in each district among different groups, and take this as the weight to calculate the proportion of satisfaction scores of various indicators of different groups (urban, rural, enterprises, civil servants and migrant workers). The solution results are as follows: Taking the data in Tables 1-5 and 6 as the original data of entropy legal right, the entropy value ej and difference coefficient gj of each evaluation index of different groups (Cities and towns, country, enterprise, civil servants and migrant workers) were calculated by using Matlab statistical software, and then the weights of each evaluation index of different groups were determined. The solution results were as follows: Table 1.The proportion of satisfaction score of each index of urban workers.
Table 2.The proportion of satisfaction score of each index of rural personnel.
Table 3.The proportion of satisfaction score of civil servants.
Table 4.The proportion of satisfaction scores of various indexes of migrant workers.
Table 5.The proportion of satisfaction score of enterprise personnel.
Table 6.Weight of each evaluation index of different groups.
The weight aj in Table 6 and proportion of satisfaction score of each index from Tables 1-5 multiplied by the score of each satisfaction option according to entropy method to get the satisfaction score pij and put it into the above formula, the overall satisfaction evaluation of different groups vi was obtained, the score of each satisfaction option (A, B, C, D, E, F) is to be assigned according to the Likert scale: 5 points, 4 points, 3 points, 2 points, 1 point, 0 point. The final solution results are shown in the following Table 7: Table 7.Overall satisfaction evaluation table of each group.
As can be seen from the above table, the overall satisfaction scores of city and town, country, enterprise, civil servants and migrant workers are all between 3 points (general) and 4 points (relatively satisfactory), indicating that all groups have a fair evaluation to the government. From the perspective of the industry, the civil servants have the highest overall satisfaction score of 3.8608, followed by enterprises with 3.7421, and the migrant workers have the lowest score. In order to get the comprehensive evaluation model, we need to give certain weight to different groups, and finally establish the public satisfaction evaluation model of the city. Therefore, based on the different influences and contributions of different groups to the satisfaction of the government, the entropy method is used in this paper again to calculate the weight of different groups, and the results are as follows: That is to say, citizens’ satisfaction score of the city is 3.65, close to 4 (relatively satisfied), indicating that residents of the city have a good evaluation of the government’s implementation of the new policy. The same method was used to calculate the weight of satisfaction of different groups in the five regions. Then, the weight was multiplied by the satisfaction score of each dimension to get the satisfaction score of different groups in the five regions. The solution results are as follows in Table 8: Table 8.The weight of satisfaction scores of each group.
The public satisfaction of the city can be obtained from the above table: As can be seen from the above Table 9, civil servants in the five districts generally have a higher satisfaction score, while on the contrary, the satisfaction of migrant workers to the new policy implemented by the government is generally low. Table 9.Satisfaction scores of different groups in five regions.
Taking the overall evaluation of different groups as the index, the percentage of options as the index value, and the sorted data as the original data of entropy legal weight, calculate the weights of each group under different zones by using Matlab statistical software. The solution results are as follows: As can be seen from the satisfaction degree and ranking of the five districts in the above Table 10, the satisfaction degree of the five districts is between 3 points (average) and 4 points (relatively satisfactory), indicating that each district is relatively satisfied with the implementation of the new policy by the government. The satisfaction in area D is the highest, while the satisfaction in area A is the lowest. Table 10.Satisfaction in five regions.
5.2Satisfaction structure analysis based on grey correlation methodIn order to better measure the influence law of each attribute factor on satisfaction, this paper selects the percentage of options of each factor as its variable value, so as to quantify each attribute factor. Based on the weight data of each evaluation index of the town group obtained by the entropy method in part 3.2, aiming at weight of each evaluation index of different districts (A, B, C, D, and E districts) for the town group, calculate the public satisfaction degree of the town group in A, B, C, D, and E districts. The public satisfaction of urban areas obtained in Table 11 is taken as a reference number. According to the calculation steps of grey correlation, MATLAB is used to calculate the correlation degree. Since the correlation degree of each factor calculated is not significant, the correlation degree of each factor’s second-level indicator minuses its mean value to get the correlation degree of each second-level indicator after transformation. After analysis and comparison, relevant factors with correlation degree of public satisfaction greater than 0.05 are selected as the main influencing factors, and the results are as follows. Table 11.Correlation degree between satisfaction degree of each district and related factors.
As can be seen from Table 11, the main factors affecting the satisfaction of urban public include age, education level, occupation, income and local residence time. Interviewees are mainly the institution staff, ageing between 26 and 40, educated in junior college and undergraduate, whose annual income is mainly between 30,000 and 50,000 yuan, and whose local residence time is mainly more than 10 years. Generally speaking, people of lower age, higher education background and resume, with middle income have lower demand for government services and are easier to meet, so people at this stage will have relatively higher satisfaction with the government. People who have lived in the local area for a long time will have a relatively high evaluation of the local government due to certain emotional factors. 6.CONCLUSION AND FUTURE WORKThe theoretical basis of the government performance evaluation system based on entropy method is relatively solid, easy to implement and promote. Compared with the traditional evaluation method, the entropy method can objectively reflect the utility value of the entropy value of indicator information, so as to determine the weight. This idea is very similar to the evaluation mechanism of satisfaction degree, so the entropy method is selected. Gray correlation analysis can determine the scores of multiple subjects and each subject in the corresponding indicators, which is very consistent with the research subject of this paper, and the empirical analysis shows that the obtained results have been widely recognized. The next step is to further improve the evaluation index system and optimize the weight design according to the feedback of this round of evaluation results, and try to introduce the multi perspective data fusion algorithm to evaluate the satisfaction. ACKNOWLEDGMENTSSupported by the Research projects of Guangdong Education Science in 2020 in the 13th five year plan (Grant No. 2020JKDY040), Teaching quality and teaching reform project of Guangdong Province in 2020 (Grant No. 414). REFERENCESZheng, F., Yu, F. and Qín, S.,
“Overall government performance evaluation: Hypothesis, theoretical demonstration and empirical study on Guangdong Province 2008,”
Information Science, 8
(3), 13
–25
(2011). Google Scholar
Zheng, F. and Lu, Y.,
“Construction and the performance evaluation system of a nomocracy government,”
Chinese Public Administration, 2014
(6), 26
–31
(2014). Google Scholar
Bao, G. and Zhou, Y.,
“Study on value carrier model construction of government performance evaluation,”
Journal of Public Management, 10
(2), 101
–110
(2013). Google Scholar
Xu, L., Li, J. and Zhang, Y.,
“On the government eco-budget performance evaluation—Based on the practical investigation,”
Accounting Research, 2012
(12), 74
–81
(2012). Google Scholar
Zou, K., Zou, S. and Chen, Y.,
“Government information services public satisfaction evaluation study based on network public opinion,”
Information Science, 32
(2), 45
–49
(2016). Google Scholar
Zhou, Y., Zhang, D. and Xiong, N.,
“Post-cloud computing paradigms: A survey and comparison,”
Tsinghua Science and Technology, 22
(6), 714
–732
(2017). https://doi.org/10.23919/TST.2017.8195353 Google Scholar
Zhu, H. and Chen, N.,
“Evaluation model of citizen’s satisfaction degree of government information disclosure based on distance measure assisted rough set,”
Journal of Intelligence, 29
(8), 94
–97
(2010). Google Scholar
Peng, G.,
“Fuzzy comprehensive model and empirical research on local government public administration performance,”
Quantitative & Technical Economics, 2015
(11), 129
–136
(2015). Google Scholar
Mo, Z.,
“An empirical research on the quality evaluation of municipal government public information,”
Information Science, 36
(8), 114
–119
(2018). Google Scholar
Zhang, Z.,
“Practice and reflection on the determination of collective forest land rights in Guangdong—Based on the satisfaction evaluation of farmers,”
Journal of Jiangsu Agricultural Science, 46
(4), 272
–276
(2018). Google Scholar
Meng, X., Lin, C. and Wang, G.,
“Study on the satisfaction degree of B&B tourism service quality in Weizhou island based on analysis of grey correlation,”
Journal of Guilin University of Aerospace Technology, 2019
(1), 89
–94
(2019). Google Scholar
Zhou, Y. and Zheng, J.,
“Efficiency evaluation of warship VHF/UHF communication based on Gray relation analysis,”
Ship Electronic Engineering, 38
(1), 108
–111
(2018). Google Scholar
|