A high rocky slope is an open complex giant system for which there is contradiction among different influencing factors and coexistence of qualitative and quantitative information. This study presents a comprehensive intelligent evaluation method of high rocky slope safety through an integrated analytic hierarchy process, extension matter element model and entropy weight to assess the safety behavior of the high rocky slope. The proposed intelligent evaluation integrates subjective judgments derived from the analytic hierarchy process with the extension matter model and entropy weight into a multiple indexes dynamic safety evaluation approach. A combined subjective and objective comprehensive evaluation process, a more objective study, through avoiding subjective effects on the weights, and a qualitative safety assessment and quantitative safety amount are presented in the proposed method. The detailed computational procedures were also provided to illustrate the integration process of the above methods. Safety analysis of one high rocky slope is conducted to illustrate that this approach can adequately handle the inherent imprecision and contradiction of the human decision-making process and provide the flexibility and robustness needed for the decision maker to better monitor the safety status of a high rocky slope. This study was the first application of the proposed integrated evaluation method in the safety assessment of a high rocky slope. The study also indicated that it can also be applied to other similar problems.
Nowadays, human beings are facing many serious environmental and natural geological disasters, accompanying the massive construction of important projects (Su et al., 2013a). More and more high and steep rocky slopes are forming and are threatening people's lives and property and the safety of whole projects. This slope safety behavior needs to be urgently analyzed. From an engineering point of view, a high rocky slope is a complex open system and the factors affecting its stability are varying and capricious, in that they have strongly chaotic characteristics. The complexity and uncertainty of these factors leads to contradiction among different factors and the coexistence of qualitative and quantitative information, which may seriously affect the safety assessment of slopes. Therefore, it is very difficult, but important, to carry out a safety assessment of high rocky slopes.
From the viewpoint of expert systems, final evaluations of the safety of one high rocky slope vary from person to person according to their different professional backgrounds, viewpoints, conditions of understanding the project, etc. Accordingly, the fact that the safety evaluation of high rocky slopes includes multiple criteria is problematic, as well as both qualitative and quantitative features being present. It is considered to be a multiple criteria decision-making problem. The paper aims to express artificial reasoning in mathematical forms to mimic the human behavior which is present in expert systems. The combination of the analytic hierarchy process, matter element analysis and entropy weight model presents a fundamental approach to mathematically express human beings' inference and interpretation. The prevailing side of the proposed method in solving the multiple criteria decision-making problem is its capability of more objective and intelligent assessment in mathematical form, combining detected influencing factors without the need of human involvement and interference.
Much research mainly focuses on one specific aspect of slopes' safety and lacks the identification of the whole security of high rocky slopes (Malkawi et al., 2000; Prsilva et al., 2008). Although there are many evaluation methods, the amount of research and number of applications are still few and superficial. Traditional methods always tend to cause contradictions among affecting factors and the coincidence of qualitative and quantitative information, resulting in uncertainty.
In recent years, we have seen the development of the finite element analysis, the fuzzy mathematic method and the artificial neural network method. They all conduct the assessment through combining qualitative and quantitative information, and the factors concerned basically do not change (Su et al., 2013b). For rocky slope safety evaluation, some advanced methods, such as geographic information systems and ground-based radar, have been attempted for slope safety evaluation and warning (Dai and Lee, 2002; Bozzano et al., 2010; Casagli et al., 2010). However, existing interpretation methods typically applied one single index (e.g., surface deformation or rainfall) as a predictor and hence revealed only one aspect of slope performance (Ermini et al., 2005). In the paper, a method is introduced though multiple monitoring indexes and influencing parameters.
For the past 1 year of research from 2014 to 2015, analysis methods mainly focused on the Bayesian network, finite element analysis, genetic algorithms, artificial neural networks, digital elevation models, statistics methods, evolutionary approach, etc. (Abdalla et al., 2015; Jamsawang et al., 2015; Fuchs et al., 2014; Bahsan et al., 2014; Peng et al., 2014; Garg and Tai, 2014; Ji et al., 2015). The disadvantages of present rocky slope safety evaluation method include that it is focused on one or certain factor, local safety analysis, single qualitative evaluation, single quantitative calculation, changeable results, more subjective analysis and so on. A holistic assessment of the slope safety state might not be achieved. Besides, a large portion of monitoring data is often not utilized in these methods.
The geological conditions of high rocky slopes are changeable and the outer environment also changes with time. The evaluation methods and theories still have large limitations and defects which need to be further developed (Pantelidis, 2011). Slope safety evaluation using multiple sources of monitoring information is more reasonable, and it is the topic of the present research. For present studies, a complete evaluation analysis, combining subjective and objective factors and presenting a qualitative evaluation conclusion and quantitative evaluation amount, is desired. An integrated approach is proposed, avoiding the aforementioned disadvantages and enhancing present research which lacks high rocky slope safety evaluation.
The objective of this study is to propose a methodology for identifying and delineating high rocky slope safety using an integrated analytic hierarchy process (AHP)–matter element analysis (MEA)–entropy weight method (EWM). Firstly, previously related research is reviewed systematically. Secondly, the multiple criteria decision-making (MCDM) process of high rocky slope safety evaluation is computerized and an MCDM evaluation system of three layers, four criteria and 15 subcriteria is built by the AHP. Thirdly, MEA is used to determine the factor importance sequence to avoid subjective judgment as much as possible, and the sutra field, controlled field and the matrices of the matter element are set up from each layer. The importance ranking of each factor is finally determined based on the single index correlation, comprehensive correlation and grade variable eigenvalue. The initial weight follows with the multiple comparison and judgment principle and matrix. A second correction with the EWM is conducted to reduce the decision maker's subjectivity on the largest level to improve the scientific nature and accuracy of the evaluation indexes. Lastly, an example of one slope is presented to illustrate the proposed methodology.
The problems of MCDM are common occurrences in all kinds of areas, as MCDM refers to decisions being made in the presence of multiple, usually conflicting, criteria (Hwang and Yoon, 1981). Since the safety evaluation of high rocky slopes includes multiple criteria and both qualitative and quantitative features, it is considered to be an MCDM problem. Subjective information and objective information coexist in MCDM. Thus, the subjective and objective approach is promoted to solve MCDM problems. For example, Kersuliene et al. (2010) proposed the new stepwise weight assessment ratio analysis method to allow a more thoughtful application of existing MCDM analytic methodologies. Ginevicius (2011) adopted a new method, namely a factor relationship for MCDM problems. To solve the inherent uncertainty and imprecision of the MCDM, a fuzzy assessment approach was introduced, combining the concept of entropy and interval normalization procedure in a fuzzy AHP (Ozkir and Demirel, 2012). Zolfani et al. (2013) combined stepwise weight assessment ratio analysis and weighted aggregated sum product assessment methods to solve the MCDM problem. The technical analysis results in the theoretical foundations of different MCDM methods and advantages and weaknesses among them were more fully shown by Larichev and Olson (2001), Belton and Stewart (2002), Hashemkhani et al. (2013) and Figueira et al. (2005).
In addition, a fundamental problem of MCDM is the derivation of the weight for a set of activities according to importance. Thus, scaling numbers from 1 to 9 were introduced to the weights of the elements in each level of the hierarchy with respect to an element of the next higher level in MCDM (Saaty, 1977). Weights based on a subjective approach reflect subjective judgements from one person, and objective weights obtained by mathematical methods are based on the analysis of the initial data. Both of them are not perfect and an integrated approach could be most appropriate for determining the weights of the attributes. Therefore, a subjective and objective integrated approach was introduced to determine attribute weights in multiple attribute decision-making problems (Ma et al., 1999). As the quantitative criteria were precisely defined, the developed quantitative multiple criteria decision-making method can be successfully applied (Ustinovichius et al., 2007). In terms of qualitative and quantitative criteria, decision-making techniques were applied, including Technique for Order of Preference by Similarity to Ideal Solution, Simple Additive Weighting and mixed methods, as well as AHP and entropy methods, for defining the importance of weights of the attributes (Karami and Johansson, 2014).
According to advantages of applied techniques, it is expected that the AHP method can provide closer results to real decisions made (Saaty, 2003). Saaty's AHP is a popular MCDM technique and is widely used. Thus, the AHP method is firstly chosen as the basic analysis approach in this paper. The AHP was proposed by Thomas L. Saaty (Saaty, 1972, 1986, 1988, 1994; Shannon, 1948; Vaidya and Kumar, 2006) and reflects the natural behavior of human thinking. Its major innovation is the introduction of pairwise comparisons. The pairwise comparison technique represents a theoretically founded approach to compute weights, representing the relative importance of criteria. Therefore, AHP has been considered as a very useful tool for dealing with complex MCDM problems by the international scientific community.
In civil engineering, especially for the situations with incomplete or ambiguous data due to great inherent uncertainty in construction projects, a risk assessment model using AHP was developed (Abdul-Rahman et al., 2013). Li et al. (2013) analyzed the inconsistent comparison matrix in AHP and proposed a way to improve comparison matrix consistency by using a sorting and ranking methodology. To manage crises in the reconstruction of the damaged areas, the AHP method for weighing the important criteria and a novel complex proportional assessment of alternatives with gray relations for evaluating the alternatives were successfully applied (Bitarafan et al., 2012). Li and Zou (2011) proposed a fuzzy AHP method to deal with the public–private partnerships in infrastructure projects. Eshtehardian et al. (2013) applied the analytical network process and AHP methods to select appropriate construction suppliers and civil engineering companies, and achieved a satisfied result. An AHP-based MCDM approach was presented for pedestrian zone selection in the absence of quantitative data (Sayyadi and Awasthi, 2013). However, the models considered present some difficulties for application and are far from being perfect, therefore requiring further analysis (Triantaphyllou, 2000).
Based on previous reviews and summaries, the AHP is proven to be a well-known decision support tool used for complex MCDM problems by providing a multi-level hierarchical structure. However, it is also indicated that it is difficult for a single mathematical method to complete the final decision-making process because of some drawbacks of the AHP. Thus, this paper adopts an integrated method to evaluate high rocky slope safety.
During the AHP process, the index importance rule is influenced seriously by artificial disturbance and it is difficult to establish a reasonable and precise index importance sequence. The incompatibility problem is very evident. To solve these problems, the matter element analysis (MEA) method based on extension theory is introduced and primarily used to study the problem of incompatibility (Cai, 1983).
Matter element analysis is a new theory to find out the regular patterns of incompatibility problems. It can better reflect the variation characteristics of the objects of analysis and aid in qualitative analysis and quantitative calculation. Extenics theory differs from the fuzziness concept described in fuzzy mathematics and certain concepts from classical mathematics. It concentrates on the changeability of the research objects and further describes the pros and cons from the qualitative level to the quantitative level. It can be used for solving multiple parameters evaluation problem by formalizing the problem and establishing the corresponding matter element.
While solving the MCDM problem, three factors of MEA, namely events, features and values, are used to describe and represent the objects to be assessed, and together form the matter element. It can better reflect the variation characteristics of the objects of the analysis and aid in qualitative analysis and quantitative calculation, which is very suitable for the decision maker to give a more precise safety assessment. Based on the matter element method, Cheng (2001) investigated a practical case study of blasting classification of rock and Tang et al. (2009) evaluated soil nutrients in an ecological fragile region. There are also other detailed applications of the matter element method, such as weather forecasting and evaluating financial security (Feng and Hong, 2014; Li et al., 2014). To expand the application of MEA, Wang et al. (2015) proposed a model that predicted rockburst intensity based on the fuzzy matter element theory.
This paper is based on the matter element concept, combining the evaluation objects, indexes and index values, and the extension nature of the matter element is used to assess the whole safety of the high rocky slope.
However, the safety evaluation weight of the slope founded on the AHP-extension matter model might be subjective, which might affect the objective analysis about its safety. In addition, for the integrated AHP and MEA, a minor factor can have a great influence on the ranking of the alternatives. Hence, the entropy approach is introduced for determining the objective weight (Ustinovichius, 2001). AHP depends on experts to different extents, and therefore contains strong subjectivity. Slight weight differences can dramatically change the order of the alternative preference. Consequently, the appropriate weight for each criterion in MCDM is critical to achieve a precise qualitative evaluation and quantitative safety amount. An objective weight correction method is an important guarantee.
As we all know, entropy is the one of the most important concepts in social science, physics and information theory. The entropy weight method (EWM) is used to determine the weights of influence indexes as a better way of avoiding subjective influence. EWM can be quantified and simulated to represent the objective information contained in an MCDM system and the subjective information possessed by a decision maker. In the literature of information theory, the concept of entropy, was firstly introduced by Shannon (1948). Shannon's entropy served as a useful method for evaluating data structures and patterns. Then, EWM was introduced in determination of criteria weights for MCDM problems (Shemshadi et al, 2011; Ye, 2010; Kildiene et al, 2011). Ge et al. (2013) established a fuzzy optimization model based on EWM to select a typical flood hydrograph in the design flood, and this model was relatively better at designing flood computation compared with the traditional typical flood hydrograph. European country management capabilities within the construction sector in the time of crisis were investigated, applying a proposed method determined via the entropy method (Susinskas et al., 2011). Assessment and selection of appropriate solutions for occupational safety were classified as an MCDM problem, and EWM was used to determine the relative significance of evaluation criteria (Dejus and Antucheviciene, 2013).
A single method effect is weak for the solution of MCDM problem and may be dangerously inaccurate for complex decision problems. An integrated approach brings a comprehensive and objective result based on previous reviews. Thus, the integrated approach is an effective evaluation method. AHP and EWM are often used to implement the safety evaluation of hydraulic or civil engineering (Kok et al., 2009; Rahman et al., 2013). Tavana and Hatami-Marbini (2011) developed an MCDM framework based on AHP and EWM for the human spaceflight mission planning. For the selection of the best material for the tool holder used in hard milling, Caliskan et al. (2013) applied the AHP and EWM to confirm criteria weighting so that a new decision model was developed. For the pursuing the goal of selecting the best transportation investment project portfolio, a fuzzy assessment approach was presented by utilizing the concept of entropy and fuzzy AHP (Ozkir and Demirel, 2012).
This paper adopts an AHP–MEA–EWM integrated method to assess the safety of high rocky slopes. It sets up the comprehensive multi-layer and multi-objective safety evaluation model for high rocky slopes from the aspects of geological condition, engineering condition, external environment and internal and external monitoring behavior. AHP is firstly used to construct a multi-layer and multi-index MCDM framework. Then, the importance ranking of all influential factors of high rocky slopes is determined based on the single index correlative degree, comprehensive correlative degree and grade variable eigenvalue of the matter element matrix. The initial weight is obtained based on the above analyses, and a second correction with the entropy weight method is made. Finally, the quantitative safety amount and qualitative safety level are determined by overlapping application of integrated methods and recursive calculation from the criteria level to the goal level.
A single index of a complex high rocky slope is not enough for the evaluation of its safety. Additionally, the stability of the high rocky slope is obviously influenced by its inner characteristics and outer environment. Therefore, it is necessary to set up a multi-level and multi-index evaluation structure. Each level plays a dominant role, with its adjacent subsequent level covering multiple indices, and each forming a layer-by-layer dominant relationship from top to bottom. Following the method above, the hierarchy of an open-cut construction of a high rocky slope has been established as shown in Fig. 1. There are lots of factors related to the rocky slope safety. Some of these factors are still unknown and a few factors are neglected for their ignorable influences to the rocky slope safety. Therefore, the dotted arrows are added to denote the unknown and ignorable factors for a more complete rocky slope safety evaluation process in Fig. 1. The highest level (level 1) of the hierarchy represents the overall goal of evaluating the high rocky slope safety. The second level (level 2) consists of all factors on the high rocky slope safety, such as geological conditions, engineering conditions, outer environment and inner and outer monitoring. The general criteria constitute the lowest level (level 3).
Safety evaluation hierarchy of high rocky slopes.
Value rank of evaluation index under different grades.
According to the specification and national standard of the water conservancy and hydropower slope engineering about the rocky slope safety classification and existing research results on the ranking standard, the differences of different areas and different projects are comprehensively considered (Wu and Chen, 2009; Zhao et al., 2011). Combined with numbers of engineering cases, the safety grade of high rocky slope can be divided into five levels shown in Table 1; I means very stable, II means stable, III means basically stable, IV means unstable and V means extremely unstable.
In order to eliminate the shortcomings of incommensurability brought by the
dimension and dimensional unit for evaluation index values under different
factors, the dimensionless method is used to process the evaluation indexes
on different grade levels. For indexes such as the cohesion force, the larger the value, the better
the tendency.
Comprehensive stability evaluation in terms of high rocky slopes is based on
the extensibility of the matter element for stability evaluation. Its core is to
determine the extension domain, and the matter element transformation of
factors is the implementation means in the extension domain. For extenics,
the matter element is the logic cell. The stability of high rocky slope is
called event
Extension evaluation will be established including every level based on the matter element extensibility. Sutra field, controlled field and the matrices of matter element for appraising will be set up from each layer. The importance ranking of each factor is finally determined in the corresponding level basing on the single index correlation, the comprehensive correlation and the grade variable eigenvalue. Through this, it can avoid subjective judgments as far as possible and provide an important basis for the improved AHP.
For the evaluation level of the matter element, evaluation event
Furthermore, the matrices of matter element for appraising can be expressed as
Based on the extenics theory, the calculation results of simple correlation
function of evaluation indexes play an important role in determining the
weight coefficient. The expression is
The evaluation index maximum correlation function value
In the maximum grade matrix
Then, the second largest grade is considered, building the second largest grade matrix and determining the sequence importance of every factor based on the similar process above. At last, the importance sequence of different factors in every indicator layer can finally be determined.
According to the scale of multiple comparison and judgment principle, A. L. Satty applied fuzzy mathematics theory to establish multiple comparison scale system (Table 2) (Xu, 2013; Chowdary et al., 2013). Considering the factor importance sequence identification in the index level, a comparative judgment matrix of the adjacent upper level is finally established. The judgment matrix is solved by a square root method, and the consistency check is carried out. Then, the factor weight vector of the index level is determined. The index weight is the maximized objective correction based on a comprehensive weight-determining method of the combination of subjective and objective factors of multi-factor entropy weight model. Ultimately the weighted value is determined.
According to the understanding and preliminary analysis of high rocky slopes, the elements involved in the slope evaluation system are arranged hierarchically by nature, including namely the establishment of the overall goal level, criteria level and subcriteria level.
Standard table of multiple comparison.
The judgment matrix is the basic information of the AHP. It is also the basis
of calculations of the relative importance and level of single sequencing. The method
takes a factor of upper level as the criterion and builds a multiple
comparison judgment matrix based on the above conclusions about the factor
importance sequence and the standard table of multiple comparison in Table 2.
The results are listed in Table 3. Every factor of the judging matrix satisfies the following
relations:
The product
Estimate the maximum characteristic value of judgment matrix as follows:
Judgment matrix of evaluation system for high slope safety.
Different order values of RI.
Evaluation flowchart of high rocky slope safety.
Through the above process, the judgment matrix meets the requirements of the
consistency check. The vector,
The following formula is adopted to determine the entropy value
The difference coefficient
The information weight value
With the help of single factor correlation function value
With extension relativity, the safety state of the high rocky slope can
eventually be obtained, namely as follows:
Integrating the aforementioned principles and methods, the calculation procedure for the evaluation of high rocky slope has been compiled in this section. This procedure is designed with the consideration of achieving the real-time dynamic evaluation and internal and external monitoring timeliness. The AHP–MEA–EWM is adopted during the calculation. One high rocky slope in China is used as a typical research project analyzed under the multi-factor evaluation system, as shown in Table 5.
Safety evaluation index value of high rocky slopes.
The height of the unique high rocky slope is more than 700 m and the width is
50–290 m for an area of 115 000 m
On the basis of the ideas explained above, the matter element extension matrix of the index level should be first constructed to determine the element importance ranking. Then simple correlation function values and elementary dependent function values can be calculated through establishing its sutra field, controlled field and the matrices of matter element for appraising. In order to identify the index importance ranking, the improved AHP is used to construct the judgment matrix and the initial weight vector is calculated after a consistency inspection. Finally, the EWM based on multi-objective decision-making is a means of secondary revision of the initial weight vector to build the extension relativity. The final safety state is determined for the high rocky slope, and the dimensionless parameters in this project are shown in Table 5.
Index level results of correlation function under geological conditions criteria for grade I.
The results of elementary dependent function for every grade.
This article takes the index evaluation system under geological conditions
(B1) criteria in Fig. 1 as an example of carrying out detailed analysis. Other
indexes can also be analyzed through a similar analysis process. For the stability
classification, the sutra field (
The result of importance ranking of different factors according to the above
methods is
Standard table of multiple comparison of
Evaluation results of criteria level (Level 2).
The results for other index layers are obtained similarly, including the weight vector, final weight result after
amendment, eigenvalue, extension relativity and the eigenvalue of the
classification grade, which are as follows.
The analysis program of evaluation system is built on the theory of the integrated AHP–MEA–EWM. For the evaluation system of the overall goal level (Level 1), the analysis steps and ideas are consistent with the criteria level (Level 2) and the classification eigenvalue of the criteria level (Level 2) constructed above is 0, 1; 1, 2; 2, 3; 3, 4; 4, 5. Based on the ideas calculated in this article, the results of the single-index relation degree, integrated incidence degree and grade variable eigenvalue for safety evaluation of high rocky slope are shown in Table 9.
Based on the above methods, the importance order is B3, B4, B2, B1. The initial value of the weight is 0.10, 0.16, 0.47, 0.28, the value of the weight after amendment is 0.11, 0.18, 0.44, 0.27 and the classification eigenvalue is 3.75. The safety state of grade slope is IV, which is fully consistent with the present situation of the high rocky slope under an unstable state with larger and more unstable deformation. It is worth noting that the results of multivariate analysis demonstrate a warning of its precarious state. Based on the results of its internal and external monitoring, this safety evaluation system has provided an important theoretical basis for making rational decisions using a procedural algorithm to assess the security status of the slope in a timely and dynamic manner.
An integrated analytic hierarchy process–matter element analysis–entropy weight method for solving the multiple criteria decision-making problem has been proposed and applied in the comprehensive safety assessment of high rocky slope. The proposed method integrates the analytic hierarchy process method, matter element theory, and the entropy weight method within a safety assessment framework. The specific multivariate computational procedures were provided to illustrate the integration process of the above methods. Its evaluation process involves factor input, self-evaluation, dynamic assessment and real-time grade standards' output, etc. The comprehensive assessment results demonstrate that the level eigenvalue of the high rocky slope is 3.75, and its security status IV is fully consistent with the actual situation. Decision makers can conduct flexible and variable response programs for the high rocky slope. This study is the first application of the proposed method in the safety assessment of high rocky slopes.
Compared with the traditional method of solving the MCDM problem, the proposed method not only can assess multi-criteria decision problems in a more objective manner through avoiding subjective effects on the weights, but also, it can simultaneously produce the qualitative evaluation conclusion and quantitative evaluation amount. The effects of subjective errors on safety assessment of the high rocky slope could be avoided to a large extent. The intelligent preliminary evaluation analysis system provides an important theoretical support for making scientific judgments in a timely way based on the feedback of safety state of high rocky slopes. Thus, decision makers can obtain a more objective and flexible evaluation for the high rocky slope. Meanwhile, finding the best method to solve the MCDM problem is an elusive goal that may never be reached. Limitations also exist in this research. For example, this method could not solve the safety state for fuzzy and uncertain factors. The imprecision of the human decision-making process might exist and all the analyses should be conducted before the evaluation of qualitative factors can be consistent as this method is still based on the AHP theory.
The proposed MCDM approach integrates subjective judgments derived from the AHP with MEA and EWM into an intelligent, preferable and subjective and objective and multiple criteria approach. The structured approach presented in this study has some obvious attractive features. (1) It is comprehensive and flexible; the approach combines a comprehensive method covering the AHP, MEA and EWM technique concerning multiple factors, multiple criteria and multiple layers. The number of the all kinds of factors is not limited and this method is flexible for extension. (2) It is structured and analytical; the miscellaneous factors are stratified into a hierarchy to simplify information input and provide a clear framework for the decision maker for such complex problems. The proposed method helps the decision maker decompose a complex problem into manageable steps. (3) It is qualitative and quantitative; the comprehensive approach presents a qualitative evaluation analysis and a quantitative evaluation amount, which can be established for the decision maker to obtain a more precise decision. (4)It is subjective and objective; the subjective evaluation of a finite number of decision alternatives is allowed as the generic nature of the proposed approach of this paper allows a finite number of influencing factors. The objective influencing factors' importance of multiple layers can be obtained by MEA and an objective weight can be achieved by integrating the AHP and EWM. (5) It is computational and intelligent; the proposed method is a mathematical and computational model which can be widely applicable to the MCDM problem.
For future research, it can be conducted in the following directions. (1) The proposed method could be developed in the future based on fuzzy theory for imprecise, ambiguous or unknown data. (2) A more objective evaluation guideline could be introduced to amend the subjective judgment of the AHP. (3) The proposed method could be applied to other MCDM problems, especially for the safety evaluation of other fields. (4) The matter element theory could be more widely applied in solving MCDM problems by integrating other methods.
This research has been partially supported by the National Natural Science Foundation of China (SN: 51579083, 41323001, 51139001, 51479054), the Jiangsu Natural Science Foundation (SN: BK2012036), the Doctoral Program of Higher Education of China (SN: 20130094110010), the Open Foundation of State Key Laboratory of Hydrology-Water Resources and Hydraulic Engineering (SN: 20145027612), the Fundamental Research Funds for the Central Universities (SN: 2015B25414) and a project funded by the Priority Academic Program Development of Jiangsu Higher Education Institutions (SN: 3014-SYS1401). Edited by: O. Katz Reviewed by: three anonymous referees