MCDM Approach to Evaluation of Goodness of Fit of Statistical Models

Document Type : Original Article

Authors

1 Faculty of Mathematical Sciences and Computer, Shahid Chamran University of Ahvaz, Ahvaz, Iran

2 Ahvaz

Abstract

Today, various models with different estimation methods are introduced and used in data modeling. The appropriateness of each method of estimating statistical models in the fit of a dataset is based on a specific goodness-of-fit criterion (or a specific objective function). Also, the goodness-of-fit index of any statistical model (including classical or fuzzy regression models) is defined and formulated according to the structure of that model. Therefore, using and applying only one criterion to compare the goodness-of-fit of a diverse set of statistical models leads to oblique/biased and directional decisions. In fact, such a process leads to prioritization of the models that their objective functions are the same as the evaluation criterion and/or their objective functions are structurally proportional to the evaluation criteria. Therefore, considering only one-criterion to evaluate the goodness-of-fit of the models deprives them of the possibility of a fair and equitable comparison, which is very challenging. Our main goal in this paper is to provide and propose an appropriate framework in the context of multi-criteria decision making to overcome the challenge. In this method, it is possible to aggregate a wide range of evaluation criteria from different point of views to generate a generalized evaluation criterion in order to identify the optimal model.
Finally, the proposed approach is employed to rank the fit of 22 different fuzzy regression models.

Keywords

References

[1]  کاظمی‌فرد، ا. یک تعمیم از مدل تصمیم‌گیری چندشاخصه‌ی TOPSIS مبتنی بر یکنواخت‌سازی مطلوبیت شاخص‌ها، مجله مدلسازی پیشرفته ریاضی، دوره 10،  شماره  1، ص ص 196-214.
 
[2] کاظمی‌فرد، ا. و صادقیان، ر. تصمیم‌گیری‌های چند معیاره، انتشارات دانش‌پرور، 1397.
 
[3] Asadolahi, M., Akbari, M.G., Hesamian, G. and Arefi, M. (2021). A Robust Support Vector Regression with Exact Predictors and Fuzzy Responses, International Journal of Approximate Reasoning, 132, 206–225.
 
[4] Arefi, M. (2020). Quantile Fuzzy Regression Based on Fuzzy Outputs and Fuzzy Parameters, Soft Computing, 24, 311–320.
 
[5] Beliakov, G., Pradera, A. and Calvo, T. (2007). Aggregation Functions: A Guide for Practitioners, Springer, Berlin Heidelberg.
 
[6] Chachi, J. (2019). A Weighted Least Squares Fuzzy Regression for Crisp Input Fuzzy Output Data, IEEE Transactions on Fuzzy Systems, 27(4), 739–748.
 
[7] Chachi, J. and Chaji, A. (2021). An OWA-Based Approach to Quantile Fuzzy Regression. Computers and Industrial Engineering, 159, 107498.
 
[8] Chachi, J., Kazemifard, A. and Jalalvand M. (2021). A Multi-Attribute Assessment of Fuzzy Regression Models, Iranian Journal of Fuzzy Systems, 18, 131–148.
 
[9] Chachi, J. and Roozbeh, M. (2017). A Fuzzy Robust Regression Approach Applied to Bedload Transport Data, Communications in Statistics-Simulation and Computation, 47, 1703–1714.
 
[10] Chachi, J. and Taheri, S.M. (2021). Outliers Detection in Fuzzy Regression Models, In: Shahbazova SN, Kacprzyk J, Balas VE, Kreinovich V (eds) Recent Developments and the New Direction in Soft-Computing Foundations and Applications, Studies in Fuzziness and Soft Computing, Springer, vol 393, pp 299–308.
 
[11] Chachi, J., Taheri, S.M. and D’Urso, P. (2022). Fuzzy Regression Analysis Based on M-estimates, Expert Systems with Applications, 187, 115891.
 
[12] Chang, P.T. and Lee, S. (1994). Fuzzy Linear Regression with Spreads Unrestricted in Sign, Computers and Mathematics with Applications, 28, 61–70.
 
[13] Choi, S.H. and Buckley, J.J. (2008). Fuzzy Regression Using Least Absolute Deviation Estimators, Soft Computing, 12, 257–263.
 
[14] Chukhrova, N. and Johannssen, A. (2019). Fuzzy Regression Analysis: Systematic Review and Bibliography, Applied Soft Computing, 84, 105708.
 
[15] D’Urso, P. and Massari, R. (2013). Weighted Least Squares and Least Median Squares Estimation for the Fuzzy Linear Regression Analysis, Metron, 71, 279–306.
 
[16] D’Urso, P., Massari, R. and Santoro, A. (2011). Robust Fuzzy Regression Analysis, Information Sciences, 181, 4154–4174.
 
[17] Ferraro, M., Coppi, R., Rodriguez, G.G. and Colubi, A. (2010). A Linear Regression Model for Imprecise Response, International Journal of Approximate Reasoning, 51, 759–770.
 
[18] Hesamian, G. and Akbari, M.G. (2020). A Robust Varying Coefficient Approach to Fuzzy Multiple Regression Model, Journal of Computational and Applied Mathematics, 371, 112704.
 
[19] Hesamian, G. and Akbari, M.G. (2021). A Robust Multiple Regression Model Based on Fuzzy Random Variables, Journal of Computational and Applied Mathematics, 388, 113270.
 
[20] Hesamian, G. and Akbari, M.G. (2021). A Fuzzy Additive Regression Model with Exact Predictors and Fuzzy Responses, Applied Soft Computing, 95, 106507.
 
[21] Hesamian, G., Akbari, M.G. and Shams, M. (2021). Parameter Estimation in Fuzzy Partial Univariate Linear Regression Model with Non-Fuzzy Inputs and Triangular Fuzzy Outputs Iranian Journal of Fuzzy Systems, 18, 51–64.
 
[22] Hojati, M., Bector, C.R. and Smimou, K. (2005). A Simple Method for Computation of Fuzzy Linear Regression, European Journal of Operational Research, 166, 172–184.
 
[23] Hwang, C. and Yoon, K. (1981). Multiple Attribute Decision Making: Methods and Applications, Springer-Verlag, NY.
 
[24] Kazemifard, A. and Chachi, J. (2021). MADM Approach to Analyse the Performance of fuzzy regression models. Journal of Ambient Intelligence and Humanized Computing, https://doi.org/10.1007/s12652-021-03394-4.
 
[25] Khammar, A.H., Arefi, M. and Akbari, M.G. (2020). A Robust Least-Squares Fuzzy Regression Model Based on Kernel Function, Iranian Journal of Fuzzy Systems, 17, 105–119.
 
[26] Khammar, A.H., Arefi, M. and Akbari, M.G. (2021). A General Approach to Fuzzy Regression Models Based on Different Loss Functions, Soft Computing, 25, 835–849.
 
[27] Lu, J. and Wang, R. (2009). An Enhanced Fuzzy Linear Regression Model with More Flexible Spreads, Fuzzy Sets and Systems, 160, 2505–2523.
 
[28] Modarres, M., Nasrabadi, E. and Nasrabadi, M.M. (2004). Fuzzy Linear Regression Analysis From the Point of View Risk, International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 12, 635–649.
 
[29] Modarres, M., Nasrabadi, E. and Nasrabadi, M.M. (2005). Fuzzy Linear Regression Models with Least Square Errors, Applied Mathematics and Computation, 163, 977–989.
 
[30] Nasrabadi, M.M. and Nasrabadi, E. (2004). A Mathematical-Programming Approach to Fuzzy Linear Regression Analysis, Applied Mathematics and Computation, 155, 873–881.
 
[31] Nasrabadi, M.M., Nasrabadi, E. and Nasrabadi, A.R. (2005). Fuzzy Linear Regression Analysis: A Multi-Objective Programming Approach, Applied Mathematics and Computation, 163, 245–251.
 
[32] Shannon, C.E. (1948). A Mathematical Theory of Communication, Bell System Technical Journal, 27, 379–423 & 623–656.
 
[33] Taheri, S.M. and Chachi, J. (2021). A Robust Variable-Spread Fuzzy Regression Model, In: Shahbazova SN, Kacprzyk J, Balas VE, Kreinovich V (eds) Developments and the New Direction in Soft-Computing Foundations and Applications, Studies in Fuzziness and Soft Computing, Springer, vol 393, pp 309–320.
 
[34] Tanaka, H., Hayashi, I. and Watada, J. (1989). Possibilistic Linear Regression Analysis for Fuzzy Data, European Journal of Operational Research, 40, 389–396.
 
[35] Tanaka, H. , Uegima, S. and Asai, K. (1982). Linear Regression Analysis with Fuzzy Model, IEEE Transactions on Systems, Man, and Cybernetics, 12, 903–907.
 
[36] Xu, R. and Li, C. (2001). Multidimensional Least-Squares Fitting With a Fuzzy Model, Fuzzy Sets and Systems, 119, 215–223.
 
[37] Xu, Z. (2015). Uncertain Multi–Attribute Decision Making: Methods and Applications, Springer-Verlag, Berlin Heidelberg.
 
[38] Zavadskas, E.K., Turskis, Z., Antucheviciene, J. and Zakarevicius, A. (2012). Optimization of Weighted Aggregated Sum Product Assessment, Electronics and Electrical Engineering, 122, 3–6.
 
[39] Zavadskas, E.K., Antucheviciene, J., Hajiagha, S.H.R. and Hashemi, S.S. (2014). Extension of Weighted Aggregated Sum Product Assessment with Interval-Valued Intuitionistic Fuzzy Numbers (Waspas-Ivif), Applied Soft Computing, 24, 1013–1021.
 
[40] Zeng, W., Feng, Q. and Lia, J. (2017). Fuzzy Least Absolute Linear Regression, Applied Soft Computing, 52, 1009–1019.
 
[41] Zhou, J., Zhang, H., Gu, Y. and Pantelous, A.A. (2018). Affordable Levels of House Prices Using Fuzzy Linear Regression Analysis: The Case of Shanghai, Soft Computing, 22, 5407–5418.
 
[42] Zimmermann, H.J. (2001). Fuzzy Set Theory and Its Applications, 4th ed., Kluwer Nihoff, Boston.
Fuzzy Systems and its Applications
Volume 4, Issue 1 - Serial Number 7
November 2021
Pages 247-267

Files

History

  • Receive Date: 24 August 2021
  • Revise Date: 13 October 2021
  • Accept Date: 17 October 2021

Share

How to cite

Statistics