1. bookVolume 11 (2021): Issue 2 (September 2021)
Journal Details
First Published
18 Jun 2013
Publication timeframe
2 times per year
access type Open Access

A Different Approach to the Evaluation of Smart Cities’ Indicators

Published Online: 15 Nov 2021
Volume & Issue: Volume 11 (2021) - Issue 2 (September 2021)
Page range: 130 - 147
Journal Details
First Published
18 Jun 2013
Publication timeframe
2 times per year

The article aims to propose a different approach to assessing smart cities which combines some commonly used indicators with several new ones in line with the concept of sustainability. The aspect of sustainable development as an essential driver for the smart city and the combination of indicators for sustainable and smart city concepts have been analysed fragmentarily so far. There are many different approaches to evaluate the indicators of city smartness; however, very little attention is paid to the analysis of the reciprocal importance of the indicators. Ten indicators representing a smart city were selected that would be keep in line all the three pillars of sustainability—environmental, social, and economic. An expert survey was conducted to assign the weights of indicators using the pairwise comparison approach. The results were processed by utilising the fuzzy analytic hierarchy process (AHP), which reduces the subjectivity in the experts’ answers. The presented approach differs from the ones commonly used and while it does not cover a wide range of usual indicators, it proposes some new ideas for further research. Some represent cities to attract young and intelligent citizens, others relate to comfortable and safe living conditions and the environmental situation. The results revealed that the most vital smartness indicators are foreign direct investments, pollutant emission, and the share of people registered as unemployed among the working-age population. These indicators cannot be easily identified as ones representing a smart city, but rather as indicators representing investment and environmental, sustainable aspects. Hence, finding a balance between the indicators related to sustainable and smart city is what highlights the need for further research.


Abdel-Basset, M.; Mohamed, R.; Elhoseny, M. & Chang, V. (2020), ‘Evaluation framework for smart disaster response systems in uncertainty environment,’ Mechanical Systems and Signal Processing, vol. 145, art. 106941. https://doi.org/10.1016/j.ymssp.2020.10694110.1016/j.ymssp.2020.106941 Search in Google Scholar

Ahad, M. A.; Paiva, S; Tripathi, G. & Feroz, N. (2020), ‘Enabling technologies and sustainable smart cities,’ Sustainable Cities and Society, vol. 61, art. 102301. https://doi.org/10.1016/j.scs.2020.10230110.1016/j.scs.2020.102301 Search in Google Scholar

Ahvenniemi, H.; Huovila, A.; Pinto-Seppä, I. & Airaksinen, M. (2017), ‘What are the differences between sustainable and smart cities?’ Cities, vol. 60, Part A, pp. 234–245. https://doi.org/10.1016/j.cities.2016.09.00910.1016/j.cities.2016.09.009 Search in Google Scholar

AlKhatib, M.; El Barachi, M.; AleAhmad, E.; Orumchian, F. & Shaalan, K. (2020), ‘A sentiment reporting framework for major city events: Case study on the China-United States trade war,’ Journal of Cleaner Production, vol. 264, art. 121426. https://doi.org/10.1016/j.jclepro.2020.12142610.1016/j.jclepro.2020.121426 Search in Google Scholar

Ayhan, M. B. (2013), ‘A fuzzy AHP approach for supplier selection problem: A case study in a gearmotor company’, International Journal of Managing Value and Supply Chains (IJMVSC), vol. 4, no. 3, pp. 11–23. https://doi.org/10.5121/ijmvsc.2013.430210.5121/ijmvsc.2013.4302 Search in Google Scholar

Berglund, E. Z.; Monroe, J. G.; Ahmed, I. & Noghabaei, M. (2020), ‘Smart infrastructure: A vision for the role of the civil engineering profession in smart cities,’ Journal of Infrastructure Systems, vol. 26, no. 2, art. 03120001. https://doi.org/10.1061/(ASCE)IS.1943-555X.000054910.1061/(ASCE)IS.1943-555X.0000549 Search in Google Scholar

Caird, S. P. & Hallett, S. H. (2019), ‘Towards evaluation design for smart city development,’ Journal of Urban Design, vol. 24, no. 2, pp. 188–209. https://doi.org/10.1080/13574809.2018.146940210.1080/13574809.2018.1469402 Search in Google Scholar

Carvalho, L. C. (2017), ‘Entrepreneurial ecosystems: Lisbon as a smart start-up city,’ in L. C. Carvalho (ed.) Handbook of Research on Entrepreneurial Development and Innovation Within Smart Cities, Hershey, PA: IGI Global, pp. 1–19. https://doi.org/10.4018/978-1-5225-1978-2.ch00110.4018/978-1-5225-1978-2.ch001 Search in Google Scholar

Chang, D.-Y. (1996), ‘Applications of the extent analysis method on fuzzy AHP,’ European Journal of Operational Research, vol. 95, no. 3, pp. 649–655. https://doi.org/10.1016/0377-2217(95)00300-210.1016/0377-2217(95)00300-2 Search in Google Scholar

Chourabi, H.; Nam, T.; Walker, S.; Gil-Garcia, J. R.; Mellouli, S; Nahon, K.; Pardo, T. A. & Scholl, H. J. (2012), ‘Understanding smart cities: An integrative framework,’ in 2012 Proceedings of the 45th Hawaii International Conference on System Sciences, IEEE, pp. 2289–2297. https://doi.org/10.1109/HICSS.2012.61510.1109/HICSS.2012.615 Search in Google Scholar

Cobo, A.; Vanti, A. A. & Rocha, R. (2014), ‘A fuzzy multicriteria approach for it governance evaluation,’ Journal of Information Systems and Technology Management: JISTEM, vol. 11, no. 2, pp. 257–276. https://doi.org/10.4301/S1807-1775201400020000310.4301/S1807-17752014000200003 Search in Google Scholar

Dameri, R. P. & Cocchia, A. (2013), ‘Smart city and digital city: Twenty years of terminology evolution,’ X Conference of the Italian Chapter of AIS, ITAIS 2013, pp. 1–8. Search in Google Scholar

Dang, T. K.; Pham, C. D. M. & Nguyen, T. L. P. (2020), ‘A pragmatic elliptic curve cryptography-based extension for energy-efficient device-to-device communications in smart cities,’ Sustainable Cities and Society, vol. 56, art. 102097. https://doi.org/10.1016/j.scs.2020.10209710.1016/j.scs.2020.102097 Search in Google Scholar

De Falco, S. (2019), ‘Are smart cities global cities? A European perspective,’ European Planning Studies, vol. 27, no. 4, pp. 759–783. https://doi.org/10.1080/09654313.2019.156839610.1080/09654313.2019.1568396 Search in Google Scholar

De Guimarães, J. C. F.; Severo, E. A.; Felix Júnior, L. A.; Preston, W.; Da Costa, L. B. & Salmoria, F. T. (2020), ‘Governance and quality of life in smart cities: Towards sustainable development goals,’ Journal of Cleaner Production, vol. 253, art. 119926. https://doi.org/10.1016/j.jclepro.2019.11992610.1016/j.jclepro.2019.119926 Search in Google Scholar

Dutta, D.; Rahman, A.; Paul, S. K. & Kundu, A. (2020), ‘Estimating urban growth in peri-urban areas and its interrelationships with built-up density using earth observation datasets’, The Annals of Regional Science, vol. 65, pp. 67–82. https://doi.org/10.1007/s00168-020-00974-810.1007/s00168-020-00974-8 Search in Google Scholar

Elgazzar, R. F. & El-Gazzar, R. (2017), ‘Smart cities, sustainable cities, or both?—A critical review and synthesis of success and failure factors,’ in Proceedings of the 6th International Conference on Smart Cities and Green ICT Systems, SCITEPRESS Science and Technology Publications, pp. 250–257. https://doi.org/10.5220/000630730250025710.5220/0006307302500257 Search in Google Scholar

Estévez-Ortiz, F.-J.; García-Jiménez, A. & Glösekötter, P. (2016), ‘An application of people’s sentiment from social media to smart cities,’ El Profesional de la Información, vol. 25, no. 6, pp. 851–858. https://doi.org/10.3145/epi.2016.nov.0210.3145/epi.2016.nov.02 Search in Google Scholar

Golabi, M. R. & Radmanesh, F. (2020), ‘A new approach to the allocation of the blue water footprint of reservoirs using fuzzy AHP model,’ Modeling Earth Systems and Environment, vol. 6, no. 2, pp. 793–797. https://doi.org/10.1007/s40808-019-00706-810.1007/s40808-019-00706-8 Search in Google Scholar

Grimaldi, D. & Fernandez, V. (2017), ‘The alignment of university curricula with the building of a smart city: A case study from Barcelona,’ Technological Forecasting and Social Change, vol. 123, pp. 298–306. https://doi.org/10.1016/j.techfore.2016.03.01110.1016/j.techfore.2016.03.011 Search in Google Scholar

Guelzim, T.; Obaidat, M. S. & Sadoun, B. (2016), ‘Introduction and overview of key enabling technologies for smart cities and homes,’ in Smart Cities and Homes, pp. 1–16. https://doi.org/10.1016/B978-0-12-803454-5.00001-810.1016/B978-0-12-803454-5.00001-8 Search in Google Scholar

Hajduk, S. (2016), ‘The concept of a smart city in urban management,’ Business, Management and Economics Engineering, vol. 14, no. 1, pp. 34–49. https://doi.org/10.3846/bme.2016.31910.3846/bme.2016.319 Search in Google Scholar

Ibrahim, M.; El-Zaart, A. & Adams, C. (2017), ‘Theory of change for the transformation towards smart sustainable cities,’ in 2017 Sensors Networks Smart and Emerging Technologies (SENSET), IEEE, pp. 1–4. https://doi.org/10.1109/SENSET.2017.812506710.1109/SENSET.2017.8125067 Search in Google Scholar

Ibrahim, M.; El-Zaart, A. & Adams, C. (2018), ‘Smart sustainable cities roadmap: Readiness for transformation towards urban sustainability,’ Sustainable Cities and Society, vol. 37, pp. 530–540. https://doi.org/10.1016/j.scs.2017. Search in Google Scholar

Jararweh, Y.; Otoum, S. & Al Ridhawi, I. (2020), ‘Trustworthy and sustainable smart city services at the edge,’ Sustainable Cities and Society, vol. 62, art. 102394. https://doi.org/10.1016/j.scs.2020.10239410.1016/j.scs.2020.102394 Search in Google Scholar

Jelonek, D.; Stępniak, C.; Turek, T. & Ziora, L. (2020), ‘Planning city development directions with the application of sentiment analysis,’ Prague Economic Papers. https://doi.org/10.18267/j.pep.74010.18267/j.pep.740 Search in Google Scholar

Kourtit, K.; Elmlund, P. & Nijkamp, P. (2020), ‘The urban data deluge: challenges for smart urban planning in the third data revolution,’ International Journal of Urban Sciences, pp. 1–17. https://doi.org/10.1080/12265934.2020.175535310.1080/12265934.2020.1755353 Search in Google Scholar

Kumar, H.; Singh, M. K.; Gupta, M. P. & Madaan, J. (2020), ‘Moving towards smart cities: Solutions that lead to the Smart City Transformation Framework,’ Technological Forecasting and Social Change, vol. 153, art. 119281. https://doi.org/10.1016/j.techfore.2018.04.02410.1016/j.techfore.2018.04.024 Search in Google Scholar

Macke, J.; Rubim Sarate, J. A. & de Atayde Moschen, S. (2019), ‘Smart sustainable cities evaluation and sense of community,’ Journal of Cleaner Production, vol. 239, art. 118103. https://doi.org/10.1016/j.jclepro.2019.118103.10.1016/j.jclepro.2019.118103 Search in Google Scholar

Monzon, A. (2015), ‘Smart cities concept and challenges,’ in International Conference on Smart Cities and Green ICT Systems (SMARTGREENS). SCITEPRESS, pp. 1–11. Search in Google Scholar

Neirotti, P.; De Marco, A.; Cagliano, A. C.; Mangano, G. & Scorrano, F. (2014), ‘Current trends in smart city initiatives: Some stylised facts,’ Cities, vol. 38, pp. 25–36. https://doi.org/10.1016/j.cities.2013.12.01010.1016/j.cities.2013.12.010 Search in Google Scholar

Peňaška, M. & Veľas, A. (2019), ‘Possibilities of tracking city indicators in the sense of the smart city concept,’ Transportation Research Procedia, vol. 40, pp. 1525–1532. https://doi.org/10.1016/j.trpro.2019.07.21110.1016/j.trpro.2019.07.211 Search in Google Scholar

Pevcin, P. (2019), ‘The evolution of city labelling in the literature,’ Economics and Culture, vol. 16, no. 1, pp. 40–45. https://doi.org/10.2478/jec-2019-0005.10.2478/jec-2019-0005 Search in Google Scholar

Saaty, T. L. (1984), ‘The analytic hierarchy process: decision making in complex environments,’ in Quantitative Assessment in Arms Control. Boston, MA: Springer US, pp. 285–308. https://doi.org/10.1007/978-1-4613-2805-6_1210.1007/978-1-4613-2805-6_12 Search in Google Scholar

Saaty, T. L. (1993), Priniatie reshenii: metod analiza ierarkhii [Account management: the analytic hierarchy process], Moskva: Radio i sviaz’. Search in Google Scholar

Said, O. & Tolba, A. (2020), ‘DORS: A data overhead reduction scheme for hybrid networks in smart cities,’ International Journal of Communication Systems, art. e4435. https://doi.org/10.1002/dac.443510.1002/dac.4435 Search in Google Scholar

Santinha, G. & de Castro, A. E. (2010), ‘Creating more intelligent cities: The role of ICT in promoting territorial governance,’ Journal of Urban Technology, vol. 17, no. 2, pp. 77–98. https://doi.org/10.1080/10630732.2010.51508810.1080/10630732.2010.515088 Search in Google Scholar

Silva, B. N.; Khan, M. & Han, K. (2020), ‘Integration of Big Data analytics embedded smart city architecture with RESTful web of things for efficient service provision and energy management,’ Future Generation Computer Systems, vol. 107, pp. 975–987. https://doi.org/10.1016/j.future.2017.06.02410.1016/j.future.2017.06.024 Search in Google Scholar

Singh, S.; Sharma, P.; Yoon, B. & Shojafar, M. (2020), ‘Convergence of blockchain and artificial intelligence in IoT network for the sustainable smart city,’ Sustainable Cities and Society, vol. 63, no. 10, art. 102364. https://doi.org/10.1016/j.scs.2020.10236410.1016/j.scs.2020.102364 Search in Google Scholar

Strielkowski, W.; Veinbender, T.; Tvaronavičienė, M. & Lace, N. (2020), ‘Economic efficiency and energy security of smart cities,’ Economic Research– Ekonomska Istraživanja, vol. 33, no. 1, pp. 788–803. https://doi.org/10.1080/1331677X.2020.173485410.1080/1331677X.2020.1734854 Search in Google Scholar

Tan, Q.; Tong, Y.; Wu, S. & Li, D. (2017), ‘Evaluating the maturity of CPS in discrete manufacturing shop-floor: A group AHP method with fuzzy grade approach,’ Mechanika, vol. 24, no. 1, pp. 100–107. https://doi.org/10.5755/j01.mech.24.1.1837010.5755/j01.mech.24.1.18370 Search in Google Scholar

Uwe, B.-R. & Gerber, B. J. (2019), ‘Smart cities and the challenges of cross domain risk management: Considering interdependencies between ICT-security and natural hazards disruptions,’ Economics and Culture, vol. 16, no. 2, pp. 106–116. https://doi.org/10.2478/jec-2019-002610.2478/jec-2019-0026 Search in Google Scholar

Wall, R. S. & Stavropoulos, S. (2016), ‘Smart cities within world city networks,’ Applied Economics Letters, vol. 23, no. 12, pp. 875–879. https://doi.org/10.1080/13504851.2015.111703810.1080/13504851.2015.1117038 Search in Google Scholar

Wall, R. S.; Stavropolous, S.; Edelenbos, J. & Pajevič, F. (2015), ‘SMARTNET: Evaluating the performance of smart cities in the global economic network,’ in M. P. Rodríguez-Bolívar (ed.) Transforming City Governments for Successful Smart Cities, Cham: Springer International Publishing, pp. 87–113.10.1007/978-3-319-03167-5_6 Search in Google Scholar

Yigitcanlar, T.; Kamruzzaman, M.; Foth, M.; Sabatini-Marques, J.; da Costa, E. & Ioppolo, G. (2019), ‘Can cities become smart without being sustainable? A systematic review of the literature,’ Sustainable Cities and Society, vol. 45, pp. 348–365. https://doi.org/10.1016/j.scs.2018.11.03310.1016/j.scs.2018.11.033 Search in Google Scholar

Zunda, S.; Zeps, A. & Strode, S. (2020), ‘Creation of a sustainable model for building and maintaining a relationship between universities and entrepreneurs,’ Business, Management and Economics Engineering, vol. 18, no. 1, pp. 33–55. https://doi.org/10.3846/bme.2020.1128710.3846/bme.2020.11287 Search in Google Scholar

Recommended articles from Trend MD

Plan your remote conference with Sciendo