Exploring Public Sentiment Towards Agile and Digital Transformation: A Refined Methodological Approach Through Twitter Sentiment Analysis and Topic Modeling

This paper examines public sentiment about Agile methodologies and Digital Transformation through high-end Twitter sentiment analysis techniques. Agile, initially developed for software development, is nowadays one of the most important drivers of innovation and adaptability in many sectors, whereas Digital Transformation reshapes the operations of organizations through the use of digital technologies. Understanding public sentiment toward these concepts is crucial for organizations that want to align their strategy with new trends and adapt to an increasingly digital world.

This approach is further fine-tuned in this research through the incorporation of advanced data preprocessing techniques and the application of more sophisticated analytical tools. VADER sentiment analysis is used to catch the polarity of sentiments expressed on social media. It also includes the adoption of Latent Dirichlet Allocation, or LDA, topic modeling in order to mine further into the conversations on Agile and Digital Transformation. This constituted some methodological improvements in this study that can allow nuanced understanding of emotions, opinions, and ideas that dominate public discourse on these transformative methodologies.

This research performs an in-depth examination of the patterns of sentiment expressed through Twitter, termed a real-time barometer of public opinion, by analyzing a dataset of 1,014 tweets using the hashtags Agile and Digital Transformation tweets collected during the period from January 31, 2023, to August 18, 2023. On the other hand, integrating topic modeling will enable the identification of key areas of interest in public discussions: the role of AI and automation, organizational challenges, and finally best practices regarding the implementation of Agile. This paper gives a wider outlook on Agile and Digital Transformation from the perspective of public engagement and provides useful insights into their practice, research, and policy implications. The findings will be useful for organizational decisions, communications, and the development of better strategies in response to perceived public views and trends that arise with digital innovations.