As sustainability emerges as a crucial factor in the development of modern enterprises, integrating environmental, social, and governance (ESG) information into financial assessments has become essential. ESG indicators serve as important metrics in evaluating a company’s sustainable practices and governance effectiveness, influencing investor trust and future growth potential, ultimately affecting stock prices. This study proposes an innovative approach that combines ESG sentiment index extracted from news with technical indicators to predict the S&P 500 index. By utilizing a deep learning model and exploring optimal window sizes, the study explores the best model through mean absolute percentage error (MAPE) as an evaluation metric. Additionally, an ablation test clarifies the influence of ESG and its causality with the S&P 500 index. The experimental results demonstrate improved predictive accuracy when considering ESG sentiment compared to relying solely on technical indicators or historical data. This comprehensive methodology enhances the advantage of stock price prediction by integrating technical indicators, which consider short-term fluctuations, with ESG information, providing long-term effects. Furthermore, it offers valuable insights for investors and financial market experts, validating the necessity to consider ESG for financial assets and introducing a new perspective to develop investment strategies and decision-making processes.
Incorporating environmental, social, and governance (ESG) criteria is essential for promoting sustainability in business and is considered a set of principles that can increase a firm's value. This research proposes a strategy using text-based automated techniques to rate ESG. For autonomous classification, data were collected from the news archive LexisNexis and classified as E, S, or G based on the ESG materials provided by the Refinitiv-Sustainable Leadership Monitor, which has over 450 metrics. In addition, Bidirectional Encoder Representations from Transformers (BERT), Robustly optimized BERT approach (RoBERTa), and A Lite BERT (ALBERT) models were trained to accurately categorize preprocessed ESG documents using a voting ensemble model, and their performances were measured. The accuracy of the ensemble model utilizing BERT and ALBERT was found to be 80.79% with batch size 20. Additionally, this research validated the performance of the framework for companies included in the Dow Jones Industrial Average (DJIA) and compared it with the grade provided by Morgan Stanley Capital International (MSCI), a globally renowned ESG rating agency known for having the highest creditworthiness. This study supports the use of sophisticated natural language processing (NLP) techniques to attain important knowledge from large amounts of text-based data to improve ESG assessment criteria established by different rating agencies.
The rapid growth of the cryptocurrency market has led to an increasing interest in the subject. Cryptocurrency is now recognized as an asset, and laws and financial regulations have begun to emerge for supporting its practical use. As a result, it has become essential to perform data mining and attain knowledge from text data related to cryptocurrency. Previous studies have focused on analyzing data from a single source such as Twitter. However, there are unique insights to be gained from data across multiple platforms. In the present study, we utilized data mining techniques to extract insights from LexisNexis, Web of Science, and Reddit, representing the media, academia, and general public, respectively. Among unsupervised learning technologies, topic modeling was employed for the analysis. Topic modeling is a methodology that uncovers hidden meanings within the collected data. Among the diverse topic modeling techniques available, bidirectional encoder representations from transformers topic was chosen for the analysis. BERTopic considered to be state-of-the-art in the field of topic modeling. Dynamic topic modeling was employed to track changes in themes over time. Our experimental results reveal a tendency in the news to cover major events related to cryptocurrencies, such as regulatory developments and market trends. Academic papers, on the other hand, tend to focus on the technology behind cryptocurrencies and related research. Finally, social media conversations center more around information delivery from an investor’s psychological perspective, such as market sentiment and investment strategies.
This study presents a comprehensive exploration of topic modeling methods tailored for large language model (LLM) using data obtained from Web of Science and LexisNexis from June 1, 2020, to December 31, 2023. The data collection process involved queries focusing on LLMs, including “Large language model,” “LLM,” and “ChatGPT.” Various topic modeling approaches were evaluated based on performance metrics, including diversity and coherence. latent Dirichlet allocation (LDA), nonnegative matrix factorization (NMF), combined topic models (CTM), and bidirectional encoder representations from Transformers topic (BERTopic) were employed for performance evaluation. Evaluation metrics were computed across platforms, with BERTopic demonstrating superior performance in diversity and coherence across both LexisNexis and Web of Science. The experiment result reveals that news articles maintain a balanced coverage across various topics and mainly focus on efforts to utilize LLM in specialized domains. Conversely, research papers are more concise and concentrated on the technology itself, emphasizing technical aspects. Through the insights gained in this study, it becomes possible to investigate the future path and the challenges that LLMs should tackle. Additionally, they could offer considerable value to enterprises that utilize LLMs to deliver services.
Growing expectations and interest in the metaverse have increased the need to explore the public hype. This study measured the hype in the South Korean metaverse context and analyzed its temporal pattern. To this end, 129,032 tweets from Korean users who used the “metaverse” keyword were collected, and 86,901 tweets were analyzed. Using BERT-based topic modeling, a content analysis was performed. The extracted topics were classified into three expectation frameworks: specific expectations, generalized expectations, and frames. Our results imply that the pre-emptive inflation of expectations by the Korean government caused the public’s excessive expectations of the metaverse. Additionally, by using Twitter as a source for analyzing user-perceived hype, it was confirmed that the public responds to the expectations of other actors about the technology rather than expecting the technology itself. Furthermore, pronounced hype dynamics were observed by analyzing the distribution of topics over time.