TY - GEN
T1 - Untangling Emotional Threads
T2 - 12th International Conference on Complex Networks and their Applications, COMPLEX NETWORKS 2023
AU - Goodarzi, Mahsa
AU - Venkatakrishnan, Radhakrishnan
AU - Canbaz, M. Abdullah
N1 - Publisher Copyright: © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.
PY - 2024
Y1 - 2024
N2 - Generative AI models, known for their capacity to generate intricate and realistic data, have rapidly found applications across various domains. Yet, doubts linger regarding the full scope of their hallucinatory capabilities and the reliability of their outcomes. These concerns underscore the need for rigorous analysis and validation of generative AI models. This study employs network analysis to explore the inherent characteristics of generative AI models, focusing on their deviations and disparities between generated and actual content. Using GPT3.5 and RoBERTa, we analyze tweets, vocabulary, and emotion networks from their outputs. Although network comparison demonstrated hallucination, non-classification, and instability patterns in GPT-3.5 compared to RoBERTa as a baseline, both models exhibit promise and room for improvement.
AB - Generative AI models, known for their capacity to generate intricate and realistic data, have rapidly found applications across various domains. Yet, doubts linger regarding the full scope of their hallucinatory capabilities and the reliability of their outcomes. These concerns underscore the need for rigorous analysis and validation of generative AI models. This study employs network analysis to explore the inherent characteristics of generative AI models, focusing on their deviations and disparities between generated and actual content. Using GPT3.5 and RoBERTa, we analyze tweets, vocabulary, and emotion networks from their outputs. Although network comparison demonstrated hallucination, non-classification, and instability patterns in GPT-3.5 compared to RoBERTa as a baseline, both models exhibit promise and room for improvement.
KW - Emotions
KW - GPT
KW - Generative AI
KW - Hallucination
KW - RoBERTa
UR - https://www.scopus.com/pages/publications/85187643683
U2 - 10.1007/978-3-031-53468-3_17
DO - 10.1007/978-3-031-53468-3_17
M3 - Conference contribution
SN - 9783031534676
T3 - Studies in Computational Intelligence
SP - 202
EP - 214
BT - Complex Networks and Their Applications XII - Proceedings of The 12th International Conference on Complex Networks and their Applications
A2 - Cherifi, Hocine
A2 - Rocha, Luis M.
A2 - Cherifi, Chantal
A2 - Donduran, Murat
PB - Springer Science and Business Media Deutschland GmbH
Y2 - 28 November 2023 through 30 November 2023
ER -