Choosing a career and educational path is a challenging decision for young people. Career planning conversational agents (CAs) can assist by identifying suitable occupations and educational paths. Trustworthiness is an important dimension for the acceptance of a career planning CA and is influenced by several factors. We conducted a user study with n=114 participants across three schools in Germany to explore the trustworthiness of different career planning CAs. We examined the correlation between trustworthiness and perceived competence, autonomy, and social relatedness from self-determination theory (SDT), as well as the explainability of interactions and several usability dimensions of the assistants. These dimensions included the ability to guide the conversation, onboarding quality, error tolerance, and information relevance. We tested three different variants of the career planning assistant: a form-based assistant, an intent-based CA, and a large language model (LLM)-based CA. The results showed that the LLM-based CA was on average significantly more trustworthy and was perceived as more explainable than the intent-based CA. Key trust factors included conversation flexibility, chatbot credibility, intent recognition, and maintenance of a secure conversation. Additionally, perceived autonomy was crucial for trust across all types of assistants and perceived relatedness for the two CAs. Our findings highlight key areas essential for developing trustworthy CAs.
The rapid development of AI technologies, in particular generative AI chatbots like ChatGPT, is changing education, especially in the areas of teaching, learning, and career planning. As these technologies become more widespread, questions of acceptance among schoolchildren are becoming increasingly important. To address this issue, the generic General Technology Acceptance Model (GTAM) was evaluated to measure the acceptance of AI-based technologies in education. The GTAM combines elements of the Technology Acceptance Model (TAM), the Theory of Planned Behavior (TPB) and the Hierarchical Attitude Models (HAM) to assess both general attitudes and specific beliefs regarding AI. In two studies, the model showed good validity, reliability and predictive quality, with an explained variance of 52.22 % in study 1 and 58.83 % in study 2 for usage intention. The results suggest that GTAM is a practical and costeffective method for evaluating the acceptance of AI technologies in educational contexts and provides developers with a reliable approach for efficiently evaluating AI applications.