What students need to understand about AI: Neither chatbots nor cars have a personality

The increase of AI tools like chatbots in education is going hand in hand with an ongoing humanization of these tools. In K-12, this increase is aimed at fostering student learning. In this article we argue and warn that such humanization runs the risk of students perceiving AI as a real personality and mistaking it for someone rather than something. To illustrate how AI-tools can be perceived as having a personality, we let an AI-expert rate ChatGPT’s personality. Additionally, we let ChatGPT’s rate its own personality and let a car enthusiast rate their car’s personality. The comparison of these three case-studies showcases that having a personality profile does not mean you have a personality. We conclude that education should provide a basic understanding of what an AI-tool is to enable students to responsibly navigate an AI-driven world.