Development and psychometric validation of the AI chatbots acceptance and perception scale for higher education students

Abstract

Abstract The rapid integration of artificial intelligence (AI) chatbots in higher education has transformed student learning experiences and institutional operations, yet comprehensive measurement tools for assessing student usage patterns remain limited. This study presents the development and psychometric validation of the AI Chatbots Usage Scale, a comprehensive instrument measuring perceptual and attitudinal dimensions of AI chatbot acceptance among higher education students. Using a two-phase methodology, the research employed separate samples for Exploratory Factor Analysis (EFA) ( n  = 374) and Confirmatory Factor Analysis (CFA) ( n  = 599) among university students aged 17–23 from the Faculty of Education in Egypt. The initial 25-item scale underwent rigorous expert validation and pilot testing before final administration. EFA revealed a four-factor structure comprising Ease of Use, Perceived Usefulness, Trust, and Accessibility, accounting for 42.48% of total variance. CFA demonstrated excellent model fit indices, with the multidimensional model significantly outperforming a unidimensional alternative. Internal consistency reliability was excellent across all factors, with coefficients ranging from 0.731 to 0.928. The validated scale demonstrates strong theoretical alignment with established technology acceptance frameworks while extending traditional models to accommodate AI-specific considerations. These findings provide researchers and educational institutions with a reliable, theoretically grounded instrument for assessing and optimizing AI chatbot implementation in higher education contexts.