Expert and Learner Evaluation of a Mobile-Assisted ESP Speaking Module: A Formative Study

This paper reports the formative evaluation of a mobile-assisted English for Specific Purposes (ESP) speaking module, ‘TourSpeak’, conducted during its development process. The study explores how experts and learners perceive the content, pedagogy, and usability of the module, as well as their feedback on its strengths, weaknesses, and suggestions for improvement. The two-stage formative evaluation consists of a review by six experts and a walkthrough by two learners in the first stage, followed by micro-evaluations from four learners in the second stage. Data was collected using evaluation checklists with structured items and open-ended questions. The responses to the structured items were analysed based on frequency, and feedback was analysed thematically. The findings indicate that the experts and learners had a positive perception of the module’s content, pedagogy, and usability. They perceived the module as pedagogically sound, enabling knowledge construction, sharing of experiences, interaction, discussion, and self-directed learning. They perceive the module’s learning objectives, content, and lesson structure as suitable for improving speaking skills. The module was usable in terms of its user interface, user-friendliness, and user acceptance. They also emphasized relevant content, realistic scenarios, clear structure, and user-friendliness as strengths of the module, while reliance on the internet is considered a weakness. Suggestions for improvement include expanding content with diverse scenarios, incorporating gamification elements, revising the feedback time, and incorporating live chat or calls. The findings provide valuable insights for language instructional designers, ESP practitioners, and mobile module developers, informing the development of ESP modules and expanding technological integration in ESP.