This study aims to enhance the learning motivation of engineering graduate students, particularly those specializing in Instrument Science and Engineering. It does so by evaluating the impact of a combined teaching approach that integrates multiple innovative methods. A total of 156 master’s students and 44 doctoral students were randomly assigned to either an experimental group or a control group. The experimental group engaged in small-group discussions, personalized online courses, and flipped classrooms, while the control group followed traditional teaching methods. Over a 20-week intervention period, several aspects were measured, including changes in learning motivation, teacher perceptions, satisfaction of basic psychological needs, and academic emotions. The results clearly indicate that the intervention significantly reduced non-regulatory behaviors and led to improvements in students’ self-regulation, decision-making abilities, and overall academic performance. Furthermore, students in the experimental group demonstrated superior outcomes in various critical areas such as research skills, engineering thinking, communication, and cooperation, all of which were reflected in their test scores when compared to the control group. Additionally, achievement test results in the small-group discussion model showed a negative correlation with class size, implying that the effectiveness of this method may vary depending on student personalities and group dynamics. The study concludes that small-group discussions positively influence engineering thinking, enhance goal clarity, and foster both student initiative and motivation. This teaching approach effectively meets the students’ needs for independent problem-solving and substantially enhances learning motivation, thereby supporting the educational goals in graduate studies related to Instrument Science and Engineering.