In this paper, we present a study to evaluate the impact of adaptive feedback on the effectiveness of a pedagogical agent for an educational computer game. We compare a version of the game with no agent, and two versions with agents that differ only in the accuracy of the student model used to guide the agent’s interventions. We found no difference in student learning across the three conditions, and we report an analysis to understand the reasons of these results.