In a randomized trial of 1,000 high school students, those using GPT-4 performed much better on practice problems but scored 17 percent worse once the AI was removed. The likely culprit was overreliance: students asked for answers, copied them, and moved on. But the researchers also showed that a more structured prompt that offered step-by-step hints rather than direct answers largely eliminated the negative effects. In some ways, that was the most important finding: the design of the AI tutor mattered enormously.
— Read on www.aei.org/technology-and-innovation/ai-works-in-education-when-it-makes-learning-harder-not-easier/