Reflexion: Language Agents with Verbal Reinforcement Learning

Summary

Rather than updating weights, Reflexion agents reflect in language on the feedback from their attempts and keep these reflections in an episodic memory buffer that guides later decisions, improving across sequential decision-making, coding and reasoning tasks.

CommentaryLearning held in words rather than weights: an agent can improve from experience while its model stays unchanged.