Marvel : The Avengers (2012)

So I'm on my first run of the marvel films and on my first time watch of The Avengers I thought it was an alright film, maybe a bit long for what it wanted to tell but in general a good film. But I'm baffled at one story thread being Hawkeye's brainwashing. The whole Loki taking over people was fine however during the last act of the film Hawkeye magically became unbrainwashed with seeing someone important to him just seemed a bit rushed or lacked was a misdirect in story. I feel like it would be more compelling to the story if they went this way but had Hawkeye fight himself during the fight in New York and you saw him trying to kill both the Avengers and Loki's army before settling with one.