In terms of storytelling, Captain America had a better sequel backbone and Guardians of the Galaxy had a new take on The Avengers premise. Oddly, Avengers 2 did not.
If they had it to do all over again, they would have marketed Ultron more, I think. Spader fucking nailed that role.