Ward was recruited by Garret while in juvie because he set fire to his house while his parents and older brother were in it.
Then, as an adult, he escaped custody of SHIELD/FBI and kidnapped his brother, took him to the family home and finished what he had started when he was 17.