A bunch of inhumans died because Simmons let Andrew out of his cell. No guilt there?
And an evil Hydra god escaped his exile on another world because he selfishly wanted to get Fitz and Coulson back. If we'd just blown up the castle, we'd never have heard from the Hydra god again.