Yeah, at the beginning of the series, magic is kind of like the Force in Star Wars - lots of people don't believe it exists.
And yes, with dragons back in the world, magic is becoming more powerful. That's how Thoros - an indifferent priest - was able to raise Beric from the dead, for example.