Wearing a suit or blazer in a classic menswear style is relatively easy to be honest, there are numerous books and guides with Timeless Rules of Style that will guide you step by step into not looking like an idiot. I think incorporating a blazer into a casual outfit though is much more difficult because a lot of this is uncharted waters.