Do I need to include all the fields under card address if I’m using WePay as my payment gateway?

Yes. Due to WePay policies, all the fields under Card Address are mandatory.