The correct cast on amounts are as follows-
Beginning at the neck edge with the larger 24 inch needle, cast on firmly 2 sts, place a marker, cast on 14 (14, 12, 12, 10, 10) sts, place a marker, cast on 22 (24, 28, 28, 32, 32) sts, place a marker, cast on 14 (14, 12, 12, 10, 10) sts, place a marker, cast on 2 sts. There will be 54 (56, 56, 56, 56, 56) sts.
Also, there should be a wrong side row before you divide for the sleeves.