That's why a Dipole antenna must never be connected directly to a coaxial line, the Dipole is a Balanced radiator, and the Coaxial an unbalanced transmission line.
You need a 1:1 Balanced-to-Unbalanced coupler, yes a Balun. Otherwise the external braid became part of the antenna