Finding reliable indicators of Lyman continuum (Ly C) photon leakage from galaxies is essential in order to infer their escape fraction in the epoch of reionization, where direct measurements of LyC flux are impossible. To this end, here we investigate whether strong C IV lambda lambda 1548, 1550 emission in the rest-frame UV spectra of galaxies traces conditions ripe for ample production and escape of LyC photons. We compile a sample of 19 star-forming galaxies in the redshift range z = 3.1-4.6 from the VANDELS survey that exhibit strong C IV emission, producing a stacked spectrum where all major rest-UV emission lines are clearly detected. Best-fitting spectral energy distribution models containing both stellar and nebular emission suggest the need for low stellar metallicities (Z = 0.1-0.2 Z(circle dot)), young stellar ages (log(age yr(-1)) = 6.1-6.5), a high ionization parameter (log U = -2) and little to no dust attenuation (E(B - V) = 0.00-0.01). However, these models are unable to fully reproduce the observed C IV and He II line strengths. We find that the Ly alpha line in the stacked spectrum is strong and peaks close to the systemic velocity, features that are indicative of significant LyC photon leakage along the line of sight. The covering fractions of low-ionization interstellar absorption lines are also low, implying Ly C escape fraction in the range approximate to 0.05-0.30, with signatures of outflowing gas. Finally, C IV/C III ratios of >0.75 for a subset of individual galaxies with reliable detections of both lines are also consistent with physical conditions that enable significant Ly C leakage. Overall, we report that multiple spectroscopic indicators of Ly C leakage are present in the stacked spectrum of strong C IV emitting galaxies, potentially making C IV an important tracer of Ly C photon escape at z > 6.