Résumé : The physical conditions giving rise to high escape fractions of ionising radiation (LyC $f_{\rm{esc}}$) in star-forming galaxies - most likely protagonists of cosmic reionisation - are not yet fully understood. Using the properties of the Lyman-$\alpha$ line profile associated with LyC escape, we select potential LyC leakers and non-leakers from a compiled sample of 1422 MUSE-Wide and MUSE HUDF Lyman-$\alpha$ emitters (LAEs) in the redshift range 2.9<z<6.7. We perform spectral stacking to obtain high signal-to-noise detections of rest-frame UV absorption and emission lines, and find that the stacks with LyC-leaker candidates show (i) strong nebular OIII]1666, [SiIII]1883 and [CIII]1907+CIII]1909 emission, suggesting high ionisation parameters due to an elevated production rate of ionising photons coming from young, metal-poor stars; (ii) high equivalent widths of HeII1640 (~1-3 A), possibly indicating a hard ionising spectrum alongside with a high ionising photon production efficiency; (iii) SiII*1533 emission, revealing the presence of neutral hydrogen off the line of sight, thus implying a highly anisotropic interstellar medium (ISM); (iv) high CIV1548,1550 to [CIII]1907+CIII]1909 ratios (CIV/CIII] > 0.75), partly associated with the increased ISM transparency. In contrast, the stacks with non-leakers show weaker nebular emission lines, low HeII1640 equivalent widths (<1 A), and low CIV/CIII] (<0.25), suggesting a low ionisation state of the ISM and a high neutral hydrogen content. Consequently, our results substantiate that the CIV/CIII] ratio can be used as an indirect tracer of $f_{\rm{esc}}$, providing a promising tool for identification of ionising sources among star-forming galaxies in the epoch of reionisation.