Résumé : As the progenitors of present-day galaxy clusters, protoclusters are excellent laboratories to study galaxy evolution. Since existing observations of protoclusters are limited to the detected constituent galaxies at UV and/or infrared wavelengths, the details of how typical galaxies grow in these young, pre-virialized structures remain uncertain. We measure the total stellar mass and star formation within protoclusters, including the contribution from faint undetected members by performing a stacking analysis of 211 $z=2-4$ protoclusters selected as Planck cold sources. We stack WISE and Herschel/SPIRE images to measure the angular size and the spectral energy distribution of the integrated light from the protoclusters. The fluxes of protoclusters selected as Planck cold sources can be contaminated by line of sight interlopers. Using the WebSky simulation, we estimate that a single protocluster contributes $33\pm15$% of the flux of a Planck cold source on average. After this correction, we obtain a total star formation rate of $7.3\pm3.2 \times 10^3\ M_{\odot} {\rm yr}^{-1}$ and a total stellar mass of $4.9\pm 2.2\times 10^{12}\ M_{\odot}$. Our results indicate that protoclusters have, on average, 2x more star formation and 4x more stellar mass than the total contribution from individually-detected galaxies in spectroscopically-confirmed protoclusters. This suggests that much of the total flux within $z=2-4$ protoclusters comes from galaxies with luminosities lower than the detection limit of SPIRE ($L_{IR} < 3 \times 10^{12} L_{\odot}$). Lastly, we find that protoclusters subtend a half-light radius of 2.8' (4.2-5.8 cMpc) which is consistent with simulations.