Abstract: The stellar mass-star formation rate (M$_\star$ - SFR) plane is essential for distinguishing galaxy populations, but how galaxies move within this plane over cosmic time remains unclear. This study aims to describe galaxy migrations in the M$_\star$ - SFR plane by reconstructing star formation histories (SFHs) for a sample of galaxies out to redshift $z < 4$. This provides insights into the physical processes driving star formation. We use data from the COSMOS field, selecting 299131 galaxies at $z < 4$ with COSMOS-Web NIRCam data (m$_\mathrm{F444W} < 27$) over 0.54 deg$^2$. Using the SED modeling code CIGALE with non-parametric SFHs, we derive physical properties and migration vectors for these galaxies. These vectors describe the direction and velocity of evolutionary paths across the M$_\star$ - SFR plane. To assess the accuracy of these vectors, we compare them to results from the Horizon-AGN simulation. Galaxies within the main sequence show low migration amplitudes and dispersed movement directions, indicating oscillation within the main sequence. Most progenitors were already on the main sequence a billion years earlier. Starburst galaxies assembled half their mass in the last 350 Myr and originated from the main sequence. Passive galaxies show uniformly declining SFHs and include massive galaxies already in the passive region at $z = 3.5-4$, with increasing density over time. Using reconstructed SFHs up to $z < 4$, we propose a coherent picture of how galaxies migrate over cosmic time in the M$_\star$ - SFR plane, highlighting the connection between major phases in the star-formation history.