We present results on the dust attenuation of galaxies at redshift similar to 3-6 by studying the relationship between the UV spectral slope (beta(UV)) and the infrared excess (IRX; L-IR/L-UV) using Atacama Large Millimeter/submillimeter Array (ALMA) far-infrared continuum observations. Our study is based on a sample of 67 massive, star-forming galaxies with a median mass of M-* similar to 10(10.7) M-circle dot spanning a redshift range z = 2.6-3.7 (median z = 3.2) that were observed with ALMA at lambda(rest) = 300 mu m. Both the individual ALMA detections (41 sources) and stacks including all galaxies show the IRX-beta(UV) relationship at z similar to 3 is mostly consistent with that of local starburst galaxies on average. However, we find evidence for a large dispersion around the mean relationship by up to +/- 0.5 dex. Nevertheless, the locally calibrated dust correction factors based on the IRX-beta(UV) relation are on average applicable to main-sequence z similar to 3 galaxies. This does not appear to be the case at even higher redshifts, however. Using public ALMA observations of z similar to 4-6 galaxies we find evidence for a significant evolution in the IRX-beta(UV) and the IRX-M-* relations beyond z similar to 3 towards lower IRX values. We discuss several caveats that could affect these results, including the assumed dust temperature. ALMA observations of larger z > 3 galaxy sample spanning a wide range of physical parameters (e.g. lower stellar mass) will be important to investigate this intriguing redshift evolution further.