Spectral diffusion and scaling of many-body delocalization transitions