Aqueous solutions of rare earth salts are an important class of paramagnetic liquids. Such liquids can be manipulated by external magnetic fields in a contactless manner and free of Joule heating. This is of particular interest for the magnetic separation of the paramagnetic rare earth ions out of this solution. If the paramagnetic liquid possesses a free surface, an inhomogeneous magnetic field leads unavoidably to a deformation of this surface. Unlike super-paramagnetic liquids, e.g. ferrofluids, the dynamics of such deformations is less studied. To observe the combined effect of gravity and magnetic field on paramagnetic solutions, a permanent magnet was moved vertically above the free surface of DyCl3 and MnSO4 solution. The deformation of the interface was followed optically by shadowgraphy, and studied for different concentrations and speeds by which the magnet is applied and removed. The speed of the moving magnet falls into two categories: (i) a quasi-static and (ii) a jump-like magnetization and demagnetization. It was found, that the interface of the liquid is oscillating with a specific frequency which is defined by the concentration of the solution, independently of the magnet velocity.