In order to improve the machining accuracy of the metal shaft parts, the vibrating abrasive belt polishing method was innovatively applied to the deterministic figuring of high-precision shaft parts based on the principle of optical deterministic figuring. In this method, the abrasive belt covered the outer surface of the contact wheel, and the elastic contact wheel contacted the shaft workpiece under a certain pressure to form a rectangular grinding area. The removal of materials could be achieved by the axial vibration of the contact wheel. The contour of the shaft′s surface can be measured by cylindricity meter, and the error′s distribution could be obtained. The dwell time of the contact wheel at different positions on cylindrical surface was calculated by pulse iteration method. The material removal quantity at different positions of workpiece was different by servo control of the machine tool′s spindle, thus the cylindricity error could be corrected deterministically. After the simulated machining, the deterministic figuring experiment was carried out on the cylindrical surface of a 45# steel shaft. Experimental results show that the average roundness error of the workpiece converges from 0.42 μm to 0.11 μm, and the cylindricity error of the workpiece improves from 0.76 μm to 0.35 μm. The shape accuracy after machining is better than that of the ultra-precision cylindrical grinder, which verifies the feasibility of high-precision deterministic figuring on the cylindrical surface of shaft parts.