This paper proposes a pseudo-haptic interface that depicts the virtual weights of dumbbells in a virtual gymnasium. When a user performs a dumbbell biceps curl, he/she fixes the elbow joint as a standard joint and lifts the dumbbell, with its movement trajectory represented as a circular arc. The trajectories and velocity of dumbbell bicep curls differ depending on human physiological characteristics. Therefore, the proposed system provides an adaptable exercise area and force visualization of virtual dumbbells using a velocity-based pseudo-haptic interface and computer vision-based tracking method. The system recognizes the position and rotation of joints related to a dumbbell biceps curl with the implementation of density-based spatial clustering of applications with noise (a clustering algorithm) and resizes the radius and angle of an integrated force circular gauge. Furthermore, when a user lifts a dumbbell, the system recognizes, using linear regression, the current position and lifting force of the virtual dumbbell and visualizes the current lifting force with a guided movement trajectory to match the lifting force. Experimental results show that the proposed pseudo-haptic interface increased weight perception and usability by up to 30% compared to conventional methods (p < 0.05).