This paper demonstrates in simulation the use of a novel direct end-effector odometry to close the position control loop of a UAV using a trackball from a human interface device. Applying a 2D position control on the target surface with a perpendicular force control, the UAV can follow a vertically aligned wall surface with unknown orientation. A simulation model of the trackball odometry sensor is developed, parameterized with data recorded in real flight experiments and validated in several simulated flight experiments to enable a model based development of future applications.