There are many kinds of three dimensional displays that have been developed to date. Most of them provide 3D visual sensation to the users, but they do not provide 3D haptic feedback. On the other hand, an interactive surface system using transparent gels enables users to touch a 3D surface. The main issue of the system, however, is that the image is distorted due to "lens effect" of the gels. This paper describes a method to solve the image distortion through the use of a light field display (LFD) which is discussed in detail in section 2. By combining the LFD and transparent gel interface, it becomes possible to show correct 3D images on gels from any viewing position.