To provide an image tracking system, with which a photographing starting point can be freely set in a photographing enable area over a wide range and photographing can be performed by exact automatic tracking.

An image tracking system 1 is composed of an image tracking device 8 with a built-in image recognizing means 37 and a portable telephone set 9, which incorporates a position information detecting means 19 and is mounted on a skier as an object to be photographed. Based on two-way interactive communication with the portable telephone set 9, the image tracking device 8 first photographs the shape of the skier in a form photographing area and registers shape data (first process). Next, the skier is photographed based on position information detected with an arbitrary position inside the photographing enable area as a photographing starting point and the shape data in photographed image data are locked based on image recognition(second process). Then, the skier under skiing is automatically tracked and photographed while maintaining the locked state based on the position information and the image recognition (third process).