To obtain an image estimation device and record an image estimation program by estimating an image region from feature amounts of a shooting object calculated from a shooting image to estimate relative coordinates of a position that a shooting image direction of an image sensor directed to the shooting object from the image region.

An upper end 16 in an estimation region including a square framed image 7 is determined from vertical coordinates in an input image in the case that value of a horizontal projection 12 firstly exceeds a threshold 14 by checking each value of a horizontal projection 12 from the front of the horizontal projection 12. A lower end 17 in the estimation region is obtained in the same way by examining from the rear each value of the horizontal projection 12. A left end 18 and a right end 19 in the estimation region is determined in the same way as in the upper end 16 and the lower end 17 by using vertical projection 13 and a threshold 15. Then, relative coordinates that a center position 24 in the input image shares in the estimation region is calculated. Thereby, since relative coordinates of a position is obtained when pointing arbitrary position on a monitor, a pointing device that points a thing on a screen in a lecture and the like can be realized.