What few records remain indicate that the original church was built in 1040, the only part remaining from that period being the base of the tower, the upper section being dated 1677. There is evidence that a much earlier church stood here. The large Yew tree in the churchyard has been dated as around 2500 years old and the stone coffin, complete with stone lid, to the right of the church porch is pre Saxon.
Rebuilt by J Butler - 1850, incorporating a tower of 1670-1673 on its South side. The church contains a plain font.

The church of St. James stands south of the River Rother and east of the road leading to the bridge. It now consists of a chancel, flanked on the north by the organ-chamber and on the south by the tower, the ground floor of which serves as vestry, of a nave, a north aisle, and a south porch; it is built of local sandstone ashlar, and roofed with tile. It is mentioned in the Domesday Book and probably then consisted of chancel, axial tower, and nave; the chancel was probably lengthened in the 13th century and a west porch added in the 17th. The tower was rebuilt in 1673 and in 1850 the chancel, nave, and porch were pulled down and the rest of the present church built, being consecrated in January 1851.