Grace Chapel was the first Anglican Church on the East Bank, built by Reverend Rodolph von Hube in 1859 to serve the German community. When he left, focus was shifted to St Peter's on the West Bank. However, when the railway line was constructed in 1859 on the East Bank both churches were suddenly too small and so St John's Church was built.