The history of the Church of the Holy Spirit of Bauska and its German congregation began when the town was moved from the peninsula by the Bauska Castle to a new place on the banks of the Memel River. The Church was completed in 1594, but the church did not yet have a tower. One was installed in 1614, and in 1623, a master craftsman from Arnstadt, Michael Ulrich, completed the tower with a cupola and a spire.