During World War II, services were suspended, but directly after the war, a band room in a public school was used for services. Eventually it was decided that a chapel should be built in the area. Grace Church bought a small piece of land, one hundred feet square from the Arndt Estate.
The chapel is constructed of native field stone, partially plastered. A wooden beamed ceiling is used throughout the chapel. The floor is a special slate used all over the area and is also used in complement with the floor of the Walsingham Shrine in Grace Church. Many examples of the gothic look of this chapel can be found throughout Sheboygan County.
The Hayssen Foundation gave Grace Church about one acre of its property directly behind the chapel. On the property there is a cabin once used by hunters. Modificataions to the cabin are being made although uses for it have not been officially decided upon but may include use for meetings, retreats, picnics, and overnights for the youth. Retired Bishop Brady consecrated the property on August 7, 1994.
Liturgies are celebrated during the summer months (Memorial Day through Labor Day) at 9:00 a.m. at the chapel in the same manner as celebrated at its mother parish, Grace Church in Sheboygan. The Rector of Grace Church is the Priest of All Saints' Chapel.