Union Memorial Baptist Church is located in downtown Westminster. Every first Sunday Holy Communion is observed. There is a plan by volunteers in the church to restore the Elsworth Cemetary.
The church participates in community outreach programs including the caring for a park on Center Street and a ministry at the Westminster Rehabilitation Center are at 2 p.m. every fourth Saturday.