On Friday morning, 35-year-old Jose Hernandez was taken into custody at St. John's Cathedral on Mariposa Street.
He was not supposed to go near the church after being arrested last month.
That's when he admitted to throwing prayer candles at religious statues and sacred stained-glass windows.
On Friday, Hernandez told police he returned to the church to attend mass.
He was removed from the property by police because of a restraining order.