Church members were seen cleaning up the damage at the Visalia Lahu Baptist Church after police say 35-year-old Khamvone Phaphon broke several windows and then set some of the blinds on fire.
Firefighters quickly responded and put out the flames.
Church members say the suspect was upset over a recent custody ruling. Police believe he was trying to retaliate against his estranged wife and her family.
The suspect is now facing charges for attempted arson and vandalism.