Officers say the passerby spotted the man in the canal near McKinley and Chestnut.
They say the citizen pulled the man out of the water and firefighters began CPR.
The man was taken to the hospital but his condition is unknown at this time.
This story is developing.