He was found drifting on a roof is believed to have survived for 3 weeks after being washed away by the deadly tsunami triggered by last month's quake.
Coast Guard members say it took them several hours to catch the dog and bring him to safety.
He was wearing a collar so rescuers are now trying to find his owner.