Los Angeles County sheriff's Lt. Dave Coleman said Monday that most residents in the rural communities of Lake Hughes and Elizabeth Lake north of Los Angeles could return to their homes as of 4 p.m. Monday.
One small area remains under a mandatory evacuation order.
The more than 46-square-mile Powerhouse Fire forced 2,800 people from 700 homes on Saturday.
The fire started Thursday and has destroyed at least six homes and damaged 15 others.
The fire is 40 percent contained.
Firefighters have been aided by lower temperatures and cooler, moist air.
The Associated Press contributed to this report.