The fire broke out around 2:30 p.m. in a grassy, remote area of Catheys Valley, northeast of White Rock Road.
As of Thursday morning, the fire was 60% contained.
Firefighters face challenges accessing the fire due to the terrain and weather conditions.
"So getting our resources in and getting access to this fire has been a small challenge. And then the winds with the current weather have been a driving factor," said Battalion Chief Mike Houk of CAL FIRE's Mariposa-Merced Unit.
Residents in Catheys Valley have been closely watching the fire's progress. From her workplace off Hornitos Road, Alyn Douglas could see smoke from the fire.
"It makes you nervous when they get that close cause you never know which way they're going to turn and how fast it's going to get here," Douglas said.
In addition to concerns about the fire itself, Douglas worries the shifting winds could affect the air quality.
"If the wind shifts this way, it's going to be horrible," she said.
Aerial images released by CAL FIRE showed thick plumes of smoke and the rapid spread of the fire through dry vegetation. The images also showed fire retardant dropped around the burn area as part of suppression efforts.
Aircraft have played a key role in the firefight. Earlier in the day, CAL FIRE aircraft were seen departing from and returning to the Fresno Air Attack Base to support operations on the Van Fire.
"Our air attack resources were there quickly today, especially with the C-130 coming out of the Fresno Air Attack Base," Houk said.
Douglas, who has experienced several wildfires in recent years, said she remains prepared in case conditions change and evacuation becomes necessary.
"I have my generator for when the power goes out. I've got ice chests. I've got all the stuff you need to just get in a car and go. I've got my paperwork all ready," she said.
More than 100 firefighters are assigned to the Van Fire. The cause remains under investigation.
Stay with ABC30 for the latest details on this developing story.
For news updates, follow Ana Torrea on Facebook, X and Instagram.