The couple was somehow able to get pass security for Tuesday's dinner honoring the Indian Prime Minister.
The Secret Service is now moving closer to beginning a criminal investigation.
The pair is described as polo-playing socialites from Northern Virginia.
A Washington post columnist recognized the couple and helped break the story.
As for the breach in security, the White House released this statement Friday saying: "The United States Secret Service said they made a mistake and they are taking action to identify exactly what happened and they will take the appropriate measures pending the results of their investigation. "