Tasos Katopodis/Getty Images

White House coronavirus task force member Dr. Ben Carson says the U.S. government can reopen the country in 3 weeks and the U.S. "can't operate out of hysteria."

Carson says that 98 percent of all coronavirus cases will recover.

The coronavirus that causes COVID-19 is now the leading cause of death for Americans. But Carson said there will be more death "if we destroy the economic infrastructure of this country."

He said the country may not recover economically if America does not open back up for business.

Despite this, the HUD Secretary said the country can't reopen too early.

"Obviously, we don't want to [resume economic activity] too early. We will wait for a couple of weeks and see if [the curve] continues down and then we also need to make sure that we have appropriate testing."

Carson suggested that the government's response to the virus has been extreme.

He also said that not enough attention was being given to the "number of people who have recovered" and that "98 percent" could expect to come through the virus.

"You probably do know someone that has it, you may have it, who knows?" Carson told Fox News host Martha MacCallum on Thursday. "But people have been terrified because we've talked about the bad."

"We can't operate out of hysteria," Carson said. "When people are hysterical, they don't do logical things."