Esper said he had directed the commander of U.S. and coalition troops in Afghanistan, "to get moving" on drawing down forces.