Opposition is growing to the Defense Department's transfer of nearly $1.7 billion to fund the U.S.-Mexico border wall.