“We will not accept a long-term proposition where they continue to hold Americans in an unjust and unlawful manner.”