When Skyrim says: You can't fast travel while enemies are nearby..

vasilkov07

Source