The people who most closely identified with President Obama are the ones shaken most by his foreign policy failures