If the US government orders the evacuation of US citizens from South Korea then yes it is probably time to be concerned about an impending strike on North Korea, however people should not read more into this visit which is routine:

Elisabeth Cordray, a U.S. deputy assistant secretary of defense, visited South Korea after North Korea’s latest nuclear test to check on preparations for evacuating U.S. citizens in the event of war, it emerged Tuesday.

The visit has sparked speculation of an impending U.S. military attack against North Korea, but the U.S. Forces Korea claimed Cordray’s visit was a “routine inspection.”

Cordray visited the 19th Expeditionary Sustainment Command, the logistic support arm of the Eighth Army, in Daegu on Sep. 13 and met its commander, John Sullivan, according to her Facebook page.

The command said Tuesday that Cordray “familiarized” herself with the process of evacuating U.S. citizens from South Korea in case of an emergency. She also discussed the readiness level of U.S. troops and was briefed on progress in relocating the main USFK military garrison in Yongsan to Pyeongtaek.  [Chosun Ilbo via reader tip]

You can read more at the link, but it seems to me that Ms. Cordray would be negligent in her duties if she did not get better familiarized with the evacuation process in South Korea if needed.