Taboo the word "anxiety" here — you're using it to mean "environmental stressors" while the GP is using it to mean "a psychological trait of not dealing well with such stressors, due to a higher baseline feeling of stress, and/or a magnified experience of stressors."

Compare/contrast: "living in exurban Detroit is depressing" (= has many environmental depressors) vs "poets are usually depressives" (= depressive disorders being common among people who choose to become poets.)

We use different words (most of the time) for these two things when speaking of depression, but often aren't so careful with anxiety.