It's not provocative if you just do it and would be considered routine.
I think what they're really saying is that it will be US AWACS while US aircraft are helping train the Poles and flying CAP further north.
In my opinion, we are doing this solely for Poland and NATO, not for Ukraine. Poland is worried and invoked the NATO treaty. We’re reminding Russia that Poland is “[NATO] alliance territory” (which it certainly is). The Ukrainians will need to take care of themselves, I don’t see us coming to their aid anytime soon.