Prayer with sinners is approved. Eating their sacrifices to strange gods isn’t.
Yes, your position is biblically supportable, if by “with” you mean “with them in the same aggregation of people at the moment.”