By the dictionary definition of ‘refugee’, you are correct.
By the fact of living in a area for refugees since birth, they got to be considered as refugees and have been so treated since birth.
bkmk