Hi @amnj86,
You did not mention which Yocto version you are building.
For reference, you could try Raspberry Pi 4 Model B - #2.
Furthermore, when I list the files in the rootfs, everything is owned by uid 1000, including
This is very strange and could explain the problems you are having.
Do you post-process the rootfs image after the Yocto build in any way?