I suspect it relates to this commit in meta-tegra,
U-boot now has a dependency on the Linux kernel, and the Linux kernel will have dependency initramfs and I believe this is how it ends up in the loop. Though I still do not have a good suggestions on how to fix.
I will try to reproduce based on your instructions and see what I come up with.