Floating color blobs , Noisy Output in nerfstudio when using custom script in Untiy to generate nerf dataset

[shubhj-gb247]

Hi, as I am new to this please bear . I have been trying to build a project in Unity which uses ARKit Foundation and Subsystems.
Its purpose is to capture images when I tap screen. The code saves the frame and stores intrinsic and extrinsic( transform.localToWorld matrix) parameters in a json file. I build the app for iOS , capture the images and generated dataset successfully.

But on using this dataset as input to nerfstudio I get noisy , blurry output. There are random white/black colored patches .

Can someone please guide me in the right direction to fix this?

Screenshot of Unity Hierarchy:

Script for capturing frame, processing and saving transforms.json

FrameCapture.cs.zip

functions of intereset: CaptureFrame() and UnityToNerf()

Generated nerf dataset (images and transforms.json) :
https://drive.google.com/file/d/1iHUSSN1FskgHc7o-Otl3GDL1Hf-pjfy5/view?usp=sharing

Command used in nerfstudio (on Windows 11) :
ns-train nerfacto --pipeline.model.predict-normals True --data ./NeilCapture 21

Output from Nerfstudio:
https://nscloud-my.sharepoint.com/:v:/g/personal/shubham_jhiknaria_neilsoft_com/Ea1BbPvpA6JApFMMDAmFLaQBsuTQ5YXQq96mU4pAYRfDxQ?e=LKpLUU

Versions:
Unity : 2021.3.29f1
AR Foundation : 4.2.10
ARKit XR Plugin : 4.2.10
App Running on iPhone 16 with iOS 18

If someone has done something like this before kindly guide me on how to resolve this.