Will my viewability score of 0.0 affect the overall Quality score if I didn’t implement in-view tracking?

Yes, it will affect the overall score. If you don’t have in-view tracking, it will look like every single impression was loaded outside the viewable area.

You can disable the Viewability metric to get a more representative overall Quality Score.