When I change only the colors of the upper floor's backgrounk walls from white to orange, I get this.

Is it possible to see white surfaces in white color, instead the fully orange pic?
Basic setup, 1 150% spot, 1km inv2 distance, Skylight 2, 0, 0.2, 4
medium preset, hdri's saved as jpg
Any advices are welcome!