Here is how the scene looks in live preview:
here is how it looks in the 3d view with light on
and here is how it looks in the 3d view with the light off
As you can see - it appears that the "lights off" state of the button appears to match the live preview. It should be the opposite correct?