Scenekit using uiview as material texture breaks with autolayout

Question

Using a UIlabel as a diffuse texture works great in Scenekit but when I rotate the device it breaks and the materials go blank. I've tried also adding the labels to a view offscreen but unfortunately the problem persists. Is there a way around that other than unloading the views and reloading them back into every material every time the orientation changes?