In short, my right eye image felt different to the left. Somehow the overall image was off when I did the blink test between the two eyes, especially in the stereo overlap area.
I did some lens checking and found a really interesting thing:
After popping the frame in (used the included lens wiper as a protective layer), the frame looked a lot more similar and the images finally looked the same in both eyes:
The photos are not angled the best, but hopefully you can see the difference regardless.
TLDR: check lens frames for any dissimilarities, pop the protruding one right back in.