Testing Outputs Against Ground Truth

[alexmi256]

I've extracted the left and right frames from a true stereoscopic movie and I'd like to compare the different models and settings against these.

How is this best achieved?
Are there built in utils/functions to do this? Some of the files in training seem promising and I see some eval functions.

I though I could give iw3 the left image and then just compare the original vs output right image but it doesn't seem to be as straighforward as that.

I saw that there is a --export option which outputs the depth map for the given image at the default or specified resolution but if I do this I would need to compute a depth map for the original left & right images which seems doesn't seem straightforward (most solutions rely on OpenCV and there seem to be variables for this).

I also tried outputing a Full SBS image and then overlaying it against the original and noticed differences in both left and right frames with the right frame containing a much larger differece. I would have throught the left frame would be untouched. This doesn't seem to be the case however and I can't tell if it's because of encoding/decoding or if the way the depth map is applied actually generates two new images (this would actually make a lot of sense to me).

[nagadomi]

There are two different types of stereo view synthesis:

1. synthesizing only one eye. left (0:input image) right (+2:synthetic image), or left (-2:synthetic image) right (0:input image)
2. synthesizing both eyes. left (-1:synthetic image) center (0:input image) right (+1:synthetic image)

iw3 is 2. 3d movie(post production) is 1. That is why the right eye frame is much different.
It is possible to output in method 1 with iw3, but there is currently no implementation of that method.

Also, there is an option to output various parameters for comparison. --find-param

nunif/iw3/utils.py

Line 1742 in e830a9a

def find_param(args, depth_model, side_model):

Adding the option to output in method 1 to this function should achieve it.