Skip to content
This repository was archived by the owner on Nov 16, 2023. It is now read-only.
This repository was archived by the owner on Nov 16, 2023. It is now read-only.

Question regarding Occlusion-Aware Pyramid #41

Description

@BailiangJ

Hi,

I have a question regarding the Occlusion-Aware Pyramid.

In the paper, it writes

image

in the code, it is

mask0 = Upsample(4)(mask2)  
mask0 = F.sigmoid(mask0) - 0.5  
c30 = c10  
c40 = self.warp(c20, Upsample(4)(flow2)*self.scale)  
# concat image 1 with zero mask
c30 = F.concat(c30, F.zeros_like(mask0), dim=1)  
# concat warped image 2 with occlusion mask
c40 = F.concat(c40, mask0, dim=1)  

From my understanding, the occlusion mask is a probability map (where 1 stands for occlusion and 0 stands for non-occlusion), and after subtraction by 0.5, the range would be [-0.5, 0.5], and value 0, in this case, would mean "don't know whether there is occlusion or not".

Then the question is why image 1 I1 is concatenated with a zero mask instead of a -0.5 mask, or the same occlusion map as image 2 I2? Since the follow-up conv layers are shared for variables c30 and c40, shouldn't the concatenated occlusion mask have the same meaning for both I1 and I2 ?

Thanks a lot!

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions