Data Science Stack Exchange is a question and answer site for Data science professionals, Machine Learning specialists, and those interested in learning more about the field. It only takes a minute to sign up.
Sign up to join this community
Is it possible to train a GAN model to inpaint an image taken from a specific setting(e.g. an office, woods, beach ...) after we have cropped out people of it?
For example, I used this repo's pretrained GAN model on Places2
I used a MaskRCNN model to segment people, and then cropped them out :
But when I fed the image to the mentioned GAN model, results weren't so great :
If it's possible, what is the best GAN architecture to use?
I would doubt there's a single correct answer for best available architecture, but the current best results come from this paper by NVIDIA and this technical report by Adobe. The latter paper is the second iteration of the repo you linked. Both papers focus on non-rectangular inpainting, which seems to be your targeted interest. Neither has publicly available code, however, so if you're interested in seeing what those models can accomplish you'll have to re-implement them yourself!
Edit: NVIDIA released a PyTorch implementation since the initial answer, here's the repo.
