There are lots of ways to improve photos. Now we have beauty mode to hide dark circles and pimples. We also have options to remove red eye or lens flare, and so on. But there is another general problem that many of us usually face. Sometimes, a blink ruins a photo. It mainly causes pain in group photos when one or more people can be seen with closed eyes. But this will change soon as Facebook has found a way to replace closed eyes with open ones effectively.
Facebook’s new way ‘in-painting’ uses machine learning system called ‘Generative Adversarial Network’ that tries to itself into thinking its creations are real. His network is trained to recognize and replicate convincing open eyes.
Also see:
We already have few ways that claims to do so, but the result is not good enough for consideration. Existing ways just paste the eyes of the people without taking care of consistency. Have a look on photos below. Photos in second column use eye opening algorithm in Adobe Photoshop Elements while the photos in last column use proposed GAN.
GAN learns not just what eyes should be used but how the eyes of the person are shaped, colored, and so on. So, the results are quite realistic and you see no color mismatch o stitching.
You wouldn’t be able to identify if a photo has the fake eyes-opened or is a real one. In testing, Facebook successfully fooled people. While the painted photos may not have the exactly same eyes as the person got in real but it will not look weird.
The method is not 100% working as it falls when a person’s eye is partially covered or sometimes it falls to recreate the color correctly. But this is not a big problem and can easily be fixed.
Facebook also has an advantage of having a test data of most of the people. If you post a photo with closed eyes or someone tags you in a group photo in which your eyes are closed, Facebook already knows how your open eyes look. So, it can effectively replace your closed eyes with the open eyes without breaking the photo.
