Sharpness can be increased eight times with VideoGigaGAN and with less artifacts than before.
The majority of the new features and experiments that Adobe has revealed recently include artificial intelligence. Some examples include the addition and removal of objects in Premiere Pro and the development of text-based images in Photoshop. VideoGigaGAN is an experimental artificial intelligence function that the firm has recently introduced. According to The Verge, the company claims that it can upscale video by eight times without the typical distortions such as flickering or distortion.
According to Adobe, VideoGigaGAN is superior to existing Video Super Resolution (VSR) solutions since it does not suffer from the typical artifacts and flickering that are caused by GAN (General Adversarial Networks). At the same time, it enhances sharpness and detail, which is something that the majority of other systems are unable to do simultaneously.
It goes without saying that the system is fabricating details that do not exist out of thin air; hence, this would not be suited for things like forensic video enhancement, which is similar to crime shows like CSI. However, the elements that it does add appear to be very realistic, such as the textures of the skin, the fine hairs, the intricacy of the swan feathers, and more.
A large-scale image upsampler known as GigaGAN is the foundation around which the model is built, according to the researchers within Adobe. Previous VSR models have struggled to produce results that are rich in details. In order to overcome this challenge, Adobe combined several techniques, including “temporal attention” (which reduces artifacts that accumulate over time), feature propagation (which adds detail where none exists), anti-aliasing, and something called “HF shuttle” (which shuts down high-frequency features).
The use of artificial intelligence to enhance humans is a controversial practice; but, if it were incorporated to products such as Premiere Pro or After Effects, it might make it possible for video makers to make low-resolution pictures look far better. Although there is no information available at this time regarding whether or not Adobe intends to achieve this, a number of other businesses, like NVIDIA, Microsoft, Blackmagic Design, and others, are also working on upscalers.