Researchers from Skoltech and the AIRI have developed a new algorithm for optimal data transfer between domains using neural networks

Since the emergence of large-scale OT and Wasserstein GANs, machine learning has increasingly embraced using neural networks to solve optimum transport (OT) issues. The OT plan has recently been shown to be usable as a generative model with comparable performance in real tasks. The OT cost is often calculated and used as the loss function to update the generator in generative models.

The Artificial Intelligence Research Institute (AIRI) and Skoltech have collaborated on a novel algorithm for optimizing information sharing across disciplines using neural networks. The theoretical underpinnings of the algorithm make its output more easily understood than competing methods. Unlike other approaches that need coupled training datasets like input-output examples, the novel approach may be trained on separate datasets from the input and output domains.

Large training datasets are difficult to come by, yet they are necessary for modern machine learning models built for applications like face or speech recognition and medical picture analysis. This is why scientists and engineers often resort to simulating real-world data sets through artificial means. Recent advances in generative models have made this job much easier by dramatically improving the quality of generated text and images.

A neural network is taught to generalize and extend from paired training samples and input-output picture sets to new incoming images; this is useful for jobs where many identical photos of varying quality must be processed. In other words, generative models facilitate the transition from one domain to another by synthesizing data from different data. A neural network may, for instance, convert a hand-drawn drawing into a digital image or improve the clarity of a satellite photo.

Aligning probability distributions with deterministic and stochastic transport maps is a unique use of the technology, which is a general tool. The method will enhance existing models in domains other than unpaired translation (picture restoration, domain adaptability, etc.). The approach allows for more control over the level of variety in produced samples and improved interpretability of the learned map compared to common methods based on GANs or diffusion models. The OT maps researchers acquire might need to be revised for unpaired activities. Researchers highlight transportation cost design for certain tasks as a potential study area.

The optimum transport and generative learning intersection lies at the heart of the chosen approach. The fields of entertainment, design, computer graphics, rendering, etc., extensively use generative models and efficient transport. Several issues in the aforementioned sectors may be amenable to the approach. The possible downside is that some professions in the graphics business may be affected by the use of the previous tools, which allow making image processing technologies publically available.

Researchers often have to make do with unrelated data sets rather than the ideal matched data because of its prohibitive cost or difficulty of acquisition. The team returned to the writings of Soviet mathematician and economist Leonid Kantorovich, drawing on his ideas on efficient cargo transportation (the optimal transport theory) to develop a novel method for planning optimal data transfer between domains. Neural Optimal transport is a novel approach that uses deep neural networks and separate datasets.

When evaluated on unpaired domain transfer, the algorithm achieves better results than the state-of-the-art approaches in picture styling and other tasks. Furthermore, it requires fewer hyperparameters, which are typically difficult to adjust, has a more interpretable result, and is based on a sound mathematical basis than competing methods.

Check out the Paper and Github. All Credit For This Research Goes To the Researchers on This Project. Also, don’t forget to join our 18k+ ML SubReddit, Discord Channel, and Email Newsletter, where we share the latest AI research news, cool AI projects, and more.