2
$\begingroup$

I am completely new to Artificial intelligence and Neural Networks. I am currently working on a plasma physics simulation project which requires a very high resolution data set. We currently have the results of two simulations of the same problem run at different resolutions - with one's resolution being higher than the other. However, we need an even higher resolution for us to use this data effectively. Unfortunately, it is not possible for us to run a higher resolution simulation because of computation power limitations. So instead, we are trying to somehow interpolate the data we have to get a reasonable estimate of what the simulation result might be if we were to run it at a higher resolution. I tried to interpolate the data using conventional interpolation techniques and functions in SciPy. However, the interpolated result is sometimes off by about 20 to 30 percent at certain points.

Problem Statement and my Idea

So I was wondering if it was possible to use a neural network to generate an output that when fed into the interpolator (code that I have written using SciPy), would yield better results than if I used just the interpolator. Currently, out data when plotted looks like this:

enter image description here

This is the data plotted at a certain time t. However, we have data similar to this for about 30 different times steps - so we have 30 different data sets that look similar to this but are slightly altered. And as I said before, we also have the high resolution and low resolution data sets for each of the 30 timesteps.

My idea for the ANN is as follows: The low resolution data (a 512 x 256 2-D array) can be fed into a the network to output a slightly modified 512 x 256 2-D array. We can then input this modified data set into our interpolator and see if it matches the high resolution data set (1024 x 512). The error function for the network would be a function of the difference of the high data set and the interpolated data set (maybe something like the sum of the squares of the difference of each element in the arrays). This can then be done for all 30 different data sets to minimise the difference in the high res and interpolated data sets.

If this works as planned, I would somehow use this trained ANN to the high resolution data set (1024 x 512) to feed it's output into the interpolator.

Questions

Is it possible to create a neural network that can do this, and if yes, what type of networks do this?

Even if the neural network can be trained, how do we upgrade to work for the high res data set (1024 x 512) when it was initially trained with the low res data set (512 x 256)?

Is this a trustworthy method to predict simulation results? (All 30 data sets look almost exactly like the image above; including the high res results)

If this is possible, please link a few resources so I can read about this further.

$\endgroup$

1 Answer 1

4
+25
$\begingroup$

It is possible. Creating higher resolution imaging with deep learning has been done in several fields. Medical imaging is one of the most common fields.

The general approach is called "learning-based upsampling". It is also called "resolution enhancement" or "super-resolution (SR) reconstruction" in the literature. The goal is to obtain a higher-resolution (HR) output from lower-resolution (LR) versions.

There are many options to consider including:

  • Sampling order (pre-upsampling SR vs. post-upsampling SR)
  • Loss functions (pixelwise L1 or L2 loss, content loss, adversarial loss, peak signal-to-noise ratio (PSNR)),
  • Architectures (Convolutional Neural Network (CNN), residual learning, recursive learning,Super-Resolution Generative Adversarial Network (SRGAN))

"A Review on Deep Learning Super Resolution Techniques" by Khoo et al is one place to begin.

One possible limitation is a lack of original data. You might have apply data augmentation within the bounds of the projects to synthetically increase the amount of training data or try Single Image Super-Resolution (SISR).

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.