1
$\begingroup$

This is a question I come across a lot in interviews but I don't understand how and what the answer is:-

If we have a neural net, and we double the neurons in it, how does the time taken for backpropagation change? does it increase by

  1. 2 times
  2. 4 times
  3. 8 times
  4. 16 times
$\endgroup$
1
$\begingroup$

The general idea is that time complexity is related to the number of operations needed to perform all the steps of backpropagation. You can find an example workthrough here: https://medium.com/swlh/computational-complexity-of-neural-networks-38c01e7e566a

For a 4 layer NN it seems the complexity is O(n⁵), where n is the number of nodes of each layer (also n is the same for every layer in that example).

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.