0
$\begingroup$

I'm working with autoencoding data in segments, and working with the latent space afterwards (I am also working on VAEs, but this segment of the project concerns deterministic AEs).

I've noticed that within the latent space, there are some neurons that don't seem to be particularly relevant to reconstruction. Here I've plotted the size of the latent space that's allocated for each segment of data against the real number of neurons it uses. I consider a neuron unused when its standard deviant is (strictly) equal to zero.

plot described above, illustrating my problem

Is there any way to remove these completely from the network? I know that tensorflow has a "pruning" library, but after reading the docs a bit I'm not convinced that it's what I need, or at least I haven't found the section that tells me what I need to do to implement this.

Improve this question
$\endgroup$

1 Answer 1

Reset to default
0
$\begingroup$

For anyone stumbling on this question, I've been digging and found some info. This paper does basically what I was looking for on VAEs, and this one is related but not directly about autoencoders.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.