1
$\begingroup$

I'm working on a project to predict the usage of all the files(rough frequency of usage) in a filesystem(a company server on which 100s of company employees are active) in near future(say the next 1 month) based on the metadata of the file system for past 6 months. I've got the following attributes about the files with me :

  1. The temporal sequence of file usage for last 6 months(whenever the file was read/written/modified and by whom).
  2. All the users who are on the server and can access the files.
  3. Last modified/written/read epoch time and by whom.
  4. File creation epoch time and by whom.
  5. Any compliance regulations on the file(whether the file contains any confidential data).
  6. Size, name, extension, version, type of the file.
  7. The number of users who can access the file.
  8. File path.
  9. The total number of times accessed.
  10. Permitted users.

Now, I plan to use LSTM but for standard LSTMs, the input is temporal sequence only. However, all the attributes that I have seem significant in predicting the future usage of the file.

  • How should I also make use of the attributes of the file that I have?
  • Should I train a Feedforward Neural Network, disregarding the fact that it usually fails on temporal sequences?
  • How should I proceed?
  • Does a variant of LSTM exist that can take into account the attributes of the file as well and predict the usage of the file in near future?
  • Do I need to use MLP and LSTM together like a hybrid?
$\endgroup$
2
$\begingroup$

Like you said, you can proceed your temporal data with a recurrent network like LSTM. I suggest you simply concatenate your other features to the output of the LSTM (with return_sequence = False). Then add some dense layers (1 could be enough) : this will output the probability of belonging to your classes.

$\endgroup$
  • $\begingroup$ Hey Adrien, can you please elaborate your suggested model for solving the problem? I couldn't comprehend, how exactly you suggested me to use deep NNs alongside LSTM ? What I have to predict is the frequency of file usage for near future(exact number of days, like for next 15 or 30 days will be decided after I run the model for first time) . If I can predict the sequence of file usage, that will be better but that is the second step. $\endgroup$ – Tushar Sinha Jun 28 '18 at 15:11

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.