6
$\begingroup$

I would like to build an LSTM network for text classification with PySpark, but I don't find any library or function about it.

Is it possible to implement this kind of network in Spark?

$\endgroup$
2
$\begingroup$

Apache Spark currently has no Deep Learning libraries. However, you can run TensorFlow models on clusters. According to this article "The TensorFlow library can be installed on Spark clusters as a regular Python library".

Additionally, I just found the SparkFlow module, that should be meant to interface Spark and TensorFlow. The GitHub repo is here.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.