Questions tagged [hpc]

HPC stands for High Performance Computing, typically a cluster of supercomputers.

Filter by
Sorted by
Tagged with
0 votes
1 answer
446 views

Running Model on both GPUs and CPUs

I have access to a hpc node, of 3 GPU and maximum of 38 CPU. I have a transformer model which I run of a single GPU at the moment, I want to utilize all the GPUs and CPUs. I have seen couple of ...
Fhunmie's user avatar
  • 17
0 votes
0 answers
19 views

find speedup for different number of processes

I am new to data science I need to create code to find speedup compared with the number of processes while using a k-nearest neighbor. which (k=1,2,3,4,5,6,7). this process should be after downloading ...
Salman Al-haddad's user avatar
4 votes
2 answers
2k views

Does spaCy support multiple GPUs?

I was wondering if spaCy supports multi-GPU via mpi4py? I am currently using spaCy's nlp.pipe for Named Entity Recognition on a high-performance-computing cluster ...
Jinhua Wang's user avatar
1 vote
0 answers
66 views

Monitor Model Training Progress over HPC Clusters

As a part of my research in Deep Learning, I have to frequently train models which require a lot of computing power. As such, I use my university's HPC environment to submit my jobs and to train my ...
Adhish Thite's user avatar
0 votes
1 answer
91 views

How do I determine the best statistical way for data transformation for standardization (like log, sq root) to remove bias between different datasets?

I'm currently working on applying data science to High Performance Computing cluster, by analyzing the log files generated and trying to see if there is a pattern that leads to a system failure(...
Kraamed's user avatar
  • 13