Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [research]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
21 views

Research in Machine Learning in the era of transformers

I'm a master's student in Machine Learning. I'm interested in pursuing research in the field, but I'm concerned about the recent advancements like ChatGPT, CLIP, and DiNO that require massive compute ...
brahim benelghali's user avatar
0 votes
0 answers
14 views

Recently Related Theories

recently Related theories for factors affecting students academic achievement in mathematics
Waniya Wanu's user avatar
0 votes
0 answers
29 views

Can one have good understanding on a method without having direct experience with it?

This question is in line of these previous questions on other sites: Is it possible to conduct scientific research without actually getting close to the sample/specimen? in Biology SE Is it possible ...
Ooker's user avatar
  • 123
0 votes
0 answers
18 views

How to use two independent datasets in machine learning phd research work?

In order to develop an academic performance prediction model for a local Higher Ed Institution, I have collected the OULAD open dataset and the local Institution's dataset which I structured into the ...
AnilPHD's user avatar
1 vote
0 answers
34 views

ML paper reproducibility

How can I reproduce results in an ML paper if I don't have the identical resources to train the models as in the paper ? (in my case I only have a laptop spec NVidia gpu and in most of the papers I ...
okm02's user avatar
  • 11
7 votes
3 answers
9k views

Why does everyone use BERT in research instead of LLAMA or GPT or PaLM, etc?

It could be that I'm misunderstanding the problems space and the iterations of LLAMA, GPT, and PaLM are all based on BERT like many language models are, but every time I see a new paper in improving ...
Ethan's user avatar
  • 173
0 votes
0 answers
17 views

Are there any publications that deal with decreasing value of data as time decreases toward an event?

I'm looking for research related to the value of data volume as time decreases approaching an event. For example, large data sets are needed to understand changes in geological and meteorological ...
Matt E.'s user avatar
1 vote
1 answer
31 views

Which statistical technique should I use for a within-person repeated measures study?

I have collected all my data for a study and need to run my analysis but have come unstuck (I should have planned better beforehand I know). I'm looking to see whether personality traits (five trait ...
Jay's user avatar
  • 11
1 vote
0 answers
25 views

Influence functions on neural networks: Help with understanding of result and derivation

I'm working through a paper titled "Understanding Black-box Predictions via Influence Functions" where they introduce the notion of influence functions from robust statistics to approximate ...
rasgaard's user avatar
0 votes
2 answers
68 views

Where can I find the applied data science research papers?

I'm trying to find conferences that have applied data science papers published. I'm only interested in top ranked conferences. And I notice quite a number of them are quite theoretical, e.g. IJAI, ...
Student's user avatar
  • 411
0 votes
2 answers
52 views

The ideal function in R for fit fitting n LASSO Regressions on n data sets

As part of a statistical learning research paper I am collaborating on, I am running/fitting two hundred sixty thousand different LASSO Regressions on the same number of different randomly generated ...
Marlen's user avatar
  • 167
4 votes
1 answer
51 views

Resources for Promotion/Demotion Strategies for ML Item Recommendation Systems?

We are looking to design a system where specific items or categories of items can be boosted/promoted up or relegated/demoted down the recommendation order. What are the common strategies or standards ...
JPTheEngineer's user avatar
0 votes
1 answer
28 views

Which specific AWS service to use for running Benchmark Regressions on datasets far too large to run locally on my laptop [closed]

I am in the middle of a research project with a collaborator in which he has proposed a novel statistical learning processor for optimal variable selection, and I am running the 3 Benchmark Variable ...
Marlen's user avatar
  • 167
2 votes
1 answer
101 views

Would adding Elastic Net as an additional Benchmark add any value when LASSO is already an included benchmark?

I am currently engaged in a research project with a collaborator in which he is proposing a novel learning algorithm for optimal variable selection, and exploring its computational, statistical, and ...
Marlen's user avatar
  • 167
1 vote
1 answer
54 views

A good 4th Benchmark method to compare the performance of a novel Variable Selection Algorithm being evaluated

I am collaborating on a research project with a respected econometrician as a graduate student (although only in an MS program, not PhD program mind you) exploring the properties and comparing the ...
Marlen's user avatar
  • 167
0 votes
1 answer
25 views

A simple way to store the factors selected by (BE) Stepwise Regression n run on N datasets via lapply, a For Loop then an lapply, or a function?

I am currently doing research with a coauthor and collaborator comparing a new optimal model selection procedure he has proposed via Monte Carlo Simulation of the new procedure vs 2 benchmarks, LASSO &...
Marlen's user avatar
  • 167
0 votes
1 answer
134 views

How to run a regression in R on multiple different csv data files within the same folder

I am trying to run a LASSO Regression via the enet function (from the elasticnet library) in R on each and every one of a large number of individual csv file formatted datasets all within the same ...
Marlen's user avatar
  • 167
0 votes
1 answer
30 views

Data Mining of unresearched data for a master's degree final project

So, I have to start thinking about the topic of my final project in a data science master's degree (business oriented, although I can choose any unrelated field) and one of the requirements is to ...
Miguel Cerdá Escobar's user avatar
2 votes
1 answer
323 views

How do researchers actually code novel architectures and layers?

Disclaimer: I am almost a complete novice when it comes to tensorflow, keras, coding in general, and neural networks/data science. While reading papers on novel architectures for neural nets, I see ...
Neelix's user avatar
  • 23
4 votes
1 answer
488 views

Zero-shot learning for tabular data?

Can anyone point me to methods for zero-shot learning on tabular data? There is some very cool work being done for zero-shot learning on images and text, but I'm struggling to find work being done to ...
tensormoby's user avatar
1 vote
0 answers
50 views

Machine learning frameworks for tree-based models

Background: Its well known that Pytorch and TensorFlow are currently the most used frameworks for Deep Learning (DL) research. As far as I know, most researchers (applied or theoretical) that ...
Enk9456's user avatar
  • 105
1 vote
0 answers
22 views

Dataset for IoT activities [closed]

First of all, I am not sure whether this is the correct Stackexchange site for this question. If not, please let me know :) My question: I am looking for a dataset pertaining to IoT activities. ...
Nht_e0's user avatar
  • 21
1 vote
2 answers
121 views

For a student who is a beginner in quantitative research and statistics, which is the better statistical tool to start: R or IBM SPSS? Why? [closed]

Currently, I am writing my research design. However, I am still indecisive on what statistical tool should I use for the data analysis. I tried looking up on the internet and there are disparate ...
Aidre Cabrera's user avatar
1 vote
0 answers
280 views

What does the term "seed lexicon" means?

I am reading a research paper (NLP) and found the phrase "seed lexicon". Could someone please explain it in detail? Edit : A sample paper Leveraging Affective Bidirectional Transformers for ...
ahmedshahriar's user avatar
1 vote
0 answers
35 views

Should I reshuffle the training set when benchmarking neural networks?

I'm trying to set up a fair benchmarking between various RNN models, where each of them is trained until convergence with a fixed random seed. Because the task is very costly, I am only able to run ...
Minh Khôi's user avatar
1 vote
1 answer
34 views

Developing a deep learning hybrid architecture for a particular problem is a highly complicated task [closed]

I am currently conducting research on application of deep learning (sensor signal recognition). I spent about a year and a half sifting through the literature and discovered some research patterns. To ...
Ahmad's user avatar
  • 148
1 vote
0 answers
34 views

[Guidance Needed]Research in data science [closed]

IMAGINE You're a research intern and you're an undergraduate student. Have some experience in data science and now new to research. Your task is to conduct research on vision transformers. Oh and by ...
Dagad's user avatar
  • 21
0 votes
2 answers
39 views

Spectral Networks and Deep Locally Connected Networks on Graphs

I’m reading the paper Spectral Networks and Deep Locally Connected Networks on Graphs and I’m having a hard time understanding the notation shown in the picture below (the scribbles are mine): ...
An Ignorant Wanderer's user avatar
3 votes
1 answer
234 views

How to determine the abnormality of a specific variable by taking into account all the other variables in the data?

I have an issue of machine learning/anomaly detection. Indeed, I have a variable Y and several other variables X. The purpose is to quantify the degree of abnormality of the data on Y but I have to ...
AdrienC's user avatar
  • 31
1 vote
0 answers
50 views

Custom Loss Function Equation

I am trying to reproduce a research paper, where it is a classification problem, and they have introduced a custom loss function that I am unable to understand. Now I think I have to implement the ...
Ahmad Anis's user avatar
1 vote
1 answer
28 views

How to conclude the generality of any classification methods?

Suppose a classification task A, and there exist a lot of methods $M_1, M_2, M_3$. The task $A$ is measured by a consistent measure. For instance, the task A can be a binary classification. In this ...
mallea's user avatar
  • 133
0 votes
2 answers
58 views

Actual problems in Data Science/Machine Learning connected with music [closed]

I'm on my $4^{th}$ year now and searching for a theme for my diploma in mathematics & computer science specialization. Is there are interesting problems or fields for researches that i can explore?...
taciturno's user avatar
  • 137
0 votes
1 answer
133 views

How do we know a neural network test accuracy is good enough when results vary with different runs?

In every paper I read about prediction models, the training accuracy and the test accuracy (sometimes also the validation accuracy) is stated as a discrete number. However, in experience, depending on ...
Daniel's user avatar
  • 181
0 votes
0 answers
105 views

What is the time complexity of learning/testing phase neural network?

What is the time complexity of feed-forward neural networks? I didn't find a book or a reliable source that's talks about this. This link provides one version by breaking the structure of a simple ...
U. User's user avatar
  • 257
0 votes
1 answer
66 views

Will the job of Data Science is going to be at risk? [closed]

Data Science is the sexiest job of 21st Century according to the different sources with a high payment salary . But it seems that there will be over production of this profession . According to U.S. ...
Mark ellon's user avatar
1 vote
2 answers
322 views

In "Attention Is All You Need", why are the FFNs in (2) the same as two convolutions with kernel size 1?

In addition, why do we need a FFN in each layer when we already have attention? Here's a screenshot of the relevant section from Vaswani et al. (2017):
redhoteggplant's user avatar
1 vote
1 answer
711 views

Is there a reference data set for ridge regression?

In order to test an algorithm, I am looking for a reference data set for ridge regression in research papers. Kind of like the equivalent of MNIST but for regression.
Marie's user avatar
  • 23
3 votes
1 answer
240 views

Need an advice on research topic [closed]

I am about to choose ML research topic for my master thesis, but i am at a dead end. The problem is, that while reading research papers, i find solutions, but not an open problems. For now, a came up ...
Дмитрий's user avatar
0 votes
1 answer
29 views

Previous work Replication and Research ethics Ask Question

I am very much concerned about biding by research ethics in my work, especially issues to do with plagiarism. I come across a recent research paper in my field of study that applies state-of-the-art ...
arilwan's user avatar
  • 123
1 vote
0 answers
56 views

Where can I find datasets suitable for an undergraduate research project? [closed]

I have tried Kaggle but couldn’t find anything suitable. Basically I want to do a machine learning or deep learning project. Ideally it would have something to do with computer forensics or security. ...
wild card's user avatar
1 vote
0 answers
190 views

Transitioning from Math PhD to ML research [closed]

I am currently a Math PhD about to defend in January. I work in a field in functional analysis that uses a lot of measure theory (but no stats). I have been considering transitioning careers since I ...
Merry's user avatar
  • 139
1 vote
1 answer
128 views

T-DBSCAN - Implementing STOP logic

I am attempting to implement the T-DBSCAN algorithm described in T-DBSCAN: A Spatiotemporal Density Clustering for GPS Trajectory Segmentation. I have been able to implement most of the logic between ...
DFenstermacher's user avatar
4 votes
5 answers
450 views

Classification training using probabilites and not raw classes (factors)

I have a problem where instead of having classes, i.e. a vector of 0s and 1s, I have the probability of an observation belonging to a class. A vector with 0.1, 0.95, 0.2, 0.3, etc. The obvious ...
wacax's user avatar
  • 3,400
1 vote
2 answers
112 views

Testable hypotheses construction; minimum predictive strength vs. significance

Is this null hypothesis TESTABLE? Research Question: "Can a predictive model utilizing logistic regression be built which predicts at least one customer will churn in 90 days, and this individual ...
user avatar
1 vote
1 answer
354 views

Site for implementing a research papers without code

Before a couple of months, I found a web page for implementing papers which are published without code. Someone posts a paper on it and then community competes to implement that paper. But I don't ...
Antonio Jurić's user avatar
1 vote
1 answer
357 views

Mapping between original feature space and an interpretable feature space

I'm reading the following really interesting paper https://arxiv.org/pdf/1602.04938.pdf on local interpretable model explanations on page 3 however particularly section 3.3 Sampling for Local ...
iaaml's user avatar
  • 11
3 votes
1 answer
63 views

How can there be more true positive than positive?

Currently reading Learning from Little: Comparison of Classifiers Given Little Training In 3 Experiment Results, the following graph is shared: The experiment is described as follow We begin by ...
Adrien Lemaire's user avatar
0 votes
1 answer
23 views

Will data science develop into a separate academic field? [closed]

Right now data science is often regarded as an interdisciplinary subfield of statistics and computer science. What would it take for data science to develop into a separate academic field (with its ...
Bayequentist's user avatar
1 vote
0 answers
424 views

Performance of UNet on low resolution images

I read the U-Net paper yesterday and it talked mostly about how it uses a small dataset (<100) of high-resolution images and performs efficiently. I was wondering how it might perform on larger ...
Aakash Choubey's user avatar
3 votes
2 answers
139 views

What is the loss function defined by Mnih and Hinton in their paper “Learning to Label Aerial Images from Noisy Data”?

In section 3.3 of the paper, they state that they use the cross entropy. Then they define the probability for a label to be a false positive as $\theta_0$ and a false negative as $\theta_1$. They use ...
Borbag's user avatar
  • 141