Questions tagged [research]
The research tag has no usage guidance.
70
questions
2
votes
2
answers
1k
views
Why does everyone use BERT in research instead of LLAMA or GPT or PaLM, etc?
It could be that I'm misunderstanding the problems space and the iterations of LLAMA, GPT, and PaLM are all based on BERT like many language models are, but every time I see a new paper in improving ...
- 123
0
votes
0
answers
16
views
Are there any publications that deal with decreasing value of data as time decreases toward an event?
I'm looking for research related to the value of data volume as time decreases approaching an event.
For example, large data sets are needed to understand changes in geological and meteorological ...
- 1
1
vote
1
answer
28
views
Which statistical technique should I use for a within-person repeated measures study?
I have collected all my data for a study and need to run my analysis but have come unstuck (I should have planned better beforehand I know).
I'm looking to see whether personality traits (five trait ...
- 11
1
vote
0
answers
21
views
Influence functions on neural networks: Help with understanding of result and derivation
I'm working through a paper titled "Understanding Black-box Predictions via Influence Functions" where they introduce the notion of influence functions from robust statistics to approximate ...
- 11
0
votes
2
answers
45
views
Where can I find the applied data science research papers?
I'm trying to find conferences that have applied data science papers published. I'm only interested in top ranked conferences. And I notice quite a number of them are quite theoretical, e.g. IJAI, ...
- 419
0
votes
0
answers
30
views
CTC loss Expected input_lengths to have value at most 144, but got value 174
Can someone help me with CTC loss. I wrote a conformer model for ASR and to train encoder I need CTC loss. But when I train model I got error "Expected input_lengths to have value at most 144, ...
- 1
0
votes
0
answers
11
views
Terminology question - closed-form QA graph networks
I'm trying to find graph network research on closed-form sequential question answering, but whenever I include 'question-answering' I of course see cutting edge research into free-form conversational, ...
- 111
0
votes
0
answers
11
views
Which F-metric to use in scientific paper?
Often, academic papers refer to F1-score, but don't explain which one they use (macro, micro, weighted). What is the common F-metric in academia?
- 101
0
votes
2
answers
49
views
The ideal function in R for fit fitting n LASSO Regressions on n data sets
As part of a statistical learning research paper I am collaborating on, I am running/fitting two hundred sixty thousand different LASSO Regressions on the same number of different randomly generated ...
- 157
4
votes
1
answer
43
views
Resources for Promotion/Demotion Strategies for ML Item Recommendation Systems?
We are looking to design a system where specific items or categories of items can be boosted/promoted up or relegated/demoted down the recommendation order.
What are the common strategies or standards ...
0
votes
0
answers
11
views
Assigning Final Scores to Identified Technologies: Considering Users' Reputation, badge counts, post scores, no.of posts, & post date
I am trying to determine the importance of various factors in assigning a score for identified technologies using the user's StackOverflow post tags and content.
The considering factors are users' ...
- 103
0
votes
1
answer
26
views
Which specific AWS service to use for running Benchmark Regressions on datasets far too large to run locally on my laptop [closed]
I am in the middle of a research project with a collaborator in which he has proposed a novel statistical learning processor for optimal variable selection, and I am running the 3 Benchmark Variable ...
- 157
2
votes
1
answer
97
views
Would adding Elastic Net as an additional Benchmark add any value when LASSO is already an included benchmark?
I am currently engaged in a research project with a collaborator in which he is proposing a novel learning algorithm for optimal variable selection, and exploring its computational, statistical, and ...
- 157
0
votes
0
answers
34
views
Mathematics for Machine Learning by A. Aldo Faisal is too abstract for machine learning?
I'm currently studying mathematics to jump into machine learning courses, and I'm taking the mathematics for machine learning specialization on Coursera while simultaneously reading the mentioned book....
1
vote
1
answer
44
views
A good 4th Benchmark method to compare the performance of a novel Variable Selection Algorithm being evaluated
I am collaborating on a research project with a respected econometrician as a graduate student (although only in an MS program, not PhD program mind you) exploring the properties and comparing the ...
- 157
0
votes
0
answers
32
views
SGD for Graph Neural Networks
I was going through some research papers about Graph Neural Networks; what struck me is that very often SGD is used as optimiser (as in PointGNN, DGCNN and Graphsage).
I figured that for "regular&...
- 11
0
votes
1
answer
22
views
A simple way to store the factors selected by (BE) Stepwise Regression n run on N datasets via lapply, a For Loop then an lapply, or a function?
I am currently doing research with a coauthor and collaborator comparing a new optimal model selection procedure he has proposed via Monte Carlo Simulation of the new procedure vs 2 benchmarks, LASSO &...
- 157
0
votes
1
answer
78
views
How to run a regression in R on multiple different csv data files within the same folder
I am trying to run a LASSO Regression via the enet function (from the elasticnet library) in R on each and every one of a large number of individual csv file formatted datasets all within the same ...
- 157
0
votes
1
answer
29
views
Data Mining of unresearched data for a master's degree final project
So, I have to start thinking about the topic of my final project in a data science master's degree (business oriented, although I can choose any unrelated field) and one of the requirements is to ...
2
votes
1
answer
320
views
How do researchers actually code novel architectures and layers?
Disclaimer: I am almost a complete novice when it comes to tensorflow, keras, coding in general, and neural networks/data science.
While reading papers on novel architectures for neural nets, I see ...
- 23
3
votes
1
answer
276
views
Zero-shot learning for tabular data?
Can anyone point me to methods for zero-shot learning on tabular data? There is some very cool work being done for zero-shot learning on images and text, but I'm struggling to find work being done to ...
- 63
1
vote
0
answers
36
views
Machine learning frameworks for tree-based models
Background: Its well known that Pytorch and TensorFlow are currently the most used frameworks for Deep Learning (DL) research. As far as I know, most researchers (applied or theoretical) that ...
- 83
1
vote
0
answers
20
views
Dataset for IoT activities [closed]
First of all, I am not sure whether this is the correct Stackexchange site for this question. If not, please let me know :)
My question: I am looking for a dataset pertaining to IoT activities. ...
- 21
1
vote
2
answers
72
views
For a student who is a beginner in quantitative research and statistics, which is the better statistical tool to start: R or IBM SPSS? Why? [closed]
Currently, I am writing my research design. However, I am still indecisive on what statistical tool should I use for the data analysis. I tried looking up on the internet and there are disparate ...
0
votes
0
answers
220
views
What does the term "seed lexicon" means?
I am reading a research paper (NLP) and found the phrase "seed lexicon".
Could someone please explain it in detail?
Edit :
A sample paper
Leveraging Affective Bidirectional Transformers for ...
- 101
1
vote
0
answers
32
views
Should I reshuffle the training set when benchmarking neural networks?
I'm trying to set up a fair benchmarking between various RNN models, where each of them is trained until convergence with a fixed random seed. Because the task is very costly, I am only able to run ...
- 111
1
vote
1
answer
31
views
Developing a deep learning hybrid architecture for a particular problem is a highly complicated task [closed]
I am currently conducting research on application of deep learning (sensor signal recognition). I spent about a year and a half sifting through the literature and discovered some research patterns. To ...
- 138
1
vote
0
answers
34
views
[Guidance Needed]Research in data science [closed]
IMAGINE
You're a research intern and you're an undergraduate student. Have
some experience in data science and now new to research.
Your task is to conduct research on vision transformers. Oh and by
...
- 21
0
votes
2
answers
29
views
Spectral Networks and Deep Locally Connected Networks on Graphs
I’m reading the paper Spectral Networks and Deep Locally Connected Networks on Graphs and I’m having a hard time understanding the notation shown in the picture below (the scribbles are mine):
...
3
votes
1
answer
160
views
How to determine the abnormality of a specific variable by taking into account all the other variables in the data?
I have an issue of machine learning/anomaly detection. Indeed, I have a variable Y and several other variables X. The purpose is to quantify the degree of abnormality of the data on Y but I have to ...
- 31
1
vote
0
answers
48
views
Custom Loss Function Equation
I am trying to reproduce a research paper, where it is a classification problem, and they have introduced a custom loss function that I am unable to understand.
Now I think I have to implement the ...
- 121
1
vote
1
answer
26
views
How to conclude the generality of any classification methods?
Suppose a classification task A, and there exist a lot of methods $M_1, M_2, M_3$.
The task $A$ is measured by a consistent measure.
For instance, the task A can be a binary classification. In this ...
- 133
0
votes
2
answers
57
views
Actual problems in Data Science/Machine Learning connected with music [closed]
I'm on my $4^{th}$ year now and searching for a theme for my diploma in mathematics & computer science specialization.
Is there are interesting problems or fields for researches that i can explore?...
- 137
0
votes
1
answer
121
views
How do we know a neural network test accuracy is good enough when results vary with different runs?
In every paper I read about prediction models, the training accuracy and the test accuracy (sometimes also the validation accuracy) is stated as a discrete number. However, in experience, depending on ...
- 181
0
votes
0
answers
101
views
What is the time complexity of learning/testing phase neural network?
What is the time complexity of feed-forward neural networks? I didn't find a book or a reliable source that's talks about this. This link provides one version by breaking the structure of a simple ...
- 257
0
votes
1
answer
64
views
Will the job of Data Science is going to be at risk? [closed]
Data Science is the sexiest job of 21st Century according to the different sources with a high payment salary . But it seems that there will be over production of this profession . According to U.S. ...
- 147
1
vote
2
answers
209
views
In "Attention Is All You Need", why are the FFNs in (2) the same as two convolutions with kernel size 1?
In addition, why do we need a FFN in each layer when we already have attention?
Here's a screenshot of the relevant section from Vaswani et al. (2017):
1
vote
1
answer
553
views
Is there a reference data set for ridge regression?
In order to test an algorithm, I am looking for a reference data set for ridge regression in research papers. Kind of like the equivalent of MNIST but for regression.
- 23
3
votes
1
answer
234
views
Need an advice on research topic [closed]
I am about to choose ML research topic for my master thesis, but i am at a dead end. The problem is, that while reading research papers, i find solutions, but not an open problems.
For now, a came up ...
- 45
0
votes
1
answer
27
views
Previous work Replication and Research ethics Ask Question
I am very much concerned about biding by research ethics in my work, especially issues to do with plagiarism. I come across a recent research paper in my field of study that applies state-of-the-art ...
- 123
1
vote
0
answers
54
views
Where can I find datasets suitable for an undergraduate research project? [closed]
I have tried Kaggle but couldn’t find anything suitable. Basically I want to do a machine learning or deep learning project. Ideally it would have something to do with computer forensics or security. ...
- 11
1
vote
0
answers
158
views
Transitioning from Math PhD to ML research [closed]
I am currently a Math PhD about to defend in January. I work in a field in functional analysis that uses a lot of measure theory (but no stats).
I have been considering transitioning careers since I ...
- 139
1
vote
1
answer
122
views
T-DBSCAN - Implementing STOP logic
I am attempting to implement the T-DBSCAN algorithm described in T-DBSCAN: A Spatiotemporal Density Clustering for GPS Trajectory Segmentation. I have been able to implement most of the logic between ...
- 113
4
votes
5
answers
427
views
Classification training using probabilites and not raw classes (factors)
I have a problem where instead of having classes, i.e. a vector of 0s and 1s, I have the probability of an observation belonging to a class.
A vector with 0.1, 0.95, 0.2, 0.3, etc.
The obvious ...
- 3,370
1
vote
2
answers
111
views
Testable hypotheses construction; minimum predictive strength vs. significance
Is this null hypothesis TESTABLE?
Research Question: "Can a predictive model utilizing logistic regression be built which predicts at least one customer will churn in 90 days, and this individual ...
user79134
1
vote
1
answer
347
views
Site for implementing a research papers without code
Before a couple of months, I found a web page for implementing papers which are published without code. Someone posts a paper on it and then community competes to implement that paper.
But I don't ...
- 1,039
1
vote
1
answer
304
views
Mapping between original feature space and an interpretable feature space
I'm reading the following really interesting paper
https://arxiv.org/pdf/1602.04938.pdf on local interpretable model explanations
on page 3 however particularly section 3.3 Sampling for Local ...
- 11
3
votes
1
answer
58
views
How can there be more true positive than positive?
Currently reading Learning from Little: Comparison of Classifiers Given Little Training
In 3 Experiment Results, the following graph is shared:
The experiment is described as follow
We begin by ...
- 161
0
votes
1
answer
23
views
Will data science develop into a separate academic field? [closed]
Right now data science is often regarded as an interdisciplinary subfield of statistics and computer science. What would it take for data science to develop into a separate academic field (with its ...
- 123
1
vote
0
answers
414
views
Performance of UNet on low resolution images
I read the U-Net paper yesterday and it talked mostly about how it uses a small dataset (<100) of high-resolution images and performs efficiently.
I was wondering how it might perform on larger ...
- 111