Questions tagged [research]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2 votes
2 answers
1k views

Why does everyone use BERT in research instead of LLAMA or GPT or PaLM, etc?

It could be that I'm misunderstanding the problems space and the iterations of LLAMA, GPT, and PaLM are all based on BERT like many language models are, but every time I see a new paper in improving ...
Ethan's user avatar
  • 123
0 votes
0 answers
16 views

Are there any publications that deal with decreasing value of data as time decreases toward an event?

I'm looking for research related to the value of data volume as time decreases approaching an event. For example, large data sets are needed to understand changes in geological and meteorological ...
Matt E.'s user avatar
1 vote
1 answer
28 views

Which statistical technique should I use for a within-person repeated measures study?

I have collected all my data for a study and need to run my analysis but have come unstuck (I should have planned better beforehand I know). I'm looking to see whether personality traits (five trait ...
Jay's user avatar
  • 11
1 vote
0 answers
21 views

Influence functions on neural networks: Help with understanding of result and derivation

I'm working through a paper titled "Understanding Black-box Predictions via Influence Functions" where they introduce the notion of influence functions from robust statistics to approximate ...
rasgaard's user avatar
0 votes
2 answers
45 views

Where can I find the applied data science research papers?

I'm trying to find conferences that have applied data science papers published. I'm only interested in top ranked conferences. And I notice quite a number of them are quite theoretical, e.g. IJAI, ...
Student's user avatar
  • 419
0 votes
0 answers
30 views

CTC loss Expected input_lengths to have value at most 144, but got value 174

Can someone help me with CTC loss. I wrote a conformer model for ASR and to train encoder I need CTC loss. But when I train model I got error "Expected input_lengths to have value at most 144, ...
EZpeezy's user avatar
0 votes
0 answers
11 views

Terminology question - closed-form QA graph networks

I'm trying to find graph network research on closed-form sequential question answering, but whenever I include 'question-answering' I of course see cutting edge research into free-form conversational, ...
ML_Engine's user avatar
  • 111
0 votes
0 answers
11 views

Which F-metric to use in scientific paper?

Often, academic papers refer to F1-score, but don't explain which one they use (macro, micro, weighted). What is the common F-metric in academia?
CLRW97's user avatar
  • 101
0 votes
2 answers
49 views

The ideal function in R for fit fitting n LASSO Regressions on n data sets

As part of a statistical learning research paper I am collaborating on, I am running/fitting two hundred sixty thousand different LASSO Regressions on the same number of different randomly generated ...
Marlen's user avatar
  • 157
4 votes
1 answer
43 views

Resources for Promotion/Demotion Strategies for ML Item Recommendation Systems?

We are looking to design a system where specific items or categories of items can be boosted/promoted up or relegated/demoted down the recommendation order. What are the common strategies or standards ...
JPTheEngineer's user avatar
0 votes
0 answers
11 views

Assigning Final Scores to Identified Technologies: Considering Users' Reputation, badge counts, post scores, no.of posts, & post date

I am trying to determine the importance of various factors in assigning a score for identified technologies using the user's StackOverflow post tags and content. The considering factors are users' ...
Lakshitha Samod's user avatar
0 votes
1 answer
26 views

Which specific AWS service to use for running Benchmark Regressions on datasets far too large to run locally on my laptop [closed]

I am in the middle of a research project with a collaborator in which he has proposed a novel statistical learning processor for optimal variable selection, and I am running the 3 Benchmark Variable ...
Marlen's user avatar
  • 157
2 votes
1 answer
97 views

Would adding Elastic Net as an additional Benchmark add any value when LASSO is already an included benchmark?

I am currently engaged in a research project with a collaborator in which he is proposing a novel learning algorithm for optimal variable selection, and exploring its computational, statistical, and ...
Marlen's user avatar
  • 157
0 votes
0 answers
34 views

Mathematics for Machine Learning by A. Aldo Faisal is too abstract for machine learning?

I'm currently studying mathematics to jump into machine learning courses, and I'm taking the mathematics for machine learning specialization on Coursera while simultaneously reading the mentioned book....
student 828382's user avatar
1 vote
1 answer
44 views

A good 4th Benchmark method to compare the performance of a novel Variable Selection Algorithm being evaluated

I am collaborating on a research project with a respected econometrician as a graduate student (although only in an MS program, not PhD program mind you) exploring the properties and comparing the ...
Marlen's user avatar
  • 157
0 votes
0 answers
32 views

SGD for Graph Neural Networks

I was going through some research papers about Graph Neural Networks; what struck me is that very often SGD is used as optimiser (as in PointGNN, DGCNN and Graphsage). I figured that for "regular&...
Max Adam's user avatar
0 votes
1 answer
22 views

A simple way to store the factors selected by (BE) Stepwise Regression n run on N datasets via lapply, a For Loop then an lapply, or a function?

I am currently doing research with a coauthor and collaborator comparing a new optimal model selection procedure he has proposed via Monte Carlo Simulation of the new procedure vs 2 benchmarks, LASSO &...
Marlen's user avatar
  • 157
0 votes
1 answer
78 views

How to run a regression in R on multiple different csv data files within the same folder

I am trying to run a LASSO Regression via the enet function (from the elasticnet library) in R on each and every one of a large number of individual csv file formatted datasets all within the same ...
Marlen's user avatar
  • 157
0 votes
1 answer
29 views

Data Mining of unresearched data for a master's degree final project

So, I have to start thinking about the topic of my final project in a data science master's degree (business oriented, although I can choose any unrelated field) and one of the requirements is to ...
Miguel Cerdá Escobar's user avatar
2 votes
1 answer
320 views

How do researchers actually code novel architectures and layers?

Disclaimer: I am almost a complete novice when it comes to tensorflow, keras, coding in general, and neural networks/data science. While reading papers on novel architectures for neural nets, I see ...
Neelix's user avatar
  • 23
3 votes
1 answer
276 views

Zero-shot learning for tabular data?

Can anyone point me to methods for zero-shot learning on tabular data? There is some very cool work being done for zero-shot learning on images and text, but I'm struggling to find work being done to ...
tensormoby's user avatar
1 vote
0 answers
36 views

Machine learning frameworks for tree-based models

Background: Its well known that Pytorch and TensorFlow are currently the most used frameworks for Deep Learning (DL) research. As far as I know, most researchers (applied or theoretical) that ...
Enk9456's user avatar
  • 83
1 vote
0 answers
20 views

Dataset for IoT activities [closed]

First of all, I am not sure whether this is the correct Stackexchange site for this question. If not, please let me know :) My question: I am looking for a dataset pertaining to IoT activities. ...
Nht_e0's user avatar
  • 21
1 vote
2 answers
72 views

For a student who is a beginner in quantitative research and statistics, which is the better statistical tool to start: R or IBM SPSS? Why? [closed]

Currently, I am writing my research design. However, I am still indecisive on what statistical tool should I use for the data analysis. I tried looking up on the internet and there are disparate ...
Aidre Cabrera's user avatar
0 votes
0 answers
220 views

What does the term "seed lexicon" means?

I am reading a research paper (NLP) and found the phrase "seed lexicon". Could someone please explain it in detail? Edit : A sample paper Leveraging Affective Bidirectional Transformers for ...
ahmedshahriar's user avatar
1 vote
0 answers
32 views

Should I reshuffle the training set when benchmarking neural networks?

I'm trying to set up a fair benchmarking between various RNN models, where each of them is trained until convergence with a fixed random seed. Because the task is very costly, I am only able to run ...
Minh Khôi's user avatar
1 vote
1 answer
31 views

Developing a deep learning hybrid architecture for a particular problem is a highly complicated task [closed]

I am currently conducting research on application of deep learning (sensor signal recognition). I spent about a year and a half sifting through the literature and discovered some research patterns. To ...
Ahmad's user avatar
  • 138
1 vote
0 answers
34 views

[Guidance Needed]Research in data science [closed]

IMAGINE You're a research intern and you're an undergraduate student. Have some experience in data science and now new to research. Your task is to conduct research on vision transformers. Oh and by ...
Dagad's user avatar
  • 21
0 votes
2 answers
29 views

Spectral Networks and Deep Locally Connected Networks on Graphs

I’m reading the paper Spectral Networks and Deep Locally Connected Networks on Graphs and I’m having a hard time understanding the notation shown in the picture below (the scribbles are mine): ...
An Ignorant Wanderer's user avatar
3 votes
1 answer
160 views

How to determine the abnormality of a specific variable by taking into account all the other variables in the data?

I have an issue of machine learning/anomaly detection. Indeed, I have a variable Y and several other variables X. The purpose is to quantify the degree of abnormality of the data on Y but I have to ...
AdrienC's user avatar
  • 31
1 vote
0 answers
48 views

Custom Loss Function Equation

I am trying to reproduce a research paper, where it is a classification problem, and they have introduced a custom loss function that I am unable to understand. Now I think I have to implement the ...
Ahmad Anis's user avatar
1 vote
1 answer
26 views

How to conclude the generality of any classification methods?

Suppose a classification task A, and there exist a lot of methods $M_1, M_2, M_3$. The task $A$ is measured by a consistent measure. For instance, the task A can be a binary classification. In this ...
mallea's user avatar
  • 133
0 votes
2 answers
57 views

Actual problems in Data Science/Machine Learning connected with music [closed]

I'm on my $4^{th}$ year now and searching for a theme for my diploma in mathematics & computer science specialization. Is there are interesting problems or fields for researches that i can explore?...
taciturno's user avatar
  • 137
0 votes
1 answer
121 views

How do we know a neural network test accuracy is good enough when results vary with different runs?

In every paper I read about prediction models, the training accuracy and the test accuracy (sometimes also the validation accuracy) is stated as a discrete number. However, in experience, depending on ...
Daniel's user avatar
  • 181
0 votes
0 answers
101 views

What is the time complexity of learning/testing phase neural network?

What is the time complexity of feed-forward neural networks? I didn't find a book or a reliable source that's talks about this. This link provides one version by breaking the structure of a simple ...
U. User's user avatar
  • 257
0 votes
1 answer
64 views

Will the job of Data Science is going to be at risk? [closed]

Data Science is the sexiest job of 21st Century according to the different sources with a high payment salary . But it seems that there will be over production of this profession . According to U.S. ...
Mark ellon's user avatar
1 vote
2 answers
209 views

In "Attention Is All You Need", why are the FFNs in (2) the same as two convolutions with kernel size 1?

In addition, why do we need a FFN in each layer when we already have attention? Here's a screenshot of the relevant section from Vaswani et al. (2017):
redhoteggplant's user avatar
1 vote
1 answer
553 views

Is there a reference data set for ridge regression?

In order to test an algorithm, I am looking for a reference data set for ridge regression in research papers. Kind of like the equivalent of MNIST but for regression.
Marie's user avatar
  • 23
3 votes
1 answer
234 views

Need an advice on research topic [closed]

I am about to choose ML research topic for my master thesis, but i am at a dead end. The problem is, that while reading research papers, i find solutions, but not an open problems. For now, a came up ...
Дмитрий's user avatar
0 votes
1 answer
27 views

Previous work Replication and Research ethics Ask Question

I am very much concerned about biding by research ethics in my work, especially issues to do with plagiarism. I come across a recent research paper in my field of study that applies state-of-the-art ...
arilwan's user avatar
  • 123
1 vote
0 answers
54 views

Where can I find datasets suitable for an undergraduate research project? [closed]

I have tried Kaggle but couldn’t find anything suitable. Basically I want to do a machine learning or deep learning project. Ideally it would have something to do with computer forensics or security. ...
wild card's user avatar
1 vote
0 answers
158 views

Transitioning from Math PhD to ML research [closed]

I am currently a Math PhD about to defend in January. I work in a field in functional analysis that uses a lot of measure theory (but no stats). I have been considering transitioning careers since I ...
Merry's user avatar
  • 139
1 vote
1 answer
122 views

T-DBSCAN - Implementing STOP logic

I am attempting to implement the T-DBSCAN algorithm described in T-DBSCAN: A Spatiotemporal Density Clustering for GPS Trajectory Segmentation. I have been able to implement most of the logic between ...
DFenstermacher's user avatar
4 votes
5 answers
427 views

Classification training using probabilites and not raw classes (factors)

I have a problem where instead of having classes, i.e. a vector of 0s and 1s, I have the probability of an observation belonging to a class. A vector with 0.1, 0.95, 0.2, 0.3, etc. The obvious ...
wacax's user avatar
  • 3,370
1 vote
2 answers
111 views

Testable hypotheses construction; minimum predictive strength vs. significance

Is this null hypothesis TESTABLE? Research Question: "Can a predictive model utilizing logistic regression be built which predicts at least one customer will churn in 90 days, and this individual ...
user avatar
1 vote
1 answer
347 views

Site for implementing a research papers without code

Before a couple of months, I found a web page for implementing papers which are published without code. Someone posts a paper on it and then community competes to implement that paper. But I don't ...
Antonio Jurić's user avatar
1 vote
1 answer
304 views

Mapping between original feature space and an interpretable feature space

I'm reading the following really interesting paper https://arxiv.org/pdf/1602.04938.pdf on local interpretable model explanations on page 3 however particularly section 3.3 Sampling for Local ...
iaaml's user avatar
  • 11
3 votes
1 answer
58 views

How can there be more true positive than positive?

Currently reading Learning from Little: Comparison of Classifiers Given Little Training In 3 Experiment Results, the following graph is shared: The experiment is described as follow We begin by ...
Adrien Lemaire's user avatar
0 votes
1 answer
23 views

Will data science develop into a separate academic field? [closed]

Right now data science is often regarded as an interdisciplinary subfield of statistics and computer science. What would it take for data science to develop into a separate academic field (with its ...
Bayequentist's user avatar
1 vote
0 answers
414 views

Performance of UNet on low resolution images

I read the U-Net paper yesterday and it talked mostly about how it uses a small dataset (<100) of high-resolution images and performs efficiently. I was wondering how it might perform on larger ...
Aakash Choubey's user avatar