Questions tagged [sequence]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
0answers
21 views

How to predict data from sequence of sequences of variable size?

input data ...
0
votes
0answers
23 views

LSTM behaviour with return_sequences and TimeDistributed

I am trying different models for a classification problem with sequence data and variable sequence length, the below model predict all at once, and it achieve better results than other models, so I ...
3
votes
3answers
106 views

Classification when the classification of the previous itens matter

I have a classification problem to solve, that seems to be common but I am struggling to find the name of this task and the best way to model this problem. Suppose I have a series of events that are ...
1
vote
0answers
15 views

How to compare different forecasting models over different time horizon?

Developed multiple Models with AR, ARIMA, VAR; LSTM , SARIMA. Now, the purpose is to find out which model performs best on a given use case with different time horizons. The time series data is ...
1
vote
0answers
26 views

How does data shuffling work when LSTM is involved?

TIL that when using the LSTM layer, the states are remembered throughout the same batch. When using stateful LSTM, they can be even remembered outside of the batch. The first realization gave me a ...
0
votes
0answers
12 views

Optimal method(s) to monitor attention matrices when doing training/inference using BERT-type models from transformers

Our team is using BERT/Roberta from the huggingface transformers library for sequence-classification (amongst other tasks). We are looking for an efficient way to monitor the attention matrices so as ...
0
votes
0answers
11 views

Find a column by name in a row in scala spark

I have a Seq[Row].Each row is an Array of Struct.Struct has four fields: a,b,c and d all of which are String.The data in a particular row is something like this: [{"a":"ahahk",&...
1
vote
0answers
18 views

Text generation with deep neural network?

For my master's project, I have to build a deep learning model for text generation: the model learns on a set of sentences, then it generates new sentences based on those from which it learned. I ...
0
votes
1answer
33 views

Deep Learning Model to predict sum of Sequences based on flag value

I am trying to Predict Sum of the Sequence based on flag but my model is not able to converge. for each time stamp, include the first element in sum if second number is 1 in Sequence. Example ...
1
vote
1answer
44 views

Handle with very short and very long sequences with Neural Network

I am working on multi-class problem with sequences. My dataset is composed of sequences of data with different length. E.g. 1500 labeled samples: 500 datapoint belongs to class A, 500 class B and 500 ...
1
vote
1answer
17 views

Seq to Seq modelling - ML Algorithms to use

Am new to ML. While I learnt the classical ML concepts like Linera regression, Logistic regression, Boosting and tree based techniques, now am slowly trying to learn Deep Learning techniques like CNN, ...
0
votes
0answers
26 views

Finding recurring patterns in a (non-numeric) sequence

Suppose we have a long sequence of events (of the form ABCBBBNFABCBNF...ABC), and we want to detect: Exact subsequences above a certain length, and which recur above a certain number of times (e.g. ...
0
votes
0answers
40 views

How to use gradient checkpointing on packed sequence RNN

I have a batch of sequences that have a variable length. To save computation I used pack_padded_sequence as following: ...
1
vote
1answer
15 views

How can I predict the last element of the fixed length=8 sequence after I get each element?

There are fixed length lists [X1, X2, X3, X4, X5, X6, X7, X8] like this. I have many lists like them from the past. In the future, I will get new element of current list on weekly bases. one new ...
0
votes
0answers
13 views

Sequence multi-class classification only learns a few outputs

I have a multi-event delineation problem, where given a signal, I have an output with the same signal length. Something like 0011002200, where each unique number ...
0
votes
1answer
152 views

Advantages of CNN vs. LSTM for sequence data like text or log-files

When do you tend to use CNN rather than LSTM (or the other way round) in classification or generation tasks of sequential data like text or log-data? What are the reasons for the decision and what ...
0
votes
0answers
14 views

Pattern detection in sequence of users behaviour for clustering

I need to detect variable-size patterns in a set of fixed-size strings, where each string represents a sequence of activity of a group of users. As an example, i have a 10 character string or user 1 ...
1
vote
0answers
43 views

Create sequence for a Conv1D layer

Im studying the following tutorial on the Keras website and I'm trying to understand how to create a sequence for a Conv1D layer. This is their method: ...
0
votes
0answers
26 views

Time-Series analysis with small data set, but long sequences

I'm working on a time-series classification problem. There are 3 classes. Dataset consists of 6 sequences from each class (total 18 sequences). Each sequence is 19,000 in length. What are some time-...
0
votes
1answer
14 views

Find differences of two protein sequence files

I have two separate files A and B of more than 100000 records of protein sequences. Now I need to find the sequences that are in ...
0
votes
1answer
37 views

Random Sequence Predictions

Can machine learning algorithms predict random number generators. key A= 1 2 3 B= 4 5 6 C= 7 8 9 Example to catch a number sequence 4 8 8 I would select B C C That would give me 27 number combinations ...
0
votes
0answers
312 views

Loss Nan: How can I properly implement a LSTM Time-Series model with a lot of parameters?

The Problem: I am very new to TF and Keras. I am attempting to train a time-series LSTM. When using only a few parameters as a test, the model seems to work fine. Once I increase the parameters to the ...
1
vote
1answer
87 views

LSTM with return_sequences - "Training a model on multiple timesteps simultaneously"

So I'm following Tensorflow's LSTM/time series tutorial and there's something I don't understand. I do understand what happens with return_sequences on/off, however,...
1
vote
2answers
71 views

Choosing a model for input: categorised, weighted sequence, output: binary variable

What would be an appropriate model for predicting a binary target variable, given a weighted sequence? Sequences will be reasonably short, typically between ~ 1 and 5 elements. Illustrated example Say ...
3
votes
2answers
584 views

In sequence models, is it possible to have training batches with different timesteps each to reduce the required padding per input sequence?

I want to train an LSTM model with variable length inputs. Specifically I want to use as little padding as possible while still using minibatches. As far as I understand each batch requires a fixed ...
1
vote
1answer
44 views

What's the difference between sequence preprocessing and text preprocessing in Keras?

In Keras, we mainly have three types of preprocessing, i.e., sequence preprocessing, text preprocessing, and image preprocessing. However, for me, I think the meanings of the word "sequence" ...
2
votes
1answer
83 views

How to train a model on top of a transformer to output a sequence?

I am using huggingface to build a model that is capable of identifying mistakes in a given sentence. Say I have a given sentence and a corresponding label as follows -> ...
2
votes
0answers
74 views

Machine learning for circular sequences

My data are sequences of real numbers $a_0,a_1,...,a_{n-1}$. The length of a sequence is fixed and equals $n$. Each sequence is mapped to a real number $y$ and I want to predict $y$ given the sequence....
3
votes
1answer
70 views

Recommender Model for Human Action in Income Protection

Problem Domain I'm working on a project that involves building a model to provide recommendations on the next best step for Human supervisors to take on income protection claims. Income protection is ...
1
vote
0answers
14 views

How to use time-sequence data with "meta data" of single value per sample?

I'm, trying to estimate a fish weight by a time-sequence signal of the change in resistance when the fish goes through a gate with electrodes installed. When the fish pass through the gate there's a ...
0
votes
1answer
256 views

How to convert DNA sequences in FASTA format to OneHot Encoded Pandas Dataframe for Neural Networks?

DNA sequences in FASTA format look like: CATGCATTAGTTATTAATAGTAATCAATTACGGGGTCATTAGTTCA... I am trying to convert them into one-hot encoded data in a Pandas ...
1
vote
0answers
31 views

Predict status of upcoming project milestones with intermediate activities

I have data of 100+ project data. Each project has about 175 sequential activities from start to end. There are approximately 7 key milestones between those 175 activities that we want to predict. ...
1
vote
0answers
18 views

What is External representation of time in Sequential learning?

I am reading the literature on sequential learning and it is often mention that in order to handle sequential/temporal data, there two categories of work in sequential learning External ...
2
votes
1answer
161 views

Predicting sequence element based on the previous M and the following N elements

I have an array of sequences of equal length, each sequence contains 300 numbers (M=300). Each element in a sequence is a number from 1 to 9: ...
0
votes
1answer
75 views

Predicting next element of a sequence given small amount of data

I have data of bank branches and amount of revenue they have generated in a month. The data looks like this: I am tasked to find the expected revenue for the branch for the next month using machine ...
2
votes
1answer
32 views

Comapring hidden markov models

Given a set of sequence transitions, there are different orders of hidden markov models that can be fitted to a dataset. Is there any test to determine which is the best model for a given sequence ...
0
votes
1answer
30 views

what's this approach to spatiotemporal data named as?

I have some sequential data (e.g. audio, video, text etc.) and I am using this approach to classify sequences. I am sure there's a name for it, but I can't think of it: ...
1
vote
1answer
142 views

Similar algorithm to apriori to find unpopular sequential patterns

I am working with a dataset that looks like similar to this one but it is way larger (approx. 30.000 arrays): ...
1
vote
1answer
52 views

HMM and its competitive alternatives

In Natural language processing, what are the major applications of Hidden Markov Chain (HMM), and what are the alternatives that usually can outperform HMM, is RNN and LSTM always the choice right now?...
4
votes
2answers
524 views

Can bidirectional RNN use variable sequence length?

A bidirectional RNN consists of two RNNs, one for the forward and another for the backward sequential directions, which outcome is concatenated at each time step. Would this configuration restrict the ...
1
vote
1answer
11 views

How and When features are attached to target label

I am using Mallet CRF library and having training set sequences like below. ...
2
votes
1answer
136 views

What's an appropriate datastore for variable length sequence data for PyTorch consumption?

I have a large number of sequences - potentially hundreds of thousands - each consisting of between 100 and 10,000 items, which each consist of about 5 floats. I need a datastore that can rapidly ...
5
votes
2answers
102 views

Predict a sequence given many sequences

I'm trying to find an algorithm that would fit this use case: My data: a bunch of fixed-size integer arrays, e.g. [0,2,3,4,5] [1,2,3,1,5] [4,1,2,4,5] ... Input: ...
1
vote
0answers
19 views

Long sequence prediction with model trained on short sequence

I'll start with a specific example. I would like to train model which predict vector of [0-1]. Values close to 1 on specific range indicates that in those timesteps is particular activation word (...
1
vote
1answer
25 views

Can OLS regression be used to predict from a complete sequence of data?

Reading online and following this example from scipy I understand OLS can be used to find data between gaps in a sequence (interpolate?) but I already have a complete sequence and want to predict the ...
1
vote
1answer
66 views

Sequence labeling with partially known labels

I am working on a sequence labeling task where, based on experience, many of the labels of a given input sequence can be reliably extracted with a simple rule-based approach. For example, considering ...
1
vote
2answers
31 views

Which input to use when generating a new sequence

I want to use sequence-to-sequence architecture to generate sequences. My data has such structure ...
1
vote
1answer
160 views

Clustering sequences of sentence embeddings

I have a sequence of events, right now I am not worried about their actual times, just the order. This is a sequence of web page views. I have modelled my data as the following, where each element ...
1
vote
0answers
28 views

Time Series Forecasting with RNN/LSTM/NARX

I have some experimental datasets (like 4 or 5), and each dataset has three time series data, say $u1(t)$, $u2(t)$, and $x(t)$. The three time series of each experiment are similar but not the same. ...
2
votes
1answer
21 views

Use LSTM to predict the proportion of steps with nonzero feature values

I am trying to do a simple regression for sequences. Each input $X_i$ is a $n=2000$ by 1 matrix, formatted as $n_i$ 0-s followed by $(n-n_i)$ 1-s. The output $y_i$ should be $n_i/n$, i.e. the ...