Questions tagged [sequence]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
1answer
23 views

LSTM with return_sequences - “Training a model on multiple timesteps simultaneously”

So I'm following Tensorflow's LSTM/time series tutorial and there's something I don't understand. I do understand what happens with return_sequences on/off, however,...
1
vote
2answers
61 views

Choosing a model for input: categorised, weighted sequence, output: binary variable

What would be an appropriate model for predicting a binary target variable, given a weighted sequence? Sequences will be reasonably short, typically between ~ 1 and 5 elements. Illustrated example Say ...
2
votes
2answers
125 views

In sequence models, is it possible to have training batches with different timesteps each to reduce the required padding per input sequence?

I want to train an LSTM model with variable length inputs. Specifically I want to use as little padding as possible while still using minibatches. As far as I understand each batch requires a fixed ...
1
vote
1answer
19 views

What's the difference between sequence preprocessing and text preprocessing in Keras?

In Keras, we mainly have three types of preprocessing, i.e., sequence preprocessing, text preprocessing, and image preprocessing. However, for me, I think the meanings of the word "sequence" ...
2
votes
1answer
22 views

How to train a model on top of a transformer to output a sequence?

I am using huggingface to build a model that is capable of identifying mistakes in a given sentence. Say I have a given sentence and a corresponding label as follows -> ...
2
votes
0answers
40 views

Machine learning for circular sequences

My data are sequences of real numbers $a_0,a_1,...,a_{n-1}$. The length of a sequence is fixed and equals $n$. Each sequence is mapped to a real number $y$ and I want to predict $y$ given the sequence....
3
votes
1answer
66 views

Recommender Model for Human Action in Income Protection

Problem Domain I'm working on a project that involves building a model to provide recommendations on the next best step for Human supervisors to take on income protection claims. Income protection is ...
1
vote
0answers
13 views

How to use time-sequence data with “meta data” of single value per sample?

I'm, trying to estimate a fish weight by a time-sequence signal of the change in resistance when the fish goes through a gate with electrodes installed. When the fish pass through the gate there's a ...
0
votes
0answers
12 views

Time-series data pipeline for Kafka + Spark?

I'm working on a project related to predicting syscall sequences' malice. The data, which are syscall sequences that each belongs to a program, will be stored temporary to Kafka (which I have no idea ...
0
votes
0answers
9 views

Estimating the progress through a workflow with an arbitrary number of steps

I have a dataset where a record (a customer order, to choose a made-up example) goes through a set of steps until eventual completion. The set of steps is generally very similar, with small variations ...
0
votes
1answer
70 views

How to convert DNA sequences in FASTA format to OneHot Encoded Pandas Dataframe for Neural Networks?

DNA sequences in FASTA format look like: CATGCATTAGTTATTAATAGTAATCAATTACGGGGTCATTAGTTCA... I am trying to convert them into one-hot encoded data in a Pandas ...
1
vote
0answers
15 views

Predict status of upcoming project milestones with intermediate activities

I have data of 100+ project data. Each project has about 175 sequential activities from start to end. There are approximately 7 key milestones between those 175 activities that we want to predict. ...
0
votes
0answers
36 views

Binary classification of multiple Sequences using Keras

I am trying to classify multiple independent sequences using Keras. My data looks like this (example with different stocks and their values). ...
1
vote
0answers
16 views

What is External representation of time in Sequential learning?

I am reading the literature on sequential learning and it is often mention that in order to handle sequential/temporal data, there two categories of work in sequential learning External ...
2
votes
1answer
48 views

Predicting sequence element based on the previous M and the following N elements

I have an array of sequences of equal length, each sequence contains 300 numbers (M=300). Each element in a sequence is a number from 1 to 9: ...
0
votes
0answers
9 views

Generating new sequences from given set

I got two classes namely positive and negative with 1500 samples on each a total of 3k. A sample sequence is like: ...
0
votes
1answer
30 views

Predicting next element of a sequence given small amount of data

I have data of bank branches and amount of revenue they have generated in a month. The data looks like this: I am tasked to find the expected revenue for the branch for the next month using machine ...
1
vote
1answer
24 views

Comapring hidden markov models

Given a set of sequence transitions, there are different orders of hidden markov models that can be fitted to a dataset. Is there any test to determine which is the best model for a given sequence ...
0
votes
1answer
28 views

what's this approach to spatiotemporal data named as?

I have some sequential data (e.g. audio, video, text etc.) and I am using this approach to classify sequences. I am sure there's a name for it, but I can't think of it: ...
1
vote
1answer
44 views

Similar algorithm to apriori to find unpopular sequential patterns

I am working with a dataset that looks like similar to this one but it is way larger (approx. 30.000 arrays): ...
1
vote
1answer
23 views

HMM and its competitive alternatives

In Natural language processing, what are the major applications of Hidden Markov Chain (HMM), and what are the alternatives that usually can outperform HMM, is RNN and LSTM always the choice right now?...
2
votes
1answer
132 views

Can bidirectional RNN use variable sequence length?

A bidirectional RNN consists of two RNNs, one for the forward and another for the backward sequential directions, which outcome is concatenated at each time step. Would this configuration restrict the ...
0
votes
0answers
17 views

Predicting the future event given the past sequence and backward

I have a problem of event sequence modelling and I want to model it with Artificial Intelligence (ML/DL) but I am not sure which algorithm to start with, I want to start simple instead of applying ...
0
votes
0answers
3 views

Sequence Chunking: Shape Error

I'm making a sequence chunking project, similar to NER and sequence labeling. The inputs are sequences of words and the outputs are labels of "B-NP", "I-NP", and "O". Input: "The", "Merciful", "." ...
1
vote
1answer
9 views

How and When features are attached to target label

I am using Mallet CRF library and having training set sequences like below. ...
1
vote
1answer
83 views

What's an appropriate datastore for variable length sequence data for PyTorch consumption?

I have a large number of sequences - potentially hundreds of thousands - each consisting of between 100 and 10,000 items, which each consist of about 5 floats. I need a datastore that can rapidly ...
0
votes
0answers
14 views

Weighting Value Of Timer Series Event Based On Subsequent Events

I am new to Data Science forum. I post a lot on StackOverflow, but this issue is more conceptual. I am doing analysis on time series data and weighting the value of an event based on the outcome. ...
0
votes
0answers
35 views

How to handle a timestep length of 0 in a LSTM model?

So I have a variable input size LSTM model similar to the one from this answer but with one-hot encoded variables. The x_train in my generator is shaped like this: (batch_size, timestep_length, ...
0
votes
0answers
95 views

Custom layer in tensorflow which remembers input statistics

I would like to implement a layer which in a sense remembers what it's usual input is, and only passes on values that deviates from that. So basically, the layers need to remember the average of all ...
5
votes
2answers
93 views

Predict a sequence given many sequences

I'm trying to find an algorithm that would fit this use case: My data: a bunch of fixed-size integer arrays, e.g. [0,2,3,4,5] [1,2,3,1,5] [4,1,2,4,5] ... Input: ...
1
vote
0answers
16 views

Long sequence prediction with model trained on short sequence

I'll start with a specific example. I would like to train model which predict vector of [0-1]. Values close to 1 on specific range indicates that in those timesteps is particular activation word (...
1
vote
1answer
22 views

Can OLS regression be used to predict from a complete sequence of data?

Reading online and following this example from scipy I understand OLS can be used to find data between gaps in a sequence (interpolate?) but I already have a complete sequence and want to predict the ...
1
vote
1answer
27 views

Sequence labeling with partially known labels

I am working on a sequence labeling task where, based on experience, many of the labels of a given input sequence can be reliably extracted with a simple rule-based approach. For example, considering ...
1
vote
2answers
27 views

Which input to use when generating a new sequence

I want to use sequence-to-sequence architecture to generate sequences. My data has such structure ...
0
votes
0answers
22 views

How to label sequential data for LSTM usage

I want to process data to feed it to a LSTM later, each 100 rows correspond to single category how should I label the data? Should I concatenate the 100 rows into a single row? Data Sample:- ...
1
vote
1answer
58 views

Clustering sequences of sentence embeddings

I have a sequence of events, right now I am not worried about their actual times, just the order. This is a sequence of web page views. I have modelled my data as the following, where each element ...
1
vote
0answers
27 views

Time Series Forecasting with RNN/LSTM/NARX

I have some experimental datasets (like 4 or 5), and each dataset has three time series data, say $u1(t)$, $u2(t)$, and $x(t)$. The three time series of each experiment are similar but not the same. ...
2
votes
1answer
18 views

Use LSTM to predict the proportion of steps with nonzero feature values

I am trying to do a simple regression for sequences. Each input $X_i$ is a $n=2000$ by 1 matrix, formatted as $n_i$ 0-s followed by $(n-n_i)$ 1-s. The output $y_i$ should be $n_i/n$, i.e. the ...
2
votes
0answers
188 views

Proper loss function for sequence prediction model with multi-step output

Consider a typical time series (sequence) prediction problem that use previous $k$ step historical features to predict the next step target. We use RNN model as an ...
3
votes
1answer
46 views

User actions sequence classification

I have a training set where each row is a series of user actions on a website (logged in, sent an invoice, etc.) and times deltas in ms between these actions. Each row has a label — a corresponding ...
2
votes
1answer
39 views

Multiple merging multiple convolutions

(First post here) I am rather new to neural networks, having used Tensorflow for a couple months now, and am looking for some advice I have on an idea to improve the accuracy of my model. I am looking ...
3
votes
1answer
83 views

Best HMM Package

What is the best HMM (Hidden Markov Model) library available in Python? I have already looked into seqlearn and hmmlearn, but both of them don't seem to be actively maintained. Thanks in advance!
3
votes
1answer
1k views

Running out of memory when training Keras LSTM model for binary classification on image sequences

I'm trying to come up with a Keras model based on LSTM layers that would do binary classification on image sequences. The input data has the following shape: ...
1
vote
1answer
1k views

LSTM to multivariate sequence classification

How can I train multivariate to multiclass sequence using LSTM in keras? I have 50000 sequences, each in the length of 100 timepoints. At every time point, I have 3 features (So the width is 3). I ...
1
vote
0answers
25 views

What is the problem classification (e.g. sequence-to-sequence) for prediction of an autocorrelated sequence from multiple autocorrelated sequences?

I will try to provide a simple example to illustrate my question. I have training data for many oil wells. The training data consists of the well identifier, a timestamp, other relevant properties ...
3
votes
0answers
251 views

Why embedding or rnn/lstm can not handle variable length sequence?

Pytorch embedding or lstm (I don't know about other dnn libraries) can not handle variable-length sequence by default. I am seeing various hacks to handle variable length. But my question is, why this ...
0
votes
0answers
596 views

Timestamp sequence classification

I am trying to classify a series of timestamps using RNN with LSTM. The data consists of timing information extracted from the uplink packets recorded during a website fetch. The dataset contains 100 ...
2
votes
2answers
68 views

Sequence prediction with unlimited predictions

I have a special kind of prediction problem. I have observed $M$ sequences $X_m = [x_1, x_2, ..., x_N]$ where the distance $d$ between $x_n$ and $x_{n+1}$ is drawn from the same normal distribution, ...
1
vote
1answer
128 views

Any non Deep Learning python packages for sequence classification.?

Stats model or any other machine learning python packages for doing sequence classification(that can be multi class) and sequence prediction (Both next step and regression). PS : Input data will be ...