Questions tagged [sequence]

The tag has no usage guidance.

2
votes
2answers
48 views

Sequence prediction with unlimited predictions

I have a special kind of prediction problem. I have observed $M$ sequences $X_m = [x_1, x_2, ..., x_N]$ where the distance $d$ between $x_n$ and $x_{n+1}$ is drawn from the same normal distribution, ...
0
votes
0answers
11 views

What machine learning model to predict a sequence of instructions from a matrix

So my task involves taking an input of variable sizes convolutional filters and predicting the sequence of instructions for a processor to implement that filter. Now the sequence can be of variable ...
1
vote
1answer
46 views

Any non Deep Learning python packages for sequence classification.?

Stats model or any other machine learning python packages for doing sequence classification(that can be multi class) and sequence prediction (Both next step and regression). PS : Input data will be ...
1
vote
1answer
65 views

what is the first input to the decoder in a transformer model?

The image is from url: Jay Alammar on transformers K_encdec and V_encdec are calculated in a matrix multiplication with the encoder outputs and sent to the encoder-decoder attention layer of each ...
0
votes
0answers
11 views

How to perform label embedding in Keras?

I am performing a sequence labelling task. The label predicted by the model for each word is to be passed to an embedding layer for getting the corresponding label embedding. The TimeDistributed ...
0
votes
2answers
39 views

Statistical methods for Sequence learning

I am bit more traditional and I am looking for a statistical method that can help me also do inference or predictions. I have some table that contains some transitions, where each row of the table ...
1
vote
1answer
93 views

bert-as-service maximum sequence length

I installed bert-as-service (bert-as-service github repo) and tried encoding some sentences in Japanese on the multi_cased_L-12_H-768_A-12 model. It seems to work ...
0
votes
0answers
19 views

Pytorch's pack_padded_sequence in Tensorflow?

If we do not use pack_padded_sequence of Pytorch, what will happen to the eval result? How to implement Pytorch's ...
1
vote
0answers
32 views

Optimizing ad placement using historical data

Edit: increased generality. I have an ad placement optimization problem and I am brainstorming to determine which ML techniques are well suited to it. Basically, I have some objective that involves ...
0
votes
1answer
24 views

Classification of keystrokes

A year or two ago I wrote a keylogger that has been quietly running in the background of my computer. Each line consists of a timestamp, a keycode, and a value representing modifier keys (e.g. ctrl, ...
0
votes
1answer
717 views

Machine learning Classification model for binary input and output data

I have a large longitudinal dataset with 5 minutes granularity for a period of around 30 months from thousands of households. I want to classify them as binary output (0/1) based on the input which is ...
2
votes
2answers
164 views

What clustering algorithm is appropriate for clustering paths?

I have a dataset with vectors in 2-dimensional space that form separate sequences (paths). Full data is presented below: , while a random sample of 5 paths looks like below (please note that ...
1
vote
2answers
403 views

What algorithms are good to predict next numbers?

Let's consider we have several hundreds of numbers like ( 1, 2, 5, 8, 7, 15, 19, 8, 4, 6, ...) those are closed numbers of a stock on consecutive days for example. I like to know what algorithms are ...
1
vote
0answers
665 views

Why does Position Embeddings work?

In the papers "Convolutional Sequence to Sequence Learning" and "Attention Is All You Need", positions embeddings are simply added to the input words embeddings to give the model a sense of the order ...
1
vote
1answer
287 views

Give Variable Length input to LSTM

My input data consist of list of list. Both list have dynamic length for every example like below. ...
1
vote
1answer
25 views

What exactly does the model generation mean in this diagram?

I've been trying to grasp a research paper on image colorization using neural networks here I am stuck at this diagram. What I need help on, is the Model Generation step after Feature extraction. ...
0
votes
1answer
102 views

Sequence models word2vec

I am working on data-set with more than 100,000 records. This is how the data looks like: ...
1
vote
0answers
262 views

Code or Package to cluster sequences (or time series) of different lengths based on HMM?

Is there any existing code or packages in Python, R, Java, Matlab, or Scala that implements the sequence clustering algorithms in any of the following 2 papers? 1) 'Clustering Sequences with Hidden ...
1
vote
1answer
86 views

Neural network for variable length data classification

How can I create a network which can predict labels of variable lengths data: Training data: ...
2
votes
0answers
45 views

Mapping “event” series, with segments of variable length, to time series for loss calculation

I have a time series of data which I map to a time series of non-exclusive binary features (in my case, short-time audio spectrograms to features of the audio). I will refer to a collection of these ...
1
vote
0answers
539 views

Sequence Embedding

Is there a way to get embedding for an ordered sequence of vectors? I want to get embeddings to feed them further into net i.e. train it to arbitrary loss function simultaneously for embeddings and ...
3
votes
2answers
197 views

Is this a problem for a Seq2Seq model?

I'm struggling to find a tutorial/example which covers using an seq2seq model for sequential inputs other then text/translation. I have a multivariate dataset with n number of input variables each ...
2
votes
1answer
151 views

Query on unstable loss curves for RNN

I’m currently building sequence models for forecasting, and have tried using RNNs, LSTMs, and GRUs. Something unusual I noticed was the highly unstable loss curves, where the loss sometimes goes back ...
4
votes
1answer
72 views

LSTM training/prediction with no starting sequence

ML newbie here. As an exercise, I'm trying to build a character based language model based on a simple 1 layer LSTM. Based on what I've learned about LSTMs, a common usage is to take in a sequence of ...
2
votes
0answers
60 views

Classifying sequences of mouse clicks with different number of clicks per sequence

I have a series of sequences, each sequence contains multiple mouse click with the following features: [x coordinate on screen, y coordinate on screen, duration of click], and each sequence is labeled ...
4
votes
3answers
120 views

Are there cyclic decision trees?

Usual decision trees are directed acyclic graphs. Are there generalizations of decision trees that contain cycles analogously to recurrent neural networks? If such trees exist, can they be applied to ...
1
vote
1answer
873 views

Very long sequence in neural networks

Beginner's question regarding sequences in neural networks: suppose I have classification problem that looks like: X = very long sequence of varying length. Y = class (assume for simplicity y=0/1). ...
3
votes
0answers
401 views

TypeError: unsupported operand type(s) for %: 'int' and 'NoneType'(Stateful LSTM Keras)

So I have a trained LSTM model with which I am trying to predict future values. The model is stateful as seen below ...
1
vote
2answers
37 views

Group prediction

I have following sort of data coming every day: (0)(3,4,5)(6,9,1)(5,35,12,232) (1)(5,1,4)(6,2)(12,54,12,43)(8,23,65) (2)(6,7,2)(34,3) (3)(4323,23,12,4543) (4)(987,32,324,23,224,12,213,21)(1,2) (...
2
votes
0answers
100 views

Next events prediction based on previous events

I have data set of sequences of user executed commands sorted in the order of its occurrence. The data looks like this. ...
1
vote
1answer
1k views

Sequence data vs time series data

What is the difference between sequence data and time series data? My understanding is that sequence data is any data where the order matters and time series is a special type of sequence data ...
1
vote
1answer
2k views

Are there any python libraries for sequences clustering?

I have a problem which I explained in other question. I've understood that my dataset is a sequence of states or something like that. Is there libraries to analyze sequence with python? And is it ...
1
vote
0answers
168 views

k- means clustering on Markov chain trasition probability

I have data set of 50 students. I want to cluster them on their sequential data ( While doing a job they followed multiple sequences A, B, c total 7 stages). I am planning to apply k-means clustering ...
1
vote
0answers
73 views

How do I separate Interleaved sentences using LSTM networks?

I have a problem statement wherein the following input The James world Bond shall can't end save us tomorrow. must be converted into this - The world shall end tomorrow & James Bond can't ...
1
vote
0answers
543 views

RNN sequence length and cell size

I am trying to build a RNN model to classify time series. My time series data consist of numbers with length 200. I am using tensorflow, and when i create the placeholder for the data it is like this:...
11
votes
2answers
6k views

How to implement “one-to-many” and “many-to-many” sequence prediction in Keras?

I struggle to interpret the Keras coding difference for one-to-many (e. g. classification of single images) and many-to-many (e. g. classification of image sequences) sequence labeling. I frequently ...
1
vote
1answer
132 views

How to evaluate sequence to sequence models?

I wonder how to evaluate variable long sequence-to-sequence predictions? Let us say I have the following $Y$ and $\hat{Y}$ $Y = [["1", "2", "2"], ["3", "2", "2"], ["1", "3", "2", "2"]]$ $\hat{Y} = [[...
0
votes
0answers
116 views

How to encode labels for CTC in Python?

I want to apply Connectionist Temporal Classification for an OCR task where I have a bunch of images with text of variable length and the output is the text itself: ...
4
votes
1answer
413 views

Viterbi-like algorithm suggesting top-N probable state sequences implementation

Traditional Viterbi algorithm (say, for hidden Markov models) provides the most probable hidden state sequence given a sequence of observations. There probably is an algorithm for decoding top-N ...
2
votes
0answers
69 views

Classifying Sequences Where Some Sequences in Both Classes

I am building a modified RNN (specifically a GRU) to classify sequences. These sequences are of variable length, and contain "states". Each point in the sequence is categorical and they look like [A,B,...
2
votes
1answer
65 views

Find average sequence from a set of sequences [closed]

I have a set of user sessions. Session consists of an ordered list of types of actions that user made (for example, bought a gun, played a mission, etc). I want to create/calculate session that have ...
1
vote
1answer
279 views

Sequence Batching in RNNs

I'm wondering why sequence batching in RNNs's target value loops back (I'm not sure what you call it), but let's take for example: We want to learn a sequence of numbers (our input) from 1 to 16: $$ ...
0
votes
0answers
359 views

How can I use machine learning methods on modelling time series data?

I face a data which records the default rate of loans by cohort.e.g. My company currently hold a portfolio comprising personal loans whose starting date was in a range from 2014 Jul till now. The ...
2
votes
1answer
299 views

Next event prediction in the sequence

I have a sequence of event and would like to predict the next one. The training data looks like this: Ev1,Ev2,Ev5,Ev6,Ev7 Ev1,Ev6,Ev99 Ev4,Ev3,Ev6 So, the idea is to get Ev7 given Ev1,Ev2,Ev5,Ev6 ...
2
votes
2answers
132 views

Modeling the influence of events order on probability

The case is to model if the sequence of events influences the probability of binary target variable. We have for example five different events which occur in time (event: A,B,C,D,E). They can occur in ...
1
vote
1answer
220 views

Given one language ngram model, how do I compare likelihoods of two texts of different length?

Let's say I have conditional probabilities estimates for N-grams and I want to find out which of the two sequences of different length 'looks more natural' in terms of the given model. How does one ...
3
votes
1answer
3k views

Principle behind seq2seq model's example in keras?

I am referring to seq2seq model's example code in keras (https://github.com/fchollet/keras/blob/master/examples/addition_rnn.py). The model is : ...
0
votes
1answer
73 views

Unsupervised sequence identification

I am looking for the best method to go from a sequence of events such as time event 1 a 2 b 3 a 4 b 5 c 6 d 7 c 8 d 9 e Where each letter corresponds to a ...
9
votes
2answers
395 views

Classification of vector sequences

My dataset is comprised of vector sequences. Each vector has 50 real-valued dimensions. The number of vectors in a sequence range from 3-5 to 10-15. In other words, the length of a sequence is not ...
8
votes
2answers
1k views

Algorithm for segmentation of sequence data

I have a large sequence of vectors of length N. I need some unsupervised learning algorithm to divide these vectors into M segments. For example: K-means is not suitable, because it puts similar ...