Questions tagged [sequence]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2
votes
1answer
18 views

Multiple merging multiple convolutions

(First post here) I am rather new to neural networks, having used Tensorflow for a couple months now, and am looking for some advice I have on an idea to improve the accuracy of my model. I am looking ...
0
votes
0answers
11 views

predict next text/word. HMM or LSTM? Which is better and what's the pro and con of each method?

I am trying to do a prediction of next word given some previous words. Would it be better to use HMM model or LSTM model? What's the pro and con of each method? Are there examples? Thank you!
1
vote
1answer
11 views

best HMM package

What is the best HMM (Hidden Markov Model) library? I looked into seqlearn and hmmlearn, but both of them don't seem to be actively maintained? Thanks!
0
votes
0answers
9 views

models and algorithms to measure the difference and trend of a matrix sequence

I have a matrix sequence, i.e, a sequence consists of about 5000 matrix, each matrix are of the same dimension, e.g., 25*20. Are there any models/metrics to characterize the trend of these matrix. For ...
2
votes
1answer
165 views

Running out of memory when training Keras LSTM model for binary classification on image sequences

I'm trying to come up with a Keras model based on LSTM layers that would do binary classification on image sequences. The input data has the following shape: ...
0
votes
0answers
8 views

pattern recognition tool

From what i've seen while searching google and the site this is most likely way simpler than what normally get's asked but i've not been able to find anything that could help me with it. What i'm ...
0
votes
0answers
7 views

Sequence prediction model choice

I am working on log data. I extract each user's history usage, and get his sessions into a file containing all the pages visited during all his sessions (each session in a line), sequences have ...
1
vote
1answer
83 views

LSTM to multivariate sequence classification

How can I train multivariate to multiclass sequence using LSTM in keras? I have 50000 sequences, each in the length of 100 timepoints. At every time point, I have 3 features (So the width is 3). I ...
1
vote
0answers
13 views

What is the problem classification (e.g. sequence-to-sequence) for prediction of an autocorrelated sequence from multiple autocorrelated sequences?

I will try to provide a simple example to illustrate my question. I have training data for many oil wells. The training data consists of the well identifier, a timestamp, other relevant properties ...
0
votes
0answers
23 views

processing sequence of sequences in PyTorch

I try to deal with some special sequences via recurrent modules and I have faced some non-trivial things: Sequences are not in same length. I have sequence of sequences, and my idea is to encode ...
3
votes
0answers
131 views

Why embedding or rnn/lstm can not handle variable length sequence?

Pytorch embedding or lstm (I don't know about other dnn libraries) can not handle variable-length sequence by default. I am seeing various hacks to handle variable length. But my question is, why this ...
0
votes
0answers
263 views

Timestamp sequence classification

I am trying to classify a series of timestamps using RNN with LSTM. The data consists of timing information extracted from the uplink packets recorded during a website fetch. The dataset contains 100 ...
0
votes
0answers
9 views

Get sequential model to output probabilities with pystruct

I have implemented a sequential model using Pystruct. The model I use is BinaryCLF and as a learner the StructuredPerceptron. So far, when I test the prediction of my model, I give as an input the ...
0
votes
0answers
68 views

training decoder only transformer for text generation

i have been trying to figure out a way to use the decoder for next word prediction tasks (given a sequence of tokens). For this purpose i modified the existing tutorial to ignore encoder inputs in the ...
2
votes
2answers
60 views

Sequence prediction with unlimited predictions

I have a special kind of prediction problem. I have observed $M$ sequences $X_m = [x_1, x_2, ..., x_N]$ where the distance $d$ between $x_n$ and $x_{n+1}$ is drawn from the same normal distribution, ...
0
votes
0answers
12 views

What machine learning model to predict a sequence of instructions from a matrix

So my task involves taking an input of variable sizes convolutional filters and predicting the sequence of instructions for a processor to implement that filter. Now the sequence can be of variable ...
1
vote
1answer
55 views

Any non Deep Learning python packages for sequence classification.?

Stats model or any other machine learning python packages for doing sequence classification(that can be multi class) and sequence prediction (Both next step and regression). PS : Input data will be ...
1
vote
1answer
985 views

what is the first input to the decoder in a transformer model?

The image is from url: Jay Alammar on transformers K_encdec and V_encdec are calculated in a matrix multiplication with the encoder outputs and sent to the encoder-decoder attention layer of each ...
0
votes
0answers
32 views

How to perform label embedding in Keras?

I am performing a sequence labelling task. The label predicted by the model for each word is to be passed to an embedding layer for getting the corresponding label embedding. The TimeDistributed ...
0
votes
2answers
41 views

Statistical methods for Sequence learning

I am bit more traditional and I am looking for a statistical method that can help me also do inference or predictions. I have some table that contains some transitions, where each row of the table ...
2
votes
1answer
692 views

bert-as-service maximum sequence length

I installed bert-as-service (bert-as-service github repo) and tried encoding some sentences in Japanese on the multi_cased_L-12_H-768_A-12 model. It seems to work ...
0
votes
0answers
51 views

Pytorch's pack_padded_sequence in Tensorflow?

If we do not use pack_padded_sequence of Pytorch, what will happen to the eval result? How to implement Pytorch's ...
1
vote
0answers
36 views

Optimizing ad placement using historical data

Edit: increased generality. I have an ad placement optimization problem and I am brainstorming to determine which ML techniques are well suited to it. Basically, I have some objective that involves ...
0
votes
1answer
36 views

Classification of keystrokes

A year or two ago I wrote a keylogger that has been quietly running in the background of my computer. Each line consists of a timestamp, a keycode, and a value representing modifier keys (e.g. ctrl, ...
1
vote
1answer
1k views

Machine learning Classification model for binary input and output data

I have a large longitudinal dataset with 5 minutes granularity for a period of around 30 months from thousands of households. I want to classify them as binary output (0/1) based on the input which is ...
2
votes
2answers
428 views

What clustering algorithm is appropriate for clustering paths?

I have a dataset with vectors in 2-dimensional space that form separate sequences (paths). Full data is presented below: , while a random sample of 5 paths looks like below (please note that ...
1
vote
2answers
888 views

What algorithms are good to predict next numbers?

Let's consider we have several hundreds of numbers like ( 1, 2, 5, 8, 7, 15, 19, 8, 4, 6, ...) those are closed numbers of a stock on consecutive days for example. I like to know what algorithms are ...
3
votes
0answers
1k views

Why does Position Embeddings work?

In the papers "Convolutional Sequence to Sequence Learning" and "Attention Is All You Need", positions embeddings are simply added to the input words embeddings to give the model a sense of the order ...
1
vote
1answer
361 views

Give Variable Length input to LSTM

My input data consist of list of list. Both list have dynamic length for every example like below. ...
1
vote
1answer
31 views

What exactly does the model generation mean in this diagram?

I've been trying to grasp a research paper on image colorization using neural networks here I am stuck at this diagram. What I need help on, is the Model Generation step after Feature extraction. ...
0
votes
1answer
147 views

Sequence models word2vec

I am working on data-set with more than 100,000 records. This is how the data looks like: ...
1
vote
0answers
400 views

Code or Package to cluster sequences (or time series) of different lengths based on HMM?

Is there any existing code or packages in Python, R, Java, Matlab, or Scala that implements the sequence clustering algorithms in any of the following 2 papers? 1) 'Clustering Sequences with Hidden ...
1
vote
1answer
152 views

Neural network for variable length data classification

How can I create a network which can predict labels of variable lengths data: Training data: ...
2
votes
0answers
49 views

Mapping “event” series, with segments of variable length, to time series for loss calculation

I have a time series of data which I map to a time series of non-exclusive binary features (in my case, short-time audio spectrograms to features of the audio). I will refer to a collection of these ...
1
vote
0answers
728 views

Sequence Embedding

Is there a way to get embedding for an ordered sequence of vectors? I want to get embeddings to feed them further into net i.e. train it to arbitrary loss function simultaneously for embeddings and ...
3
votes
2answers
305 views

Is this a problem for a Seq2Seq model?

I'm struggling to find a tutorial/example which covers using an seq2seq model for sequential inputs other then text/translation. I have a multivariate dataset with n number of input variables each ...
2
votes
1answer
245 views

Query on unstable loss curves for RNN

I’m currently building sequence models for forecasting, and have tried using RNNs, LSTMs, and GRUs. Something unusual I noticed was the highly unstable loss curves, where the loss sometimes goes back ...
4
votes
1answer
80 views

LSTM training/prediction with no starting sequence

ML newbie here. As an exercise, I'm trying to build a character based language model based on a simple 1 layer LSTM. Based on what I've learned about LSTMs, a common usage is to take in a sequence of ...
2
votes
0answers
67 views

Classifying sequences of mouse clicks with different number of clicks per sequence

I have a series of sequences, each sequence contains multiple mouse click with the following features: [x coordinate on screen, y coordinate on screen, duration of click], and each sequence is labeled ...
4
votes
3answers
184 views

Are there cyclic decision trees?

Usual decision trees are directed acyclic graphs. Are there generalizations of decision trees that contain cycles analogously to recurrent neural networks? If such trees exist, can they be applied to ...
1
vote
1answer
1k views

Very long sequence in neural networks

Beginner's question regarding sequences in neural networks: suppose I have classification problem that looks like: X = very long sequence of varying length. Y = class (assume for simplicity y=0/1). ...
3
votes
0answers
508 views

TypeError: unsupported operand type(s) for %: 'int' and 'NoneType'(Stateful LSTM Keras)

So I have a trained LSTM model with which I am trying to predict future values. The model is stateful as seen below ...
1
vote
2answers
38 views

Group prediction

I have following sort of data coming every day: (0)(3,4,5)(6,9,1)(5,35,12,232) (1)(5,1,4)(6,2)(12,54,12,43)(8,23,65) (2)(6,7,2)(34,3) (3)(4323,23,12,4543) (4)(987,32,324,23,224,12,213,21)(1,2) (...
3
votes
0answers
146 views

Next events prediction based on previous events

I have data set of sequences of user executed commands sorted in the order of its occurrence. The data looks like this. ...
2
votes
1answer
3k views

Sequence data vs time series data

What is the difference between sequence data and time series data? My understanding is that sequence data is any data where the order matters and time series is a special type of sequence data ...
1
vote
1answer
2k views

Are there any python libraries for sequences clustering?

I have a problem which I explained in other question. I've understood that my dataset is a sequence of states or something like that. Is there libraries to analyze sequence with python? And is it ...
2
votes
0answers
200 views

k- means clustering on Markov chain trasition probability

I have data set of 50 students. I want to cluster them on their sequential data ( While doing a job they followed multiple sequences A, B, c total 7 stages). I am planning to apply k-means clustering ...
1
vote
0answers
86 views

How do I separate Interleaved sentences using LSTM networks?

I have a problem statement wherein the following input The James world Bond shall can't end save us tomorrow. must be converted into this - The world shall end tomorrow & James Bond can't ...
1
vote
0answers
603 views

RNN sequence length and cell size

I am trying to build a RNN model to classify time series. My time series data consist of numbers with length 200. I am using tensorflow, and when i create the placeholder for the data it is like this:...
11
votes
2answers
8k views

How to implement “one-to-many” and “many-to-many” sequence prediction in Keras?

I struggle to interpret the Keras coding difference for one-to-many (e. g. classification of single images) and many-to-many (e. g. classification of image sequences) sequence labeling. I frequently ...