Skip to main content
OverflowAI is here! AI power for your Stack Overflow for Teams knowledge community. Learn more

Questions tagged [sequential-pattern-mining]

Filter by
Sorted by
Tagged with
0 votes
1 answer
69 views

What is the best practice to detect constant and nearly constant data over time?

I'm experimenting with the characterization of data over time. I generated some synthesized data with certain periodic patterns over time every 5mins (granularity of 5mins= data generated with the ...
Mario's user avatar
  • 400
0 votes
1 answer
37 views

Identification of inexactly-recurring material in time series stream

I am working on a personal project involving the analysis of a stream of audio data and the identification of (non-verbatim) repeated subsequences. My research on time series has so far lead me to ...
Stan's user avatar
  • 101
0 votes
0 answers
15 views

Pattern recognition in time data serie

I have a log file with phone call data, described by 2 attributes: call_time, call_from. I want to discover some patterns in the data, using some statistical method. I don't have any predefined ...
Duccio Fabbri's user avatar
0 votes
0 answers
46 views

How to train Keras Sequential model in batches?

newbie here. I have a large dataset in many local CSV files. It's impossible to fit it in memory within budget. How can I train a Sequential model in batches? I've found ...
Putnik's user avatar
  • 105
0 votes
1 answer
39 views

How can I solve this kind of problem about predicting the sequence of once in life events?

So let's imagine I have a dataset of children. For each of them a have a bunch of characteristics (generation, gender, race, class, urban/rural, religion, bmi, number of siblings etc..) and plus the ...
Floralys's user avatar
0 votes
0 answers
699 views

How to Use Generative AI for Time Series Forecasting?

What I have A time series dataset of time stamps (hourly resolution), some covariates (like store foot-traffic) and items sold. What to forecast Number of items sold for next 24 hours, i.e. 24 ...
Della's user avatar
  • 335
0 votes
0 answers
42 views

Sequence Regression and Sequence Learning

My training data is structured as sequential data in the following format: where $n$ represents the $n$th data point in my training data of length $N$, and $m \leq M := M(n)$ represents the $m$th ...
Wilson's user avatar
  • 101
0 votes
1 answer
96 views

How RNN or LSTM delays the input

RNN or LSTM are known to hold the previous timestamp data as "memory" so that short or long range dependencies can be remembered. But in the following simple keras model, where is that delay ...
Sandeep Bhutani's user avatar
2 votes
1 answer
198 views

What is the fastest way to detect periodicity in a binary time series?

Example, T = array([0,1,1,1,0,0,1,0,1,1,1,0,0,1,1,1,1,1,0,0,1,0,1,1,1,0,0,1,0,1,1,0,0,0,1,0,1,1,1,0,0,1]) ( T is almost a repeat of the array([0,1,1,1,0,0,1]) six ...
Imp's user avatar
  • 21
0 votes
1 answer
207 views

Improvement of the Keras model for a regression task

I am trying to build an expectation model for my (19502,3) data using Keras Sequential model. This dataset has been generated using a parametric sweep in a simulation software. With this model, I want ...
Alex Moh's user avatar
2 votes
2 answers
2k views

How to find common patterns in thousands of strings?

I don't want to find "abc" in strings ["kkkabczzz", "shdirabckai"] Not like that. But bigger patterns like this: If I have to _________, then I will ___. ["If I have ...
Mohit Gangrade's user avatar
2 votes
0 answers
875 views

What algorithms exist for identify repeating patterns in a single image?

I am looking for algorithms or models for detecting and identifying repeated patterns in a single image. For example, an arbitrary smaller image might be pasted at random locations in the image. In ...
interoception's user avatar
1 vote
3 answers
863 views

How to use machine learning to find pattern of similar regions in signals

I have a long time series signal. This signal is usually very stable, but it will change when the sensor is stimulated, and this change is usually very short. I know this can be trained using the ...
Linminxiang's user avatar
3 votes
1 answer
986 views

Is sequential pattern mining possible with machine learning?

I am curious if sequential pattern mining algoritmhs fill a unique gap or the same thing can be achieved with alternative methods for example wih machine learning or something else. Do you know any ...
inf3rno's user avatar
  • 133
0 votes
1 answer
607 views

Detect time pattern in sequence of events

I have a time series with a timestamp and an associated event: Time Event 1 A 2 B 3 C T A I was wondering if there is a technique/method to figure out which events most often precede others in a ...
secretsanta's user avatar
0 votes
0 answers
33 views

Direct Discriminative Pattern Mining for Effective Classification - implementation

I'm looking for any actual working code implementation of the DDPMiner algorithm mentioned in the Direct Discriminative Pattern Mining for Effective Classification article form 2008 I'm having real ...
Eli Zatlawy's user avatar
1 vote
1 answer
33 views

Help with DDP Mining algorithm for Effective Classification of data sets from 2 groups

I'm trying to implement the DDPmine algorithm from this article as part of some project, and I do not understand where in the algorithm we use the Class Label of each transaction? We have transactions ...
Eli Zatlawy's user avatar
1 vote
1 answer
39 views

Using Information from the rest of a Sequence to Predict the Label for any one Item

I have a dictionary of variable-length sequences: [(file_name[-10:], len(tag_is_header_list)) for file_name, tag_is_header_list in HEADER_PATTERN_DICT.items()] <...
Dave Babbitt's user avatar
1 vote
1 answer
49 views

Mining timelines in a long text

I am trying to detect timeline of brands histories. For my specific case, I believe it is easy because data is already clustered. For each Wikipedia article I can spot sentences surrounding dates. ...
bacloud14's user avatar
  • 453
2 votes
0 answers
117 views

Which one to choose to identify patterns of user activity: Sequence analysis or process mining?

I have the following user activity data that where for each user the activity type they were engaged are recorded along with the phase: ...
renakre's user avatar
  • 111
1 vote
0 answers
67 views

How to infer which sequence of events are more likely to result in an event of interest?

Background I have a sequence/series of events. Some sequences will end up with an event of interest $y$, while others won't. $$S_1 = [a, b, c, d, ..., y]$$ $$S_2 = [a, b, b, e, ..., a]$$ $$...$$ $$S_n ...
Ben's user avatar
  • 141
1 vote
0 answers
19 views

What is External representation of time in Sequential learning?

I am reading the literature on sequential learning and it is often mention that in order to handle sequential/temporal data, there two categories of work in sequential learning External ...
A.B's user avatar
  • 336
1 vote
1 answer
347 views

Similar algorithm to apriori to find unpopular sequential patterns

I am working with a dataset that looks like similar to this one but it is way larger (approx. 30.000 arrays): ...
Eve Edomenko's user avatar
1 vote
0 answers
31 views

Advanced frequent pattern identification

I have some dictionary data like this: ...
Arman Malekzadeh's user avatar
1 vote
0 answers
132 views

Multiple time series sequence prediction for multiple multivariate time series

My question is somehow similar to this question, but not satisfied with the answer. I have 100 samples, each sample consists of ...
Rajan's user avatar
  • 11
2 votes
1 answer
373 views

How to find pattern in sequential data?

I have multiple sequential data that lead up to an event. All I want to do if find the equivalent sequential data or a pattern that leads to the event. The data is also multivariate so I want to ...
Kyrios's user avatar
  • 21
0 votes
1 answer
426 views

Feature Selection algorithm/library for CRF

I am using the Conditional Random Fields CRF suite scikit-learn wrapper algorithm. I have read on the literature various approaches for feature selection, but I cannot find any on that package or, ...
20-roso's user avatar
  • 680
3 votes
1 answer
102 views

How to update the posterior belief when we are observing a stream of correlated data from a fixed but unknown data source

I want to build a [probabilistic] model that aims to infer the true value of an unknown categorical variable, $y \in \{1,2,..., K\}$. We have a dataset $(X,y): \mathbb{R}^d\rightarrow \{1,2,..., K\}$ ...
Mo-'s user avatar
  • 1,255
1 vote
0 answers
176 views

Most efficient algorithm for sequential pattern mining on a dataset with large amount of items in each transaction?

To provide some context, I am trying to do frequent pattern mining on a dataset of system error logs from servers. I organized it into transactions based on the thread ID, which results in some very ...
Diana's user avatar
  • 11
1 vote
0 answers
60 views

Pattern identification in data

I have some data in following format: ...
Sandeep Bhutani's user avatar
3 votes
0 answers
250 views

Time series pattern recognition

I have measured stress at 1 million points inside a material at 100 time steps. I have made a probability distribution plot for three time steps and I see that the evolution of stress looks like this: ...
user134439's user avatar
1 vote
0 answers
53 views

rule generation in a big dataset

Given a dataset with 30 fields and 25000 instances, 1) what are your suggestions for novel methods of rule extraction? 2) Can I use association rule mining in addition to sequential rule mining? 3)...
anna's user avatar
  • 11
0 votes
1 answer
281 views

Sequence extraction in a dataset

I am looking for a way to extract sequences/patterns from a dataset such as this one: ...
Nes's user avatar
  • 3
1 vote
0 answers
102 views

Mini-batches with sequential data

I am a little bit confused. When using mini-batches, it is a good idea to shuffle. This will not work if the training examples are dependent on each other, e.g. 5 minute voltage measurement data, ...
Ben Groene's user avatar
1 vote
0 answers
28 views

How to apply sequentinal MSE model to data that is not binary?

I have been using this model with binary data to predict likely hood of play from this guide. ...
RustyShackleford's user avatar
1 vote
0 answers
291 views

How to model machine learning problem for cache replacement policy?

I am trying to implement machine learning on Cache Replacement Policy. I want to train a ML model on labelled data acquire from Belady's Optimal Algorithm for Cache replacement policy. For example, ...
Jay Patel's user avatar
2 votes
0 answers
48 views

ACF (Autocorrelation) estimation

I have two signals "Signal A" and Signal B" and I plot the autocorrelation for each signal with itself as shown below. How I can determine which signal has a stronger correlation with itself. To ...
Neno M.'s user avatar
  • 165
1 vote
1 answer
287 views

Process mining with ML

I have a little more general question. My dataset consists of N sequences of events. Example of one sequence could be [A,B,C,D,X,Y] and another [A,B,Z], where letters represent different events. The ...
Matúš Košík's user avatar
0 votes
1 answer
965 views

Machine Learning: Classify Array of Numbers based on Patterns

I have experimented with various regression/classifier libraries, they accept training input like "5 is bad" and "10 is good" so they can tell you 7 is bad and 8 is good. Now imagine a more ...
user9114945's user avatar
2 votes
1 answer
419 views

Clustering events in a sequence

I have a sequence of recurring events that I would to group together into representing different operation activities of the underlying process. These events may have an order in their occurrence; or ...
bb5kb's user avatar
  • 33
1 vote
1 answer
183 views

Clustering/ Classifying users based on sequence of action and time

I have some user data where each user has a certain pattern of being at different places for some time. I would like to create a model which will cluster/classify these users based on these patterns ...
Y0gesh Gupta's user avatar
1 vote
0 answers
16 views

Model for 'Pattern to Pattern'?

How to create a model that will generate a similar pattern/image? And how sould I address it, if I only have 400 exmples after the augmentation. This is the kind of data I have (16X16) 0,0,0,0,0,0,0,...
Sahar Milis's user avatar
1 vote
1 answer
114 views

Detection of Anomalous Sequential User Behavior

I have a dataset containing a set of normal user sessions. Each session contains a suite of ordered user requests on N system resources {R1, ..., RN}. I want to design a continuous authentication ...
Houcine Amraoui's user avatar
2 votes
0 answers
500 views

k- means clustering on Markov chain trasition probability

I have data set of 50 students. I want to cluster them on their sequential data ( While doing a job they followed multiple sequences A, B, c total 7 stages). I am planning to apply k-means clustering ...
Bloodstone Programmer's user avatar
3 votes
2 answers
112 views

Collection Of Variable Length Sequences and Descriptions: A Search Problem

I have a tough problem and need some advice: Suppose I have a collection of variable length sequences, many of which are unique -- imagine the moves to a chess game, eg d4 Nf6 c4 g6 Nc3 Bg7 ...
elliptic_kid's user avatar
1 vote
1 answer
173 views

What is the best non-deep learning hand written digits recognition system?

What would be the best Sequence Mining Algorithm to use for Hand Written digit Recognition system (other then Deep learning)?
ou2105's user avatar
  • 387
1 vote
1 answer
575 views

Using python to identify common paths that users follow among different activities

I have a click-stream data of users regarding their behaviour in a platform. There are activities provided in a temporal order and users can go back and forth between these activities. Below is an ...
renakre's user avatar
  • 111
4 votes
0 answers
225 views

How's frequent pattern mining in data mining? [closed]

I am reading a paper Frequent pattern mining:current status and future directions. From this paper I learned that a lot of people did some interesting jobs in this field. But this review is published ...
Will Cai's user avatar
  • 153
0 votes
1 answer
59 views

Simplest way to train a number sequence generator

Here is all 34 rows of my training data: ...
Dave Babbitt's user avatar
2 votes
2 answers
396 views

Recognize and predict a periodic pattern

I need to design a controller that tries to collect as much falling objects (raindrops) from an unknown source. Beneficial to solving the problem could be the recognition of the seemingly random ...
hasdrubal's user avatar
  • 121