Questions tagged [sequential-pattern-mining]
The sequential-pattern-mining tag has no usage guidance.
58
questions
0
votes
0
answers
12
views
Pattern recognition in time data serie
I have a log file with phone call data, described by 2 attributes: call_time, call_from. I want to discover some patterns in the data, using some statistical method. I don't have any predefined ...
- 101
0
votes
0
answers
21
views
How to train Keras Sequential model in batches?
newbie here. I have a large dataset in many local CSV files. It's impossible to fit it in memory within budget. How can I train a Sequential model in batches? I've found ...
- 105
0
votes
1
answer
26
views
How can I solve this kind of problem about predicting the sequence of once in life events?
So let's imagine I have a dataset of children. For each of them a have a bunch of characteristics (generation, gender, race, class, urban/rural, religion, bmi, number of siblings etc..) and plus the ...
- 1
0
votes
0
answers
163
views
How to Use Generative AI for Time Series Forecasting?
What I have
A time series dataset of time stamps (hourly resolution), some covariates (like store foot-traffic) and items sold.
What to forecast
Number of items sold for next 24 hours, i.e. 24 ...
- 315
0
votes
0
answers
30
views
Sequence Regression and Sequence Learning
My training data is structured as sequential data in the following format:
where $n$ represents the $n$th data point in my training data of length $N$, and $m \leq M := M(n)$ represents the $m$th ...
- 101
0
votes
0
answers
17
views
Can support be accounted multiple time for same sequence in sequential pattern mining?
I want to find top-k frequent sequential patterns from a list of sequences. Order of occurrence matters here (subsequence (1,2) is not same as (2,1)). Suppose I have 2 sequences:
S1=[1,2,3,1,5,2]
S2=[...
- 1
0
votes
1
answer
70
views
How RNN or LSTM delays the input
RNN or LSTM are known to hold the previous timestamp data as "memory" so that short or long range dependencies can be remembered.
But in the following simple keras model, where is that delay ...
- 884
2
votes
1
answer
76
views
What is the fastest way to detect periodicity in a binary time series?
Example,
T = array([0,1,1,1,0,0,1,0,1,1,1,0,0,1,1,1,1,1,0,0,1,0,1,1,1,0,0,1,0,1,1,0,0,0,1,0,1,1,1,0,0,1])
( T is almost a repeat of the array([0,1,1,1,0,0,1]) six ...
- 21
0
votes
1
answer
99
views
Improvement of the Keras model for a regression task
I am trying to build an expectation model for my (19502,3) data using Keras Sequential model. This dataset has been generated using a parametric sweep in a simulation software.
With this model, I want ...
- 1
2
votes
2
answers
719
views
How to find common patterns in thousands of strings?
I don't want to find "abc" in strings ["kkkabczzz", "shdirabckai"]
Not like that.
But bigger patterns like this:
If I have to _________, then I will ___.
["If I have ...
- 121
2
votes
0
answers
530
views
What algorithms exist for identify repeating patterns in a single image?
I am looking for algorithms or models for detecting and identifying repeated patterns in a single image. For example, an arbitrary smaller image might be pasted at random locations in the image. In ...
- 123
1
vote
3
answers
464
views
How to use machine learning to find pattern of similar regions in signals
I have a long time series signal. This signal is usually very stable, but it will change when the sensor is stimulated, and this change is usually very short. I know this can be trained using the ...
- 111
3
votes
1
answer
782
views
Is sequential pattern mining possible with machine learning?
I am curious if sequential pattern mining algoritmhs fill a unique gap or the same thing can be achieved with alternative methods for example wih machine learning or something else. Do you know any ...
- 133
0
votes
1
answer
497
views
Detect time pattern in sequence of events
I have a time series with a timestamp and an associated event:
Time
Event
1
A
2
B
3
C
T
A
I was wondering if there is a technique/method to figure out which events most often precede others in a ...
- 11
0
votes
0
answers
29
views
Direct Discriminative Pattern Mining for Effective Classification - implementation
I'm looking for any actual working code implementation of the DDPMiner algorithm mentioned in the
Direct Discriminative Pattern Mining for Effective Classification article form 2008
I'm having real ...
- 111
1
vote
1
answer
28
views
Help with DDP Mining algorithm for Effective Classification of data sets from 2 groups
I'm trying to implement the DDPmine algorithm from this article as part of some project, and I do not understand where in the algorithm we use the Class Label of each transaction?
We have transactions ...
- 111
1
vote
1
answer
38
views
Using Information from the rest of a Sequence to Predict the Label for any one Item
I have a dictionary of variable-length sequences:
[(file_name[-10:], len(tag_is_header_list)) for file_name,
tag_is_header_list in HEADER_PATTERN_DICT.items()]
<...
- 131
1
vote
1
answer
49
views
Mining timelines in a long text
I am trying to detect timeline of brands histories. For my specific case, I believe it is easy because data is already clustered. For each Wikipedia article I can spot sentences surrounding dates. ...
- 453
2
votes
0
answers
112
views
Which one to choose to identify patterns of user activity: Sequence analysis or process mining?
I have the following user activity data that where for each user the activity type they were engaged are recorded along with the phase:
...
- 111
1
vote
0
answers
65
views
How to infer which sequence of events are more likely to result in an event of interest?
Background
I have a sequence/series of events. Some sequences will end up with an event of interest $y$, while others won't.
$$S_1 = [a, b, c, d, ..., y]$$
$$S_2 = [a, b, b, e, ..., a]$$
$$...$$
$$S_n ...
- 141
1
vote
0
answers
18
views
What is External representation of time in Sequential learning?
I am reading the literature on sequential learning and it is often mention that in order to handle sequential/temporal data, there two categories of work in sequential learning
External ...
- 316
1
vote
1
answer
307
views
Similar algorithm to apriori to find unpopular sequential patterns
I am working with a dataset that looks like similar to this one but it is way larger (approx. 30.000 arrays):
...
- 113
1
vote
0
answers
31
views
1
vote
0
answers
117
views
Multiple time series sequence prediction for multiple multivariate time series
My question is somehow similar to this question, but not satisfied with the answer. I have 100 samples, each sample consists of ...
- 11
2
votes
1
answer
320
views
How to find pattern in sequential data?
I have multiple sequential data that lead up to an event. All I want to do if find the equivalent sequential data or a pattern that leads to the event. The data is also multivariate so I want to ...
- 21
0
votes
1
answer
378
views
Feature Selection algorithm/library for CRF
I am using the Conditional Random Fields CRF suite scikit-learn wrapper algorithm. I have read on the literature various approaches for feature selection, but I cannot find any on that package or, ...
- 670
3
votes
1
answer
99
views
How to update the posterior belief when we are observing a stream of correlated data from a fixed but unknown data source
I want to build a [probabilistic] model that aims to infer the true value of an unknown categorical variable, $y \in \{1,2,..., K\}$.
We have a dataset $(X,y): \mathbb{R}^d\rightarrow \{1,2,..., K\}$ ...
- 1,225
1
vote
0
answers
169
views
Most efficient algorithm for sequential pattern mining on a dataset with large amount of items in each transaction?
To provide some context, I am trying to do frequent pattern mining on a dataset of system error logs from servers. I organized it into transactions based on the thread ID, which results in some very ...
- 11
1
vote
0
answers
54
views
3
votes
0
answers
234
views
Time series pattern recognition
I have measured stress at 1 million points inside a material at 100 time steps. I have made a probability distribution plot for three time steps and I see that the evolution of stress looks like this:
...
- 31
1
vote
0
answers
53
views
rule generation in a big dataset
Given a dataset with 30 fields and 25000 instances,
1) what are your suggestions for novel methods of rule extraction?
2) Can I use association rule mining in addition to sequential rule mining?
3)...
- 11
0
votes
1
answer
209
views
Sequence extraction in a dataset
I am looking for a way to extract sequences/patterns from a dataset such as this one:
...
- 3
1
vote
0
answers
99
views
Mini-batches with sequential data
I am a little bit confused.
When using mini-batches, it is a good idea to shuffle. This will not work if the training examples are dependent on each other, e.g. 5 minute voltage measurement data, ...
- 51
1
vote
0
answers
28
views
How to apply sequentinal MSE model to data that is not binary?
I have been using this model with binary data to predict likely hood of play from this guide.
...
- 145
1
vote
0
answers
285
views
How to model machine learning problem for cache replacement policy?
I am trying to implement machine learning on Cache Replacement Policy. I want to train a ML model on labelled data acquire from Belady's Optimal Algorithm for Cache replacement policy.
For example,
...
- 11
2
votes
0
answers
45
views
ACF (Autocorrelation) estimation
I have two signals "Signal A" and Signal B" and I plot the autocorrelation for each signal with itself as shown below. How I can determine which signal has a stronger correlation with itself.
To ...
- 165
1
vote
1
answer
277
views
Process mining with ML
I have a little more general question. My dataset consists of N sequences of events. Example of one sequence could be [A,B,C,D,X,Y] and another [A,B,Z], where letters represent different events. The ...
- 11
0
votes
1
answer
882
views
Machine Learning: Classify Array of Numbers based on Patterns
I have experimented with various regression/classifier libraries, they accept training input like "5 is bad" and "10 is good" so they can tell you 7 is bad and 8 is good.
Now imagine a more ...
- 103
2
votes
1
answer
387
views
Clustering events in a sequence
I have a sequence of recurring events that I would to group together into representing different operation activities of the underlying process.
These events may have an order in their occurrence; or ...
- 33
1
vote
1
answer
172
views
Clustering/ Classifying users based on sequence of action and time
I have some user data where each user has a certain pattern of being at different places for some time. I would like to create a model which will cluster/classify these users based on these patterns ...
- 111
1
vote
0
answers
16
views
Model for 'Pattern to Pattern'?
How to create a model that will generate a similar pattern/image?
And how sould I address it, if I only have 400 exmples after the augmentation.
This is the kind of data I have (16X16)
0,0,0,0,0,0,0,...
- 156
1
vote
1
answer
108
views
Detection of Anomalous Sequential User Behavior
I have a dataset containing a set of normal user sessions. Each session contains a suite of ordered user requests on N system resources {R1, ..., RN}.
I want to design a continuous authentication ...
- 111
2
votes
0
answers
471
views
k- means clustering on Markov chain trasition probability
I have data set of 50 students. I want to cluster them on their sequential data ( While doing a job they followed multiple sequences A, B, c total 7 stages). I am planning to apply k-means clustering ...
3
votes
2
answers
110
views
Collection Of Variable Length Sequences and Descriptions: A Search Problem
I have a tough problem and need some advice:
Suppose I have a collection of variable length sequences, many of which are unique -- imagine the moves to a chess game, eg
d4 Nf6
c4 g6
Nc3 Bg7
...
- 31
1
vote
1
answer
155
views
What is the best non-deep learning hand written digits recognition system?
What would be the best Sequence Mining Algorithm to use for Hand Written digit Recognition system (other then Deep learning)?
- 387
1
vote
1
answer
547
views
Using python to identify common paths that users follow among different activities
I have a click-stream data of users regarding their behaviour in a platform. There are activities provided in a temporal order and users can go back and forth between these activities. Below is an ...
- 111
4
votes
0
answers
214
views
How's frequent pattern mining in data mining? [closed]
I am reading a paper Frequent pattern mining:current status and future directions.
From this paper I learned that a lot of people did some interesting jobs in this field. But this review is published ...
- 153
0
votes
1
answer
59
views
2
votes
2
answers
390
views
Recognize and predict a periodic pattern
I need to design a controller that tries to collect as much falling objects (raindrops) from an unknown source. Beneficial to solving the problem could be the recognition of the seemingly random ...
- 121
3
votes
2
answers
316
views
Supervised Learning on Sequential data
I am doing credit risk modelling on costumer transaction data a part of which looks like this :
...
- 358