Questions tagged [sequential-pattern-mining]
The sequential-pattern-mining tag has no usage guidance.
55 questions
0
votes
1
answer
375
views
What is the best practice to detect constant and nearly constant data over time?
I'm experimenting with the characterization of data over time. I generated some synthesized data with certain periodic patterns over time every 5mins (granularity of 5mins= data generated with the ...
- 432
0
votes
1
answer
37
views
Identification of inexactly-recurring material in time series stream
I am working on a personal project involving the analysis of a stream of audio data and the identification of (non-verbatim) repeated subsequences.
My research on time series has so far lead me to ...
- 101
0
votes
1
answer
60
views
How can I solve this kind of problem about predicting the sequence of once in life events?
So let's imagine I have a dataset of children. For each of them a have a bunch of characteristics (generation, gender, race, class, urban/rural, religion, bmi, number of siblings etc..) and plus the ...
- 1
0
votes
0
answers
795
views
How to Use Generative AI for Time Series Forecasting?
What I have
A time series dataset of time stamps (hourly resolution), some covariates (like store foot-traffic) and items sold.
What to forecast
Number of items sold for next 24 hours, i.e. 24 ...
- 335
0
votes
1
answer
120
views
How RNN or LSTM delays the input
RNN or LSTM are known to hold the previous timestamp data as "memory" so that short or long range dependencies can be remembered.
But in the following simple keras model, where is that delay ...
- 914
2
votes
1
answer
340
views
What is the fastest way to detect periodicity in a binary time series?
Example,
T = array([0,1,1,1,0,0,1,0,1,1,1,0,0,1,1,1,1,1,0,0,1,0,1,1,1,0,0,1,0,1,1,0,0,0,1,0,1,1,1,0,0,1])
( T is almost a repeat of the array([0,1,1,1,0,0,1]) six ...
- 21
0
votes
1
answer
266
views
Improvement of the Keras model for a regression task
I am trying to build an expectation model for my (19502,3) data using Keras Sequential model. This dataset has been generated using a parametric sweep in a simulation software.
With this model, I want ...
- 1
3
votes
2
answers
2k
views
How to find common patterns in thousands of strings?
I don't want to find "abc" in strings ["kkkabczzz", "shdirabckai"]
Not like that.
But bigger patterns like this:
If I have to _________, then I will ___.
["If I have ...
- 131
2
votes
0
answers
1k
views
What algorithms exist for identify repeating patterns in a single image?
I am looking for algorithms or models for detecting and identifying repeated patterns in a single image. For example, an arbitrary smaller image might be pasted at random locations in the image. In ...
- 123
1
vote
3
answers
1k
views
How to use machine learning to find pattern of similar regions in signals
I have a long time series signal. This signal is usually very stable, but it will change when the sensor is stimulated, and this change is usually very short. I know this can be trained using the ...
- 111
3
votes
1
answer
1k
views
Is sequential pattern mining possible with machine learning?
I am curious if sequential pattern mining algoritmhs fill a unique gap or the same thing can be achieved with alternative methods for example wih machine learning or something else. Do you know any ...
- 133
0
votes
1
answer
785
views
Detect time pattern in sequence of events
I have a time series with a timestamp and an associated event:
Time
Event
1
A
2
B
3
C
T
A
I was wondering if there is a technique/method to figure out which events most often precede others in a ...
- 11
1
vote
1
answer
34
views
Help with DDP Mining algorithm for Effective Classification of data sets from 2 groups
I'm trying to implement the DDPmine algorithm from this article as part of some project, and I do not understand where in the algorithm we use the Class Label of each transaction?
We have transactions ...
- 111
1
vote
1
answer
39
views
Using Information from the rest of a Sequence to Predict the Label for any one Item
I have a dictionary of variable-length sequences:
[(file_name[-10:], len(tag_is_header_list)) for file_name,
tag_is_header_list in HEADER_PATTERN_DICT.items()]
<...
- 131
1
vote
1
answer
52
views
Mining timelines in a long text
I am trying to detect timeline of brands histories. For my specific case, I believe it is easy because data is already clustered. For each Wikipedia article I can spot sentences surrounding dates. ...
- 463
2
votes
0
answers
121
views
Which one to choose to identify patterns of user activity: Sequence analysis or process mining?
I have the following user activity data that where for each user the activity type they were engaged are recorded along with the phase:
...
- 111
1
vote
0
answers
72
views
How to infer which sequence of events are more likely to result in an event of interest?
Background
I have a sequence/series of events. Some sequences will end up with an event of interest $y$, while others won't.
$$S_1 = [a, b, c, d, ..., y]$$
$$S_2 = [a, b, b, e, ..., a]$$
$$...$$
$$S_n ...
- 141
1
vote
0
answers
20
views
What is External representation of time in Sequential learning?
I am reading the literature on sequential learning and it is often mention that in order to handle sequential/temporal data, there two categories of work in sequential learning
External ...
- 336
1
vote
1
answer
389
views
Similar algorithm to apriori to find unpopular sequential patterns
I am working with a dataset that looks like similar to this one but it is way larger (approx. 30.000 arrays):
...
- 113
1
vote
0
answers
32
views
1
vote
0
answers
137
views
Multiple time series sequence prediction for multiple multivariate time series
My question is somehow similar to this question, but not satisfied with the answer. I have 100 samples, each sample consists of ...
- 11
2
votes
1
answer
393
views
How to find pattern in sequential data?
I have multiple sequential data that lead up to an event. All I want to do if find the equivalent sequential data or a pattern that leads to the event. The data is also multivariate so I want to ...
- 21
0
votes
1
answer
465
views
Feature Selection algorithm/library for CRF
I am using the Conditional Random Fields CRF suite scikit-learn wrapper algorithm. I have read on the literature various approaches for feature selection, but I cannot find any on that package or, ...
- 688
3
votes
1
answer
105
views
How to update the posterior belief when we are observing a stream of correlated data from a fixed but unknown data source
I want to build a [probabilistic] model that aims to infer the true value of an unknown categorical variable, $y \in \{1,2,..., K\}$.
We have a dataset $(X,y): \mathbb{R}^d\rightarrow \{1,2,..., K\}$ ...
- 1,255
1
vote
0
answers
188
views
Most efficient algorithm for sequential pattern mining on a dataset with large amount of items in each transaction?
To provide some context, I am trying to do frequent pattern mining on a dataset of system error logs from servers. I organized it into transactions based on the thread ID, which results in some very ...
- 11
1
vote
0
answers
61
views
3
votes
0
answers
261
views
Time series pattern recognition
I have measured stress at 1 million points inside a material at 100 time steps. I have made a probability distribution plot for three time steps and I see that the evolution of stress looks like this:
...
- 31
1
vote
0
answers
53
views
rule generation in a big dataset
Given a dataset with 30 fields and 25000 instances,
1) what are your suggestions for novel methods of rule extraction?
2) Can I use association rule mining in addition to sequential rule mining?
3)...
- 11
0
votes
1
answer
317
views
Sequence extraction in a dataset
I am looking for a way to extract sequences/patterns from a dataset such as this one:
...
- 3
1
vote
0
answers
103
views
Mini-batches with sequential data
I am a little bit confused.
When using mini-batches, it is a good idea to shuffle. This will not work if the training examples are dependent on each other, e.g. 5 minute voltage measurement data, ...
- 51
1
vote
0
answers
28
views
How to apply sequentinal MSE model to data that is not binary?
I have been using this model with binary data to predict likely hood of play from this guide.
...
- 145
1
vote
0
answers
300
views
How to model machine learning problem for cache replacement policy?
I am trying to implement machine learning on Cache Replacement Policy. I want to train a ML model on labelled data acquire from Belady's Optimal Algorithm for Cache replacement policy.
For example,
...
- 11
2
votes
0
answers
49
views
ACF (Autocorrelation) estimation
I have two signals "Signal A" and Signal B" and I plot the autocorrelation for each signal with itself as shown below. How I can determine which signal has a stronger correlation with itself.
To ...
- 165
1
vote
1
answer
289
views
Process mining with ML
I have a little more general question. My dataset consists of N sequences of events. Example of one sequence could be [A,B,C,D,X,Y] and another [A,B,Z], where letters represent different events. The ...
- 11
0
votes
1
answer
1k
views
Machine Learning: Classify Array of Numbers based on Patterns
I have experimented with various regression/classifier libraries, they accept training input like "5 is bad" and "10 is good" so they can tell you 7 is bad and 8 is good.
Now imagine a more ...
- 103
2
votes
1
answer
443
views
Clustering events in a sequence
I have a sequence of recurring events that I would to group together into representing different operation activities of the underlying process.
These events may have an order in their occurrence; or ...
- 33
1
vote
1
answer
195
views
Clustering/ Classifying users based on sequence of action and time
I have some user data where each user has a certain pattern of being at different places for some time. I would like to create a model which will cluster/classify these users based on these patterns ...
- 111
1
vote
0
answers
16
views
Model for 'Pattern to Pattern'?
How to create a model that will generate a similar pattern/image?
And how sould I address it, if I only have 400 exmples after the augmentation.
This is the kind of data I have (16X16)
0,0,0,0,0,0,0,...
- 156
1
vote
1
answer
115
views
Detection of Anomalous Sequential User Behavior
I have a dataset containing a set of normal user sessions. Each session contains a suite of ordered user requests on N system resources {R1, ..., RN}.
I want to design a continuous authentication ...
- 111
2
votes
0
answers
513
views
k- means clustering on Markov chain trasition probability
I have data set of 50 students. I want to cluster them on their sequential data ( While doing a job they followed multiple sequences A, B, c total 7 stages). I am planning to apply k-means clustering ...
3
votes
2
answers
114
views
Collection Of Variable Length Sequences and Descriptions: A Search Problem
I have a tough problem and need some advice:
Suppose I have a collection of variable length sequences, many of which are unique -- imagine the moves to a chess game, eg
d4 Nf6
c4 g6
Nc3 Bg7
...
- 31
1
vote
1
answer
193
views
What is the best non-deep learning hand written digits recognition system?
What would be the best Sequence Mining Algorithm to use for Hand Written digit Recognition system (other then Deep learning)?
- 387
1
vote
1
answer
586
views
Using python to identify common paths that users follow among different activities
I have a click-stream data of users regarding their behaviour in a platform. There are activities provided in a temporal order and users can go back and forth between these activities. Below is an ...
- 111
4
votes
0
answers
228
views
How's frequent pattern mining in data mining? [closed]
I am reading a paper Frequent pattern mining:current status and future directions.
From this paper I learned that a lot of people did some interesting jobs in this field. But this review is published ...
- 153
0
votes
1
answer
59
views
2
votes
2
answers
423
views
Recognize and predict a periodic pattern
I need to design a controller that tries to collect as much falling objects (raindrops) from an unknown source. Beneficial to solving the problem could be the recognition of the seemingly random ...
- 121
3
votes
2
answers
324
views
Supervised Learning on Sequential data
I am doing credit risk modelling on costumer transaction data a part of which looks like this :
...
- 378
0
votes
2
answers
139
views
How to "count" certain events in a time series
What techniques are suitable and what do I need to learn in order to
detect and count the number of "events" (pic) that consist of:
a) shape 1 3 and 4 and not of (2 and 5) or
b) of all shapes above ...
- 33
3
votes
2
answers
5k
views
best python library for finding sequential rules mining?
I want to do sequence learning for that I want to find frequent sequential rules ,this rule consider the order of occurrence
- 41
2
votes
1
answer
197
views
Network Visualization - R code - Which Package is needed?
I'm trying to create a network visualization to study the flights to and from a certain airport.
My data consists of 123000 rows in this format:
...
- 367