Questions tagged [time-series]

Time series are data observed over time (either in continuous time or at discrete time periods).

769 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
9
votes
2answers
1k views

Input for LSTM for financial time series directional prediction

I'm working on using an LSTM to predict the direction of the market for the next day. My question concerns the input for the LSTM. My data is a financial time series $x_1 \ldots x_t$ where each $x_i$...
8
votes
2answers
2k views

Forecasting Multiple (few hundreds) uni-variate time series with inflated zeros

I am a novice seeking help to gain experience in Data Science. Let us take a scenario where a big company would like to forecast its sales (a specific product) across different stores in different ...
6
votes
2answers
1k views

Triangle Pattern Recognition on Financial Market with Python

I'm working on a personal project to find Triangles on any stock in Python. I detect the max and min points (shift(-5,+5) because if I consider only shift(-1+1) I have a lot of lines) and write lines ...
5
votes
2answers
74 views

Detecting abundance of a certain periodic pattern in a time series?

I am really stumped at the moment about how to solve a particular problem. I have many time series like this: This represents the number of hours a person spends on a website each day throughout the ...
5
votes
1answer
681 views

Time Series pattern recognition and classification problem

I have some labeled sensor data. Now, I would like to know how to extract features from time series using DFT, DWT, and HAAR transforms. I know that the transformations above transform a signal to ...
5
votes
3answers
333 views

Cluster evolution over time

I have a dataset of transactional data with customer ID and I want to segment the dataset into groups using cluster analysis. I'm interested in following the evolution of each cluster over time, but ...
4
votes
0answers
78 views

Applying Differencing on a time series, before or after train and test split?

I am attempting to improve my RNN model by making my dependent variable, a stock price, non-stationary. I am aiming to make the series stationary by removing the trend with a log transformation and ...
4
votes
0answers
113 views

Repeated k-fold Cross Validation for time series data?

I have a relative small sample size (330 with 45 features) + it's time series data. I want to train my LightGBM regression model for best generalized RMSE score and want to use repeated CV. I use ...
4
votes
1answer
88 views

How to find lagged cross correlation between time series?

I have 2 time series, $X$ and $Y$, and I'm trying to find the best lag range that correlates $X$ to $Y$ (find the amount(s) of lag of $X$ that best correlate to the target variable $Y$). For instance, ...
4
votes
2answers
452 views

How to identify recurring patterns in this set of transactional data

I'm working on a dataset of banking transactions and would like to find recurrent transactions. I've been mapping transactions per merchant in timeseries, and tried to use acf from statsmodels.tsa....
4
votes
1answer
3k views

Autoencoders for the compression of time series

I am trying to use autoencoder (simple, convolutional, LSTM) to compress time series. Here are the models I tried. Simple autoencoder: ...
4
votes
0answers
58 views

Fitting model to differenced time series

I have a time series on daily stock price of company(2013 data points).I took a first order difference and the following acf and pacf plots of the differenced series were obtained. However, I am ...
4
votes
1answer
901 views

Train LSTM model with multiple time series

I am predicting energy usage for a bedroom within a school residential building with date, temperature, and humidity as input features, using 7 time-steps and ...
4
votes
1answer
4k views

Monthly trend with fb prophet-Interpreting the graph

I have monthly data with month/year in one column and price on another. I would like to get a yearly trend with fb prophet library in python (how to use monthly data with the library is explained at ...
4
votes
1answer
532 views

k-Nearest Neighbours with time series data - how to obtain whole-time-period estimators

I have a large dataset for the activities performed by multiple staff in a factory over a long period of time - 01/01/2017 - present. The activities performed by the different staff are recorded at ...
4
votes
0answers
75 views

Classify driver based on time-series sensor data

I want to build a model that can detect which driver is driving now the car based on a dataset that contains 20 driver records for 3600s each driver ( the dataset contains all the car sensors values ...
4
votes
1answer
12k views

Plot of ACF & PACF

There are 96 observations of energy consumption per day from 01/05/2016 - 31/05/2017. I am trying an ARIMA model in R to be fitted to these time series observations. I have chosen the frequency of ...
4
votes
2answers
289 views

how to calculate p value

I need to calculate statistical significance between two time series, each with 4500 terms. My null hypothesis is that $H_0: \mu=\mu_0$ (value in time t of first time series is equal to value in time ...
4
votes
3answers
265 views

How can one generate future forecasts from probabilistic events?

I have an event "whether an item sold will be returned or not" which I can predict with a certain probability based on information gathered at the time that the purchase occurs (product features, ...
3
votes
1answer
37 views

ML model to forecast time series data

This question has three sub-parts, answering each of which probably doesn't require huge text. I hope that is okay. I'm trying to understand time series prediction using ML. I have the target variable ...
3
votes
0answers
61 views

Appropriate visualization for this kind of data

Late edit: currently working through the FlameGraphs bibliography here. It looks like what I'm doing is similar to an icicle chart, but with passage of time on the x-axis. The author mentions ...
3
votes
0answers
60 views

Detecting pushups based on pose data

I've been playing with Google's MLKit, and decided to detect push ups. As a quick test, I took the position of the left shoulder, and plotted the Y Axis. Here's how a variety of trials look: Five ...
3
votes
1answer
392 views

Why does my CNN validation loss increase immediately, even with lots of data?

The Issue I've been working on a regression CNN implementation to predict time series data and have run into an issue where my validation loss and training loss diverge immediately during training, as ...
3
votes
1answer
45 views

preprocessing time sequence

I have a long list of event (400 unique events, sequence ~10M long). I want to train an RNN to predict next event. The preprocessing steps i took are: (1) turning to OneHotEncoding using pandas: <...
3
votes
0answers
2k views

How to apply a groupby rolling function to create multiple columns in the dataframe

I am setting up a volume profile series over a stock data. I have implemented the market profile code from this github repo and the link to the data is here and the example here. Some Sample of data ...
3
votes
2answers
81 views

How can I approach this problem?

Let's say I have a dataset with pricing information for the same flight during the past year. So, for a flight departing on day D, I have the available price from D-130 up to D (departure day). Then ...
3
votes
1answer
86 views

How to update the posterior belief when we are observing a stream of correlated data from a fixed but unknown data source

I want to build a [probabilistic] model that aims to infer the true value of an unknown categorical variable, $y \in \{1,2,..., K\}$. We have a dataset $(X,y): \mathbb{R}^d\rightarrow \{1,2,..., K\}$ ...
3
votes
0answers
79 views

summarizing time series dataset: extract time window sliding, change points, pattern seasonality in time series

I need to detect list of change points in time series dataset (temperature), and I need to split dataset into set of classes (patterns) and detect seasonality of each class (pattern). for example ...
3
votes
2answers
169 views

Similarity Measure of Simulated Time Series vs Observed time Series

In my work I have an observed Time Series and Simulated ones. I want to compare the Light Curves and check for similarityto find out which simulated curve fits best respectivley which parameters ...
3
votes
0answers
500 views

Is there a way to use Plotly as an annotation tool, for labelling time-series for instance?

I have been tasked to create a tool aimed at labelling sections and/or precise data points of a biomedical time-series. Our main framework is written in Python. I would like to know whether it is ...
3
votes
1answer
63 views

What Models should i try for this problem?

I need some advice for a problem i'm working on with automobile data. The vehicles provide a series of codes at every second which are bieng stored, though it can vary how many. For example , at time ...
3
votes
0answers
50 views

Timeseries prediction error measurement. How to deal with diffrent time scales?

I have some time series and a prediction model. Now I would like to measure how good/bad the prediction is for different products. The problem is that for each product the time points (frequency of ...
3
votes
1answer
1k views

Advice on imputing temperature data with StatsModels MICE

This may be a dumb question but I can't figure out how to actually get the values imputed using StatsModels MICE back into my data. I have a dataframe (dfLocal) with hourly temperature records for ...
3
votes
0answers
36 views

Keras 'cross section' model with time trend

Problem: I have a problem in which cross-sectional features (X) explain a continuous outcome (y). In addition, there is a linear time trend (t) in the data. Using OLS, such a model would write: $y = ...
3
votes
0answers
164 views

Time series pattern recognition

I have measured stress at 1 million points inside a material at 100 time steps. I have made a probability distribution plot for three time steps and I see that the evolution of stress looks like this: ...
3
votes
1answer
160 views

Clustering time series based on monotonic similarity

Context I am involved in the task of clustering 1500 time series of 500 observations into a few clusters. The time series share all the same observed properties at different spatial locations, but ...
3
votes
2answers
724 views

Dealing with time series data which has multiple observations for the same timestamp

I have a time series data in Python 3 as follows: ...
3
votes
0answers
295 views

Multivariate time Series classification - One class

I need your help with time series classification. I have measurements of different medical parameters for patients captured at every one hour. The output label is whether the patient has Acute Kidney ...
3
votes
0answers
231 views

Layman's explanation of when to use which smoother algorithm/technique: FFT, loess, Savitzky-Golay, etc

As an analytics practitioner, I frequently come across noisy data (e.g. IoT data). When building a model or machine learning algorithm, it can be advantageous to smooth this data. Over the years, I ...
3
votes
1answer
45 views

Detect Missing Records in Dataset

I have a dataset that contains several measures from various widgets on a daily basis. While the widgets remain relatively stable over time, sometimes there are legitimate reasons for one to disappear ...
3
votes
1answer
93 views

Need help on Time Series ARIMA Model

I'm working on forecasting daily volumes and have used time series model to check for data stationarity. However, I'm strugging at forecasting data with 90% accuracy. Right now variation is extremely ...
3
votes
0answers
366 views

Anomaly detection in cooling process data without exact labels

I have a data set where I look at the cooling of a process. The starting temperature may vary between 580 and 180 degrees. I know that at some point the cooling system failed (see examples in the plot)...
3
votes
1answer
230 views

Data normalization in nonstationary data classification with Learn++.NSE based on MLP

I need to predict technical aggregate condition using vibration monitoring data. We consider this data to be nonstationary i.e. distribution parameters and descriptive statistics are not constant. I ...
3
votes
0answers
207 views

Methods for analyzing multiple time series

My agenda is finding patterns and possible a model that describe my data. My data is comprised of multiple time-series uni-variate sets. ...
3
votes
3answers
90 views

Find recurrent dates in a small set (and get rid of non recurrent ones)

I need help in the analyse of a categorization problem. Given a set of dates (small set: 20 elements maximum), I would like to group dates which are equally distributed (with a tolerance). It can be,...
3
votes
0answers
979 views

Predict event likelihood given time of other events

On a daily basis there is a sequence of events. Each event may or may not occur on a given day. Given the times of the preceding events for the current day I want to be able to say whether there is ...
3
votes
0answers
104 views

How to find a model for a short discrete time-series?

I'm examining the activity of customers over the years which have about one event per year. This results is many short time-series for which I found the distributions (hit/miss over 4 years sorted by ...
2
votes
0answers
15 views

Why does a linear regression in time series forecasting does not provide a line in predictions?

I'm reading the TensorFlow Time Series forecasting Tutorial 1 trying to perform my own time series prediction. However, specifically on single-shot models section for multiple time steps, the Linear ...
2
votes
0answers
25 views

Models for Long-Term Time-Series Forecasting and Pattern Recognition

I'm trying to find a solution for long-term electricity hourly prices forecasting. Explaining simply, I have some data from 2018 - 2021 containing Demand, Renewable Generation, Hydropower Generation, ...
2
votes
0answers
26 views

Why the LSTM on Keras does not work correctly when it is necessary to predict several steps forward

I used AirPassenger Dataset. And based on several previous values(for examples 20) I want to predict several(3 or 5) steps in future. Like X -> y [10,20,30,....200]->[210,220,230] [20,30,40,.......

1
2 3 4 5
16