Questions tagged [finance]
Field concerned with the allocation (investment) of assets and liabilities over space and time, often under conditions of risk or uncertainty.
58
questions
1
vote
0
answers
15
views
Discrete wavelet transform - DWT (beginner)
I recently stumbled upon this article : https://www.bportugal.pt/sites/default/files/anexos/papers/wp201612_0.pdf
In the paper they use DWT and I am having trouble understanding how to construct them. ...
- 106
0
votes
0
answers
36
views
Which error metric is best for financial returns?
I am trying to predict price change i.e most of the time values around zero (+ and -). In my backtest I predict only one period during test. I would like to know in each iteration which model was the ...
- 106
0
votes
0
answers
15
views
Data source for financial data mining
I plan to do data modeling in the financial area for my master's dissertation. I am thinking of finding the connection between a certain company or country characteristics ( x values) and their ...
- 1
1
vote
0
answers
60
views
Workflow for stock prediction in machine learning
I'm trying to find the best workflow for a stock prediction problem.
My idea goes as follows : I will use a classfication and a regression at the same time
Classification (-1 ; 0 ; 1)
Regression (...
- 106
1
vote
1
answer
38
views
Persistence and stationarity together
I am trying to analyse a time series. I want to get only quantitative results (so, I'm excluding things like "looking at this plot we can note..." or "as you can see in the chart ...&...
- 169
0
votes
0
answers
22
views
Automatize autocorrelation in python
I'm trying to automatize my autocorrelation study in Python. My question is: is it possible?
Let me explain. I have a time series and I just learnt how to interpret the autocorrelation plot. My ...
- 169
2
votes
0
answers
42
views
change target variable value to reflect better affordability
Context
I am working on a regression problem trying to predict affordability.
My dataset contains daily installments repaying a purchase in a form of contract. Essentially, a minimum daily rate the ...
- 21
1
vote
0
answers
27
views
Legal issues with Machine Learning [closed]
I'm confused with why people claim that current legal system cannot handle any wrongdoings of algorithms that involve Machine Learning and Artificial Intelligence. The claim is that it is impossible ...
- 11
0
votes
1
answer
61
views
"Up or down but not sideways" bimodal time series prediction - what is the best way to model it?
Say I have a time series (e.g. bitcoin price). I want to predict tomorrow's price, specifically tomorrow's % change in price from today. Let's say this is gaussian distributed, with the mean at 0%.
If ...
- 111
1
vote
0
answers
27
views
Linear regression of times series data with heteroskedasticity
I am trying to find out if stock market movements, on average and in extreme conditions, affect gold prices. I am following the regression model proposed by Baur and McDermott (2010) which is given as:...
- 11
0
votes
0
answers
32
views
Data Transformation for Machine Learning Regression Task
I am performing a ML regression task, using XGBoost Regressor. I am using financial time series data, namely the Close price of the EUR/USD exchange rate which I will transform into geometric log ...
0
votes
0
answers
9
views
Algortihm for distributing volume in 1min stock intervals
Context: I have historical 1min prices for stocks, including premarket. However, when importing real-time data, the standard practice in the financial data industry is to give only OHLC (open, high, ...
- 121
0
votes
1
answer
43
views
Regression and Classification, which is better in financial market price prediction?
I want to use a model to trade in finanical market.
which i have several features, like macd, rsi, or other common features.
and my target is to make a tradeable predict in every time point.
so my ...
- 117
0
votes
1
answer
27
views
Steps to fit a Machine learning model for prediction of up and down market movement
I have around 5 years of data of an index containing many features on a daily basis. I want to classify whether the index will move up or down the next trading day (up or down movement is determined ...
1
vote
0
answers
36
views
Optimize Yahoo Finance Code for Analysis [closed]
I am trying to analyze a number of companies using financial data I gathered from Yahoo Finance. I am also using the yfinance API to get some more details about the company using functions. Since I am ...
- 301
1
vote
0
answers
27
views
How does the GAN based prediction in K. Zhang et al. (2018) improve performance?
In Stock Market Prediction Based on Generative Adversarial Network by K. Zhang et. al, the authors feed financial data (X0...Xt) into an LSTM to predict Xt+1.
Then, they evaluate whether the series (...
- 584
1
vote
1
answer
785
views
How do I get Multiple CSV files (csv file names will be column names) from a folder to a pandas dataframe?
I think the title is enough for what is my problem here. I have 100 tickers in a folder. I got all csv files to one list. but I wanna see the tickers name which these are csv file names.
what should ...
- 11
0
votes
1
answer
45
views
Should I concat multiple stock timeseries datasets into one?
I have several timeseries datasets of stock data, with fundamental indicators. I would like to build a model that selects stocks for buy and hold.
I understand that to perform this task I have two ...
- 1
1
vote
1
answer
170
views
How to find the best fitting parametric distribution for an empirical dataset (stock returns)?
Given some real-valued empirical data (time series), I could convert it to a histogram to have an (non-parametric) empirical distribution of the data, but histograms are blocky and jagged.
Instead, I ...
- 214
1
vote
0
answers
84
views
Matching financial reconciliation data / matching multiple rows based on column values
I'm working with financial reconciliation data and the ask is to train the algorithm to match transactions (that are otherwise manually matched if the existing application didn't because not all the ...
- 11
2
votes
2
answers
42
views
Predicting financial data (choosing a model)
it is my first time doing something with financial data. I have a dataset with account numbers and some other information about each client (some clients span more than one row since we have info for ...
1
vote
0
answers
19
views
Correcting high AR(1) coefficients in dynamic Gordon model
I have just finished my thesis on a heterogeneous dividend expectations model applied to the COVID-19 crisis! However after receiving some feedback there is one last issue I want to resolve. I'm using ...
0
votes
3
answers
56
views
What's the best way to do classification basing on two given datasets (annual data and daily data)?
I want to do binary-classification basing on two given dataset, one is annual statistical data of a company and has the label I should be able to predict like this:
...
- 26
0
votes
1
answer
34
views
How to measure Covid impact by analysing credit card transaction of customer
I Want to know how can I identify that is the customer is in financial distress due to the COVID situation using its credit card transactions.
I have a daily transaction of customers till current ...
- 11
1
vote
0
answers
20
views
Lasso stricter with more data
I am currently analyzing investment strategies, and have implemented a backtest accordingly. This essentially means that I predict returns each month by using all prior historical data. Consequently, ...
- 111
2
votes
0
answers
27
views
Financial Time Series and Machine Learning question
I am working on a Machine Learning project applied to a financial time series.
Initially, I grabbed features (open, high, low, close) and implemented a Random Forest.
One of the subsequent tasks ...
- 21
2
votes
0
answers
294
views
Will flattening multivariate time series data before clustering make the results meaningless?
I have a large number of financial time series that I wish to do cluster analysis on. Each time series has the same length and spans multiple years of daily data (returns, volatility, etc.). As part ...
- 121
1
vote
1
answer
109
views
Image classification on stock data
I am trying to classify stock images into 4 categories:
Category 1: Image patterns which gives more than 10% profit next 3
day.
Category 2: Image patterns which gives less than 10% profit but
...
- 111
1
vote
0
answers
12
views
Corpus suggestion for financial domain [closed]
I am looking for a financial corpus or any form of publicly available financial texts which is replete with technical terms and acronyms.
Any suggestion is appreciated.
- 111
-1
votes
2
answers
1k
views
What is the approx minimum size of dataset required to build 90% correct model?
I am working with a financial dataset size which is around 3000. I have attempted the supervised-learning regression techniques and not able to go beyond 70% accuracy.
Features: 10
Data size:3700
...
- 151
1
vote
2
answers
66
views
Understandable and explainable machine learning model
I want to find formula for best financial portfolio.
Inputs: Historical fundamental data for last 15 years. For 3000 companies for every quatal we have things like ...
- 121
1
vote
0
answers
14
views
Bootstrapped curves and machine learning
I am exploring machine learning models to employ for my use case as described below and would appreciate some expertise
Effectively I have bootstrapped bond prices to derive a zero coupon curve for ...
- 121
1
vote
2
answers
782
views
Splitting training and test set with financial data
I am using trees algorithms (decision tree, random forest and XGBoost) to forecast the sign of the returns in the stock market (classification).
I am using this article as a reference:
http://...
- 13
0
votes
1
answer
124
views
How do I find all the drastic changes in the stock and fetch news for those days of the stock?
I am analyzing MindTree company's stocks as an internship project using python pandas and have been given the task to find all the drastic changes by looking at the produced plot for the stock and ...
user77166
0
votes
1
answer
29
views
May I use the same data in several time series intervals?
I am playing with RNNs / LTSMs for a classification task in predicting financial data.
I have a time-series going many years back, and are planning to divide it into a number of shorter time-...
- 115
1
vote
2
answers
210
views
LSTM for financial data
I'm using LSTM to predict financial data. As input data I use log returns and I want to predict the next day market movement. Do I need to retrain the ANN every day in order to keep time consistency ...
- 85
2
votes
2
answers
3k
views
How is data science applied in investment banking?
What do data scientists do at investment banks? What tools are they using? What kind of analysis are they doing? Why are they doing it? Etc.
- 437
2
votes
2
answers
2k
views
Binary Classification Probabilities
I'm using keras in R to predict financial time series. I guess that ANN converges.
But when I do predictions I can see that probabilities don't sum up to 1
I'm using ...
- 85
1
vote
1
answer
740
views
Predict the loss amount for insurance policies using the historical trends and features?
Anyone who has worked with insurance policy datasets, please guide me to an appropriate dataset for this problem .
Also, what is this 'loss amount' and what model will be appropriate for it?
1
vote
1
answer
1k
views
Can LSTM Predict The Next Few Days Of Stock Price?
I have searched many websites and forums describing stock price forecast using LSTM.
They shared two things in common: one is that all the sources make predictions with same set of data and none of ...
- 11
3
votes
1
answer
70
views
Structure the dataset for financial machine learning
I am trying to construct a dataset to apply MLP in forecasting financial returns. The main idea is that I want to predict future equity returns (1 month ahead, but the horizon can vary, just to give ...
- 67
1
vote
0
answers
232
views
Any tool that can help on manually label a time series data please?
i am working with a 10 years weekly financial time series data set, which has the standard format date open high low close volume.
i would like to manually label (classify) the data set with label/...
- 141
1
vote
0
answers
74
views
Are there any APIs for financial pattern recognition? [closed]
I have seen this question on the site, however it is asking for the techniques that can be used for implementation. The thing I want to know is that, on the other hand, if are there any APIs or ...
- 111
2
votes
1
answer
80
views
Preprocess list data
I got question about preparation data for my ML algorithm.
Raw data has format similar to:
...
- 123
2
votes
2
answers
1k
views
how many rows have values from the same columns pandas
I have a df with many columns that represent the market cap of companies that compose an index. The index of the dataframe is dates. Before the company enters the index or after it leaves it, the ...
- 21
0
votes
1
answer
54
views
Constructing graph of crypto financial instruments 2016-2017
Set of financial instruments represent the set of vertices of the graph. For any pair of vertices $i$ and $j$, an edge connecting them is added to the graph if the corresponding correlation ...
- 111
1
vote
1
answer
337
views
Best way to store financial data together with news
My question is if there is a DBMS that allows storing financial data (i.e. timestamp+value) together with small text fragments.
These small fragments will not be very long, but it might help an ...
- 191
1
vote
1
answer
775
views
Reinforcement Learning algorithm for Optimized Trade Execution
My question deals with the algorithm described in the paper:
Reinforcement Learning for Optimized Trade Execution
This paper uses reinforcement learning technique to deal with the problem of ...
- 13
2
votes
0
answers
33
views
Find a Default Assumption for a series of Forecasted Loans
Your help would be appreciated!
I'm trying to calculate the net returns of a series loans, at different stages of completion. I've categorised the loans into open loans (repaying & late loans) ...
- 21
1
vote
1
answer
134
views
Understanding portfolio-level risk models
I have a tremendous amount of experience training supervised machine learning models. However, I recently became a data scientist at a small financial services company, and I've been asked to build ...
- 4,039