Questions tagged [survival-analysis]
Survival analysis is concerned with modelling the time before subjects change state, typically time until death or failure. One key feature of such data is that they can be censored, that is, some subjects will not have changed state before the study ends.
41 questions
0
votes
0
answers
19
views
Temporal mismatch
I am building a predictive model to determine risk for a disease over the course of a hospital stay. I am using medical records from a hospital electronic medical record database. The predictions are ...
- 141
0
votes
1
answer
74
views
Survival analysis on time series data for predictive maintenance
I want to train a survival analysis model for predictive maintenance on an asset (confidential, let's say it's a motor). The dataset consists of hourly readings of multiple sensors, the type of motor, ...
- 1
0
votes
0
answers
54
views
Video anomaly detection/ Evaluation AUC
I have trained an unsupervised anomaly detector for surveillance videos. After inference, I rescale the scores between max/min from the resulting scores array.
scores = (scores - min(scores))/max(...
- 1
1
vote
1
answer
374
views
predictions based on irregular repeated measures?
I need to make a model that predicts certain medical outcomes based on the answer to health-related questionnaires. Providers have patients fill out these questionnaires more than once, at irregular ...
- 11
1
vote
0
answers
31
views
Late entry in Survival Analysis
I would like to ask how to deal with new entries of individuals in Survival Analysis.
I have a study about the time to event of several individuals who suffer from a disease. The study starts on a ...
- 11
1
vote
1
answer
65
views
Memory issues for AalenAdditiveFitter in Lifelines packages in Python
We are working on a problem related to survival analysis. We have already implemented Cox Proportional-Hazard Model and Accelerated Failure Time algorithm. Now we want to see how the covariates change ...
- 113
1
vote
0
answers
32
views
Like Time-To-Event analysis, but looking at the timing of events that do or do not happen on a binary outcome
I have a problem where every observation has a binary outcome that occurs at the end of a fixed period, and the predictor variables describe a few types of event that either happen on some day within ...
- 11
0
votes
1
answer
35
views
What is the best way to model survival when the hazard rate decreases over time?
The standard survival analysis model - for example the model which forms the basis for the proportional hazards model - assumes the hazard rate is constant. In many applications this would be the ...
1
vote
2
answers
102
views
What is the typical things in Data that i have to look for, when implementing Survival Models using Machine Learning?
Problem Scenario
I am working on an industry specific problem focussed on predicting the failure of a seal/gasket in the given time interval(T) in a high-pressure-compression environment. Whenever ...
- 111
1
vote
0
answers
410
views
CoxPH model with Frailty and L1 regularization
This question stems from an approach proposed by Dr. Silverman, "Predicting Horse Race winners through A
Regularized Conditional Logistic Regression with Frailty."
In this paper, he proposes ...
- 11
2
votes
1
answer
83
views
Survival analysis to estimate kanban tasks completion times
I am working on a problem to estimate task completion time in kanban (project management tool).
While doing EDA, I looked at tasks that are either done or cancelled. In this case, I defined the ...
- 121
1
vote
0
answers
80
views
How to do prediction on survival data, using Random Forest
I should make prediction on survival data, using the random Forest method. My question is: should I follow the same approach as in logistic regression? taking into account only the status variable or ...
- 131
1
vote
0
answers
38
views
analyze the effect of some new changes to business rules on customers retention and sales
I am trying to analyze the effect of a particular business rule on customer behavior.
Background: I have two call centers operating in my company. One is an in-house call center and the other one is a ...
0
votes
1
answer
62
views
Can I use survival analysis model to predict probability of an item sold
I am building a model to calculate probability of items being sold( at least within a reasonable amount of time).
I know when the item hit the market and when/if the item sold.
What is the best ...
- 113
2
votes
2
answers
126
views
How to compute score and predict for outcome after N days
Let's say I have a medical dataset/EHR dataset that is retrospective and longitudinal in nature. Meaning one person has multiple measurements across multiple time points (in the past). I did post here ...
- 2,655
1
vote
0
answers
111
views
Modeling count data with time-dependent rate
For processes of discrete events occurring in continuous time with time-independent rate, we can use count models like Poisson or Negative Binomial. For discrete events that can occur once per sample ...
- 229
1
vote
0
answers
51
views
state transition classification on terminal state
I have data on a unit $i$ which enters an entry state $S_0$.
This unit has some covariates $x_i$
I would like to predict the probability the unit will reach the terminal state $S_{pos}$ or $S_{neg}$. ...
- 329
0
votes
1
answer
265
views
How to impute right-censored data
I have a dataset of vectors representing movement with various characteristics. Some vectors represents the movement that was stopped by external factor and therefore, observed value for length of ...
- 95
2
votes
1
answer
199
views
In survival analysis, which is the correct way to introduce a variable which changes the survival rate but occurs at different times?
I am making a survival analysis with a cox regression with proportional hazards, we want to analyze wheter the introduction of a phenomenon influences the time until the death of an individual.
A ...
- 2,308
5
votes
2
answers
5k
views
How do I predict survival curves using xgboost?
The xgboost package enables survival modeling using parameter arguments: objective = "survival:cox" and eval_metric = "cox-nloglik".
The predict method for the resulting model only outputs risk ...
- 809
3
votes
1
answer
253
views
Can I apply survival analysis to predict if a user will revisit the website?
I have one business problem in hand which is to predict if a user will revisit the website or not within 6 months. I need to majorly understand what are the factors which make the user return and also ...
- 75
1
vote
0
answers
60
views
Can i use survival analysis to predict if a person will "die" or not, and then get the survival time if the person does?
I want to determine, given a project, "How long will it take for this project to be successful ?"
Therefore, survival analysis seems like a perfect fit in this case (as I do have some projects that ...
- 109
0
votes
2
answers
2k
views
Python lifelines - ConvergenceWarning: Newton-Raphson failed to converge sufficiently in Cox prop hazard
When calling CoxPHFitter() on my full dataset I'm getting the following error:
...
- 194
1
vote
1
answer
505
views
Time Series Classification with multiple rows per date
I have a time series data set with the lifecycle of 9000 different B2B sales leads. What I call lifecycle consists of a dataset with one registry per day for every different sales Lead identifier with ...
- 11
3
votes
1
answer
79
views
Survival regression with major event that won't happen
I would like to do some survival regression about the duration before the "death" of an individual. The final purpose is to know, given an individual, how long it should take before he'll most likely "...
- 109
3
votes
1
answer
7k
views
What is the outcome of a Cox regression in xgboost?
I am creating a model using xgboost. Regarding its parameters, its objective is survival:cox ...
- 151
3
votes
1
answer
333
views
How to get the survival duration prediction for each individual in the data by using the Kaplan-Meier method?
I am trying to learn how to use the Kaplan-Meier survival estimator model in the lifelines package. The documentation says that the KaplanMeierFitter.fit function ...
- 308
0
votes
1
answer
174
views
How to do multivariate survival analysis on dataset having only categorical variables
I have a dataset where I have around 50 independent variables used to run survival analysis on the target variables. But out of these 50 variables, 46 variables are categorical variables i.e. having ...
1
vote
0
answers
230
views
Variable selection methods in survival analysis
I am using two models for my research. One is the coxph regression model and other is survival trees. I have found the scikit-survival package in python which is able to identify contributing ...
2
votes
1
answer
85
views
What kind of algorithm should I use to build ML model that can predict just next reoccurence of an event in the future (at irregular time interval)?
I'm quite new to machine learning and statistics.
I've a dataset from some ecommerce sale's history. It's almost 2k instances, and features include personId (string), productCategory (string/...
- 41
3
votes
1
answer
962
views
How to treat missing data for survival analysis
I have a dataset consisting of questionnaires from patient survey data. There are around 10 questions which are asked during several stages of treatment like during first day of visit, after a week, ...
0
votes
1
answer
116
views
How to model manufacturing shift data with irregular production times?
Problem Setting:
Let's say there are three shifts a day in a manufacturing plant. The plant suffers from irregular power supply thereby affecting in how it is functioning in time and the shift's ...
- 33
3
votes
1
answer
180
views
Survival Analysis: Pseudo Observation Vs Stratified Cox Regression. Which one is better?
I've been looking into the Cox Regression method for Survival Analysis in Churn Prediction. Cox regression will allow us to determine the probability that a subscriber will unsubscribe after a time $t$...
- 222
12
votes
2
answers
4k
views
Predict task duration
I'm trying to create a regression model that predicts the duration of a task. The training data I have consists of roughly 40 thousand completed tasks with these variables:
Who performed the task (~...
- 238
6
votes
1
answer
6k
views
How to use survival analysis for predictive maintenance for time series data?
So, I have a dataset with daily operating conditions for different machines and a flag saying if it failed or not.
Here is a snapshot of the data.
How can I use survival analysis or any other ...
3
votes
2
answers
2k
views
Machine Learning or Survival Analysis?
I am working on building prediction model for disk failures (time taken to occur a disk failure and what parameters could strongly affect disk failures). I am bit confused on-
What data preprocessing ...
- 191
1
vote
0
answers
571
views
Predicting purchase order?
What is the best option or rather options to predict how much order a customer will place in the future, say next 3 months on a monthly basis. Also will a customer place an order.
I used ARIMA to ...
- 141
5
votes
1
answer
1k
views
Time dependent Classification problem
I am trying to solve a decision making problem. In it, information evolves and increases with time for each event observed, and the history of the event may be useful.
The problem is as follows: in ...
- 51
2
votes
2
answers
795
views
R plot(surv(), newdata=...) draws same lines many times - why?
I'm new to R and cannot make plotting work as desired. The problem is that R seems to draw the same four lines over and over again, redundantly. The details of the case I'm having are as follows.
I ...
- 21
6
votes
3
answers
768
views
Data driven approach to define a churn user
I'm trying to define a churn prediction model for an online service (betting/gambling). A lot of papers talk about churn analysis/prediction for telco companies where defining a churn user is ...
- 61
4
votes
1
answer
318
views
What are available methods for modeling startup survival rates?
I am interested in modeling startup companies failure and success rates to describe what is the representative startup.
I have 40 companies in a dataset. Each company is represented as a list of all ...
- 383