You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am confused by the use of train and test sets for these time series models.
Here you setup your entire dataset and split it into test and train sets.
It seems like you would want to evaluate your model by seeing how well it performs on the test set using only the train set. But in the notebook the test set is used when evaluating the model.
To actually see how well the model predicts into the future, wouldn't we instead want to set the df parameter of the rolling_forcast function to train and then add lines to that function that extend the supplied df with the predictions?
Currently, because df_dff (which holds both train and test data) is used, you're not truly seeing how well your models predict into the future.
Am I misunderstanding? Is this what we want to be doing?
I changed the code to do as I think I'm expecting:
And I see this:
The text was updated successfully, but these errors were encountered:
I am confused by the use of train and test sets for these time series models.
Here you setup your entire dataset and split it into test and train sets.
![image](https://private-user-images.githubusercontent.com/97637822/389213742-1faeba80-af9f-4749-91f5-f16e29fbde83.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk2NzAyNDMsIm5iZiI6MTczOTY2OTk0MywicGF0aCI6Ii85NzYzNzgyMi8zODkyMTM3NDItMWZhZWJhODAtYWY5Zi00NzQ5LTkxZjUtZjE2ZTI5ZmJkZTgzLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTYlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjE2VDAxMzkwM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTFhMDg3ZDhlZjZlNjA1NTdlNmIzZjE5MmI4ZjE1ZjEwNGJmYWNhNWYyYWM5MWZiZDE0NDE0YzlhM2IxYzk1MGMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.EwOYbpDgnwW142Ml-bAPkKodc2SujexRxZRwLDPmvrQ)
![image](https://private-user-images.githubusercontent.com/97637822/389213777-cd4af66b-ac9e-44c0-ba48-03a212c395f5.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk2NzAyNDMsIm5iZiI6MTczOTY2OTk0MywicGF0aCI6Ii85NzYzNzgyMi8zODkyMTM3NzctY2Q0YWY2NmItYWM5ZS00NGMwLWJhNDgtMDNhMjEyYzM5NWY1LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTYlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjE2VDAxMzkwM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTFkMGZhOWMxY2ZlZTRkZmUyYmQ3MTFmYzQxMGQ2NTQxNDc0Y2RlZDZmNWI3YTQ3MGJmYWU1YmUyYTUyYWNhMDQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.Y_FOW4Q5Zzu10nftis34zkCperI7lrAyGo4jTiNzkO8)
It seems like you would want to evaluate your model by seeing how well it performs on the test set using only the train set. But in the notebook the test set is used when evaluating the model.
To actually see how well the model predicts into the future, wouldn't we instead want to set the
df
parameter of therolling_forcast
function totrain
and then add lines to that function that extend the supplied df with the predictions?Currently, because df_dff (which holds both train and test data) is used, you're not truly seeing how well your models predict into the future.
Am I misunderstanding? Is this what we want to be doing?
I changed the code to do as I think I'm expecting:
And I see this:
![image](https://private-user-images.githubusercontent.com/97637822/389216970-84d9861a-378d-433f-89b6-8c4c81b29ce1.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk2NzAyNDMsIm5iZiI6MTczOTY2OTk0MywicGF0aCI6Ii85NzYzNzgyMi8zODkyMTY5NzAtODRkOTg2MWEtMzc4ZC00MzNmLTg5YjYtOGM0YzgxYjI5Y2UxLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTYlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjE2VDAxMzkwM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTBlOGIyMjQyY2M2ZTViNTM1OWJmNDAxNmZkYTEyYTRlODEyMjJjOGY1ZjI5YTNmNDUyMmY0MTljZjQ5YzRiMzMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.-hcHuw4SHWd95UmIruOmDfHg7XrBmRZa7fX-zr5Xjm8)
The text was updated successfully, but these errors were encountered: