Grading
Info
Medium
Hint: feature selection
Delete the first 37 one-hot features (state information)
| Score | |
|---|---|
| epoch | 787 |
| train loss | 1.175 |
| val loss | 1.001 |
| public score | 1.269 |
| private score | 1.415 |
Strong
Hint: Different model architechtures and optimizers
Build deeper model 16-8-1 ā 32-16-8-1
| Score | |
|---|---|
| epoch | 1265 |
| train loss | 1.123 |
| val loss | 0.955 |
| public score | 0.972 |
| private score | 1.027 |
Boss
Hint: L2 regularization and try more parameters
This is too hard. I give up.
My best score: private score: 0.990; public score: 0.942
Actually I tried too many times and I just forgot how to get this score⦠Maybe based on strong model, I used LeakyReLU, added L2 regularization, and implemented k-fold cross validation, then selected the best model.
For future DL training
- Make structural records, every time just change one thing.
- Change should be simple, donāt change too much.
- Organize code and try to get better, but donāt fall into perfectionism.