Comparing two models with different majority classes

23 Views Asked by At

I calculated the accuracy for a model with listwise deletion (0.75) and for a multiple imputation model (0.67).

It seems like the standard model performs better. However, the naive baseline of the standard model is 70% (the majority class is 70% of the observations) while the naive baseline of the imputed dataset is 60%.

Should I compare 0.677 (accuracy of the multiply imputed model) with 0.75 and conclude that it performs worse, or should I conclude that 0.677 compared to 0.6 (naive baseline imputed dataset) is better than 0.749 compared to 0.7 (naive baseline complete cases dataset)?

I hope you can help me!

0

There are 0 best solutions below