Add train validity check
🚀 Feature

Motivation

Currently, only validation check is being run.
In order to fix: #4797, we need the introduction of train validity check.
Refer to discussion in #5084.
Pitch

Alternatives

Additional context