Will load_from_checkpoint load Huggingface models as well? 
What is your question?
Just wanted to know will using the load_from_checkpoint for a LightningModule load the state_dict for the HuggingFace models as well?
Eg: for the given example in the docs, will state_dict be loaded for BertModel.from_pretrained thing as well?
Ideally, load_from_checkpoint should load state_dict for Bert as well like BertModel.from_pretrained(same_checkpoint) would do.
Code
class BertMNLIFinetuner(LightningModule):

    def __init__(self):
        super().__init__()

        self.bert = BertModel.from_pretrained('bert-base-cased', output_attentions=True)
        self.W = nn.Linear(bert.config.hidden_size, 3)
        self.num_classes = 3


    def forward(self, input_ids, attention_mask, token_type_ids):

        h, _, attn = self.bert(input_ids=input_ids,
                         attention_mask=attention_mask,
                         token_type_ids=token_type_ids)

        h_cls = h[:, 0]
        logits = self.W(h_cls)
        return logits, attn