Very informative read - thank you Keyur. Look forward to the followup article you intent to write. Have you found BERT cased models perform better than uncased in your probe study for dependency relationships?