Syntactically-informed word representations from graph neural network

•Syntactically-informed representations based on static and/or contextual representations.•Pre-encode syntactic information with automatically annotated data.•Improve performance over base representations on three information extraction tasks.•Syntactic dependencies can be beneficial for both static and contextual embeddings.•Easily adapt in different linguistic tasks than fine-tuning large models.