X SQL: reinforce context into schema representation

In this work, we present a new network architecture, called X-SQL, for the problem of parsing natural language to SQL query. X-SQL proposes to reinforce the contextual output from BERT-style pre-training model into the structural schema representation, and learn a new schema representation for downstream tasks. We evaluated X-SQL on the WikiSQL dataset. Experimental results show that X-SQL achieves new state-of-the-art results on WikiSQL, with substantial improvement on all metrics over both development and test sets.