(WIP) Review of Language, trees, and geometry in neural networks

1906.02715 Visualizing and Measuring the Geometry of BERT https://pair-code.github.io/interpretability/bert-tree/ https://pair-code.github.io/interpretability/context-atlas/blogpost/ Existing representation: word embeddings Language is made of discrete structures, yet neural networks operate on continuous data: vectors in high-dimensional space. A successful language-processing network must translate this symbolic information into some kind of geometric representation—but in what form? Word embe...

Submit