Text this: Entities and Structures in the Embedding Process