
Double Trouble: Bilingual Pretraining Leaves Language-Conditioned Effects in Shared-Language Representations
, Ziwei Zhu, Antonios Anastasopoulos.
Abstract
We show that bilingual pretraining changes deeper English representations across eight language pairs, even when the models’ word embeddings align.








