Product Models for Transformer