Bidirectional transformers