Transformer NLP Experiments Experiments on transformers as part of Berkeley Artificial Intelligence Research Lab (BAIR)