Google DeepMind Interview Question

Explain transformers in the context of LLMs