Let's not Pay Attention