Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?

Tay, Yi, Dehghani, Mostafa, Abnar, Samira · arXiv · 2022