Post: https://allenai.org/blog/omega

Comments from the Author: https://x.com/nouhadziri/status/1937567606543716508

Dziri's research has been my favorite in terms of probing the limits/weaknesses of transformers. This seems to be consistent with her past findings: any form of these models are poor at compositional generalization.