Compositional Generalization

Preprint

• Ito, T., Cocchi, L., Klinger, T., Ram, P., Campbell, M., Hearne, L. (2024) The Importance of Positional Encoding Initialization in Transformers for Relational Reasoning. arXiv

• Klinger, T., Liu, Q., Dan, S., Crouse, M., Ram, P., and Gray, A. G. (2023) Compositional Program Generation for Few-shot Systematic Generalization. arXiv

Journal

• Ito, T., Campbell, M., Horesh, L., Klinger, T. and Ram, P. (2024) Quantifying Artificial Intelligence Through Algebraic Generalization. Nature Machine Intelligence (Perspective). paper

Conference

• Ram, P., Clarkson, K.L., Klinger, T., Ubaru, S. and Gray, A.G. (2025) Transformers Learn Faster with Semantic Focus. Advances in Neural Information Processing Systems. paper

• Carrow, S., Erwin, K., Vilenskaia, O., Ram, P., Klinger, T., Khan, N., Makondo, N. and Gray, A.G. (2025) Neural Reasoning Networks: Efficient Interpretable Neural Networks with Automatic Textual Explanations. *AAAI Conference on Artificial Intelligence. paper

• Ram, P., Klinger, T., and Gray, A. G. (2024) What makes a Model Compostional? A Theoretical View. To appear in International Joint Conference on Artificial Intelligence (IJCAI). arxiv

Workshop

• Ito, T., Cocchi, L., Klinger, T., Ram, P., Campbell, M. and Hearne, L. (2025). Learning Interpretable Positional Encodings in Transformers Depends on Initialization. *ICML 2025 workshop on Actionable Interpretability. paper

• Ram, P., Klinger, T., and Gray, A. G. (2024) What makes a Model Compostional? A Neuro-Symbolic Theoretical View. *IJCAI 2024 workshop on Logical Foundations for Neuro-Symbolic Artificial Intelligence (LNSAI). arxiv

• Ram, P., Klinger, T., and Gray, A. G. (2023) How Compositional is a Model? International Joint Conference on Artificial Intelligence 2023 Workshop on Knowledge-Based Compositional Generalization. paper slides

• Klinger, T., Liu, Q., Crouse, M., Dan, S., Ram, P., & Gray, A. G. (2023) Compositional Program Generation for Systematic Generalization. International Joint Conference on Artificial Intelligence 2023 Workshop on Knowledge-Based Compositional Generalization. paper