In-Context Learning

Preprints

• Clarkson, K.L., Horesh, L., Ito, T., Park, C. and Ram, P. (2025) Finding Clustering Algorithms in the Transformer Architecture. paper

Conference

• Clarkson, K.L., Horesh, L., Ito, T., Park, C. and Ram, P. (2026) Transformer Circuits Can Realize Clustering Algorithms. International Conference on Machine Learning. paper code

• Kang, I., Ram, P., Zhou, Y., Samulowitz, H. and Seneviratne, O. (2026) Language Model Representations for Efficient Few-Shot Tabular Classification. Proceedings of the ACM Web Conference 2026, 4069-4080. paper

• Abbas, M., Zhou, Y., Ram, P., Baracaldo, N., Salonidis, T., Samulowitz, H., Chen, T. (2024) Enhancing In-context Learning via Linear Probe Calibration. International Conference on Artificial Intelligence and Statistics (AISTATS). paper, arXiv, code