Inside PRAGMA: Revolut's Foundation Model for Banking

· Philipp D. Dubach · April 26, 2026, 5:17 p.m.
Summary
The blog post analyzes PRAGMA, a large-scale encoder-only transformer model developed by Revolut for banking applications, comparing it to Nubank's nuFormer. It discusses the architectural decisions, performance metrics, and implications for the future of representation learning in banking, emphasizing the importance of input representation and practical outcomes in real-world applications.
AUTHOR
Sponsored
Zulip logo Zulip
Organized team chat for people who take work seriously. Topic-based threading keeps conversations focused.
Try Zulip
Become a sponsor →
BLOG POST FEATURED ON

Add this plugin to your blog