Community Blog

Community Blog

Building a Shared Benchmarking Framework for AI in Financial Services

September 26, 2025

Generative AI is transforming every sector, but in financial services its adoption comes with unique stakes: compliance, trust, and systemic risk. While large language models (LLMs) and other AI systems promise productivity gains across research, compliance, trading, and customer engagement, they also introduce challenges that generic benchmarks cannot adequately address.

This tension was at the heart of the recent FINOS workshop and techsprint in London, where engineers, architects, developers and open-source contributors working in the FSI converged to shape an Evaluation Framework for AI in Finance.

Interested in FINOS open source AI? Click the link below to see how to get involved in the FINOS AI Community.

AI Strategic initiative series: Building an AI Governance Framework - Key Takeaways from the NYC Workshop

Setting the Scene – From Washington to Wall Street

In our previous instalment, we followed FINOS Technical Project Advocate Karl Moll to the U.S. SEC’s AI Roundtable in Washington, D.C. The consensus there was clear: robust, risk‑based AI governance is now a board‑level imperative for every financial‑services institution (FSI). 

OS in Finance Webinar - The Unexpected Risks of AI in Finance: What You’re Not Watching Could Cost You featuring Sonatype & NVIDIA

At our most recent FINOS Open Source in Finance Meetup, speakers from NVIDIA and Sonatype discussed the risks of AI in Finance.

This video is from a live virtual meetup on 7 May 2025.

Navigating the AI Frontier in Finance - Insights from the SEC Roundtable

I'm Karl Moll, a Technical Project Advocate at FINOS, and I recently had the valuable opportunity to attend the SEC Roundtable on Artificial Intelligence in the Financial Industry in Washington D.C. This standout event brought together a diverse group of experts to tackle the complexities at the intersection of AI, finance, regulatory compliance, and governance. I’m excited to share how FINOS’s role in these vital discussions has developed — including our work on a pioneering AI Governance Framework.

 

No More Posts