---
title: 2025-09-20 - AI Evaluation & Benchmarking TechSprint
description: The scoping workshop (Day 1) will finish with a Must‑Have feature backlog and roadmap for the Evaluation & Benchmarking Suite. Day 2 is where we build. In just eight focused hours we aim to:
image: https://www.finos.org/hubfs/FINOS%20events/2025-09-20%20-%20FINOS%20AI%20Evaluation%20%26%20Benchmarking%20TechSprint.png
---

[![FINOS](https://www.finos.org/hs-fs/hubfs/sofin%20assets/SOFIN%20LOGOS/finos-logo.png?width=543&height=126&name=finos-logo.png "FINOS")](https://finos.org)

- [Projects](https://www.finos.org/projects) 
    - [Artificial Intelligence (AI)](https://ai.finos.org/)
    - [Common Domain Model (CDM)](https://www.finos.org/common-domain-model)
    - [FDC3](https://www.finos.org/fdc3)
    - [Fluxnova](https://fluxnova.finos.org)
    - [FINOS Common Cloud Controls](https://www.finos.org/common-cloud-controls-project)
    - [High Performance Computing (HPC)](https://hpc.finos.org)
    - [OSERA](https://osera.finos.org/)
    - [Open Source Readiness Initiative](https://www.finos.org/open-source-readiness)
    - [OS-Climate](https://www.finos.org/os-climate)
    - [Try our Projects](https://www.finos.org/project-sandbox)
    - [All Projects Landscape](https://landscape.finos.org/)
- [Community](https://www.finos.org/engage-with-our-community) 
    - [FINOS Community Calendar](https://www.finos.org/calendar)
    - [Community Quickstart](https://www.finos.org/get-involved)
    - [FINOS Community Site](https://community.finos.org/)
    - [Contribute](https://community.finos.org/docs/governance/Software-Projects/contribution)
    - [Unable to Contribute?](https://www.finos.org/open-source-readiness)
    - [Join our Slack channel](https://finos-lf.slack.com/messages/finos-community/)
    - [Recognize a contributor](https://github.com/finos/community/issues/new?assignees=mcleo-d&labels=community-recognition&template=Community-Recognition.md&title=FINOS+Community+Recognition)
    - [Ambassador Program](https://www.finos.org/ambassador-program)
- [Membership](https://www.finos.org/membership-benefits) 
    - [Members](https://www.finos.org/members)
    - [Inquire](https://www.finos.org/membership-benefits#become-a-member)
    - [Join](https://joinnow.platform.linuxfoundation.org/?project=finos)
    - [Member ROI Summary & Calculator](https://www.finos.org/roi-report-calculator)
    - [Dependency Consumption Analysis](https://www.finos.org/dependency-consumption-analysis)
- Resources 
    - [2025 Mission & Vision](https://www.finos.org/2024-in-review-2025-vision)
    - [Research & Case Studies](https://www.finos.org/research-case-studies)
    - [Training](https://training.linuxfoundation.org/finos/)
    - [Open Source Maturity Model](https://osr.finos.org/docs/bok/OSMM/Introduction)
    - [Contributions Live Dashboard](https://metrics.finos.org)
    - [Our Github Organization](https://github.com/finos/)
    - [Our Developer Toolchain](https://odp.finos.org/)
    - [FINOS Store](https://store-finos.myshopify.com/)
- News & Events 
    - [This Week At FINOS](https://www.finos.org/this-week-at-finos)
    - [Community Blog](https://www.finos.org/blog)
    - [Newsletter](https://www.finos.org/newsletter)
    - [Podcast: Open Source in Finance](https://www.finos.org/open-source-in-finance-podcast)
    - [Press Releases](https://www.finos.org/press)
    - [FINOS Events](https://www.finos.org/hosted-events)
    - [Community Events](https://www.finos.org/featured-events)
    - [Community Spotlight](https://www.finos.org/community-spotlight)
    - [Stay Informed](https://www.finos.org/sign-up)
- [About](https://www.finos.org/about-us) 
    - [Stay Informed](https://www.finos.org/sign-up)
    - [FAQs](https://www.finos.org/faq)
    - [Contact Us](https://www.finos.org/contact-us)
    - [Governing Board](https://www.finos.org/governing-board)
    - [Technical Oversight Committee](https://www.finos.org/technical-oversight-committee)
    - [Team](https://www.finos.org/team)
    - [Governance](https://www.finos.org/governance)
    - [Code of Conduct](https://www.finos.org/code-of-conduct)
- [OSFF + Videos](https://events.linuxfoundation.org/open-source-finance-forum) 
    - [OSFF 2026](https://events.linuxfoundation.org/open-source-finance-forum/)
    - [OSFF Toronto 2026 Videos](https://www.finos.org/osff-toronto-2026-videos)
    - [OSFF New York 2025 Videos](https://www.finos.org/osff-nyc-2025-videos)
    - [OSFF London 2026 Videos](https://www.finos.org/osff-london-2026-videos)
    - [apidays Paris 2025 Videos](https://www.finos.org/apidays)

- [Projects](https://www.finos.org/projects) 
    - [Artificial Intelligence (AI)](https://ai.finos.org/)
    - [Common Domain Model (CDM)](https://www.finos.org/common-domain-model)
    - [FDC3](https://www.finos.org/fdc3)
    - [Fluxnova](https://fluxnova.finos.org)
    - [FINOS Common Cloud Controls](https://www.finos.org/common-cloud-controls-project)
    - [High Performance Computing (HPC)](https://hpc.finos.org)
    - [OSERA](https://osera.finos.org/)
    - [Open Source Readiness Initiative](https://www.finos.org/open-source-readiness)
    - [OS-Climate](https://www.finos.org/os-climate)
    - [Try our Projects](https://www.finos.org/project-sandbox)
    - [All Projects Landscape](https://landscape.finos.org/)
- [Community](https://www.finos.org/engage-with-our-community) 
    - [FINOS Community Calendar](https://www.finos.org/calendar)
    - [Community Quickstart](https://www.finos.org/get-involved)
    - [FINOS Community Site](https://community.finos.org/)
    - [Contribute](https://community.finos.org/docs/governance/Software-Projects/contribution)
    - [Unable to Contribute?](https://www.finos.org/open-source-readiness)
    - [Join our Slack channel](https://finos-lf.slack.com/messages/finos-community/)
    - [Recognize a contributor](https://github.com/finos/community/issues/new?assignees=mcleo-d&labels=community-recognition&template=Community-Recognition.md&title=FINOS+Community+Recognition)
    - [Ambassador Program](https://www.finos.org/ambassador-program)
- [Membership](https://www.finos.org/membership-benefits) 
    - [Members](https://www.finos.org/members)
    - [Inquire](https://www.finos.org/membership-benefits#become-a-member)
    - [Join](https://joinnow.platform.linuxfoundation.org/?project=finos)
    - [Member ROI Summary & Calculator](https://www.finos.org/roi-report-calculator)
    - [Dependency Consumption Analysis](https://www.finos.org/dependency-consumption-analysis)
- Resources 
    - [2025 Mission & Vision](https://www.finos.org/2024-in-review-2025-vision)
    - [Research & Case Studies](https://www.finos.org/research-case-studies)
    - [Training](https://training.linuxfoundation.org/finos/)
    - [Open Source Maturity Model](https://osr.finos.org/docs/bok/OSMM/Introduction)
    - [Contributions Live Dashboard](https://metrics.finos.org)
    - [Our Github Organization](https://github.com/finos/)
    - [Our Developer Toolchain](https://odp.finos.org/)
    - [FINOS Store](https://store-finos.myshopify.com/)
- News & Events 
    - [This Week At FINOS](https://www.finos.org/this-week-at-finos)
    - [Community Blog](https://www.finos.org/blog)
    - [Newsletter](https://www.finos.org/newsletter)
    - [Podcast: Open Source in Finance](https://www.finos.org/open-source-in-finance-podcast)
    - [Press Releases](https://www.finos.org/press)
    - [FINOS Events](https://www.finos.org/hosted-events)
    - [Community Events](https://www.finos.org/featured-events)
    - [Community Spotlight](https://www.finos.org/community-spotlight)
    - [Stay Informed](https://www.finos.org/sign-up)
- [About](https://www.finos.org/about-us) 
    - [Stay Informed](https://www.finos.org/sign-up)
    - [FAQs](https://www.finos.org/faq)
    - [Contact Us](https://www.finos.org/contact-us)
    - [Governing Board](https://www.finos.org/governing-board)
    - [Technical Oversight Committee](https://www.finos.org/technical-oversight-committee)
    - [Team](https://www.finos.org/team)
    - [Governance](https://www.finos.org/governance)
    - [Code of Conduct](https://www.finos.org/code-of-conduct)
- [OSFF + Videos](https://events.linuxfoundation.org/open-source-finance-forum) 
    - [OSFF 2026](https://events.linuxfoundation.org/open-source-finance-forum/)
    - [OSFF Toronto 2026 Videos](https://www.finos.org/osff-toronto-2026-videos)
    - [OSFF New York 2025 Videos](https://www.finos.org/osff-nyc-2025-videos)
    - [OSFF London 2026 Videos](https://www.finos.org/osff-london-2026-videos)
    - [apidays Paris 2025 Videos](https://www.finos.org/apidays)

![FINOS Events](https://www.finos.org/hubfs/FINOS/website/banner-backgrounds/Events%20(Gold%2080).png)

# FINOS Events

# AI EVALUATION & BENCHMARKING SUITE - TECHSPRINT

 September 20, 2025, 9:00am BST

 London + Virtual

Turn [yesterday’s ideas](https://www.finos.org/hosted-events/2025-09-19-ai-evaluation-benchmarking-workshop) into *working code* for the Evaluation and Benchmarking Suite community.

[REGISTER HERE](https://www.finos.org/hosted-events/2025-09-20-ai-evaluation-benchmarking-techsprint#form)

**Why a TechSprint?**

The [scoping workshop (Day 1)](https://www.finos.org/hosted-events/2025-09-19-ai-evaluation-benchmarking-workshop) will finish with a **Must‑Have feature backlog and roadmap** for the Evaluation & Benchmarking Suite. Day 2 is where we *build*. In just eight focused hours we aim to:

1. Ship the **first proof‑of‑concept for the “add‑your‑own‑benchmark data” feature**.
2. Prototype integrations with leading open‑source eval tools such as DeepEval, Ragas, truLens, promptFoo.
3. Automate FINOS‑style governance checks (licensing, dataset metadata, risk tags) on every pull request.

By the closing demo we expect *multiple merged PRs* and a clear follow‑on workstream for the wider community.

 

**What stack we will provide? **

- ![Inference Stack](https://www.finos.org/hs-fs/hubfs/FINOS%20AI%20Strategic%20Initiative%20-%20Focus%20on%20Benchmarking%20Suite.png?width=960&height=540&name=FINOS%20AI%20Strategic%20Initiative%20-%20Focus%20on%20Benchmarking%20Suite.png)
  
   Inference Stack
- ![Agentic Runtime Stack](https://www.finos.org/hs-fs/hubfs/FINOS%20AI%20Strategic%20Initiative%20-%20Focus%20on%20Benchmarking%20Suite%20(1).png?width=960&height=540&name=FINOS%20AI%20Strategic%20Initiative%20-%20Focus%20on%20Benchmarking%20Suite%20(1).png)
  
   Agentic Runtime Stack

 

**Who should attend?**

1. **Backend & data engineers** keen to work with HuggingFace, FastAPI, GitHub Actions
2. **Data‑/ML‑scientists** who maintain or create finance‑specific tasks/datasets
3. **Model‑risk, compliance & DevSecOps** specialists translating EU AI Act controls into code
4. **UI/UX & documentation writers** to polish the demo deliverables

**What you’ll leave with**

1. **Publicly visible contributions** merged (or ready to merge) into FINOS‑Labs repos.
2. **Reusable tooling** for your own AI governance pipelines.
3. **Network & bragging rights** – best demo wins sponsor swag and a FINOS blog feature.

**Logistics**

1. Date: 20 Sept 2025 – the day after the Scoping Workshop
2. Time: 09:00 – 18:00 BST
3. Format: Red Hat, Peninsular House, 30-36 Monument Street, 4th floor, London EC3R 8NB, United Kingdom & Virtual
4. Cost: Free – registration required (capacity limited to ensure mentor access).

 

**Supported by**

![RedHat](https://www.finos.org/hubfs/OSFF%202025%20(Open%20Source%20in%20Finance%20Forum)/OSFF%20London%202025/Email%20Sponsor%20Images/OSFF%20Website%20Originals/RedHat.svg)

![Nvidia-1](https://www.finos.org/hs-fs/hubfs/Nvidia-1.png?width=1039&height=494&name=Nvidia-1.png)

![N1-logo_black](https://www.finos.org/hs-fs/hubfs/N1-logo_black.png?width=976&height=224&name=N1-logo_black.png)

 

### Share this:

- [Tweet](https://twitter.com/share)

[![FINOS Logo](https://www.finos.org/hs-fs/hubfs/sofin%20assets/SOFIN%20LOGOS/FINOS_Icon_Wordmark_White.png?width=689&height=971&name=FINOS_Icon_Wordmark_White.png "FINOS Logo")](https://www.finos.org/)

[![Twitter logo](https://finos.org/hubfs/2419532/FINOS/website/logos/social-logos/twitter-blue-social-panel.png)](https://twitter.com/finosfoundation) [![GitHub logo](https://finos.org/hubfs/2419532/FINOS/website/logos/social-logos/github-black-social-panel.png)](https://finos.github.io) [![LinkedIn logo](https://finos.org/hubfs/2419532/FINOS/website/logos/social-logos/linkedin-blue-social-panel.png)](https://www.linkedin.com/company/finosfoundation) [![SlideShare logo](https://finos.org/hubfs/2419532/FINOS/website/logos/social-logos/Homepage%20Social%20Panel/slideshare-logo.png)](https://www.slideshare.net/finosfoundation) [![YouTube logo](https://finos.org/hubfs/2419532/FINOS/website/logos/social-logos/Homepage%20Social%20Panel/youtube_logo-1.png)](https://www.youtube.com/channel/UCfJAdRALzJ7J7snubrb_Y-Q)

[Contact Us](https://www.finos.org/contact-us)  
[info@finos.org](mailto:info@finos.org)  
+1 (650) 665-9773

[Privacy | ](https://www.finos.org/privacy-policy)[Terms of Service |](https://www.finos.org/terms-of-service)[Community Code of Conduct |](https://www.finos.org/code-of-conduct)[Email Preferences](https://www.finos.org/hs/manage-preferences/unsubscribe-simple)

![](https://px.ads.linkedin.com/collect/?pid=537250&fmt=gif)