Singapore Champions New Global AI Testing Standardisation Efforts on Benchmarking and Red Teaming

1. Singapore has put forward a new international standard, ISO/IEC 42119-8, to standardise the testing methodology for Generative AI systems, aimed at strengthening the foundation for trustworthy AI testing. This is the first international standard of its kind for the testing of Generative AI systems and will be discussed at the 17^th ISO/IEC JTC 1/SC 42 plenary meeting¹, held in Singapore from 20-24 April. Co-organised by the Infocomm Media Development Authority (IMDA) and Enterprise Singapore (EnterpriseSG) and hosted in the ASEAN region for the first time, the bi-annual plenary will gather more than 35 national bodies and over 250 AI experts from around the world, including the US, UK, China, Japan, Germany, France, and the Republic of Korea.

2. With the rapid development and pervasiveness of AI across ecosystems, it is crucial that there are globally recognised AI standards to ensure AI is used in a reliable and safe way. Specifically, Singapore has put forth a new ISO/IEC 42119-8 standard with a focus on benchmarking and red teaming methodologies for Generative AI systems with standardised testing approaches. Overall, it establishes an important framework for AI testing that enhances the reproducibility and comparability of results. This, in turn, will drive assurance and overall trust in AI systems and enable safer, more reliable adoption by AI deployers and users.

3. The ISO/IEC 42119-8 builds on IMDA’s past work in developing domestic testing frameworks, including our AI Verify Toolkit and the Starter Kit for Testing of LLM-Based Applications for Safety and Reliability and in the nascent field of assurance through the Global AI Assurance Sandbox. It is part of Singapore's broader commitment to international AI standards, as seen in the national adoption and accreditation programme of ISO/IEC 42001 led by EnterpriseSG, and the contribution of real-world use cases to support ISO/IEC TR 24030's documentation of AI applications in practice. Together, these efforts lay the groundwork for trustworthy AI implementation.

4. IMDA and EnterpriseSG are hosting a series of capacity building initiatives on the sidelines of the plenary meeting:

• Broad-Based Foundational Training Workshop, organised in partnership with the American National Standards Institute (ANSI) to strengthen AI standards capability of ASEAN member states in AI Standards.
• AI Standards and Policy Workshop, a 3^rd global workshop organised by ISO and targeted at national standards bodies and AI policy makers from 15 countries. The workshop focuses on practical applications of key ISO/IEC AI standards for governance.
• AI Assurance Exchange: AI Standards in Action, organised by Singapore’s AI Verify Foundation with a gathering of participants from global standard-setters, policymakers, and industry leaders to discuss the evolving landscape of AI standards. Participants will take part in three panels - opportunities and gaps in AI standards, standards for the region and translating AI Standards into practice through the Global AI Assurance Sandbox.

5. Singapore is committed to developing a trusted AI ecosystem through our AI Safety Institute (AISI), leadership in the ASEAN Working Group on AI Governance (WG-AI), and our role as lead ASEAN member for the AI Priority Area under the ASEAN Digital Trade Standards and Conformance Working Group (DTSCWG). This close cooperation advances our shared goal of ensuring AI is built and deployed in a trustworthy manner for individuals and enterprises alike.