Last updated: 16 March 2023
Published on: 25 May 2022
6 MINS READ
SWITZERLAND, DAVOS – 25 MAY 2022: Singapore launches A.I. Verify - the world’s first AI Governance Testing Framework and Toolkit for companies who want to demonstrate responsible AI in an objective and verifiable manner. This was announced by Singapore’s Minister for Communications and Information Mrs Josephine Teo at the World Economic Forum Annual Meeting in Davos. A.I. Verify – currently a Minimum Viable Product (MVP), aims to promote transparency between companies and their stakeholders through a combination of technical tests and process checks.
Globally, testing for the trustworthiness for AI systems is an emergent space. As more companies use AI in their products and services, fostering public’s trust in AI technologies remains key in unlocking the transformative opportunities of AI.
Singapore remains at the forefront of international discourse on AI ethics
The launch of A.I. Verify follows Singapore’s launch of the Model AI Governance Framework (second edition) in Davos in 2020, and the National AI Strategy in November 2019. Having provided practical detailed guidance to industry on implementing responsible AI, A.I. Verify is Singapore’s next step in helping companies be more transparent about their AI products and services, to build trust with their stakeholders. A.I. Verify is developed by the Infocomm Media Development Authority (IMDA) and the Personal Data Protection Commission (PDPC).
Objective and verifiable testing process for industry
Developers and owners can verify the claimed performance of their AI systems against a set of principles through standardised tests. A.I. Verify packages a set of open-source testing solutions together, including a set of process checks into a Toolkit for convenient self-assessment. The Toolkit will generate reports for developers, management, and business partners, covering major areas affecting AI performance. The approach is to allow transparency, of what the AI model claims to do vis-à-vis the test results, and covers areas such as:
- On the use of AI to achieve what stated outcome
- Understanding how the AI model reaches a decision
- Whether the decisions predicted by the AI show unintended bias
- Safety and resilience of AI system.
- Accountability and oversight of AI systems.
The Pilot Testing Framework and Toolkit:
- Allows AI system developers/owners to conduct self-testing – to maintain commercial requirements while providing a common basis to declare results.
- Does not define ethical standards. It validates AI system developer’s/owner’s claims about the approach, use, and verified performance of their AI systems.
- Does not however guarantee that any AI system tested under this Pilot Framework will be free from risks or biases or is completely safe.
Minister for Communications and Information Mrs Josephine Teo said, “A.I. Verify is another step forward in Singapore’s AI development. In developing the world’s first product to demonstrate responsible AI in an objective and verifiable manner, we aim to help businesses become more transparent to their stakeholders in the A.I use. This will, in turn, promote greater public trust towards the use of AI. We invite industry partners from all around the world to join us in this pilot and contribute to building international standards in AI governance.”
Also commenting on the launch, Mr Chia Song Hwee, Deputy CEO, Temasek International and member of Singapore’s Advisory Council on the Ethical Use of AI and Data said, “I would like to congratulate IMDA for taking responsible AI to the next milestone with the launch of this testing framework and toolkit. Rapid digitisation has led to a proliferation of data and improved algorithms. As companies across sectors continue to innovate, this toolkit will enable them to turn concepts of responsible and trustworthy AI into practical applications that will benefit all stakeholders, from business owners to end users.”
Building interoperability of trustworthy AI with partners and industry
Developed under the guidance of the Advisory Council on the Ethical Use of AI and Data, 10 companies from different sectors and of different scale, have already tested and/or provided feedback. These companies are AWS, DBS Bank, Google, Meta, Microsoft, Singapore Airlines, NCS (Part of Singtel Group)/Land Transport Authority, Standard Chartered Bank, UCARE.AI, and X0PA.AI.
In addition, Singapore is engaging other like-minded countries and partners to enhance the interoperability of AI governance frameworks and to develop international standards on AI such as through Singapore’s participation in ISO/IEC JTC1/SC 42 on Artificial Intelligence. IMDA is also working together with the U.S. Department of Commerce to build interoperable AI governance frameworks.Beyond the pilot stage of the MVP, Singapore aims to work with AI system owners/developers globally to collate and build industry benchmarks. This enables Singapore to continue contributing to the development of international standards on AI governance.
Organisations invited to participate in pilot
As AI governance and testing is nascent, Singapore welcomes organisations to participate in piloting the MVP. Companies participating in the pilot will have the unique opportunity to:
- Gain early access to the MVP and use it to conduct self-testing on their AI systems/models;
- Use MVP-generated reports to demonstrate transparency and build trust with their stakeholders; and
- Help shape an internationally applicable MVP to reflect industry needs and contribute to international standards development.
More details can be found: https://go.gov.sg/aiverify
 MVP - a product with just enough features for early adopters to test and provide feedback for product development.
Annex A: Quotes from Industry and Partners (102.56KB)
Annex B: Background on Singapore’s AI governance work (260.39KB)
JOINTLY ISSUED BY INFOCOMM MEDIA DEVELOPMENT AUTHORITY (IMDA), THE MINISTRY OF COMMUNICATIONS AND INFORMATION (MCI) AND PERSONAL DATA PROTECTION COMMISSION (PDPC)
About Info-communications Media Development Authority (IMDA)
The Infocomm Media Development Authority (IMDA) leads Singapore’s digital transformation by developing a vibrant digital economy and an inclusive digital society. As Architects of Singapore’s Digital Future, we foster growth in Infocomm Technology and Media sectors in concert with progressive regulations, harnessing frontier technologies, and developing local talent and digital infrastructure ecosystems to establish Singapore as a digital metropolis.
For media clarifications, please contact:
CHOO Hong Xian (Mr)
Manager, Communications and Marketing, IMDA
DID: (65) 6955 0221
Delia WU (Ms)
Assistant Director, Communications and Engagement Division, MCI
DID: (65) 6461 7427
IMDA and United States Federal Communications commission signed MOU to promote bilateral cooperation
The Infocomm Media Development Authority (IMDA) of Singapore and the United States Federal Communications Commission (FCC) have...
Nominations for 3rd edition of 100 Women in Tech list now open
Public invited to nominate women who are making an impact on Singapore’s tech industry “Girls in Tech” category returns for female...
Singapore and the European Free Trade Association launch negotiations on Digital Economy Agreement
Singapore and the European Free Trade Association (EFTA) have launched negotiations on an EFTA-Singapore Digital Economy Agreement...
Singapore and the European Union Sign Digital Partnership
Minister-in-charge of Trade Relations S Iswaran and European Commissioner for Internal Market Thierry Breton signed the...
Singapore firms can now tap on Temus-IMDA's talent conversion programme to fill tech roles
Singapore’s Minister for Communications and Information Mrs Josephine Teo officiated the launch of Temus’ Step IT Up programme...
Enhanced measures against scam SMS
As part of the measures announced by the Infocomm Media Development Authority (IMDA) in October last year, all organisations that...
IMDA and ACMA signed Memorandum of Understanding for enhanced cooperation to combat scam and spam communications
Infocomm Media Development Authority (IMDA) and Australian Communications and Media Authority (ACMA) signed Memorandum of...
The Korea-Singapore Digital Partnership Agreement Enters into force
The Korea-Singapore Digital Partnership Agreement (KSDPA) will enter into force on 14 January 2023. The KSDPA was signed by Second...
IMDA announces a $5 million fund to support Singapore’s media industry to adopt virtual production
To ensure that the local media industry remains competitive as the international partner of choice to create premium IP, the...
20 Industry Digital Plans, which have contributed to the uplifting of more than 85,000 businesses, will be progressively refreshed, with the Food Services Sector being the first to benefit from the refreshed model
The refreshed Food Services Industry Digital Plan will include a refreshed Digital Solution Roadmap, introduction of a roadmap...