Tenders Are Invited For Ai-Mediated Assessment Solutions For Pisa

Tenders are invited for AI-Mediated Assessment Solutions for PISA The Organisation for Economic Co-operation and Development (OECD) is issuing this Call for Proposals to identify a partner (or partners) to cooperate with the PISA Secretariat on AI-mediated assessment solutions, supporting the RDI Programme more information are available on this website: www.oecd.org/pisa/innovation . The OECD is particularly interested in student-facing AI tools and agents that can be integrated into digital assessments to create interactive and engaging tasks. Such solutions should enable students to access, evaluate, create, modify, and collaboratively produce information and artefacts through interaction with AI tools and outputs - generating evidence for traditional domain competencies as well as transversal and emerging competencies such as collaboration and AI literacy. The core activities sought under this cooperation include, but are not limited to: Interactive AI tools for assessment Technical integration, delivery, and data management Pilot studies and psychometric research 2.1 Interactive AI tools for assessment Core collaboration activities under this heading may include, but are not limited to: Design and development of authentic, multimodal assessment scenarios using AI assistants and conversational interfaces that support information-seeking, inquiry, and task completion Opportunities for students to access, evaluate, create, modify, and collaboratively produce or evaluate information and artefacts with AI support Design of coherent assessment experiences and testing interfaces incorporating multiple AI tools and capabilities Development of assessment formats and tasks that target specific transversal competencies, such as collaboration or communication Use of AI for adaptive testing and scaffolding 2.2 Technical integration, delivery, and data management Core collaboration activities under this heading may include, but are not limited to: Deployment and technical maintenance of a secure, scalable AI-enabled assessment platform and tools suitable for use with students aged approximately 14 to 16 Integration of AI tools, agents, and multimodal capabilities within assessment delivery environments Technical support for translation and delivery in multilingual environments Development of technical documentation, implementation guidance, and operational support Development and implementation of secure, resource-efficient data management practices and infrastructure Support for compliance with relevant legal, ethical, and operational requirements related to student data and AI systems 2.3 Pilot studies and psychometric research Core collaboration activities under this heading may include, but are not limited to: Technical support for pilot design, school recruitment, and implementation across multiple countries Support for administering tests and for monitoring/troubleshooting during pilot administrations Analysis and scaling of studentAI interaction data and process data generated during assessments Validation of AI-mediated assessment experiences Contributions to other research, development, and validation activities supporting the future use of AI-enabled assessments in PISA 3. Expected format of the proposal The proposal is expected to be approximately two pages long and should include the following elements: 1) Description of the proposed solution the proposal should describe the solution the partner proposes to develop in collaboration with the OECD team, explaining how it could be used in PISA (e.g. as a new assessment domain for a future PISA cycle), the scope of work (e.g. a set of ten assessment tasks with scoring rules), and the intended use of AI (e.g. AI mentors or peers that communicate with students during assessments), including specific information on the AI models to be used. 2) Proposed collaboration with the OECD team the proposal should specify how the partner plans to collaborate with the OECD and what inputs from the OECD team would be required to implement the solution. For example, the proposal might indicate that bi-weekly meetings will be organised to gather OECD input on the instruments and research. 3) IP rights considerations potential partners should clarify their position on the IP implications of their proposed solution, including whether the solution can be licensed to the OECD, and must clearly identify any third-party rights that are used. 4) Data privacy and digital security considerations, where relevant where the proposal involves the collection of personal data, the partner should describe the measures it plans to take to protect participants rights. The proposal should also address data and digital security considerations specific to AI use (e.g. how it will ensure that no collected data is used for AI training). Tender Link : https://www.oecd.org/en/about/calls-for-tenders.html#opportunities