The UK is set to spearhead pioneering new work which will help make sure AI systems behave predictably and as designed.
Led by the UK’s AI Security Institute, the Alignment Project is backed by an international coalition including the Canadian AI Safety Institute, Canadian Institute for Advanced Research (CIFAR), Schmidt Sciences, Amazon Web Services (AWS), Anthropic, Halcyon Futures, the Safe AI Fund, UK Research and Innovation, and the Advanced Research and Invention Agency (ARIA).
The project will fund cutting-edge research into AI alignment, including ways to make sure AI systems continue to follow our goals as the technology becomes more capable and finding techniques to ensure AI systems remain transparent and responsive to human oversight.
The Alignment Project, guided by a world-class expert advisory board, including Yoshua Bengio, Zico Kolter, Shafi Goldwasser, and Andrea Lincoln, will remove key barriers that have previously limited alignment research by offering three distinct levels of support:
- Grant funding: up to £1 million for researchers across disciplines from computer sciences to cognitive science,
- Compute access: Up to £5 million dedicated cloud computing credits from AWS, enabling technical experiments beyond typical academic reach,
- Venture capital: Investment from private funders to accelerate commercial alignment solutions.
The project combines funding, infrastructure, and market incentives to drive breakthrough progress.
Governments, philanthropists, and industry partners are now able to come forward to join The Alignment Project, contributing to its work through research grants, cloud compute resources, or venture funding for startups tackling alignment challenges.
Geoffrey Irving, Chief Scientist, AI Security Institute, said:
“AI alignment is one of the most urgent and under-resourced challenges of our time. Progress is essential, but it’s not happening fast enough relative to the rapid pace of AI development. Misaligned, highly capable systems could act in ways beyond our ability to control, with profound global implications.
“The Alignment Project tackles this head-on by bringing together governments, industry, philanthropists, VC and researchers to close the critical gaps in alignment research. International coordination isn’t just valuable – it’s necessary. By providing funding, compute resources, and interdisciplinary collaboration to bring more ideas to bear on the problem, we hope to increase the chance that transformative AI systems serve humanity reliably, safely, and in ways we can trust.”
Jack Clark, Co-Founder and Head of Policy at Anthropic said:
“As AI systems become increasingly intelligent, it is urgent that we improve our understanding of how they work. Anthropic is delighted to work with the UK AI Security Institute and other partners on the Alignment Project, which will bring greater focus to these issues.”
Nora Ammann, Technical Specialist, Advanced Research and Invention Agency (ARIA) said:
“We’re proud to support this multilateral effort to solve challenges around AI alignment that we expect to define the next decade of AI adoption. We’re particularly excited about opportunities to partner on developing mathematically rigorous understanding and assurances for advanced AI systems, which will complement the work of ARIA’s Safeguard AI programme.”
John Davies, Managing Director UK, Germany and International Organisations Worldwide Public Sector at Amazon Web Services, said:
“We are delighted to support the UK AI Security Institute’s Alignment Project by providing access to the free cloud computing credits that will enable researchers to run control experiments and stress test the safety of AI models. This initiative will help ensure that companies, governments, academia, and researchers work together to deliver groundbreaking generative AI innovation with trust at the forefront.”
The Honourable Evan Solomon, Minister of Artificial Intelligence and Digital Innovation and Minister responsible for the Federal Economic Development Agency for Southern Ontario, said:
“We are at a hinge moment in the story of AI, where our choices today will shape Canada’s economic future and influence the global trajectory of this technology. By investing strategically in scale, infrastructure, and adoption, we’re not just fueling opportunity for Canadians, we’re making sure progress is matched by purpose and responsibility.
“That’s why this partnership, uniting the Canadian AI Safety Institute and CIFAR with the UK’s AI Security Institute, matters. Together, we’re advancing cutting-edge research to ensure the next generation of AI systems are not only powerful, but reliable – serving societies here at home and around the world.”
Mark Greaves, Executive Director of AI and Advanced Computing at Schmidt Sciences, said:
“Keeping AI systems aligned with human values is a great scientific challenge of our time. Meeting this challenge will require the same creativity and cross-disciplinary energy that powered past scientific revolutions. The Alignment Project is designed to accelerate leading AI alignment researchers and attract brilliant minds from other fields to this challenge. Schmidt Sciences is proud to partner with the UK AI Security Institute and a global consortium to develop techniques to ensure that AI system behavior is aligned with human values.”
Professor Charlotte Deane, Executive Chair at EPSRC, said:
“This partnership unites critical elements of the UK’s AI ecosystem, bridging the gap between fundamental discovery science and the practical challenges of AI alignment. EPSRC is dedicated to advancing the pioneering research that underpins AI safety, and by coordinating our efforts with the AI Security Institute and partners across the sector, we are strengthening the coherence of our national AI ecosystem. Together, we will ensure that the UK’s leadership in artificial intelligence drives both breakthrough innovation and tangible benefits for society.”
