Navigating the AI safety landscape: a comprehensive overview of the AI Safety Institute (AISI)
Blog from Tess Buckley at techUK as part of our #UnleashInnovation campaign week 2024.
AI innovations, particularly in Generative AI, are evolving swiftly, resulting in the landscape presenting both unparalleled opportunities and unprecedented risks. Consequently, ensuring the safety of AI technologies has emerged as a critical concern for governments, civil societies, and industries worldwide. Getting this right is vital if we are to ensure that the UK remains a trusted global leader in the development and application of emerging technologies.
This insight is a comprehensive overview of the UK’s AI Safety Insitute, summarising its ambitions, progress on those ambitions, strategic partnerships and approaches to evaluations. Each area is linked to a further explanatory insight which readers can visit if they wish to learn more.
Origins and objectives of the AISI
The genesis of the AISI traces back to the Bletchley AI Summit, where it was introduced as the successor to the AI taskforce. While DSIT retains its role in policymaking, the AISI takes charge of research, evaluations, and shaping the future trajectory of AI. Its overarching goal is to safeguard public interests and proactively steer the course of AI development. Additionally, the AISI aspires to position the UK as a global center of excellence in AI safety, with endorsements from governments and leading AI labs worldwide. Read more here.
Focus areas and strategic partnerships
The AISI has delineated three priority areas to achieve its objectives: evaluating advanced AI models, conducting foundational AI safety research, and facilitating global information exchange. Through a series of progress reports, it showcases tangible advancements and collaborations towards these goals.
First Progress Report: The AISI lays the groundwork with the establishment of specialised research teams, expert advisory boards, and strategic partnerships with leading organisations.
Second Progress Report: Notable strides include the expansion of research capabilities, the establishment of the UK's AI Research Resource, Isambard-AI, and fostering partnerships for knowledge sharing.
Third Progress Report: The AISI intensifies its focus on evaluating AI systems' technical capabilities, pre-deployment risk testing, and collaboration with diverse stakeholders. Talent acquisition and retention remain pivotal for sustained progress.
In addition to its domestic endeavors, the AISI has forged strategic partnerships on the international stage. Collaborations with countries like the Republic of Korea and the US exemplify its commitment to global cooperation in advancing AI safety standards.
Approach to evaluations and role of the AISI
Central to the AISI's mandate is its role as an independent evaluator of AI systems. Through rigorous evaluation methodologies, including red teaming, human uplift evaluations, and AI agent assessments, it aims to provide early warning signs of potential risks. While maintaining confidentiality in its evaluation process, the AISI pledges transparency by selectively disclosing evaluation results.
It’s important to note that the AISI doesn't seek to offer definitive safety certifications but rather serves as a supplementary oversight body. The ultimate decision to deploy AI systems rests with the developers, with the AISI providing critical insights to inform responsible decision-making. Read more here.
What’s next?
For many UK-based technology companies, understanding the role, purpose and operations of the AISI will be essential if they are to safely and effectively move from the conception and development of AI technologies to their eventual application and commercialisation.
techUKs AI Safety programme, led by Tess Buckley, will continue to provide more updates on AI safety conversation to ensure communication and understanding of a safe and beneficial AI-powered future.
You can read more insights in which techUK demystifies key parts of the UK Government and research landscape by viewing our Institutions of Innovation interview series.
The UK is home to emerging technologies that have the power to revolutionise entire industries. From quantum to semiconductors; from gaming to the New Space Economy, they all have the unique opportunity to help prepare for what comes next.
techUK members lead the development of these technologies. Together we are working with Government and other stakeholders to address tech innovation priorities and build an innovation ecosystem that will benefit people, society, economy and the planet - and unleash the UK as a global leader in tech and innovation.
For more information, or to get in touch, please visit our Innovation Hub and click ‘contact us’.
Tech and Innovation Summit, 6 Nov (rescheduled date)
Emerging technologies will be debated and explored at our annual Tech and Innovation Summit, taking place on 6 November. This campaign week will directly feed into the themes discussed at the Summit.
techUK’s flagship Tech and Innovation Summit returns to traverse the extraordinary and ground-breaking discoveries made possible by the application of emerging and transformative technologies.
#UnleashInnovation - techUK's Technology and Innovation programme is excited to host its innovation campaign week, as part of the Unleashing Innovation campaign, from 13-17 May.
This campaign explored how the UK can lead on the development, application and commercialisation of space technologies and ultimately realise the benefits of the New Space Economy.
These technologies include AI, quantum, lasers, robotics & automation, advanced propulsion and materials, and semiconductors.
Activity has taken the form of roundtables, panel discussions, networking sessions, Summits, thought leadership pieces, policy recommendations, and a report.
Get in touch below to find out more about techUK's ongoing work in this area.
This webinar explored the space industry of tomorrow and panellists spoke about what steps the UK can take to become a superpower across a broad spectrum of emerging and transformative space technologies.
Rory joined techUK in June 2023 after three years in the Civil Service on its Fast Stream leadership development programme.
During this time, Rory worked on the Government's response to Covid-19 (NHS Test & Trace), school funding strategy (Department for Education) and international climate and nature policy (Cabinet Office). He also tackled the social care crisis whilst on secondment to techUK's Health and Social Care programme in 2022.
Before this, Rory worked in the House of Commons and House of Lords alongside completing degrees in Political Economy and Global Politics.
Today, he is techUK's Programme Manager for Emerging Technologies, covering dozens of technologies including metaverse, drones, future materials, robotics, blockchain, space technologies, nanotechnology, gaming tech and Web3.0.
This campaign has explored how the UK can lead on the development, application and commercialisation of the technologies set to underpin the Gaming & Esports sector of the future.
These include AI, augmented / virtual / mixed / extended reality, haptics, cloud & edge computing, semiconductors, and advanced connectivity (5/6G).
Activity has taken the form of roundtables, panel discussions, networking sessions, Summits, and thought leadership pieces. A report featuring member case studies and policy recommendations is currently being produced (to be launched in September 2024).
Get in touch below to find out more about contributing to or collaborating on this campaign.
This webinar explored the gaming industry of tomorrow and asked what steps businesses can take to lead in the development, commercialisation, application and adoption of the key emerging technologies that will underpin it.
This webinar explored the key technologies behind the future of Esports in the UK and asked what more the UK can do to lead on their development and application.
Rory joined techUK in June 2023 after three years in the Civil Service on its Fast Stream leadership development programme.
During this time, Rory worked on the Government's response to Covid-19 (NHS Test & Trace), school funding strategy (Department for Education) and international climate and nature policy (Cabinet Office). He also tackled the social care crisis whilst on secondment to techUK's Health and Social Care programme in 2022.
Before this, Rory worked in the House of Commons and House of Lords alongside completing degrees in Political Economy and Global Politics.
Today, he is techUK's Programme Manager for Emerging Technologies, covering dozens of technologies including metaverse, drones, future materials, robotics, blockchain, space technologies, nanotechnology, gaming tech and Web3.0.
Running from July to December 2024, this campaign will explore how the UK can lead on the development, application and commercialisation of web3 and immersive technologies.
These include blockchain, smart contracts, digital assets, augmented / virtual / mixed / extended reality, spatial computing, haptics and holograms.
Activity will take the form of roundtables, workshops, panel discussions, networking sessions, tech demos, Summits, thought leadership pieces, policy recommendations, and reports.
Get in touch below to find out more about contributing to or collaborating on this campaign.
Rory joined techUK in June 2023 after three years in the Civil Service on its Fast Stream leadership development programme.
During this time, Rory worked on the Government's response to Covid-19 (NHS Test & Trace), school funding strategy (Department for Education) and international climate and nature policy (Cabinet Office). He also tackled the social care crisis whilst on secondment to techUK's Health and Social Care programme in 2022.
Before this, Rory worked in the House of Commons and House of Lords alongside completing degrees in Political Economy and Global Politics.
Today, he is techUK's Programme Manager for Emerging Technologies, covering dozens of technologies including metaverse, drones, future materials, robotics, blockchain, space technologies, nanotechnology, gaming tech and Web3.0.
Our annual Campaign Weeks enable techUK members to explore how the UK can lead on the development and application of emerging and transformative technologies.
Members do this by contributing blogs or vlogs, speaking at events, and highlighting examples of best practice within the UK's tech sector.
#UnleashInnovation - techUK's Technology and Innovation programme is excited to host its innovation campaign week, as part of the Unleashing Innovation campaign, from 13-17 May.
#SuperchargeUKTech - techUK's Technology and Innovation programme is excited to have hosted its innovation campaign week, as part of the Supercharging Innovation campaign, between 18-22 September.
Laura is techUK’s Head of Programme for Technology and Innovation.
She supports the application and expansion of emerging technologies, including Quantum Computing, High-Performance Computing, AR/VR/XR and Edge technologies, across the UK. As part of this, she works alongside techUK members and UK Government to champion long-term and sustainable innovation policy that will ensure the UK is a pioneer in science and technology
Before joining techUK, Laura worked internationally as a conference researcher and producer covering enterprise adoption of emerging technologies. This included being part of the strategic team at London Tech Week.
Laura has a degree in History (BA Hons) from Durham University, focussing on regional social history. Outside of work she loves reading, travelling and supporting rugby team St. Helens, where she is from.
Rory joined techUK in June 2023 after three years in the Civil Service on its Fast Stream leadership development programme.
During this time, Rory worked on the Government's response to Covid-19 (NHS Test & Trace), school funding strategy (Department for Education) and international climate and nature policy (Cabinet Office). He also tackled the social care crisis whilst on secondment to techUK's Health and Social Care programme in 2022.
Before this, Rory worked in the House of Commons and House of Lords alongside completing degrees in Political Economy and Global Politics.
Today, he is techUK's Programme Manager for Emerging Technologies, covering dozens of technologies including metaverse, drones, future materials, robotics, blockchain, space technologies, nanotechnology, gaming tech and Web3.0.
Programme Manager - Digital Ethics and AI Safety, techUK
Tess Buckley
Programme Manager - Digital Ethics and AI Safety, techUK
Tess is the Programme Manager for Digital Ethics and AI Safety at techUK.
Prior to techUK Tess worked as an AI Ethics Analyst, which revolved around the first dataset on Corporate Digital Responsibility (CDR), and then later the development of a large language model focused on answering ESG questions for Chief Sustainability Officers. Alongside other responsibilities, she distributed the dataset on CDR to investors who wanted to further understand the digital risks of their portfolio, she drew narratives and patterns from the data, and collaborate with leading institutes to support academics in AI ethics. She has authored articles for outlets such as ESG Investor, Montreal AI Ethics Institute, The FinTech Times, and Finance Digest. Covered topics like CDR, AI ethics, and tech governance, leveraging company insights to contribute valuable industry perspectives. Tess is Vice Chair of the YNG Technology Group at YPO, an AI Literacy Advisor at Humans for AI, a Trustworthy AI Researcher at Z-Inspection Trustworthy AI Labs and an Ambassador for AboutFace.
Tess holds a MA in Philosophy and AI from Northeastern University London, where she specialised in biotechnologies and ableism, following a BA from McGill University where she joint-majored in International Development and Philosophy, minoring in communications. Tess’s primary research interests include AI literacy, AI music systems, the impact of AI on disability rights and the portrayal of AI in media (narratives). In particular, Tess seeks to operationalise AI ethics and use philosophical principles to make emerging technologies explainable, and ethical.
Outside of work Tess enjoys kickboxing, ballet, crochet and jazz music.
Usman joined techUK in January 2024 as Programme Manager for Artificial Intelligence.
Prior to joining techUK, Usman worked as a policy, government affairs and public affairs professional in the advertising sector. He has also worked in sales and marketing and FinTech.
Usman is a graduate of the London School of Economics, BPP Law School and Queen Mary University of London.
When he isn’t working, Usman enjoys spending time with his family and friends. He also has a keen interest in running, reading and travelling.
Programme Manager, Digital Ethics and AI Safety, techUK
Tess is the Programme Manager for Digital Ethics and AI Safety at techUK.
Prior to techUK Tess worked as an AI Ethics Analyst, which revolved around the first dataset on Corporate Digital Responsibility (CDR), and then later the development of a large language model focused on answering ESG questions for Chief Sustainability Officers. Alongside other responsibilities, she distributed the dataset on CDR to investors who wanted to further understand the digital risks of their portfolio, she drew narratives and patterns from the data, and collaborate with leading institutes to support academics in AI ethics. She has authored articles for outlets such as ESG Investor, Montreal AI Ethics Institute, The FinTech Times, and Finance Digest. Covered topics like CDR, AI ethics, and tech governance, leveraging company insights to contribute valuable industry perspectives. Tess is Vice Chair of the YNG Technology Group at YPO, an AI Literacy Advisor at Humans for AI, a Trustworthy AI Researcher at Z-Inspection Trustworthy AI Labs and an Ambassador for AboutFace.
Tess holds a MA in Philosophy and AI from Northeastern University London, where she specialised in biotechnologies and ableism, following a BA from McGill University where she joint-majored in International Development and Philosophy, minoring in communications. Tess’s primary research interests include AI literacy, AI music systems, the impact of AI on disability rights and the portrayal of AI in media (narratives). In particular, Tess seeks to operationalise AI ethics and use philosophical principles to make emerging technologies explainable, and ethical.
Outside of work Tess enjoys kickboxing, ballet, crochet and jazz music.
This digital energy transition campaign week will focus on the digital transformation of the energy sector, its ability to deliver higher impact through tech and the capability of our industry to deliver a just transition.
At last month’s Police Digital Summit in the UK, a panel of police, tech specialists and criminal justice stakeholders discussed how technology could help to meet the challenges of rape and serious sexual offences, and violence against women and girls; techUK’s Georgie Henley, who chaired the panel, highlights some of the key points from the discussion, and the collaborative approaches that can ensure improved responses in the future.
Guest blog: Allison Schwartz, Vice-President, Global Government Relations and Public Affairs Leader at D-Wave writes on the announcement of the first commercial quantum computing system in Europe, marking the expansion of practical quantum computing in the region.