Summary   Plans for 2021 Our first focus area will be cooperation & conflict in the context of transformative AI (TAI). In addition to improving our prioritization within this area, we plan to build a field around bargaining in artificial learners using tools from game theory and multi-agent reinforcement learning (MARL) and to make initial publications on related governance aspects. Our second focus area will be malevolence. We plan to assess how important this area is relative to our other work and investigate how preferences to create suffering could arise in TAI systems. Research will remain CLR’s main activity in 2021. We will continue trying to grow our research team. We will increase our grantmaking efforts across our focus areas. […]

We have renamed the Foundational Research Institute (FRI) to the Center on Long-Term Risk (CLR) and will stop using the Effective Altruism Foundation (EAF) brand (except as the name of our legal entities).

We describe CLR's plans for 2020 and give an overview of our successes and mistakes in 2019.