Publications

The following are selected publications from our researchers.


Cooperation, conflict, and transformative AI

Multi-agent systems

Show all

Cook, Tristan. Replicating and extending the grabby aliens model. Effective Altruism Forum, April 2022.
Links | BibTeX
Cook, Tristan; Corlouer, Guillaume. The optimal timing of spending on AGI safety work; why we should probably be spending more now. Effective Altruism Forum, November 2022.
Links | BibTeX
Baum, Seth D; Armstrong, Stuart; Ekenstedt, Timoteus; Häggström, Olle; Hanson, Robin; Kuhlemann, Karin; Maas, Matthijs M; Miller, James D; Salmela, Markus; Sandberg, Anders; Sotala, Kaj; Torres, Phil; Turchin, Alexey; Yampolskiy, Roman V. Long-term trajectories of human civilization. Foresight, 21 (1), pp. 53-83, 2019.
Links | BibTeX
Kokotajlo, Daniel. Soft takeoff can still lead to decisive strategic advantage. Alignment Forum, August 2019.
Links | BibTeX
Gloor, Lukas. Rebuttal of Christiano and AI Impacts on takeoff speeds?. LessWrong, April 2019.
Links | BibTeX
Gloor, Lukas. Cause prioritization for downside-focused value systems. Effective Altruism Forum, January 2018.
Links | BibTeX
Althaus, David. Descriptive Population Ethics and Its Relevance for Cause Prioritization. Effective Altruism Forum, April 2018.
Links | BibTeX
Sotala, Kaj. How feasible is the rapid development of artificial superintelligence?. Physica Scripta, 92 (11), 2017.
Links | BibTeX
Sotala, Kaj; Gloor, Lukas. Superintelligence as a Cause or Cure for Risks of Astronomical Suffering. Informatica, 41 (4), 2017.
Links | BibTeX
Oesterheld, Caspar. Complications in evaluating neglectedness. The Universe from an Intentional Stance Blog, June 2017.
Links | BibTeX
Tomasik, Brian. How the Simulation Argument Dampens Future Fanaticism. CLR Website, June 2016.
Links | BibTeX

Show all

Cook, Tristan. Replicating and extending the grabby aliens model. Effective Altruism Forum, April 2022.
Links | BibTeX
Cook, Tristan; Corlouer, Guillaume. The optimal timing of spending on AGI safety work; why we should probably be spending more now. Effective Altruism Forum, November 2022.
Links | BibTeX
Baum, Seth D; Armstrong, Stuart; Ekenstedt, Timoteus; Häggström, Olle; Hanson, Robin; Kuhlemann, Karin; Maas, Matthijs M; Miller, James D; Salmela, Markus; Sandberg, Anders; Sotala, Kaj; Torres, Phil; Turchin, Alexey; Yampolskiy, Roman V. Long-term trajectories of human civilization. Foresight, 21 (1), pp. 53-83, 2019.
Links | BibTeX
Kokotajlo, Daniel. Soft takeoff can still lead to decisive strategic advantage. Alignment Forum, August 2019.
Links | BibTeX
Gloor, Lukas. Rebuttal of Christiano and AI Impacts on takeoff speeds?. LessWrong, April 2019.
Links | BibTeX
Gloor, Lukas. Cause prioritization for downside-focused value systems. Effective Altruism Forum, January 2018.
Links | BibTeX
Althaus, David. Descriptive Population Ethics and Its Relevance for Cause Prioritization. Effective Altruism Forum, April 2018.
Links | BibTeX
Sotala, Kaj. How feasible is the rapid development of artificial superintelligence?. Physica Scripta, 92 (11), 2017.
Links | BibTeX
Sotala, Kaj; Gloor, Lukas. Superintelligence as a Cause or Cure for Risks of Astronomical Suffering. Informatica, 41 (4), 2017.
Links | BibTeX
Oesterheld, Caspar. Complications in evaluating neglectedness. The Universe from an Intentional Stance Blog, June 2017.
Links | BibTeX
Tomasik, Brian. How the Simulation Argument Dampens Future Fanaticism. CLR Website, June 2016.
Links | BibTeX

Strategic considerations

Show all

Cook, Tristan. Replicating and extending the grabby aliens model. Effective Altruism Forum, April 2022.
Links | BibTeX
Cook, Tristan; Corlouer, Guillaume. The optimal timing of spending on AGI safety work; why we should probably be spending more now. Effective Altruism Forum, November 2022.
Links | BibTeX
Baum, Seth D; Armstrong, Stuart; Ekenstedt, Timoteus; Häggström, Olle; Hanson, Robin; Kuhlemann, Karin; Maas, Matthijs M; Miller, James D; Salmela, Markus; Sandberg, Anders; Sotala, Kaj; Torres, Phil; Turchin, Alexey; Yampolskiy, Roman V. Long-term trajectories of human civilization. Foresight, 21 (1), pp. 53-83, 2019.
Links | BibTeX
Kokotajlo, Daniel. Soft takeoff can still lead to decisive strategic advantage. Alignment Forum, August 2019.
Links | BibTeX
Gloor, Lukas. Rebuttal of Christiano and AI Impacts on takeoff speeds?. LessWrong, April 2019.
Links | BibTeX
Gloor, Lukas. Cause prioritization for downside-focused value systems. Effective Altruism Forum, January 2018.
Links | BibTeX
Althaus, David. Descriptive Population Ethics and Its Relevance for Cause Prioritization. Effective Altruism Forum, April 2018.
Links | BibTeX
Sotala, Kaj. How feasible is the rapid development of artificial superintelligence?. Physica Scripta, 92 (11), 2017.
Links | BibTeX
Sotala, Kaj; Gloor, Lukas. Superintelligence as a Cause or Cure for Risks of Astronomical Suffering. Informatica, 41 (4), 2017.
Links | BibTeX
Oesterheld, Caspar. Complications in evaluating neglectedness. The Universe from an Intentional Stance Blog, June 2017.
Links | BibTeX
Tomasik, Brian. How the Simulation Argument Dampens Future Fanaticism. CLR Website, June 2016.
Links | BibTeX

Show all

Cook, Tristan. Replicating and extending the grabby aliens model. Effective Altruism Forum, April 2022.
Links | BibTeX
Cook, Tristan; Corlouer, Guillaume. The optimal timing of spending on AGI safety work; why we should probably be spending more now. Effective Altruism Forum, November 2022.
Links | BibTeX
Baum, Seth D; Armstrong, Stuart; Ekenstedt, Timoteus; Häggström, Olle; Hanson, Robin; Kuhlemann, Karin; Maas, Matthijs M; Miller, James D; Salmela, Markus; Sandberg, Anders; Sotala, Kaj; Torres, Phil; Turchin, Alexey; Yampolskiy, Roman V. Long-term trajectories of human civilization. Foresight, 21 (1), pp. 53-83, 2019.
Links | BibTeX
Kokotajlo, Daniel. Soft takeoff can still lead to decisive strategic advantage. Alignment Forum, August 2019.
Links | BibTeX
Gloor, Lukas. Rebuttal of Christiano and AI Impacts on takeoff speeds?. LessWrong, April 2019.
Links | BibTeX
Gloor, Lukas. Cause prioritization for downside-focused value systems. Effective Altruism Forum, January 2018.
Links | BibTeX
Althaus, David. Descriptive Population Ethics and Its Relevance for Cause Prioritization. Effective Altruism Forum, April 2018.
Links | BibTeX
Sotala, Kaj. How feasible is the rapid development of artificial superintelligence?. Physica Scripta, 92 (11), 2017.
Links | BibTeX
Sotala, Kaj; Gloor, Lukas. Superintelligence as a Cause or Cure for Risks of Astronomical Suffering. Informatica, 41 (4), 2017.
Links | BibTeX
Oesterheld, Caspar. Complications in evaluating neglectedness. The Universe from an Intentional Stance Blog, June 2017.
Links | BibTeX
Tomasik, Brian. How the Simulation Argument Dampens Future Fanaticism. CLR Website, June 2016.
Links | BibTeX

Decision theory

Show all

Baum, Seth D; Armstrong, Stuart; Ekenstedt, Timoteus; Häggström, Olle; Hanson, Robin; Kuhlemann, Karin; Maas, Matthijs M; Miller, James D; Salmela, Markus; Sandberg, Anders; Sotala, Kaj; Torres, Phil; Turchin, Alexey; Yampolskiy, Roman V. Long-term trajectories of human civilization. Foresight, 21 (1), pp. 53-83, 2019.
Links | BibTeX
Sotala, Kaj. How feasible is the rapid development of artificial superintelligence?. Physica Scripta, 92 (11), 2017.
Links | BibTeX
Sotala, Kaj; Gloor, Lukas. Superintelligence as a Cause or Cure for Risks of Astronomical Suffering. Informatica, 41 (4), 2017.
Links | BibTeX

Malevolence

Show all

Cook, Tristan. Replicating and extending the grabby aliens model. Effective Altruism Forum, April 2022.
Links | BibTeX
Cook, Tristan; Corlouer, Guillaume. The optimal timing of spending on AGI safety work; why we should probably be spending more now. Effective Altruism Forum, November 2022.
Links | BibTeX
Baum, Seth D; Armstrong, Stuart; Ekenstedt, Timoteus; Häggström, Olle; Hanson, Robin; Kuhlemann, Karin; Maas, Matthijs M; Miller, James D; Salmela, Markus; Sandberg, Anders; Sotala, Kaj; Torres, Phil; Turchin, Alexey; Yampolskiy, Roman V. Long-term trajectories of human civilization. Foresight, 21 (1), pp. 53-83, 2019.
Links | BibTeX
Kokotajlo, Daniel. Soft takeoff can still lead to decisive strategic advantage. Alignment Forum, August 2019.
Links | BibTeX
Gloor, Lukas. Rebuttal of Christiano and AI Impacts on takeoff speeds?. LessWrong, April 2019.
Links | BibTeX
Gloor, Lukas. Cause prioritization for downside-focused value systems. Effective Altruism Forum, January 2018.
Links | BibTeX
Althaus, David. Descriptive Population Ethics and Its Relevance for Cause Prioritization. Effective Altruism Forum, April 2018.
Links | BibTeX
Sotala, Kaj. How feasible is the rapid development of artificial superintelligence?. Physica Scripta, 92 (11), 2017.
Links | BibTeX
Sotala, Kaj; Gloor, Lukas. Superintelligence as a Cause or Cure for Risks of Astronomical Suffering. Informatica, 41 (4), 2017.
Links | BibTeX
Oesterheld, Caspar. Complications in evaluating neglectedness. The Universe from an Intentional Stance Blog, June 2017.
Links | BibTeX
Tomasik, Brian. How the Simulation Argument Dampens Future Fanaticism. CLR Website, June 2016.
Links | BibTeX

Ethics & meta-ethics

Show all

Cook, Tristan. Replicating and extending the grabby aliens model. Effective Altruism Forum, April 2022.
Links | BibTeX
Cook, Tristan; Corlouer, Guillaume. The optimal timing of spending on AGI safety work; why we should probably be spending more now. Effective Altruism Forum, November 2022.
Links | BibTeX
Baum, Seth D; Armstrong, Stuart; Ekenstedt, Timoteus; Häggström, Olle; Hanson, Robin; Kuhlemann, Karin; Maas, Matthijs M; Miller, James D; Salmela, Markus; Sandberg, Anders; Sotala, Kaj; Torres, Phil; Turchin, Alexey; Yampolskiy, Roman V. Long-term trajectories of human civilization. Foresight, 21 (1), pp. 53-83, 2019.
Links | BibTeX
Kokotajlo, Daniel. Soft takeoff can still lead to decisive strategic advantage. Alignment Forum, August 2019.
Links | BibTeX
Gloor, Lukas. Rebuttal of Christiano and AI Impacts on takeoff speeds?. LessWrong, April 2019.
Links | BibTeX
Gloor, Lukas. Cause prioritization for downside-focused value systems. Effective Altruism Forum, January 2018.
Links | BibTeX
Althaus, David. Descriptive Population Ethics and Its Relevance for Cause Prioritization. Effective Altruism Forum, April 2018.
Links | BibTeX
Sotala, Kaj. How feasible is the rapid development of artificial superintelligence?. Physica Scripta, 92 (11), 2017.
Links | BibTeX
Sotala, Kaj; Gloor, Lukas. Superintelligence as a Cause or Cure for Risks of Astronomical Suffering. Informatica, 41 (4), 2017.
Links | BibTeX
Oesterheld, Caspar. Complications in evaluating neglectedness. The Universe from an Intentional Stance Blog, June 2017.
Links | BibTeX
Tomasik, Brian. How the Simulation Argument Dampens Future Fanaticism. CLR Website, June 2016.
Links | BibTeX

Prioritization & macrostrategy

Cook, Tristan. Replicating and extending the grabby aliens model. Effective Altruism Forum, April 2022.
Links | BibTeX
Cook, Tristan; Corlouer, Guillaume. The optimal timing of spending on AGI safety work; why we should probably be spending more now. Effective Altruism Forum, November 2022.
Links | BibTeX
Baum, Seth D; Armstrong, Stuart; Ekenstedt, Timoteus; Häggström, Olle; Hanson, Robin; Kuhlemann, Karin; Maas, Matthijs M; Miller, James D; Salmela, Markus; Sandberg, Anders; Sotala, Kaj; Torres, Phil; Turchin, Alexey; Yampolskiy, Roman V. Long-term trajectories of human civilization. Foresight, 21 (1), pp. 53-83, 2019.
Links | BibTeX
Kokotajlo, Daniel. Soft takeoff can still lead to decisive strategic advantage. Alignment Forum, August 2019.
Links | BibTeX
Gloor, Lukas. Rebuttal of Christiano and AI Impacts on takeoff speeds?. LessWrong, April 2019.
Links | BibTeX
Gloor, Lukas. Cause prioritization for downside-focused value systems. Effective Altruism Forum, January 2018.
Links | BibTeX
Althaus, David. Descriptive Population Ethics and Its Relevance for Cause Prioritization. Effective Altruism Forum, April 2018.
Links | BibTeX
Sotala, Kaj. How feasible is the rapid development of artificial superintelligence?. Physica Scripta, 92 (11), 2017.
Links | BibTeX
Sotala, Kaj; Gloor, Lukas. Superintelligence as a Cause or Cure for Risks of Astronomical Suffering. Informatica, 41 (4), 2017.
Links | BibTeX
Oesterheld, Caspar. Complications in evaluating neglectedness. The Universe from an Intentional Stance Blog, June 2017.
Links | BibTeX
Tomasik, Brian. How the Simulation Argument Dampens Future Fanaticism. CLR Website, June 2016.
Links | BibTeX

AI Forecasting

Show all

Cook, Tristan. Replicating and extending the grabby aliens model. Effective Altruism Forum, April 2022.
Links | BibTeX
Cook, Tristan; Corlouer, Guillaume. The optimal timing of spending on AGI safety work; why we should probably be spending more now. Effective Altruism Forum, November 2022.
Links | BibTeX
Baum, Seth D; Armstrong, Stuart; Ekenstedt, Timoteus; Häggström, Olle; Hanson, Robin; Kuhlemann, Karin; Maas, Matthijs M; Miller, James D; Salmela, Markus; Sandberg, Anders; Sotala, Kaj; Torres, Phil; Turchin, Alexey; Yampolskiy, Roman V. Long-term trajectories of human civilization. Foresight, 21 (1), pp. 53-83, 2019.
Links | BibTeX
Kokotajlo, Daniel. Soft takeoff can still lead to decisive strategic advantage. Alignment Forum, August 2019.
Links | BibTeX
Gloor, Lukas. Rebuttal of Christiano and AI Impacts on takeoff speeds?. LessWrong, April 2019.
Links | BibTeX
Gloor, Lukas. Cause prioritization for downside-focused value systems. Effective Altruism Forum, January 2018.
Links | BibTeX
Althaus, David. Descriptive Population Ethics and Its Relevance for Cause Prioritization. Effective Altruism Forum, April 2018.
Links | BibTeX
Sotala, Kaj. How feasible is the rapid development of artificial superintelligence?. Physica Scripta, 92 (11), 2017.
Links | BibTeX
Sotala, Kaj; Gloor, Lukas. Superintelligence as a Cause or Cure for Risks of Astronomical Suffering. Informatica, 41 (4), 2017.
Links | BibTeX
Oesterheld, Caspar. Complications in evaluating neglectedness. The Universe from an Intentional Stance Blog, June 2017.
Links | BibTeX
Tomasik, Brian. How the Simulation Argument Dampens Future Fanaticism. CLR Website, June 2016.
Links | BibTeX

Other

Show all

Cook, Tristan. Replicating and extending the grabby aliens model. Effective Altruism Forum, April 2022.
Links | BibTeX
Cook, Tristan; Corlouer, Guillaume. The optimal timing of spending on AGI safety work; why we should probably be spending more now. Effective Altruism Forum, November 2022.
Links | BibTeX
Baum, Seth D; Armstrong, Stuart; Ekenstedt, Timoteus; Häggström, Olle; Hanson, Robin; Kuhlemann, Karin; Maas, Matthijs M; Miller, James D; Salmela, Markus; Sandberg, Anders; Sotala, Kaj; Torres, Phil; Turchin, Alexey; Yampolskiy, Roman V. Long-term trajectories of human civilization. Foresight, 21 (1), pp. 53-83, 2019.
Links | BibTeX
Kokotajlo, Daniel. Soft takeoff can still lead to decisive strategic advantage. Alignment Forum, August 2019.
Links | BibTeX
Gloor, Lukas. Rebuttal of Christiano and AI Impacts on takeoff speeds?. LessWrong, April 2019.
Links | BibTeX
Gloor, Lukas. Cause prioritization for downside-focused value systems. Effective Altruism Forum, January 2018.
Links | BibTeX
Althaus, David. Descriptive Population Ethics and Its Relevance for Cause Prioritization. Effective Altruism Forum, April 2018.
Links | BibTeX
Sotala, Kaj. How feasible is the rapid development of artificial superintelligence?. Physica Scripta, 92 (11), 2017.
Links | BibTeX
Sotala, Kaj; Gloor, Lukas. Superintelligence as a Cause or Cure for Risks of Astronomical Suffering. Informatica, 41 (4), 2017.
Links | BibTeX
Oesterheld, Caspar. Complications in evaluating neglectedness. The Universe from an Intentional Stance Blog, June 2017.
Links | BibTeX
Tomasik, Brian. How the Simulation Argument Dampens Future Fanaticism. CLR Website, June 2016.
Links | BibTeX