Designing a Safe Motivational System for Intelligent Machines

DOI

10.2991/agi.2010.21How to use a DOI?

Abstract

As machines become more intelligent, more flexible, more autonomous and more powerful, the questions of how they should choose their actions and what goals they should pursue become critically important. Drawing upon the examples of and lessons learned from humans and lesser creatures, we propose a hierarchical motivational system flowing from an abstract invariant super-goal that is optimal for all (including the machines themselves) to low-level reflexive 'sensations, emotions, and attentional effects' and other enforcing biases to ensure reasonably 'correct' behavior even under conditions of uncertainty, immaturity, error, malfunction, and even sabotage.

Copyright

© 2010, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Mark R. Waser
PY  - 2010/06
DA  - 2010/06
TI  - Designing a Safe Motivational System for Intelligent Machines
BT  - Proceedings of the 3d Conference on Artificial General Intelligence (2010)
PB  - Atlantis Press
SP  - 94
EP  - 99
SN  - 1951-6851
UR  - https://doi.org/10.2991/agi.2010.21
DO  - 10.2991/agi.2010.21
ID  - Waser2010/06
ER  -