Compression Progress, Pseudorandomness, & Hyperbolic Discounting

DOI

10.2991/agi.2010.34How to use a DOI?

Abstract

General intelligence requires open-ended exploratory learning. The principle of compression progress proposes that agents should derive intrinsic reward from maximizing "interestingness", the first derivative of compression progress over the agent's history. Schmidhuber posits that such a drive can explain "essential aspects of ... curiosity, creativity, art, science, music, [and] jokes", implying that such phenomena might be replicated in an artificial general intelligence programmed with such a drive. I pose two caveats: 1) as pointed out by Rayhawk, not everything that can be considered "interesting" according to this definition is interesting to humans; 2) because of (irrational) hyperbolic discounting of future rewards, humans have an additional preference for rewards that are structured to prevent premature satiation, often superseding intrinsic preferences for compression progress.

Copyright

© 2010, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Moshe Looks
PY  - 2010/06
DA  - 2010/06
TI  - Compression Progress, Pseudorandomness, & Hyperbolic Discounting
BT  - Proceedings of the 3d Conference on Artificial General Intelligence (2010)
PB  - Atlantis Press
SP  - 160
EP  - 161
SN  - 1951-6851
UR  - https://doi.org/10.2991/agi.2010.34
DO  - 10.2991/agi.2010.34
ID  - Looks2010/06
ER  -