The book provides a gentle introduction to Universal Artificial Intelligence (UAI), a theory that provides a formal underpinning of what it means for an agent to act intelligently in a general class of environments.
An Introduction to Universal Artificial Intelligence provides a gentle introduction to Universal Artificial Intelligence (UAI), a theory that provides a formal underpinning of what it means for an agent to act intelligently in a general class of environments. First presented in Universal Artificial Intelligence (Hutter, 2004), UAI presents a model in which most other problems in AI can be presented, and unifies ideas from sequential decision theory, Bayesian inference and information theory to construct AIXI, an optimal reinforcement learning agent that learns to act optimally in unknown environments. AIXI represents a theoretical bound on intelligent behaviour, and so we also discuss tractable approximations of this optimal agent.
The book covers important practical approaches including efficient Bayesian updating with context tree weighting, and stochastic planning, approximated by sampling with Monte Carlo tree search. Algorithms are also included for the reader to implement, along with experimental results to compare against. This serves to approximate AIXI, as well as being used in state-of-the-art approaches in AI today. The book ends with a philosophical discussion of AGI covering the following key questions: Should intelligent agents be constructed at all, is it inevitable that they will be constructed, and is it dangerous to do so?
This text is suitable for late undergraduates and includes an extensive background chapter to fill in the assumed mathematical background.
Recenzijas
Is it possible to mathematically define and study artificial superintelligence? If that sounds like an interesting question, then this is definitely the book for you. Starting with probability theory, complexity theory and sequence prediction, it takes you right through to the safety of superintelligent machines. Shane Legg, co-founder of DeepMind
This is seminal work! Roman Yampolskiy, Tenured Associate Professor at the University of Louisville, USA
This is an important, timely, high-quality book by highly respected authors. Jürgen Schmidhuber, Director of the AI Initiative at King Abdullah University of Science and Technology, Scientific Director at the Swiss AI Lab IDSIA, Co-Founder & Chief Scientist at NNAISENSE
Clearly very strongly based on mathematical foundations. This offers a theoretical depth which will be of value in research, education (at an appropriate level), and for advanced practitioners. Alan Dix, Director of the Computational Foundry at Swansea University and Professorial Fellow at Cardiff Metropolitan University
Part I: Introduction.
1. Introduction.
2. Background. Part II: Algorithmic Prediction.
3. Bayesian Sequence Prediction.
4. The Context Tree Weighting Algorithm.
5. Variations on CTW. Part III: A Family of Universal Agents.
6. Agency.
7. Universal Artificial Intelligence.
8. Optimality of Universal Agents.
9. Other Universal Agents.
10. Multi-agent Setting. Part IV: Approximating Universal Agents. 11. AIXI-MDP.
12. Monte-Carlo AIXI with Context Tree Weighting.
13. Computational Aspects. Part V: Alternative Approaches. 14. Feature Reinforcement Learning. Part VI: Safety and Discussion. 15. AGI Safety.
16. Philosophy of AI.
Marcus Hutter is Senior Researcher at DeepMind in London and Professor in the Research School of Computer Science (RSCS) at the Australian National University (ANU) in Canberra, Australia (fulltime till 2019 and honorary since then). He is Chair of the ongoing Human Knowledge Compression Contest. He received a masters degree in computer science in 1992 from the University of Technology in Munich, Germany, a PhD in theoretical particle physics in 1996, and completed his Habilitation in 2003. He worked as an active software developer for various companies in several areas for many years, before he commenced his academic career in 2000 at the Artificial Intelligence (AI) institute IDSIA in Lugano, Switzerland, where he stayed for six years. Since 2000, he has mainly worked on fundamental questions in AI resulting in over 200 peer-reviewed research publications and his book Universal Artificial Intelligence (Springer, EATCS, 2005). He has served (as PC member, chair, organizer) for numerous conferences, and reviews for major conferences and journals. He has given numerous invited lectures, and his work in AI and statistics was nominated for and received several awards (UAI, IJCAI-JAIR, AGI Kurzweil, Lindley). http://www.hutter1.net/
David Quarel is completing a PhD at the ANU. He holds a BSc in mathematics and MSc in computer science, specialising in artificial intelligence and machine learning. David has several years experience in developing course content and distilling complex topics suitable for a wide range of academic audiences, as well as having delivered guest lectures at the ANU, and spent two years as a full-time tutor before starting his PhD.
Elliot Catt is a Research Scientist at DeepMind London and has previously completed a PhD in Universal Artificial Intelligence. He holds a BSc and MSc in mathematics and a PhD in computer science. Elliot has lectured on the topic of Advanced Artificial Intelligence at the ANU and published several pieces of work on the topic of Universal Artificial Intelligence. https://catt.id/