1: \begin{thebibliography}{10}
2:
3: \bibitem{Beeson:85}
4: M.~Beeson.
5: \newblock {\em Foundations of Constructive Mathematics}.
6: \newblock Springer-Verlag, Heidelberg, 1985.
7:
8: \bibitem{Bell:66}
9: J.~S. Bell.
10: \newblock On the problem of hidden variables in quantum mechanics.
11: \newblock {\em Rev. Mod. Phys.}, 38:447--452, 1966.
12:
13: \bibitem{Bennett:00}
14: C.~H. Bennett and D.~P. DiVicenzo.
15: \newblock Quantum information and computation.
16: \newblock {\em Nature}, 404(6775):256--259, 2000.
17:
18: \bibitem{Bishop:95}
19: C.~M. Bishop.
20: \newblock {\em Neural networks for pattern recognition}.
21: \newblock Oxford University Press, 1995.
22:
23: \bibitem{Brouwer:07}
24: L.~E.~J. Brouwer.
25: \newblock {Over de Grondslagen der Wiskunde. Dissertation, Doctoral Thesis,
26: University of Amsterdam}, 1907.
27:
28: \bibitem{Cajori:19}
29: F.~Cajori.
30: \newblock {\em History of mathematics (2nd edition)}.
31: \newblock Macmillan, New York, 1919.
32:
33: \bibitem{Cantor:1874}
34: G.~Cantor.
35: \newblock {\"{U}ber eine Eigenschaft des Inbegriffes aller reellen
36: algebraischen Zahlen}.
37: \newblock {\em Crelle's Journal f\"{u}r Mathematik}, 77:258--263, 1874.
38:
39: \bibitem{Chaitin:75}
40: G.J. Chaitin.
41: \newblock A theory of program size formally identical to information theory.
42: \newblock {\em Journal of the ACM}, 22:329--340, 1975.
43:
44: \bibitem{Chaitin:87}
45: G.J. Chaitin.
46: \newblock {\em Algorithmic Information Theory}.
47: \newblock Cambridge University Press, Cambridge, 1987.
48:
49: \bibitem{Deutsch:97}
50: D.~Deutsch.
51: \newblock {\em The Fabric of Reality}.
52: \newblock Allen Lane, New York, NY, 1997.
53:
54: \bibitem{Erber:85}
55: T.~Erber and S.~Putterman.
56: \newblock Randomness in quantum mechanics -- nature's ultimate cryptogram?
57: \newblock {\em Nature}, 318(7):41--43, 1985.
58:
59: \bibitem{Everett:57}
60: H.~{Everett III}.
61: \newblock {`Relative State'} formulation of quantum mechanics.
62: \newblock {\em Reviews of Modern Physics}, 29:454--462, 1957.
63:
64: \bibitem{Fredkin:82}
65: E.~F. Fredkin and T.~Toffoli.
66: \newblock Conservative logic.
67: \newblock {\em International Journal of Theoretical Physics}, 21(3/4):219--253,
68: 1982.
69:
70: \bibitem{Freyvald:74}
71: R.~V. Freyvald.
72: \newblock Functions and functionals computable in the limit.
73: \newblock {\em Transactions of Latvijas Vlasts Univ. Zinatn. Raksti},
74: 210:6--19, 1977.
75:
76: \bibitem{Gacs:83}
77: P.~G\'{a}cs.
78: \newblock On the relation between descriptional complexity and algorithmic
79: probability.
80: \newblock {\em Theoretical Computer Science}, 22:71--93, 1983.
81:
82: \bibitem{Goedel:31}
83: K.~G\"{o}del.
84: \newblock \"{U}ber formal unentscheidbare {S\"{a}tze der Principia Mathematica
85: und verwandter Systeme I}.
86: \newblock {\em Monatshefte f\"{u}r Mathematik und Physik}, 38:173--198, 1931.
87:
88: \bibitem{Gold:65}
89: E.~M. Gold.
90: \newblock Limiting recursion.
91: \newblock {\em Journal of Symbolic Logic}, 30(1):28--46, 1965.
92:
93: \bibitem{Green:87}
94: M.B. Green, J.H. Schwarz, and E.~Witten.
95: \newblock {\em Superstring Theory}.
96: \newblock Cambridge University Press, 1987.
97:
98: \bibitem{Hochreiter:01meta}
99: S.~Hochreiter, A.~S. Younger, and P.~R. Conwell.
100: \newblock Learning to learn using gradient descent.
101: \newblock In {\em Lecture Notes on Comp. Sci. 2130, Proc. Intl. Conf. on
102: Artificial Neural Networks (ICANN-2001)}, pages 87--94. Springer: Berlin,
103: Heidelberg, 2001.
104:
105: \bibitem{Hutter:01alpha+}
106: M.~Hutter.
107: \newblock Convergence and error bounds of universal prediction for general
108: alphabet.
109: \newblock {\em Proceedings of the 12th European Conference on Machine Learning
110: (ECML-2001)}, (TR IDSIA-07-01, cs.AI/0103015), 2001.
111: \newblock (On J. Schmidhuber's SNF grant 20-61847).
112:
113: \bibitem{Hutter:01loss+}
114: M.~Hutter.
115: \newblock General loss bounds for universal sequence prediction.
116: \newblock In C.~E. Brodley and A.~P. Danyluk, editors, {\em Proceedings of the
117: $18^{th}$ International Conference on Machine Learning (ICML-2001)}, pages
118: 210--217. Morgan Kaufmann, 2001.
119: \newblock (On J. Schmidhuber's SNF grant 20-61847).
120:
121: \bibitem{Hutter:01aixi+}
122: M.~Hutter.
123: \newblock Towards a universal theory of artificial intelligence based on
124: algorithmic probability and sequential decisions.
125: \newblock {\em Proceedings of the 12$^{th}$ European Conference on Machine
126: Learning (ECML-2001)}, pages 226--238, 2001.
127: \newblock (On J. Schmidhuber's SNF grant 20-61847).
128:
129: \bibitem{Hutter:01fast+}
130: M.~Hutter.
131: \newblock The fastest and shortest algorithm for all well-defined problems.
132: \newblock {\em International Journal of Foundations of Computer Science},
133: 13(3):431--443, 2002.
134: \newblock (On J. Schmidhuber's SNF grant 20-61847).
135:
136: \bibitem{Hutter:02selfopt+}
137: M.~Hutter.
138: \newblock Self-optimizing and {P}areto-optimal policies in general environments
139: based on {B}ayes-mixtures.
140: \newblock In J.~Kivinen and R.~H. Sloan, editors, {\em Proceedings of the 15th
141: Annual Conference on Computational Learning Theory (COLT 2002)}, Lecture
142: Notes in Artificial Intelligence, pages 364--379, Sydney, Australia, 2002.
143: Springer.
144: \newblock (On J. Schmidhuber's SNF grant 20-61847).
145:
146: \bibitem{Hutter:03aixigentle}
147: M.~Hutter.
148: \newblock A gentle introduction to the universal algorithmic agent {AIXI}.
149: \newblock In B.~Goertzel and C.~Pennachin, editors, {\em Real AI: New
150: Approaches to Artificial General Intelligence}. Plenum Press, New York, 2003.
151: \newblock To appear.
152:
153: \bibitem{JordanRumelhart:90}
154: M.~I. Jordan and D.~E. Rumelhart.
155: \newblock Supervised learning with a distal teacher.
156: \newblock Technical Report Occasional Paper \#40, Center for Cog. Sci.,
157: Massachusetts Institute of Technology, 1990.
158:
159: \bibitem{Kaelbling:96}
160: L.P. Kaelbling, M.L. Littman, and A.W. Moore.
161: \newblock Reinforcement learning: a survey.
162: \newblock {\em Journal of AI research}, 4:237--285, 1996.
163:
164: \bibitem{Kolmogorov:65}
165: A.N. Kolmogorov.
166: \newblock Three approaches to the quantitative definition of information.
167: \newblock {\em Problems of Information Transmission}, 1:1--11, 1965.
168:
169: \bibitem{Levin:73}
170: L.~A. Levin.
171: \newblock Universal sequential search problems.
172: \newblock {\em Problems of Information Transmission}, 9(3):265--266, 1973.
173:
174: \bibitem{Levin:74}
175: L.~A. Levin.
176: \newblock Laws of information (nongrowth) and aspects of the foundation of
177: probability theory.
178: \newblock {\em Problems of Information Transmission}, 10(3):206--210, 1974.
179:
180: \bibitem{LiVitanyi:97}
181: M.~Li and P.~M.~B. Vit\'{a}nyi.
182: \newblock {\em An Introduction to {Kolmogorov} Complexity and its Applications
183: (2nd edition)}.
184: \newblock Springer, 1997.
185:
186: \bibitem{Loewenheim:15}
187: L.~L\"{o}wenheim.
188: \newblock {\"{U}ber M\"{o}glichkeiten im Relativkalk\"{u}l}.
189: \newblock {\em Mathematische Annalen}, 76:447--470, 1915.
190:
191: \bibitem{Feder:98}
192: N.~Merhav and M.~Feder.
193: \newblock Universal prediction.
194: \newblock {\em IEEE Transactions on Information Theory}, 44(6):2124--2147,
195: 1998.
196:
197: \bibitem{Mitchell:97}
198: T.~Mitchell.
199: \newblock {\em Machine Learning}.
200: \newblock McGraw Hill, 1997.
201:
202: \bibitem{Forth:70}
203: C.~H. Moore and G.~C. Leach.
204: \newblock {FORTH} - a language for interactive computing, 1970.
205: \newblock http://www.ultratechnology.com.
206:
207: \bibitem{Newell:63}
208: A.~Newell and H.~Simon.
209: \newblock {GPS}, a program that simulates human thought.
210: \newblock In E.~Feigenbaum and J.~Feldman, editors, {\em Computers and
211: Thought}, pages 279--293. McGraw-Hill, New York, 1963.
212:
213: \bibitem{NguyenWidrow:89}
214: Nguyen and B.~Widrow.
215: \newblock The truck backer-upper: An example of self learning in neural
216: networks.
217: \newblock In {\em Proceedings of the International Joint Conference on Neural
218: Networks}, pages 357--363. IEEE Press, 1989.
219:
220: \bibitem{Penrose:89}
221: R.~Penrose.
222: \newblock {\em The Emperor's New Mind.}
223: \newblock Oxford University Press, 1989.
224:
225: \bibitem{Popper:34}
226: K.~R. Popper.
227: \newblock {\em The Logic of Scientific Discovery}.
228: \newblock Hutchinson, London, 1934.
229:
230: \bibitem{Putnam:65}
231: H.~Putnam.
232: \newblock Trial and error predicates and the solution to a problem of
233: {Mostowski}.
234: \newblock {\em Journal of Symbolic Logic}, 30(1):49--57, 1965.
235:
236: \bibitem{Rissanen:86}
237: J.~Rissanen.
238: \newblock Stochastic complexity and modeling.
239: \newblock {\em The Annals of Statistics}, 14(3):1080--1100, 1986.
240:
241: \bibitem{Rogers:67}
242: H.~{Rogers, Jr.}
243: \newblock {\em Theory of Recursive Functions and Effective Computability}.
244: \newblock McGraw-Hill, New York, 1967.
245:
246: \bibitem{SOAR:93}
247: P.~S. Rosenbloom, J.~E. Laird, and A.~Newell.
248: \newblock {\em The {SOAR} Papers}.
249: \newblock MIT Press, 1993.
250:
251: \bibitem{Rumelhart:86}
252: D.~E. Rumelhart, G.~E. Hinton, and R.~J. Williams.
253: \newblock Learning internal representations by error propagation.
254: \newblock In D.~E. Rumelhart and J.~L. McClelland, editors, {\em Parallel
255: Distributed Processing}, volume~1, pages 318--362. MIT Press, 1986.
256:
257: \bibitem{Christof:00}
258: C.~Schmidhuber.
259: \newblock Strings from logic.
260: \newblock Technical Report CERN-TH/2000-316, CERN, Theory Division, 2000.
261: \newblock http://xxx.lanl.gov/abs/hep-th/0011065.
262:
263: \bibitem{Schmidhuber:91nips}
264: J.~Schmidhuber.
265: \newblock Reinforcement learning in {M}arkovian and non-{M}arkovian
266: environments.
267: \newblock In D.~S. Lippman, J.~E. Moody, and D.~S. Touretzky, editors, {\em
268: Advances in Neural Information Processing Systems 3}, pages 500--506. Morgan
269: Kaufmann, 1991.
270:
271: \bibitem{Schmidhuber:95kol}
272: J.~Schmidhuber.
273: \newblock Discovering solutions with low {Kolmogorov} complexity and high
274: generalization capability.
275: \newblock In A.~Prieditis and S.~Russell, editors, {\em Machine Learning:
276: Proceedings of the Twelfth International Conference}, pages 488--496. Morgan
277: Kaufmann Publishers, San Francisco, CA, 1995.
278:
279: \bibitem{Schmidhuber:97brauer}
280: J.~Schmidhuber.
281: \newblock A computer scientist's view of life, the universe, and everything.
282: \newblock In C.~Freksa, M.~Jantzen, and R.~Valk, editors, {\em Foundations of
283: Computer Science: Potential - Theory - Cognition}, volume 1337, pages
284: 201--208. Lecture Notes in Computer Science, Springer, Berlin, 1997.
285:
286: \bibitem{Schmidhuber:97nn}
287: J.~Schmidhuber.
288: \newblock Discovering neural nets with low {Kolmogorov} complexity and high
289: generalization capability.
290: \newblock {\em Neural Networks}, 10(5):857--873, 1997.
291:
292: \bibitem{Schmidhuber:00v2}
293: J.~Schmidhuber.
294: \newblock Algorithmic theories of everything.
295: \newblock Technical Report IDSIA-20-00, quant-ph/0011122, IDSIA, Manno
296: (Lugano), Switzerland, 2000.
297: \newblock Sections 1-5: see \cite{Schmidhuber:02ijfcs}; Section 6: see
298: \cite{Schmidhuber:02colt}.
299:
300: \bibitem{Schmidhuber:01direct}
301: J.~Schmidhuber.
302: \newblock Sequential decision making based on direct search.
303: \newblock In R.~Sun and C.~L. Giles, editors, {\em Sequence Learning:
304: Paradigms, Algorithms, and Applications}. Springer, 2001.
305: \newblock Lecture Notes on AI 1828.
306:
307: \bibitem{Schmidhuber:02ijfcs}
308: J.~Schmidhuber.
309: \newblock Hierarchies of generalized {Kolmogorov} complexities and
310: nonenumerable universal measures computable in the limit.
311: \newblock {\em International Journal of Foundations of Computer Science},
312: 13(4):587--612, 2002.
313:
314: \bibitem{Schmidhuber:02oopsmlj}
315: J.~Schmidhuber.
316: \newblock Optimal ordered problem solver.
317: \newblock Technical Report IDSIA-12-02, IDSIA, Manno-Lugano, Switzerland, 2002.
318: \newblock Available at arXiv:cs.AI/0207097 or http://www.idsia.ch/\~{
319: }juergen/oops.html. {\em Machine Learning Journal}, Kluwer, 2003, accepted.
320:
321: \bibitem{Schmidhuber:02colt}
322: J.~Schmidhuber.
323: \newblock The {Speed Prior:} a new simplicity measure yielding near-optimal
324: computable predictions.
325: \newblock In J.~Kivinen and R.~H. Sloan, editors, {\em Proceedings of the 15th
326: Annual Conference on Computational Learning Theory (COLT 2002)}, Lecture
327: Notes in Artificial Intelligence, pages 216--228. Springer, Sydney,
328: Australia, 2002.
329:
330: \bibitem{Schmidhuber:03nips}
331: J.~Schmidhuber.
332: \newblock Bias-optimal incremental problem solving.
333: \newblock In S.~Becker, S.~Thrun, and K.~Obermayer, editors, {\em Advances in
334: Neural Information Processing Systems 15}, pages 1571--1578, Cambridge, MA,
335: 2003. MIT Press.
336:
337: \bibitem{Schmidhuber:03gm2}
338: J.~Schmidhuber.
339: \newblock G\"{o}del machines: self-referential universal problem solvers making
340: provably optimal self-improvements.
341: \newblock Technical Report IDSIA-19-03, arXiv:cs.LO/0309048 v2, IDSIA,
342: Manno-Lugano, Switzerland, October 2003.
343:
344: \bibitem{Schmidhuber:03newai1}
345: J.~Schmidhuber.
346: \newblock The new {AI}: General \& sound \& relevant for physics.
347: \newblock Technical Report TR IDSIA-04-03, Version 1.0, cs.AI/0302012 v1,
348: February 2003.
349:
350: \bibitem{Schmidhuber:03grandai}
351: J.~Schmidhuber.
352: \newblock Towards solving the grand problem of {AI}.
353: \newblock In P.~Quaresma, A.~Dourado, E.~Costa, and J.~F. Costa, editors, {\em
354: Soft Computing and complex systems}, pages 77--97. Centro Internacional de
355: Mathematica, Coimbra, Portugal, 2003.
356: \newblock Based on \cite{Schmidhuber:03newai1}.
357:
358: \bibitem{Schmidhuber:02nipsws}
359: J.~Schmidhuber and M.~Hutter.
360: \newblock {NIPS 2002 workshop on universal learning algorithms and optimal
361: search. Additional speakers: R. Solomonoff, P. M. B. Vit\'{a}nyi, N.
362: Cesa-Bianchi, I. Nemenmann. Whistler, CA}, 2002.
363:
364: \bibitem{Schmidhuber:97bias}
365: J.~Schmidhuber, J.~Zhao, and M.~Wiering.
366: \newblock Shifting inductive bias with success-story algorithm, adaptive
367: {Levin} search, and incremental self-improvement.
368: \newblock {\em Machine Learning}, 28:105--130, 1997.
369:
370: \bibitem{Skolem:19}
371: T.~Skolem.
372: \newblock {Logisch-kombinatorische Untersuchungen \"{u}ber Erf\"{u}llbarkeit
373: oder Beweisbarkeit mathematischer S\"{a}tze nebst einem Theorem \"{u}ber
374: dichte Mengen}.
375: \newblock {\em Skrifter utgit av Videnskapsselskapet in Kristiania, I,
376: Mat.-Nat. Kl.}, N4:1--36, 1919.
377:
378: \bibitem{Solomonoff:64}
379: R.J. Solomonoff.
380: \newblock A formal theory of inductive inference. {Part I}.
381: \newblock {\em Information and Control}, 7:1--22, 1964.
382:
383: \bibitem{Solomonoff:78}
384: R.J. Solomonoff.
385: \newblock Complexity-based induction systems.
386: \newblock {\em IEEE Transactions on Information Theory}, IT-24(5):422--432,
387: 1978.
388:
389: \bibitem{Solomonoff:86}
390: R.J. Solomonoff.
391: \newblock An application of algorithmic probability to problems in artificial
392: intelligence.
393: \newblock In L.~N. Kanal and J.~F. Lemmer, editors, {\em Uncertainty in
394: Artificial Intelligence}, pages 473--491. Elsevier Science Publishers, 1986.
395:
396: \bibitem{Solomonoff:89}
397: R.J. Solomonoff.
398: \newblock A system for incremental learning based on algorithmic probability.
399: \newblock In {\em Proceedings of the Sixth Israeli Conference on Artificial
400: Intelligence, Computer Vision and Pattern Recognition}, pages 515--527. Tel
401: Aviv, Israel, 1989.
402:
403: \bibitem{Hooft:99}
404: G.~'t~Hooft.
405: \newblock Quantum gravity as a dissipative deterministic system.
406: \newblock Technical Report SPIN-1999/07/gr-gc/9903084,
407: http://xxx.lanl.gov/abs/gr-qc/9903084, Institute for Theoretical Physics,
408: Univ. of Utrecht, and Spinoza Institute, Netherlands, 1999.
409: \newblock Also published in {\em Classical and Quantum Gravity 16}, 3263.
410:
411: \bibitem{Turing:36}
412: A.~M. Turing.
413: \newblock On computable numbers, with an application to the
414: {Entscheidungsproblem}.
415: \newblock {\em Proceedings of the London Mathematical Society, Series 2},
416: 41:230--267, 1936.
417:
418: \bibitem{Ulam:50}
419: S.~Ulam.
420: \newblock Random processes and transformations.
421: \newblock In {\em Proceedings of the International Congress on Mathematics},
422: volume~2, pages 264--275, 1950.
423:
424: \bibitem{Vapnik:95}
425: V.~Vapnik.
426: \newblock {\em The Nature of Statistical Learning Theory}.
427: \newblock Springer, New York, 1995.
428:
429: \bibitem{Neumann:66}
430: J.~von Neumann.
431: \newblock {\em Theory of Self-Reproducing Automata}.
432: \newblock University of Illionois Press, Champain, IL, 1966.
433:
434: \bibitem{Wallace:68}
435: C.~S. Wallace and D.~M. Boulton.
436: \newblock An information theoretic measure for classification.
437: \newblock {\em Computer Journal}, 11(2):185--194, 1968.
438:
439: \bibitem{Werbos:74}
440: P.~J. Werbos.
441: \newblock {\em Beyond Regression: New Tools for Prediction and Analysis in the
442: Behavioral Sciences}.
443: \newblock PhD thesis, Harvard University, 1974.
444:
445: \bibitem{Werbos:87specifications}
446: P.~J. Werbos.
447: \newblock Learning how the world works: Specifications for predictive networks
448: in robots and brains.
449: \newblock In {\em Proceedings of IEEE International Conference on Systems, Man
450: and Cybernetics, N.Y.}, 1987.
451:
452: \bibitem{Wiering:96levin}
453: M.A. Wiering and J.~Schmidhuber.
454: \newblock Solving {POMDPs} with {L}evin search and {EIRA}.
455: \newblock In L.~Saitta, editor, {\em Machine Learning: Proceedings of the
456: Thirteenth International Conference}, pages 534--542. Morgan Kaufmann
457: Publishers, San Francisco, CA, 1996.
458:
459: \bibitem{Zuse:67}
460: K.~Zuse.
461: \newblock Rechnender {Raum}.
462: \newblock {\em Elektronische Datenverarbeitung}, 8:336--344, 1967.
463:
464: \bibitem{Zuse:69}
465: K.~Zuse.
466: \newblock {\em Rechnender {Raum}}.
467: \newblock Friedrich Vieweg \& Sohn, Braunschweig, 1969.
468: \newblock English translation: {\em Calculating Space,} MIT Technical
469: Translation AZT-70-164-GEMIT, Massachusetts Institute of Technology (Proj.
470: MAC), Cambridge, Mass. 02139, Feb. 1970.
471:
472: \bibitem{Zvonkin:70}
473: A.~K. Zvonkin and L.~A. Levin.
474: \newblock The complexity of finite objects and the algorithmic concepts of
475: information and randomness.
476: \newblock {\em Russian Math. Surveys}, 25(6):83--124, 1970.
477:
478: \end{thebibliography}
479: