Alle Publikationen
- <<
- <
- 1
1997
-
(1997): Long Short-Term Memory. In: Neural Computation 9 (8), S. 1735-1780. DOI: 10.1162/neco.1997.9.8.1735
DOI: https://doi.org/10.1162/neco.1997.9.8.1735 Abstract: Learning to store information over extended time intervals via recurrent backpropagation takes a very long time, mostly due to insucient, decaying error back ow. We brie y review Hochreiter's 1991 analysis of this problem, then address it by introducing a novel, ecient, gradient-based method called \Long Short-Term Memory" (LSTM). Truncating the gradient where this does not do harm, LSTM can learn to bridge minimal time lags in excess of 1000 discrete time steps by enforcing constant error ow through \constant error carrousels" within special units. Multiplicative gate units learn to open and close access to the constant error ow. LSTM is local in space and time; its computational complexity per time step and weight is O(1). Our experiments with articial data involve local, distributed, real-valued, and noisy pattern representations. In comparisons with RTRL, BPTT, Recurrent Cascade-Correlation, Elman nets, and Neural Sequence Chunking, LSTM leads to many more successful runs, and learns much faster. LSTM also solves complex, articial long time lag tasks that have never been solved by previous recurrent network algorithms.
Keywords: deutsche Community, Intellektualtechnik, Kogn. Architektur, kognitive Architekturen, Künstliche Intelligenz, Mensch-Technik-Relationen (MTR), Neuronale Netzwerke, Programmieren, Realtechnik, Sprachverstehen, Technik, Wiedererkennen / Erinnerung / Erkennen von Personen und Sitautionen, Social Recognition 1987
-
(1987): Brain mechanisms and social/affective behavior. In: Social Science Information 26 (2), S. 375-384
Abstract: Information (International Social Science Council) 1987.26:375-384
1981
-
Higgins, E. T.; Herman, C. P.; Zanna, M. P. (Hg.) (1981): Social cognition. Ontario Symposium on Personality and Social Psychology; University of Western Ontario. Hillsdale, NJ: Erlbaum
Keywords: Cognition, Congresses, Favoriten, Gedächtnis, Kognition, Personenwahrnehmung, Schemata, Schematheorie, Social Perception, soziale Kognition, Soziale Wahrnehmung, Soziales Handeln, Sozialpsychologie, The Ontario Symposium, Überblick, Wiedererkennen / Erinnerung / Erkennen von Personen und Sitautionen, Social Recognition 1932
-
(1932): Remembering: A Study in Experimental and Social Psychology. Cambridge: Cambridge University Press
Abstract: Cambridge University Press
- <<
- <
- 1