Full-text

URL: http://www.itee.uq.edu.au/~btonkes/papers/SEAL.ps.gz

Cached: PDF-146K    PS-98K    PS.gz-36K

SAVE AS an easy-to-recall long filename:

Filename format: author--year--title   PDF-146K    PS-36K    :: About GZip'd PS

Filename format: author--year--title--journal|proceedings|...--pages   PDF-146K    PS-36K

Related links

CiteSeer: http://citeseer.ist.psu.edu/context/764604/0

Web search: Google Web Search   ::   Google Scholar

Within this site: Cited by (3)    References (10)

Abstract

We develop a new framework for studying the biases that recurrent neural networks bring to language processing tasks. A semantic concept represented by a point in Euclidian space is translated into a symbol sequence by an encoder network. This sequence is then fed to a decoder network which attempts to translate it back to the original concept. We show how a pair of recurrent networks acting as encoder and decoder can develop their own symbolic language that is serially transmitted between them either forwards or backwards. The encoder and decoder bring different constraints to the task, and these early results indicate that the conflicting nature of these constraints may be reflected in the language that ultimately emerges, providing important clues to the structure of human languages.

@inproceedings{tonkes98aParadox,
  author={B. Tonkes and A. Blair and J. Wiles},
  title={A paradox of neural encoders and decoders, or, why don't we talk backwards?},
  year={1998},
  pages={357-364},
  editor={B. McKay and X. Yao and C. S. Newton and J.-H. Kim and T. Furuhashi},
  publisher={Springer},
  booktitle={Proceedings of the Second Asia-Pacific Conference on Simulated Evolution and Learning (SEAL98)},
  url={http://www.isrl.uiuc.edu/~amag/langev/paper/tonkes98aParadox.html}
}

HOME   ::  Conference List   ::   Conference Paper	Comments to: junwang4 you-know-at gmail.com	Last update: 10/27/09