This is an electronic reprint of the original article.
This reprint may differ from the original in pagination and typographic detail.
Powered by TCPDF (www.tcpdf.org)
This material is protected by copyright and other intellectual property rights, and duplication or sale of all or
part of any of the repository collections is not permitted, except that material may be duplicated by you for
your research use or educational purposes in electronic or print form. You must obtain permission for any
other use. Electronic or print copies may not be offered, whether for sale or otherwise to anyone who is not
an authorised user.
Sima, Jiri; Orponen, Pekka
General purpose computation with neural networks: a survey of complexity theoretic results
Published in:
Neural Computation
DOI:
10.1162/089976603322518731
Published: 01/01/2003
Document Version
Peer reviewed version
Please cite the original version:
Sima, J., & Orponen, P. (2003). General purpose computation with neural networks: a survey of complexity
theoretic results. Neural Computation, 15(12), 2727-2778. https://doi.org/10.1162/089976603322518731
! "
# $%
"
&
$% ' ( )
* + , - ! - . - / 0 1 2 0
' 3
. - /
#
& 4
! / +
4
/ 5
6
4
( 7
/
' 8
0 1
& 4
! / +
4
/ , 0 1 - 9 / 2 : /
4
9 ; /
3
. < = !
4
5
> ? @ ? A 0 B C 5 DE F G H >
# ( I
. / E 5 2 : /
4
9 ; /
3
. < = !
4
5 J K L M N O J P O M J P O Q
> / R R
(
@
# 3
0 + / + S
T
(
< 0
# (
- 0
# 8
1 0
# U
9 / 0
#
/ - !
4
(
= 2 0
' 3
. - /
#
& 4
! / +
4
/ 5
V / = , ! + R ! W + ! X /
#
, ! -
8
0 1
U
/
4
9 + 0 = 0
I 8
5
> ? @ ? A 0 B C Y G G 5 Z * [ \ G F G D C V W
U
5 Z ! + =
(
+
7
5 ] ^ _ ] ` a ` N b O J P c d b P
e
f g h i h j k l m n j k o p j q q r i s n n t k o h u v r w k j x o i y z z { | g } ~ y z | g
t ~ ~
g h i h j k l m n j k o p j q q r i s n n t k o h u v r w k j x o ~ k t o m h z l j u h r t p x q j x u
h i s k
h r j x u i s j k p
h o m h h
p i o p x w q p o h k j o s k h t x o m h l t n s
o j o p t x j q j i n h l o i t x h s k j q x h o
t k
t u h q i v r n k h i h x o p x w j u h o j p q h u
o j
t x t r t o m h
j k p t s i t u h q i j l l t k u p x w o t o m h p k l t n q h
p o r o m h
t k h o p l l m j k j l o h k p i o p l i
m h l k p o h k p j t l q j i i p
l j o p t x p x l q s u h h w o m h
j k l m p o h l o s k h t o m h x h o
t k
h h u t k
j k u
i k h l s k k h x o
o p h t u h q
u p i l k h o h
i l t x o p x s t s i
i o j o h o r n h
v p x j k r
i j x j q t w
h p w m o l t x
i o k j p x o i
i r h o k p l
i j i r h o k p l
x h o
t k
i p
h
x p o h x h o i
i p x
x p o h j p q p h i
l t n s o j o p t x o r n h
u h o h k p x p i o p l
i n k t v j v p q p i o p l
h o l
m h s x u h k q r p x w k h i s q o i l t x l h k x p x w o m h l t n s o j o p t x j q n t
h k j x u l t
n q h
p o r p i i s h i t n h k l h n o k t x g }
p x x h k
o j
h
j q q j x u i n p
p x w x h s k j q
x h o
t k
i j k h v k p h
r i s k
h r h u
p o m n t p x o h k i o t o m h k h q h
j x o q p o h k j o s k h
x t s k i s k
h r
h t l s i j p x q r t x o m h u p w p o j q l t n s o j o p t x
m t i h p x
n s o i j x u t s o n s o i j k h v p x j k r p x x j o s k h j q o m t s w m o m h p k
j q s h i j k h
s p o h
t o h x h x l t u h u j i j x j q t w x h s k t x i o j o h i z q i t
h l t n q h o h q r t p o o m h
p n t k o j x o q h j k x p x w p i i s h i
! " # $ % & ' & ( " ) ' * ! " # $ * + , (& - " . / + % 0 ' * / + & 1 " 0 2 3
h s k j q x h o
t k
i j k h v h p x w p x
h i o p w j o h u p x j x r
h q u i t j k o p
l p j q p x o h q q p w h x l h j i
j l t n s o j o p t x j q n j k j u p w j q o h k x j o p
h o t o m h l t x
h x o p t x j q
t x
h s j x x t u h q
~
m h l t n s o j o p t x j q n t o h x o p j q j x u q p p o i t l t x
h x o p t x j q l t n s o h k i j k h v r x t
h q q
s x u h k i o t t u p x o h k i t l q j i i p l j q t u h q i t l t n s o j o p t x i s l m j i
s k p x w j l m p x h i
z x j q t w t s i q r j x r s x u j h x o j q o m h t k h o p l j q k h i s q o i m j
h v h h x j l m p h
h u p x o m h n j i o
u h l j u h l t x l h k x p x w o m h l j n j v p q p o p h i t x h s k j q x h o
t k
i t k w h x h k j q l t n s o j o p t x
j k o q h r
{
s
s k t w j
k n t x h x
k n t x h x ~
j k v h k k r
j k v h k k r
g t r l m t
u m s k r { p s
k q p o i
r
{ p h w h q j x x
j
{
j ~
{ p s g t r l m t
u m s k r
j p q j o m
j
p h u h k j x x
x n j k o p l s q j k o m h l t n s o j o p t x j q n t
h k t x h s k j q x h o i m j i v h h x p x
h i o p w j o h u
v r l t n j k p x w o m h p k
j k p t s i t u h q i
p o m h j l m t o m h k j x u
p o m t k h o k j u p o p t x j q
l t n s o j o p t x j q t u h q i j x u u h i l k p n o p
h o t t q i i s l m j i
x p o h j s o t j o j k h w s q j k h
n k h i i p t x i w k j j k i
s k p x w j l m p x h i } t t q h j x l p k l s p o i h o l
m h j p t o m p i
j n n k t j l m p i o t
x u t s o
m j o p i h p o m h k s q o p j o h q r t k h
l p h x o q r l t n s o j v q h v r
n j k o p l s q j k x h s k j q t u h q i j x u m t
o t t n o p j q q r p n q h h x o o m h k h
s p k h u s x l
o p t x i
m h j p x o h l m x p l j q o t t q t o m p i p x
h i o p w j o p t x p i l t n s o j o p t x j q l t n q h
p o r
o m h t k r
} j q l
j
j k
j
y j v j k k
t
} t
h o
| k h i l h x
p
j n j u p
p o k p t s
z i j k h i s q o j l t n q h
p o r o m h t k h o p l o j
t x t r t x h s k j q x h o
t k
i
m j i h
t q
h u h x k p l m p x w o m h o k j u p o p t x j q k h n h k o t p k h t t k j q l t n s o j o p t x j q t u h q i
j x u h
h x n t p x o p x w t s o x h
i t s k l h i t h
l p h x o l t n s o j o p t x
x j u u p o p t x i p x l h x h s k j q x h o
t k
t u h q i m j
h j q i t v h h x p x i n p k h u v r x h s k t
n m r i p t q t w p l j q
x t
q h u w h o m h k h i n h l o p
h o m h t k h o p l j q k h i s q o i jr m h q n o t v k t j u h x
t s k s x u h k i o j x u p x w t o m h l t n s o j o p t x j q n k p x l p n q h i t h x o j q n k t l h i i h i
" 0 # ' * ! " # $ % & ' & ( " ) ' *
"
+ * " . / + % 0 ' * / + & 1 " 0 2
h o s i
k i o k h l j q q j w h x h k j q t u h q t j x
j k o p
l p j q
x h s k j q x h o
t k
o m j o l t x i p i o i t
i p n q h l t n s o j o p t x j q
t k
p x u h
h u j i
m h k h
p i l j q q h u o m h x h o
t k
{ t h t o m h i h s x p o i j r i h k
h j i h
o h k x j q p x n s o i
t k t s o n s o i j x u m h x l h
h j i i s h o m j o o m h x h o
t k
m j i
j x u
x h s k t x i k h i n h l o p
h q r
m h k h j p x p x w t x h i j k h l j q q h u
x h s k t x i
m h s x p o i
j k h u h x i h q r l t x x h l o h u p x o t j x t k p h x o h u w k j n m k h n k h i h x o p x w o m h
t o m h
x h o
t k
p x
m p l m j q i t h j l m h u w h
q h j u p x w k t x h s k t x
o t
p i q j v h q h u
p o m
j k h j q
!
" #
$ %
% & ' ( )
m h j v i h x l h t j l t x x h l o p t x
p o m p x
o m h j k l m p o h l o s k h l t k k h i n t x u i o t j
h k t
h p w m o v h o
h h x o m h k h i n h l o p
h x h s k t x i
m h
* + ! *
t j x h s k j q x h o
t k
u h o h k p x h i t k h j l m x h s k t x
(
o m h h
t q s o p t x t p o i k h j q
, -. /
&
( )
j i j s x l o p t x t o p h
0 1
m p i h i o j v q p i m h i o m h
#
2 3
-. /
, -. /
4
, -. /
5
( )
5
j o h j l m o p h p x i o j x o
0 1
z o o m h v h w p x x p x w t j l t n s o j o p t x o m h x h s k j q x h o
t k
p i n q j l h u p x j x
+ 3
-6 /
m p l m j r j q i t p x l q s u h j x h
o h k x j q p x n s o
r n p l j q q r j x h o
t k
i o j o h p i s n u j o h u v r j i h q h l o h u i s v i h o t x h s k t x i l t q q h l o p x w o m h p k
k t o m h
t s o n s o i t o m h p k p x l p u h x o x h s k t x i
p j o m h s x u h k q r p x w
h p w m o h u l t x x h l o p t x i j x u
o k j x i t k p x w o m h i h p x n s o
j q s h i p x o t o m h p k l s k k h x o i o j o h i p x j q q r j w q t v j q t s o n s o
k t o m h x h o
t k
p i k h j u j o o m h h x u t k h
h x p x o m h l t s k i h t l t n s o j o p t x
x o m h n k h i h x o i s k
h r
h j p x q r l t x i p u h k
$ +
l t n s o j o p t x i t
h k
7 !
h
o h k x j q p x n s o i n k t
p u p x w
7 !
t s o n s o i j q o m t s w m o m h i h
j q s h i j r v h h x l t u h u