'Perceiving invisible light through a FILCHED cortical prosthesis'

ARTICLE Received 24 Aug 2012 | Accepted 15 Jan 2013 | Published 12 Feb 2013

DOI: 10.1038/ncomms2497

1 Perceiving invisible light through a somatosensory cortical prosthesis Eric E. Thomson1,2, Rafael Carra1,w & Miguel A.L. Nicolelis1,2,3,4,5

2a 2b 2c

Sensory neuroprostheses show great potential for alleviating major sensory deficits. It is not known, however, whether such devices can augment the subject’s normal perceptual range.

Here we show that adult rats can learn to perceive otherwise invisible infrared light through a neuroprosthesis that couples the output of a head-mounted infrared sensor to their somatosensory cortex (S1) via intracortical microstimulation. Rats readily learn to use this new information source, and generate active exploratory strategies to discriminate among infrared signals in their environment. S1 neurons in these infrared-perceiving rats respond to both whisker deflection and intracortical microstimulation, suggesting that the infrared representation does not displace the original tactile representation. Hence, sensory cortical prostheses, in addition to restoring normal neurological functions, may serve to expand natural perceptual capabilities in mammals.

1 Department of Neurobiology, Duke University, Box 3209, 311 Research Drive, Bryan Research, Durham, North Carolina 27710, USA. 2 Edmond and Lily Safra International Institute for Neuroscience of Natal (ELS-IINN), Natal 01257050, Brazil. 3 Department of Biomedical Engineering, Duke University, Durham, North Carolina 27710, USA. 4 Department of Psychology and Neuroscience, Duke University, Durham, North Carolina 27710, USA. 5 Center for Neuroengineering, Duke University, Durham, North Carolina 27710, USA. w Present address: University of Sao Paulo School of Medicine, Sao Paulo 01246-000, Brazil. Correspondence and requests for materials should be addressed to M.A.L.N. (e-mail: nicoleli@neuro.duke.edu).

NATURE COMMUNICATIONS | 4:1482 | DOI: 10.1038/ncomms2497 | www.nature.com/naturecommunications

& 2013 Macmillan Publishers Limited. All rights reserved.

1

ARTICLE

NATURE COMMUNICATIONS | DOI: 10.1038/ncomms2497

M

adult rats learned to navigate their IR world as if they had acquired a novel distal sensory modality.

Results Behavioural performance. We initially trained six rats on a simple visual discrimination task. Rats were placed in a circular chamber that included three reward ports (Figs 1a,b). On each trial, a visible LED was activated in one of the ports, and rats were rewarded with water for poking their nose in that port. Once they reached criterion on this task (70% correct, after 25±5 days (mean±s.e.m.)), we surgically affixed an IR detector to the rat’s head, and implanted stimulating microelectrodes in the whisker region of S1 cortex (Figs 1c,d).

After this surgical procedure, we returned the animals to the same chamber, where they had to learn to perform the same task using IR light, which is invisible to rats (see Methods for details on the task and training)11. To allow the rats to perceive IR light levels, the value of the IR detector output was converted into a pattern of electrical stimulation in S1, with stimulation frequency updated every 50 ms depending on the IR intensity detected (Fig. 1d). Electrical stimulation frequency increased as rats approached, or oriented their heads toward, an IR source (see Supplementary Movie 1). Note that such electrical stimulation in S1 is known to induce some type of tactile sensation in humans12 and monkeys13.

It took 26±6 days for all six implanted rats to learn to discriminate among the IR sources at or above the criterion used in the initial visual task (470% correct). While training with their new IR gear, rats underwent clear changes in behavioural strategy.

b

a

c

Port 1 IR LED

Port 2

IR detector

Water port

θ

Visible LED

θ Port 3 Stimulating electrodes

Online processing (5 ms)

e * * * *

400

Current (μA)

d

Frequency (Hz)

4

IR level (v)

3

ost sensory neuroprosthetic systems aim to restore function within the same modality as a pre-existing sensory deficit. For instance, cochlear implants restore auditory function1, and stimulation along the visual pathway can restore visual function2,3.

In some cases, however, it might be necessary to augment, rather than simply restore, the usual function of a sensory area4,5.

For instance, in people that suffer permanent damage to the visual cortex, we might ask the somatosensory cortex to take over some of the roles of the visual system. Such cross-modal plasticity has been demonstrated in juvenile animals6–8. For example, rewiring experiments in newborn ferrets have shown that when visual inputs are rerouted to the auditory cortex, the auditory cortex acquires many anatomical and functional properties of the visual cortex7,8, and even mediates visually guided behaviour8.

Such results suggest that the function of a primary sensory area can dramatically change depending on the type of input it receives from the environment9,10. To date, however, the literature lacks a clear demonstration of such functional plasticity in normal adult mammals. This would require that the adult brain be plastic enough to extract novel information embedded within pre-existing representations, and use this information to generate appropriate behaviours.

In the present study, we test whether adult rats can incorporate a novel sensory modality into their perceptual repertoire.

Specifically, we examined whether adult rats could learn to discriminate among infrared (IR) sources after we coupled the output of a head-mounted IR detector to electrical microstimulators in the whisker representation of S1. We discovered that, after training with this sensory prosthetic device,

0 IR level

Time (s)

Time (s)

Figure 1 | Methods. (a) Set-up of the IR behaviour chamber. Three reward ports line the walls of the circular chamber. The proximity of the ports to one another is indicated by the angle y. The rat has an IR detector (red) affixed to its head, and the cone emanating from the detector represents the area within which it will respond to IR stimuli. The red lines emanating from port 3 represent the IR signal emitted from that IR source. (b) Arrangement of each reward port, which includes a recess with a water spout, an IR LED above, and a broad-spectrum visible LED below. (c) Design of stimulating electrodes (see Methods for details). The inset shows how each stimulating electrode pair is configured in the array (scale bar, 300 mm). (d) Example of electrode placement. Cytochrome oxidase-stained barrel field shows the location of four stimulating electrodes. Each penetration is indicated with a red asterisk.

Reference line: 500 mm. (e) Coupling IR levels with ICMS. On each trial, the IR light turns on, which activates the IR detector that is mounted on the rat’s head. Processing converts the detected IR level into a stimulation frequency. This value is sent to the microstimulator, which produces the desired current pulses. The inset on the right-hand-side illustrates the structure of each biphasic waveform in the pulse train.

2

NATURE COMMUNICATIONS | 4:1482 | DOI: 10.1038/ncomms2497 | www.nature.com/naturecommunications

& 2013 Macmillan Publishers Limited. All rights reserved.

ARTICLE

NATURE COMMUNICATIONS | DOI: 10.1038/ncomms2497

each lasting 200 ms: unilateral whisker deflection (via air puffs), ICMS (using current magnitudes that were applied during the task) and both stimuli delivered simultaneously.

S1 neurons were clearly not hijacked by ICMS, even after many months of microstimulation. In fact, most (83%) S1 neurons showed quite robust responses to whisker deflection (Fig. 3a,b).

The breakdown of all response types is detailed in Fig. 3c. Briefly, of 76 units, 84% (64/76) responded to one or the other stimulus, while 16% (12/76) showed no significant response to either stimulus. The majority (83% (63/76)) showed significant responses to whisker deflection. Of these, 83% (52/63) were multimodal neurons, exhibiting significant responses to ICMS as well. Only one neuron in our sample showed a response to ICMS but not whisker deflection. Among the multimodal S1 neurons, the response to both stimuli delivered simultaneously was highly sublinear (Fig. 3d; P ¼ 4.6 10 17; two-tailed paired t-test).

Population responses in S1 increased according to a saturating function of whisker deflection magnitude (Fig. 3e). Response magnitudes also increased with ICMS frequency up to 350 Hz, but dropped off at 400 Hz, likely due to adaptation (Fig. 3f). This neuronal response-profile is akin to an IR receptive-field for the range of IR stimulation frequencies employed in the task.

5

6

Discussion In 1969, Bach-y-Rita performed the classic ‘sensory substitution’ experiments, in which visual stimuli were projected onto the skin via mechanical actuators, allowing congenitally blind patients to experience a visual world for the first time4. Here we have applied the logic of sensory substitution directly to the somatosensory cortex, bypassing the body’s periphery, with the goal of building a cortical sensory prosthesis capable of augmenting the subject’s perceptual capability5. Instead of giving a binary, top–down signal instructing the rats where to move17, we connected S1 to a new graded sensory cue available in their environment, and they spontaneously adopted novel foraging behaviours in response.

Note that, in principle, this experimental paradigm could use any novel stimulus (for example, magnetic or radio waves) to be represented in S1.

We observed that neurons in the stimulated regions of S1 maintained their ability to respond to whisker deflection. This suggests that two different cortical representations (one tactile and one IR) became superimposed on the animal’s S1 cortex, creating a novel bimodal processing region. However, it is important to emphasize that behavioural studies will be needed to determine the consequences, for whisker-based tactile discrimination, of adding this new information to S1.

The mechanisms by which animals learn to use this new information source will also be an interesting avenue for future research, as such research should suggest how to accelerate sensory prosthetic acquisition. To investigate the mechanisms of plasticity, including those theories implicating glial cells18, it will be helpful to examine functional and structural changes in cortical and subcortical tactile processing centres as rats learn to discriminate among IR sources.

Overall, our behavioural results suggest that animals initially treated S1 electrical stimulation as an unexpected whisker deflection, and eventually treated it as a stimulus originating away from the body in the surrounding environment. However, we are unable, using the methods in this paper, to determine whether the fully trained rats consciously experienced microstimulation as a new distal sensory modality, or simply learned to associate a tactile sensation with an otherwise imperceptible distal sensory cue. This is a question that could presently be addressed with sensory substitution experiments in humans. Indeed, one such study suggests that some subjects experienced tactile stimuli 4

as visual in nature after training with a visual-to-tactile peripheral substitution device19.

The next generation of sensory neuroprosthetics research in humans will likely continue to rely on ICMS rather than optogenetics20,21. Indeed, our experimental strategy has been quite different from optogenetic approaches22–25: instead of stimulating a specific cell-type population, we indiscriminately stimulated all S1 neurons in the vicinity of the stimulating electrodes’ tips. Despite the fact that this unusual signal was delivered at extremely high frequencies, and likely spread through most of S126–28, these animals readily learned to exploit this new sensory channel.

One potential application of the technology used in this study is in the design of a new generation of motor neuroprostheses that, instead of simply sending a brain-derived motor control signal to move a prosthetic limb, would provide continuous sensory feedback to the user’s brain from the prosthesis29–31.

Such closed-loop bidirectional brain–machine–brain interaction could significantly improve reaction time, behavioural accuracy and likely aid the integration of the limb into the user’s internal body image9,30,32,33.

However, there is another aspect of the present work that has rarely been explored in the neuroprosthetics literature: the potential to expand or augment a species’ normal perceptual range. In that pursuit, we have implemented, as far as we can tell, the first cortical neuroprosthesis capable of expanding a species’ perceptual repertoire to include the near IR electromagnetic spectrum, which is well outside the rat photoreceptors’ spectral sensitivity. Thus, by taking advantage of this novel paradigm, our rats were able to transcend the limitation of perceiving only those stimuli that can activate their bodies’ native sensory transducers.

Methods Behavioural task and training. All experiments were performed on female Long Evans rats B14-weeks-old (B250 g; Harlan Laboratories). Rats were trained in a chamber with three reward ports that were situated 90° apart (Fig. 1a). Each port was fit with a visible broad-spectrum LED, and an infrared LED (Opto Semiconductors Inc., 940 nm peak emittance (range of non-zero emissions was between 825 and 1000 nm), and IR intensity dropped to half-max at 120°) (Fig. 1a). We first trained water-deprived rats to poke in the port whose visible LED was activated.

Each trial began when a visible light in one randomly selected port was activated.

Rats received water when they broke the photobeam in that port (correct trials).

Trials counted as incorrect when the rats poked in a different port, or did not poke at all and let the trial terminate (this was set to occur between 15 and 20 seconds after the onset of the light). On incorrect trials, they received no water, an error tone, and a longer delay to the next trial. For some rats, we delivered air puffs to the face on incorrect trials.

Once animals performed above a criterion value (470% correct) 44 days in a row, we implanted an array of stimulating electrodes into S1 (Fig. 1d). The array includes an IR detector attached to the connector (see Fig. 1c and Surgery below).

After the animals recovered from surgery, we determined the minimal currents required to evoke a behavioural response in at least two electrode pairs (thresholds were between 1 and 200 mA, see Stimulating Electrodes and Stimulator below for details). We then trained them in the same behavioural chamber, but incrementally replacing visible light with ICMS linked to IR levels from their detector (Fig. 1e).

Initially, each trial had the same structure as trials in the initial behavioral task described above, except that the onset of the visible light was preceded by IR-level dependent stimulation (up to 400 Hz) that lasted 0.6–1.5 s. In four of six rats, we began with brief durations of stimulation (600–700 ms) to acclimate them to stimulation. In two of the rats, we started with longer stimulation durations to get estimates of behavioural latency as they learned the task (Fig. 2b). Thus the animals learned that stimulation indicated the presence of the visible light. The stimulation frequency was exponentially proportional to the IR levels (Fig. 1e). We used an exponential function because IR intensity dropped logarithmically from the IR source. We stimulated at high frequencies for two reasons: one, in preliminary experiments we found that using a lower frequency range (that is, 0–100 Hz) yielded less reliable performance; two, we wished to avoid evoking kindling seizures34. Stimulation frequencies were updated every 50 ms based on IR levels, and it took B5 ms for the stimulation frequency to actually change in the rat once the command was sent. Pulse frequency was the only variable that tracked IR levels: current amplitudes were kept the same for each pulse.

Once it became clear, based on visual inspection, that the animals were comfortable with stimulation, we added ‘IR-only’ trials in which the IR-dependent

NATURE COMMUNICATIONS | 4:1482 | DOI: 10.1038/ncomms2497 | www.nature.com/naturecommunications

& 2013 Macmillan Publishers Limited. All rights reserved.

7 8 9 10

%

Positioning! #$%%! #! &'()) doi:%&.()*+,po..)&%%.))&&/ P234i.5ed 784i8e May )&%% (5==p:,,>>>.?ciAP.orC,Do2r8a4,po.)

1 Mac-i/e 1ercep4io/ 6-ro78- 9a47ra: ;/4e::i8e/ce <o=4y=:a? @A:yar Herc5ra=.IoCo .=. %JK%, MNiN /O&%& PIrai8e ERai4: .I4yarS=.p.4NiN.2a AeceiNed TeceR3er *&=5 , )&%&U reNi.ed Marc5 %.= , )&%%U accep=ed Apri4 )&=5, )&%%.

2a 2b 2c

AC@6<AD6 The sensing organs are exponentially better than any of analogous artificial ones. That is why using them in full scale is a perspective trend to the efficient (advanced) machine perception. On the other hand, limitations of sensing organs could be replaced by the perfect artificial ones with the subsequent training the nervous system on their output signals.

An attempt to lay down the foundations of biosensing by natural sensors and in addition to them by the artificial transducers of physical quantities, also with their expansion into space arrays and external/implantable functioning in relation to the nervous system is performed. The advances in nanotechnology are opening the way to achieving direct electrical contact of nanoelectronic structures with electrically and electrochemically active neurocellular structures. The transmission of the sensors’ signals to a processing unit has been maintaining by an electromagnetic transistor/memristor (externally) and superconducting transducer of ionic currents (implantable). The arrays of the advanced sensors give us information about the space and direction dynamics of the signals' spreading.The measuring method and necessary performance data of the sensor for the robot’s orientation in the ambient magnetic field with living being-machine interaction in order to obtain input and output signals from brain and motor nerves to the measurement system and vice versa are introduced. The range of applied sensors differs from an induction sensor to superconducting induction magnetometer. The analytical expressions for arrangements of the head sensors in differential and vector (*D) relative positions are deduced. Sensitivity of the perception method makes it possible to recognize the linear translation of %&!) m and disposal in space of %&!* m*. Interaction between living beings and robotic equipment is given analytical treatment.

KeywordsE Magnetic Field, Induction Sensor, SuFET, Nerve Impulses, Interface, Gradiometer, Sensing Area

%F ;/4rod7c4io/F Ar4iHicia: @e/=or= Ii4- 4-e J7Ka/ Mac-i/e ;/4erHace E4ec=ro8ic Wo.e i. a .Rar= i8.=r2Re8= =5a= i. de.iC8ed =o de=ec= a8d di.criRi8a=e aRo8C coRp4eX odo2r. 2.i8C a8 array oY .e8.or.. T5e array oY .e8.or. co8.i.=. oY a 82RK 3er oY 3road4y =28ed (8o8K.peciYic) .e8.or. =5a= are =rea=ed >i=5 a Narie=y oY odo2rK.e8.i=iNe 3io4oCica4 or c5eRica4 Ra=eria4. [%\.

T5i. i8.=r2Re8= proNide. a rapid, .iRp4e a8d 8o8K i8Na.iNe .aRp4i8C =ec58i]2e, Yor =5e de=ec=io8 a8d ide8K =iYica=io8 oY a ra8Ce oY No4a=i4e coRpo28d.. T5e Iey Y28c=io8 oY a8 e4ec=ro8ic 8o.e i. =o RiRic 52Ra8 o4YacK =ory .y.=eR. Typica44y a8 e4ec=ro8ic 8o.e co8.i.=. oY =5ree e4eRe8=.: a .e8.or array >5ic5 i. eXpo.ed =o =5e No4a=i4e., co8Ner.io8 oY =5e .e8.or .iC8a4. =o a reada34e YorRa= a8d .oY=>are a8a4y.i. oY =5e da=a =o prod2ce c5aK rac=eri.=ic o2=p2=. re4a=ed =o =5e odo2r e8co28=ered. T5e Rai8 par=. oY a =ypica4 3io.e8.or are .5o>8 i8 Li87re %.

T5e ar=iYicia4 =ac=i4e .e8.or i8=eCra=e. a Ricro e4ecK =roKRec5a8ica4 .y.=eR (MEM?) array 5aNi8C a 82R3er

oY .e8.i8C e4eRe8=. (%+ c5a88e4. i8 a3o2= )& RR)) .iRiK 4ar =o =5e i88erNa=io8 de8.i=y oY Rec5a8orecep=or. i8 =5e 5a8d (a3o2= % 28i=, RR)). T5e =ec58o4oCica4 approac5 i.

3a.ed o8 a *T MEM? core 28i= >i=5 a .oY= a8d coRK p4ia8= pacIaCi8C. T5e Ricro.e8.or ca8 3e i8=eCra=ed >i=5 a pacIaCi8C arc5i=ec=2re re.24=i8C i8 a ro32.= a8d coRK p4ia8= =ac=i4e .e8.or Yor app4ica=io8 i8 ar=iYicia4 5a8d., >5i4e .e8.i=iNe e8o2C5 =o de=ec= .4ip eNe8=., .5o>i8C =5a= .i4ico8 3a.ed =ac=i4e .e8.or. ca8 Co 3eyo8d 4a3ora=ory prac=ice [)\. T5e =ac=i4e .e8.or array, depic=ed i8 Li87re #, 5ad %+ c5a88e4. a. =o=a4 =ac=i4e .e8.or o2=p2=..

T5e Rea.2reRe8= oY RaC8e=ic Yie4d. (M^.) i. a8 iRK por=a8= =a.I Yor =5e RaDori=y oY a2=o8oRo2. Ri..io8..

T5e di.=ri32=io8 oY perRa8e8= a8d =5e Na42e oY periodica4 M^. CiNe =5e da=a a3o2= p4aceRe8= oY YerroRaC8e=ic o3K Dec=. a8d .o2rce. oY EM radia=io8 re.pec=iNe4y. 78 =5e o=5er 5a8d, =5e.e .iC8a4. >i44 3e a reYere8ce poi8= a8d C2idi8C 4i8e Yor a >a4Ii8C ro3o= (Li87re M).

Te=ec=io8 oY .oRe RaC8e=ic a8oRa4ie. oY =5e Ear=5’.

M^ a8d =5eir Naria=io8. i. proNided 3y Y42XCa=e .e8.or.

FopyriC5= G )&%% ?ciAe..!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!POS

44

Mac$i&e Percep,io& T$ro/0$ 1a,/ra2 I&,e22i0e&ce

!i#$re () *A, -.e /ai1 par34 o6 a 3ypica9 :io4e14or; *<, A 4e14or array; eac. po9y/er c.a1#e4 i34 4i=e a1d 3.ere6ore i34 re4i43a1ce; :y a di66ere13 a/o$13 a1d /a?i1# a pa33er1 o6 3.e c.a1#e) @opyri#.3 ABBC D!EA)

!i#$re A *a, FG de4i#1 o6 3.e 3ac3i9e 4e14or array) *:, -opH 3.e A I A MKME array co/pared Li3. .$/a1 6i1#erM :o3N 3o/H a !D< i/a#e o6 3.e MKME 4e14or) *c, -op OieL o6 3.e 4e14or array) @opyri#.3 ABBP DKKK)

!i#$re F -.e La9?i1# ro:o3 i1 M! e1Oiro1/e13) a, QNy p9a1e de6i1e4 3.e Oaryi1# G@ 1a3$ra9 M!M :, aro$1d = aQi4 4pread4 A@ i1d$43ria9 M! i13er6ere1ce)

567. 9$e& ,$e :pec,r/; o< EM :i0&a2: i& ,$e e&>iro&? ;e&, 2ie: i& a @ide <reB/e&cy ra&0e (EF GH ? IFF JGH),

,$e app2ica,io& o< $i0$2y?:e&:i,i>e i&d/c,io& :e&:or: (IM:) i: &ece::ary. T$e app2ica,io& o< a 2o@?Tc MNOIP de>ice i: aQ2e ,o e;Qrace Qo,$ o< ,$e :aid <reB/e&cy ra&0e: @i,$ ;aRi;/; :e&:i,i>i,y. I, i: ;ade o< &o&?;a0&e,ic ;a,e? ria2 a&d ,$e pri&cip2e o< opera,io& i: ,o de,ec, ,@o ;a0? &e,ic :i0&a2: a, di<<ere&, di:,a&ce: <ro; ,$e :o/rce a&d arra&0e <or ,$e; ,o Qe i& oppo:i,io& aro/&d a 2oca2 :/? percoo2ed circ/i,. T$i: S0radio;e,erâ&#x20AC;&#x2122; approac$ e2i;i&a,e: ;o:, o< ,$e &oi:eUca/:ed Qy :p/rio/: MV: ori0i&a,i&0 <ro;, <or eRa;p2e, e2ec,rica2 de>ice: or &a,/ra2 (0eo? ;a0&e,ic :o/rce:. A ,ypica2 /&:$ie2ded 2aQora,ory $a: a &oi:e 2e>e2 i& ,$e F ? EF GH <reB/e&cy re0io& o< aQo/, EF!X T a&d 0eo;a0&e,ic &oi:e i& ,$e :a;e <reB/e&cy ra&0e i: o< ,$e order o< EF!EF T. A&y :;a22 <ie2d c$a&0e: ,$e direc,io& o< ,$e MV >ec,or i& ,$e :pace a&d ,$i: pro? d/ce: a di:,or,io& i& ,$e @a>e<or; o< ,$e :i0&a2 i& ,$e de,ec,io& coi2:. T$e >ery eRpe&:i>e /:e o< ,$e MNOIP ;a0&e,o;e,er /p /&,i2 &o@ $a: prod/ced ;a&y ad>a&ce: i& ,$e /&der:,a&di&0 o< MV: <ro; @eaJ :o/rce:. T$e ad>a&ce o< ;/c$ c$eaper roo;U,e;pera,/re :e&:or ,ec$&o2o0ie: o<<er: ,$e pro:pec, o< ;/c$ 0rea,er /:e o< MV ;o&i,ori&0 5Y7. A: a 0e&era2 r/2e, :cie&,i<ic i&:,r/? ;e&,a,io& :$o/2d i;pac, ;a:: co&:,rai&,: a: 2i,,2e a: po:? :iQ2eZ $o@e>er, roQo,?;o/&,ed i&:,r/;e&,: i& par,ic/2ar ;/:, Qe 2i0$,@ei0$, ,o :/r>i>e dep2oy;e&, /&der $i0$? :,re:: co&di,io&: @$e& /:ed i& co&&ec,io& @i,$ :pace? cra<, or /&der@a,er. T$i: @ei0$, co&:,rai&, ca& 2i;i, Qo,$ ,$e :iHe o< ,$e :e&:or a&d i,: p2ace;e&, o& ;o>i&0 par,.

A2:o, a/,o&o;o/: :y:,e;: reB/ire ;i&i;a2 co&:/;p,io& po@er. Bo,$ <ac,or: ,ra&:2a,e i&,o :e>ere co&:,rai&,: o& ,$e capaQi2i,y o< ,$e i&:,r/;e&, ,o ;ea:/re @eaJ EMV: e&co/&,ered i& ,$e e&>iro&;e&,. I& addi,io&, o/,er :pace a&d /&der@a,er co&di,io&: reB/ire e&d/ra&ce a0ai&:, >aria,io&: i& ,$e @ide ra&0e o< ,e;pera,/re, $/;idi,y, a&d a,;o:p$eric pre::/re.

T$e $/;a& ;ac$i&e i&,er<ace /:i&0 e2ec,ro;y\o0ra; (EM]) :i0&a2 ,o ar,i<icia22y co&,ro2 ,$e 2i;Q ;o>e;e&,.

Eac$ ;/:c2e <iQer $a: a po,e&,ia2 a&d ;o,or /&i, ac,io& po,e&,ia2 0e&era,ed Qy co&:,r/c,io& o< ;/:c2e i: :,/died a&d corre:po&di&0 ac,/a,io& i: pro>ided ,o roQo,ic: ar;.

I& ,$i: :y:,e; a re2a,i>e2y ;ore <2eRiQ2e a&d roQ/:, co;;/&ica,io& ,ec$&iB/e 0e&era,e: co;;a&d: <ro; EM] :i0&a2: (!i#$re R). M/c$ a& a/,o&o;o/: ;oQi2e $/;a&oid roQo, @i22 Qe aQ2e ,o a::i:, i& a @orJ:$op e&? >iro&;e&, a&d i&,erac, @i,$ a $/;a& 5I7. T$ree a:pec,: ,o reac$ ,$i: ,ar0e, are co&:idered. Vir:,, $o@ ,$e Qrai& o< ,$e eRo:Je2e,o& roQo, i: co&:,r/c,ed ,o Qe aQ2e ,o ;a? &ip/2a,e oQ\ec,: 2iJe $/;a&: do. Meco&d eRp2ora,io& o< appropria,e Qi&o;i&a2: ,$a, ca& Qe /:ed a: a& ac,/a,i&0 B/a&,i,y ,o ;o>e ,$e ^oQo,ic ar;Z a&d <i&a22y $o@ pro?

0ra;;i&0 o< ;a&ip/2a,io& ,a:J: i: rea2iHed. I;p2a&,aQ2e &e/ra2 proQe: are 0e&era22y pre<erred ,o

_opyri0$, ` aFEE Mci^e:.!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!POS

Mac$i&e Percep,io& T$ro/0$ 1a,/ra2 I&,e22i0e&ce

4 5 10

$a6e a 7i&i7/7 8oo,pri&, a9 po99i:2e ,o 7i&i7i;e &e/ra2 da7a0e a&d ,o 8aci2i,a,e ea9y e&,ry a&d 7o6e7e&, ,$ro/0$ ,$e :rai& ,i99/e. Po2y7eric 7icropro:e9 $a6e recei6ed a 0rea, dea2 o8 a,,e&,io& o?i&0 ,o ,$eir 9i7p2e 8a:rica,io& proce99, 82eAi:i2i,y a&d :ioco7pa,i:i2i,y. I7B p2a&,a:2e &e/ra2 pro:e9 8or &e/ro9cie&ce a&d :rai& 7aB c$i&e i&,er8ace9 are 0e&era22y pre8erred ,o $a6e a 7i&iB 7/7 8oo,pri&, a9 po99i:2e ,o 7i&i7i;e &e/ra2 da7a0e C4D. A co&cep,/a2 repre9e&,a,io& o8 ,$e 7/2,ic$ip recordi&0 i&,er8ace i9 9$o?& i& !i#$re (. T$e de6ice $a&d2e9 F4 &e/ra2 recordi&0 c$a&&e29 a9 a proo8 o8 co&cep, C5D. A2,er&a,i6e2y, a 9/perco&d/c,i&0 8ie2dBe88ec, ,ra&9i9,or (H/IET) :a9ed &e/ro,ra&9d/cer (H/IETTr) ?i,$ car:o& &a&o,/:e9 (L1T) or picM/p coi2 (PL) Mi&d o8 i&p/, cirB c/i, 8or ,$e &er6e a&d &e/ro&ic i7p/29e $a9 :ee& deB 9i0&ed CND. A &a&oH/IET ?i,$ a $i0$B,e7pera,/re 9/B perco&d/c,i&0 c$a&&e2 i9 i&,rod/ced i&,o ,$e &er6e 8i:re or :rai& ,i99/e 8or ,ra&9d/ci&0 ,$eir 9i0&a29 i& :o,$ direcB ,io&9. A9 a re9/2,, ?e $a6e ac$ie6ed H/IETTr ,$a, i9 9/i,a:2e 8or a9cer,ai&i&0 ,$e 6arie,y o8 6a2/e9 COD. T?o direc,io&9 o8 H/IETTr 8/&c,io& e&a:2e decodi&0 o8 ,$e9e 9i0&a29 :y co7pari&0 ,$e re9/2, o8 i,9 reac,io& o& 9o7e proce99 or or0a& ?i,$ a& ac,io& o& ,$e7 o8 ,$e 9i7/2a,ed e2ec,rica2 or :ioc$e7ica2 9i0&a2 a8,er ,$eir re6er9e ,ra&9B d/ci&0 ,$ro/0$ ,$e H/IETTr(9). Moreo6er, a &/7:er o8 ,$e re2e6a&, 7ea9/ri&0 de6ice9, a9 a& i&,er7edia,e e2eB 7e&, :e,?ee& p$y9ica2 6a2/e a&d ,$e &er6e 9y9,e7, are de9i0&ed o& i,9 :a9i9 CFPD.

)* +i#,a. /roce22i,# i, 34e 5ioi,3er6ace2 Ma0&e,ocardio0rap$y (MLQ) i9 a &o&i&6a9i6e 7e,$od o8 de,ec,i&0 ,$e cardiac 7a0&e,ic 8ie2d9 a:o6e ,$e :ody 9/r8ace /9i&0 RL HSTIR9. MLQ $a9 ,$e po,e&,ia2 ,o de,ec, arr$y,$7ia a&d i9c$e7ia ?i,$ a 2o?er 2e6e2 o8 adB 6er9e e88ec,9 ,$a& e2ec,rocardio0ra79. A29o 7o9, HSTIR9 are i&corpora,ed i&,o ?$o2eB$ead 9y9,e79 8or 7a0&e,oe&cep$a2o0rap$y (MEQ) B ,$e de,ec,io& o8 MI9 prod/ced :y :rai&. A ,ypica2 $e27e, co&,ai&9 a:o/, UPP 9e&9or9, i&c2/di&0 a &/7:er o8 re8ere&ce 9e&9or9 8or &oi9e ca&ce22a,io&, coo2ed ,o V.W X. CFFD A c/rre&, ,re&d i& 9/c$ dia0&o9,ic9 are por,a:2e a&d ?eara:2e 7a0&e,o7e,er 9y9,e79 ?$ic$ $a6e, i& ,$e 9a7e ,i7e, $i0$ 9i0&a2 proce99i&0 a&d 9i0&a2B,oB&oi9e ra,io para7e,er da,a c$arac,eri9,ic9. Hi7/2,a&eo/9 a7p2i8icaB ,io& o8 ,$e piMi&0 /p MLQ Y MEQ &e/ro9i0&a29 :y a& o&B9i,e 7a0&e,ic 82o? $a9 :ee& i7p2e7e&,ed. Ma,riA o8 ,$e 9e&9i&0 7icroB&a&oPL9 are di9,ri:/,ed /&der ,$e $ear, or :rai& 9/r8ace ?i,$ ,e7pera,/re o8 ,$e :ody CFWD. I7p2a&,a:2e &e/ra2 pro:e9 are 0e&era22y pre8erred ,o $a6e a 7i&i7/7 8oo,pri&, a9 po99i:2e ,o 7i&i7i;e &e/ra2 da7a0e a&d ,o 8aci2i,a,e ea9y e&,ry a&d 7o6e7e&, ,$ro/0$ ,$e :rai& ,i99/e. Po2y7eric 7icropro:e9 $a6e

45

recei6ed a 0rea, dea2 o8 a,,e&,io& o?i&0 ,o ,$eir 9i7p2e 8a:rica,io& proce99, 82eAi:i2i,y a&d :ioco7pa,i:i2i,y. I7B p2a&,a:2e &e/ra2 pro:e9 8or &e/ro9cie&ce a&d :rai& 7aB c$i&e i&,er8ace9 are 0e&era22y pre8erred ,o $a6e a 7i&iB 7/7 8oo,pri&, a9 po99i:2e ,o 7i&i7i;e &e/ra2 da7a0e CFUD. T$e co&cep, o8 a& i7p2a&,a:2e ?ire2e99 p2a,8or7, ?i,$o/, a&y perc/,a&eo/9 9Mi&Bp/&c,/ri&0 e2e7e&,9, deB 7a&d9 ,$e i7p2e7e&,a,io& o8 a $e,ero0e&eo/9, ac,i6e 7icroe2ec,ro&ic9 p2a,8or7. A, a 7i&i7/7, ,$e i7p2a&,ed Z7icro9y9,e7[ re\/ire9 i&B9i,/ i&,e0ra,io& o8 /2,raB 2o?Bpo?er 7icroe2ec,ro&ic AHIL9 ?i,$ ,$e cor,ica2 7iB croe2ec,rode &e/ra2 pro:e9, a&d 7/9, pro6ide :road:a&d ,e2e7e,ry a&d a 7ea&9 ,o de2i6er po?er ?ire2e992y ,o ,$e ac,i6e i7p2a&,ed co7po&e&,9 CFVD. A F4Bc$a&&e2 6er9io& o8 a 8/22y i7p2a&,a:2e 7icro9y9B ,e7 $a9 :ee& i7p2e7e&,ed a&d ,e9,ed o& ,$e :e&c$,op a&d /9ed i& i&i,ia2 a&i7a2 ,e9,9. T$i9 7icro9y9,e7 i9 a 9i&02eB/&i, co&9,r/c, (!i#$re 7) ?$ere a&a2o0 a&d di0i,a2 c$ip9 are i&,e0ra,ed o& a 82eAi:2e 9/:9,ra,e ,o0e,$er ?i,$ a 2o? ,$re9$o2d, i&8rared 9e7ico&d/c,or diode 2a9er ,o ,ra&97i, ,$e di0i,i;ed &e/ra2 9i0&a29 ,$ro/0$ ,$e 9Mi&.

Po?er a&d c2ocMi&0 are de2i6ered ,o ,$e 9y9,e7 6ia i&B d/c,i6e co/p2i&0, :/, ,$e 9y9,e7 ca& a29o :e co&8i0/red ,o :e po?ered op,ica22y /9i&0 a $i0$ e88icie&cy p$o,oB 6o2,aic e&er0y co&6er,er.

By i7p2e7e&,i&0 LM^H ,ec$&o2o0y 8or &e/ra2 i7a0B i&0, &o, o&2y i9 i7a0i&0 i& 7/2,ip2e 7oda2i,ie9 po99i:2e, e2ec,rica2 9,i7/2a,io& a&d 9e&9i&0 ca& :e i&,e0ra,ed o&,o a 9i&02e de6ice, ,$ere:y re9/2,i&0 i& a $i0$2y co7pac, a&d 7i&ia,/ri;ed ,oo2 8or ,$e 9,/dy o8 ,$e :rai& (!i#$re 8) CF_D. I7pro6e7e&, i& ,$e pacMa0i&0 proce99 $a9 re9/2,ed i&

!i#$re 9* :M< 4a2 =! co,3e,3 >$p 3o )(@ =AB* Copyri#43 )@@E F!+A*

Lopyri0$, ` WPFF Hciae9.!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!POS

45

Mac$i&e Percep,io& T$ro/0$ 1a,/ra2 I&,e22i0e&ce

co6p2e,e pa77 o8 ,$e ro9o,’7 ;a2<i&0. P2aci&0 o8 ,$e P>’7 ,rip2e,7 (,$e ,$ree or,$o0o&a2 co6po&e&,7 a, eac$ 2oca,io&) o& ,$e re7pec,iAe 2i697 0iAe ,$e &ece77ary da,a 8or ,$e ,riaDia2 ME de,er6i&a,io& accordi&0 ,o ,$e 0eo6e,rica2 7/66a,io&. I& 7/c$ a ca7e, ,$e 8reG/e&cy o8 ,$e 2i69’7 o7ci22a,io&7 i7 6/c$ 2o;er ,$a& a69ie&, ME &oi7e. T$a, i7 ;$y, ,$ey do &o, i&82/e&ce ,$e 6ea7/red co6po&e&,7 a&d, 6oreoAer, ,$e7e o7ci22a,io&7 ca& 9e addi,io&a22y 7/ppre77ed 9y a pa77iAe HE 8i2,er I5JK. T$e Aa2/e o8 ME i&d/c,io& a2o&0 a 7i&02e co6po&e&, ;i22 9e ca2c/2a,ed 7i6i2ar2y ,o EG/a,io&. M a&d EG/a,io&. 5 9y ,$e 8or6/2a: ! SNU out BPC " (4) G T$e depe&de&ce o8 Ao2/6e,ric error o& ,$e 9a7e2i&e 8or e&Airo&6e&,a2 &oi7e i7 7$o;& I5OK.

"#"# $%peri*e+,a. /a.ida,io+ o2 ,3e Me,3od I& ,$e 5i67re 8 are 7$o;& ,$e o7ci22a,io&7 o8 a& e2ecP ,ro6o,iAe 8orce 5PQ o8 ,$e de7cri9ed P> ;i,$ re7pec, ,o ,$e 9a7ic Ao2,a0e M, ;$ic$ are co&8or6 ,o ME BS ;i,$ a& o&;ard 6oAe6e&, 7peed o8 IT M 6U7. T$e 7i0P &a2P;aAe e&Ae2ope V i7 a re7/2, o8 ,$e i&8or6aP ,io&a2P6ea7/ri&0 proce77 a&d co&8ir6i&0 a9o/, ,$e 7pace di7,ri9/,io& o8 ,$e ME Aaria,io&7, ;$ic$ are 9a7e7 8or ,$e adAa&ced percep,io&P0/ide a9i2i,ie7. T$e 2eAe27 o8 ,$e IT’7 o/,p/, 7i0&a27 a&d 9o/&darie7 o8 ,$eir c$a&0e7 i& rea2i,y 8or a22 ,$e de7cri9ed deAice7’ Aaria&,7 are 7$o;& i& 5i67re 9:.

I& order ,o i6proAe re2ia9i2i,y o8 ,$e 6e,$od a&d i&P crea7e ,$e ;or<i&0 8reG/e&cy i&,e&7i,y 7i0&a2 8i2,ra,io& o/,7ide, a ;or<i&0 8reG/e&cy i7 i&,rod/ced. I&,er8erP e&ce 7/ppre77io& i7 ac$ieAed 9y i&,rod/ci&0 &P/&i, W>P8i2,er7 i&,o ,$e i&p/, 7,a0e7 o8 prea6p2i8ier i&,e&7iP 8ica,io&.

T$e eG/a,io& 8or HE 8i2,ra,io& i7 o8 ,$e 7iD,$ order re2aP ,iAe ,o W>: - M & J 5 * 5 '(+ # RC!L $ ) Q5 # RC!L $ ' MJ " S % , L .

,iAe2y ]c/,Po/,^ 8ro6 ,$e re7, o8 o7ci22a,io&7, 9o,$ o8 EM a&d 6ec$a&ica2 ori0i& I5JK.

"#:# M5 5ee.i+6 <i,3 a =i>i+6 ?ei+6@Mac3i+e B+,er2ace T$e de7i0& proAide7 a 6ea&7 ,o /pda,e opera,i&0P, 6o&i,ori&0 para6e,er7, opera,io&a2 ,$re7$o2d7, a&d 7e&P 7or a&d WE 2i&< 7peci8ic 8ir6;are 6od/2e7 ]oAerP,$ePair^.

I, i7 co6po7ed o8 ,;o 6ai& co6po&e&,7 P a 7e&7orP ;ireP 2e77 $ard;are i&,er8ace a&d 7y7,e6 i&,e0ra,io& 8ra6eP ;or<, ;$ic$ 8aci2i,a,e7 ,$e de8i&i&0 o8 i&,erac,io& 9eP ,;ee& 7e&7or7Uac,/a,or7 9a7ed o& proce77 &eed7. T$e i&,e22i0e&ce &ece77ary ,o proce77 ,$e 7e&7or 7i0&a27, 6o&i,or ,$e 8/&c,io&7 a0ai&7, de8i&ed opera,io&a2 ,e6P p2a,e7, a&d e&a92e 7;appi&0 o8 7e&7or a&d WE 2i&<, reP 7ide7 o& ,$e 6icroco&,ro22er o8 ,$e $ard;are i&,er8ace I54K. T$e 9a7ic 7ce&ario i7 7$o;& i& 5i67re 98. A7 a re7/2, 2iAi&0 9ei&07 co&,ro2 driAe7 9y preAio/72y ,ra&72a,ed 9io7i0&a27. I& ,$e o,$er Aaria&,, 9io7i0&a27 8ro6 or0a&7 o8 ,$e 7e&7e7 or 9rai& ,ra&7d/ce direc,2y i&,o i&,e22i0e&, or ro9o,ic 7y7,e67 ;$ic$, i& 7/c$ a ;ay, pic< /p e&Airo&P 6e&,a2 i&8or6a,io&.

He, /7 co&7ider ,$e co&&ec,io& 9e,;ee& ,$e i&p/, (9ioP 7i0&a2 Inerve) a&d o/,p/, (ME B) Aaria92e7 o8 ,$e a/,o&oP 6o/7 7y7,e6 i& ,$e ;ide 8reG/e&cy ra&0e "B:I5XK

(X)

;$ere !L a&d "L are ,$e i&,er8ere&ce 7/ppre77io& 8ac,or7.

T$e eDperi6e&,a2 c/rAe, 0iAe& i& 5i67re 9; co&8ir67 ,$e co6p/,ed Aa2/e7 o8 7/ppre77io& a ,ra&78er 8/&c,io& Y 8or a ,;oP/&i, W>P8i2,er. I, i7 a27o po77i92e ,o app2y a ,;i&PT W>P8i2,er, 9/, o&2y 8or ,$e ZEP 8Z, re2a,iAe ,o ,$e ;or<i&0 o&e fwork I55K. T$e re7po&7e c/rAe i& ,$e 8reP G/e&cy ra&0e ,$a, i7 o8 i6por,a&ce 8or orie&,a,io&, ;o/2d 9e Air,/a22y 82a, YE, ;$e& W a&d > are re2a,ed ,o eac$ o,$er a7 8o22o;7: M " f work ([) 5/ RC A7 a re7/2,, ,$e ;or<i&0 ME 8reG/e&cy ;i22 9e e88ecP

5i67re 9:# C3e *a6+i,7de c3a+6eD o2 orie+,a,e o+ M5 2re@ E7e+cy d7ri+6 ,3e <a.Gi+6 pa,3#

5i67re 9;# C3e Di*7.,a+eo7D e22ec, o2 Ho,3 =5 a+d I5 2i.@ ,erD o+ i+,er2ere+ceD i+ <ide 2reE7e+cy ra+6e#

>opyri0$, _ 5SMM TciWe7.!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!POS

7

Mac$i&e Percep,io& T$ro/0$ 1a,/ra2 I&,e22i0e&ce

45

<* M$-5i9e/9or >a5a !$9io/ 6or 5,e Medi$2 a/d @/.iro/2e/5

coGp/,i&0, a&d proce??i&0 ,ec$&o2o0ie?, i, &oB ?eeG? 2i:e2y ,$a, i&?ec,? co/2d @e &aDi0a,ed a? Go@i2e i&HorGaA ,io& 0a,$erer?. T$ereHore, o/r ?peciHic Ge,$odo2o0y $a? @road iGp2ica,io&? &o, o&2y Hor ?,/dyi&0 ,$e i?ec, Z GaA c$i&e i&,erHace @/, a2?o Hor ,$e H/,/re /?e oH &aDi0a,ed i&?ec,? a? e&Diro&Ge&,a2 ?e&,i&e2?. Y$e& i&?,r/Ge&,ed Bi,$ e</ipGe&, ,o 0a,$er i&HorGa,io& Hor e&Diro&Ge&,a2 ?e&?i&0, ?/c$ i&?ec,? po,e&,ia22y ca& a??i?, Ga& ,o Go&iA ,or ,$e eco?y?,eG? ,$a, Be ?$are Bi,$ ,$eG. [i0$2y Gi&ia,/riOed \M]R e2ec,ro&ic? o& GicroA Gac$i&ed pro@e? $a? e&a@2ed coGp2eQ B\I. ^eDe2opA Ge&,? i& Gicropro@e ,ec$&o2o0y $aDe ?$iH,ed ,$e &o,io& oH Der,e@ra,e iGp2a&,a@2e &e/roGo,or pro?,$e,ic? HroG ?cie&ce c,io& ,o rea2i,y. T$i? ,ec$&o2o0y proDide? ,ec$A &i</e? a&d ,oo2? ,o /&der?,a&d a&d 0e&era,e ro@/?, e2ecA ,ro&ica22y co&,ro22ed G/?c2e GoDeGe&, V58X. T$e adopA ,io& oH ,$e pay2oad @y ,$e @ody, a? ,$e deDe2opi&0 ,i??/e HorG? aro/&d i,, &o, o&2y e&?/re? a ?ec/re a,,ac$Ge&, ,o ,$e i&?ec,, @/, a2?o e&a@2e? a $i0$2y predic,a@2e e2ec,ro&ic i&,erHace ,o ,$e i&?ec,’? ?e&?oria2, &e/ra2, or G/?c/2ar ?y?,eG?. Ye ca22 ,$i? proced/re Ear2y Me,aGorp$o?i?

I&?er,io& Tec$&o2o0y (EMIT). EMIT proced/re a22oB? Hor re2ia@2e IMI a&d $y@rid @ioe2ec,ro&ic ?,r/c,/re? B$ere \M]R deDice? a&d MEMR ?,r/c,/re? are co/p2ed Bi,$ i&?ec,? &a,/ra2 ?e&?or? a&d ac,/a,or?. T$e?e ?y?,eG? ca& 2ead ,o ,$e ?o2/,io& oH Ga&y e&0i&eeri&0 c$a22e&0e? @y /&der?,a&di&0 a&d Ga&ip/2a,i&0 ,$e coGG/&ica,io& a&d a/,oGa,ic co&,ro2 ?y?,eG? oH i&?ec,? (!i#$re (A).

T$e iGp2a&,ed pro@e? ca& a2?o @e /?ed ,o record e2ecA ,rop$y?io2o0ica2 ?i0&a2? d/ri&0 &a,/ra2 i0$, ,o ?,/dy ,$e 2ocoGo,iDe @e$aDior. M/r,$er Heed@ac: ?,/die? oH i&?ec, G/?c2e ca& @e co&d/c,ed ,o op,iGiOe ,$e i0$, co&,ro2. I& ,$i? ?,/dy, ,$e recordi&0 capa@i2i,y Ba? /?ed ?o2e2y ,o a??e?? ,$e ?/cce?? oH @ioe2ec,rica2 co/p2i&0 (!i#$re (B).

Sece&, deDe2opGe&,? i& @ioe&0i&eeri&0, &a&o,ec$&o2o0y, a&d ?oH, coGp/,i&0 Ga:e i, po??i@2e ,o crea,e a &eB 0e&A era,io& oH i&,e22i0e&, ?e&?i&0. T$ere are deDe2opi&0 opA por,/&i,ie? Hor coG@i&i&0 &a,/ra2 a&d ar,iHicia2 ?e&?i&0 a@i2i,ie? i& ,$e ?y&,$e?iOed ?y?,eG. Bac:ed /p @y ,$e rapid ?,ride? oH &a&o,ec$&o2o0y, &a&o?e&?or re?earc$ i?

Ga:i&0 a ,BoAdirec,io&a2 pro0re??, Hir?,2y i& eDo2Di&0 &eB ?e&?or? eGp2oyi&0 Ge?o?copic p$e&oGe&a, a&d ?eco&d2y i& ,$e perHorGa&ce e&$a&ceGe&, oH eQi?,i&0 ?e&?or?. 1a&o?e&?or? are &a&o,ec$&o2o0yAe&a@2ed ?e&A ?or? c$arac,eriOed @y o&e oH ,$e Ho22oBi&0 a,,ri@/,e?: ei,$er ,$e ?iOe oH ,$e ?e&?or or i,? ?e&?i,iDi,y i? i& ,$e &a&o?ca2e, or ,$e ?pa,ia2 i&,erac,io& di?,a&ce @e,Bee& ,$e ?e&?or a&d ,$e o@Uec, i? i& &a&oGe,er?. T$e?e &a&o?e&A ?or? $aDe @ee& @road2y c2a??iHied i&,o p$y?ica2 a&d c$eGica2 ca,e0orie?, Bi,$ ,$e @io?e&?or? p2aced o& @orA der2i&e? oH @io2o0ica2 ?i0&a2? Bi,$ ,$e reGai&i&0 c2a??e?

VIWX. Yi,$ co&,i&/ed Gi&ia,/riOa,io& oH i&HorGa,io& ?e&?i&0,

!i#$re (;* +,e 9e/9or!ac5$a5or 9i#/a-9 C"Inerve!"BD 6or 5,e di66ere/5 di95a/ce9 z $/der 5,e e66ec5 o6 M! Ei5, 9o2e 6reF$e/cie9 6( G 6<*

8

!i#$re ()* +,e -i.i/# 0ei/#12ac,i/e i/5er6ace i/ 5,e 0ioro1 0o5ic percep5io/ 9y95e2*

Seq I nerve " !B B zc

(78)

Ta:i&0 i&,o acco/&, E</a,io&. (>) i? po??i@2e ,o ca2c/A 2a,e ,$e re2a,io& @e,Bee& ?e&?or o/,Ai& (Inerve) a&d ac,/aA ,or i&Ao/, (Uout) re?pec,iDe2y B$e& ro@o,’? 2iG@? are o?A ci22a,i&0 Bi,$ ,$e Hre</e&cy !limb.

Seq I nerve " !B U out # z 7 I ' z ' 7 I$ %8 md I zc JK G!!"#$ SN ?i& &(& L) z >

(77)

RiG/2a,ed </a2i,a,iDe perHorGa&ce da,a oH ,$e $/Ga& ro@o, i&,erHace i& ,$e aG@ie&, MM B are ?$oB& i& !i#$re (;.

\opyri0$, _ I877 RciSe?.!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!POS

45

Mac$i&e Percep,io& T$ro/0$ 1a,/ra2 I&,e22i0e&ce

"i$%re *+, -A/ 0ro22 2ec(io4 a4d -7/ i88%2(ra(ed dia$ra9 o: ()e i$)( 9%2c8e2 po<eri4$ ()e %p= a4d do<42(ro>e o: Ma4d%ca 2e@(a <i4$2, A)e (ip2 o: ()e :8e@iB8e proBe i4 -A/ (ar$e( ()e i$)( po<eri4$ 9%2c8e2 d8 a4d dC -7/, DEM i9= a$e o: ()e :8e@iB8e=proBe (ip <i() e@pa4ded i9a$e o: ()e $ro%4d a4d ac(%a(io4 pad2 ca4 Be 2ee4 i4 -0/, A)e )o8e a( ()e (ip i2 ope4ed :or 9%2c8e $ro<(), 0opyri$)( GHHI JEEE,

"i$%re *I, Ac(%a(io4 proBe2 <ere a82o %2ed (o record 9%2= c8e po(e4(ia82 a2 a4 i4dica(io4 o: e::icie4( (i22%eKproBe co%= p8i4$, Lo(e4(ia82 recorded :ro9 ()e dor2o8o4$i(%di4a8 9%2= c8e2 -9%8(ip8e=ce88 recordi4$ <i() MH K *HH (i9e2 a9p= 8ica(io4/ )aCe 2pi>i4$ :reN%e4cy 2i9i8ar (o <i4$=:8appi4$ ra(e -OGP QR/, SB2erCed 2pi>e2 di2appeared i99edia(e8y <)e4 <i4$ :8appi4$ 2(opped, 0opyri$)( GHHI JEEE,

3

M/2,iproce<<or da,a >/<io& i< i& e>>ec, i&,ri&<ica22y per>or;ed :y a&i;a2< a&d $/;a& :ei&0< ,o ac$ie9e a ;ore acc/ra,e a<<e<<;e&, o> ,$e proce<<i&0 e&9iro&;e&,.

T$e ai; o> <i0&a2 proce<<i&0 :y ,$e co;:i&ed ar,i>i8 cia282i9i&0 :ei&0 ;/2,iproce<<or <y<,e; i< ,o ac=/ire co;p2e,e i&>or;a,io&, </c$ a< a deci<io& or ,$e ;ea<8 /re;e&, o> =/a&,i,y, /<i&0 a <e2ec,ed <e, o> i&p/, da,a <,e;;i&0 ,o a ;/2,iproce<<or <y<,e;8 di0i,a2 da,a are co;i&0 ,o ar,i>icia2 proce<<or a&d ,$e re<, o> i&>or;a,io& co&</;e< :y a &e/ra2 <y<,e; o> 2i9i&0 :ei&0. T$ere:y, a :i0 a;o/&, o> a9ai2a:2e i&>or;a,io& i< ;a&a0ed /<i&0 <op$i<,ica,ed da,a proce<<i&0 >or ,$e ac$ie9e;e&, o> a $i0$ 2e9e2 o> preci<io& a&d re2ia:i2i,y.

I, i< po<<i:2e ,o </:<,i,/,e ,$e ;icroco;p/,er i& a& o:8 Fec,8orie&,ed pro:2e; <o2/,io& <c$e;e :y ,$e &a,/ra2 proce<<i&0 or0a&8 :rai& or <pi&a2 cord. A< a re</2,, ,$e <o>,Hare co;po&e&, Hi22 :e e2i;i&a,ed a&d ,$e ;o<, 0e&era2 c$arac,eriIa,io& o> ,$e proce<<i&0 pro:2e; i& o&e8coordi&a,e di;e&<io&a2 ca2c/2a,io&< co/2d :e ac8 =/ired &a,/ra22y, accordi&0 ,o ,$e >eed:acJ reac,io& o& ,$e i&p/, eKpo</re >or ca2i:ra,io&, error correc,io&, <ca28 i&0 /p or doH&, ra&0e eK,e&<io&, <a;p2i&0, re<o2/,io&, e,c.

M/2,i<e&<or da,a >/<io& i< i& e>>ec, i&,ri&<ica22y per8 >or;ed :y a&i;a2< a&d $/;a& :ei&0< ,o ac$ie9e a ;ore acc/ra,e a<<e<<;e&, o> ,$e </rro/&di&0 e&9iro&;e&,. T$e de<cri:ed i&,e22i0e&, <y<,e; i< i&,rod/ci&0 a &eH ;/28 ,i<e&<or8:rai& i&,er>ace BLE. Mi0$8c$a&&e2 co/&, recordi&0 ;icro<y<,e;< are &eeded ,o record >ro; a 0roHi&0 &/;:er o> <i,e< i& ,$e ce&,ra2 &er9o/< <y<,e;. T$e<e de9ice< are i&,e&ded ,o pro9ide $i0$ i&9e<,i0a,io& acc/racy i& &e/ro<cie&ce eK8 peri;e&,<, a&d re,rie9e ,$e co&,ro2 <i0&a2< i& pro<,$e,ic app2ica,io&< B4E. T$ey are ;ai&2y co;po<ed o> a ;icro8 e2ec,rode array a<<e;:2ed a&d e&c2o<ed Hi,$ i&,e0ra,ed circ/i,< (IO<), i;p2e;e&,i&0 ,$e ac,i9e par,. "i$%re GH <$oH< ,$e o/,p/, <e=/e&ce re<po&<e< o> ,$e AQIO< H$e& ,$e co&<,r/c,ed ,e<, <i0&a2< are a,,e&/a,ed a&d /<ed a< i&p/, <i0&a2< ,o ,$e ;/2,ic$ip i&,er>ace.

Oo9era0e ca& :e ac$ie9ed :y de<i0&i&0 <o;e Ji&d o> de&<i,y co&,ro2 ;ec$a&i<;, ,$a, i<, <c$ed/2i&0 ,$e <e&<or< ,o HorJ a2,er&a,i9e2y ,o ;i&i;iIe ,$e poHer Ha<,a0e d/e ,o ,$e o9er2ap o> ac,i9e &ode<’ <e&<i&0 area< BCDE. T$e <e&<i&0 area o> a &ode i< a di<J o> a 0i9e& radi/< (<e&<i&0 ra&0e). T$e <e&<i&0 e&er0y co&</;p,io& i< propor,io&a2 ,o ,$e area o> <e&<i&0 di<J< :y a >ac,or o> !1, or ,$e poHer co&</;p,io& per /&i,. T$e&, ,$e <e&<i&0 e&er0y co&</;p,io& per (/&i,) area (QEOPA) i< E = !1"D, a&d >or ;ode2 He $a9e: E # !D" T $ D.U4 % !D

(U)

I> e9ery >o/r e=/a2 &ei0$:ori&0 di<J< i& ;ode2 are ,a&0e&,, ,$e& ,$ere i< a 0ap :e,Hee& ,$e; (<ee "i$%re G*).

T$a, /&co9ered <pace ;ay :e co9ered :y o&e eK,ra di<J. I> ,$e e&er0y co&</;p,io& o> a di<J o> radi/< r i< pro8 por,io&a2 ,o rT, n ! T, ,$e& o&e co/2d <a9e e&er0y :y de8 crea<i&0 ,$e radi/< o> a& eK,ra di<J. I& order ,o decrea<e ,$e radi/< r o> a& eK,ra di<J a&d ,o pre<er9e ,$e co9era0e, ,$e &ei0$:ori&0 di<J< o> radi/< R ;/<, o9er2ap. T$o/0$ ,$i< o9er2appi&0 ;ay :e <;a22, ,$e radi/< r ;ay decrea<e 0rad/a22y. Ve <eeJ a& op,i;a2 radi/< r >or ,$e eK,ra di<J, a&d ,$i< de,er;i&e< ,$e eK,e&, ,o H$ic$ ,$e di<J< o> ra8 di/< R o9er2ap. T$i< ca<e i< i&,er;edia,e :e,Hee& ,$e pre9io/< ;ode2<, a&d He Hi22 i22/<,ra,e i,< ad9a&,a0e o9er ,$e;.

T$e ,i2e i< a <=/are Hi,$ 9er,ice< i& ,$e ce&,er< o> >o/r &ei0$:ori&0 di<J< o> radi/< W (<ee "i$%re TU V). 1o,e ,$a, i& ,$a, ca<e, ,$e dia0o&a2 di<J< do &o, i&,er<ec,, :/, a22

Oopyri0$, X TYDD QciWe<.!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!POS

6

Mac$i&e Percep,io& T$ro/0$ 1a,/ra2 I&,e22i0e&ce

>?

!i#$re ()* Mea-$red o$0p$0- o2 03e di22ere40 -0a#e- o2 03e 5$60ic3ip i40er2ace* o$0p$0 -i#4a6 o2 03e co4di0io4i4# circ$i0- 80op9: reco4-0r$c0ed o$0p$0 o2 03e A<= 85idd6e9: a4d reco4-0r$c0ed o$0p$0 o2 03e di#i0a6 A>?= 8@o00o59* o46y de0ec0ed BaCe2or5are cap0$red a4d 0ra4-5i00ed* =opyri#30 ())D ?EEE*

K* Le-$60-

!i#$re (F* Gp0i5a6 arra4#e5e40 o2 -e4-or- Bi03 0Bo adH I$-0a@6e -e4-i4# ra4#e-* =opyri#30 ())D M<J? J$@6i-3i4#*

,$e<e @o/r di<B< are ,$e &ei0$Cor< o@ a& eD,ra di<B o@ raE di/< r.

A< a re</2,, He $aIe ,$e ra,io o@ ,$e ,o,a2 area Sf J K!R7L? o@ ,$e par,< o@ di<B< i&<ide ,$e ,i2e diIided Cy ,$e area SpJ 9K R7L? o@ ,$e ,i2e, a&d ,$e coIera0e de&<i,y D J M!LN " 9>NN, a&d E " 9.9>N !9.

9) I, i< po<<iC2e ,o app2y a ,Hi&ET ;4E@i2,er @or coPE Ca,i&0 </c$ i&,er@ere&ce< a&d &oi<e<, C/, o&2y @or ,$e Q; o& ,$e $i0$ or decrea<i&0 par, o@ ,$e ,ra&<@er @/&c,io& (TQ). T$e iPproIePe&, o@ Pe,ro2o0ica2 per@orPa&ce da,a @roP ,$e i&d/c,io& MQ ,ra&<d/cer Cy </ppre<<i&0 ,$e co&<ideraC2e i&,er@ere&ce< i& ,$e 2oH par, o@ i,< @reV/e&cy ra&0e H$ere TQ i< ri<i&0 Ha< propo<ed. :/ppre<<io& o@ </c$ i&,er@ere&ce< i< ac$ieIed Cy i&corpora,i&0 &E/&i, ;4E@i2,er< i&,o ,$e i&p/, circ/i,< o@ ,$e ,ra&<d/cer Hi,$ a &e0a,iIe Pa0&e,ic @2/D @eedCacB 2oopS 7) A Pa0&e,oPe,erECa<ed Po,io& cap,/re <y<,eP ,$a, ca& addre<< <eIera2 /</a2 $/Pa& PoIePe&,< $a< Cee& pre<e&,ed. T$i< approac$ i< He22 </i,ed ,o p2a&ar PoIeE Pe&,< H$ic$ are c2a<<ica22y per@orPed Cy $/Pa&<. Q/rE ,$erPore, i& a& adIa&,a0eo/< Hay, ,$i< a&02e i&@orPa,io& Hi,$ a& acce2eroPe,er ,o <epara,e ,$e 0raIi,a,io&a2 a&d Bi&ePa,ica2 coPpo&e&,< i& ,$e acce2eroPe,ric <i0&a2 ca& Ce coPCi&edS M) ;ece&, deIe2opPe&,< i& Cioe&0i&eeri&0, &a&o,ec$E &o2o0y, a&d <o@, coPp/,i&0 PaBe i, po<<iC2e ,o crea,e a &eH 0e&era,io& o@ B4I. T$ere are deIe2opi&0 oppor,/&iE ,ie< @or coPCi&i&0 &a,/ra2 a&d ar,i@icia2 <e&<i&0 aCi2i,ie< i& ,$e <y&,$e<iUed <y<,eP. I, i< 0e&era22y coPPe&,ed ,$a, ,$ere eDi<,< a& oIerH$e2Pi&0 Iarie,y o@ &a&o<e&<or<.

TaBe& a< a H$o2e, &a&o<e&<or< are proIidi&0 coPparaC2e

4opyri0$, 6 7899 :ci;e<.!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!POS

9

45

8

Mac$i&e Percep,io& T$ro/0$ 1a,/ra2 I&,e22i0e&ce

or 6/perior per7or8a&ce ,o ,$eir 8icro6e&6or co8pe,i,or6, a, 68a22er 6i:e6 a&d i& 8a&y ca6e6, 8ore eco&o8ica22y.

T$e 2i8i,6 o7 ad>a&ced 8e,$od are: @) pre6e&ce o7 ,$e AC MD6 E$ic$ are co&6ideraF2e 6,ro&0 ,$a& ,$e &oi6e 2e>e2 o7 MD a&d Ea2Gi&0 >iFra,io&6H I) ,$e $ead 6e&6or i6 co&&ec,ed ri0id2y ,o ,$e roFo,ic 2e06 a&d 8o>e8e&, i6 per7or8ed Ei,$ a co&6,a&, $oriJ :o&,a2 6peedH K) ,$e poEer co&6/8p,io& o7 ,$e a/,o&o8o/6 roFo, i6 62i0$,2y i&crea6ed 7or ,$e 6e&6or’6 7/&c,io&i&0 8ai&,eJ &a&ce. A26o roFo,’6 8a66 Ei22 Fe added i& a ca6e o7 apJ p2ica,io& o7 a MeEar 7or 6/perco&d/c,i&0 6e&6orH N) ,$e di77ere&,ia2 arra&0e8e&, o7 a 6e&6i&0 e2e8e&, a2J 2oE6 a 6i&02eJdirec,io&a2 percep,io& a&d ,$e ,$reeJco8J po&e&, >ec,or 6e&6or ca& Fe /6ed 7or orie&,a,io& i& a 6paceH O) Fe,Eee& Fo,$ 6e&6or6 a&d ac,/a,or6 a 8/,/a2 72oE o7 i&7or8a,io& ePi6,6 Fy 8ea&6 o7 ,$e ePp2ai&ed $/8a& roJ Fo, i&,er7ace. I, i6 pre6/8ed ,$a, ,$e &er>eJ 8ac$i&e i&J ,er7ace Ei22 a22oE ,$e c2o6e 8o&i,ori&0 o7 72oE da,a E$ic$ are re6,ric,i&0 ,o ,$e ,ra&6d/ci&0 aFi2i,y o7 a FioJ 6e&6or o7 &er>e i8p/26e6 a&d 8a66Jdi8e&6io&a2 para8eJ ,er6 o7 IQ.

!" $e&ere(ce* U@V

UIV

E. Ma$8o/di, TE2ec,ro&ic 1o6e Tec$&o2o0y a&d I,6 ApJ p2ica,io&6,Y Sensors & Transducers Journal, Zo2. @[4, i66. `, I[[], pp. @4JIO. S. Beccai, Q. Rocce22a a&d S. A6cari et al., TMe>e2op8e&, a&d EPperi8e&,a2 A&a2y6i6 o7 a Qo7, Co8p2ia&, Tac,i2e Micro6e&6or 7or A&,$ropo8orp$ic Ar,i7icia2 ba&d,Y IEEE- ASME Transactions on Mechatronics, Zo2. @K, I[[`, pp. @O`J@5`.doi:@[.@@[]^TMECb.I[[`.]@`N`K

Tra&6d/ci&0 o7 ,$e 1e/ro6i0&a26,Y Proceedings Nanotechnology 2008: Life Sciences, Medicine, and Bio Materials, 1a&o Qcie&ce h Tec$&o2o0y I&6,i,/,e, Ca8Frid0e, CRC Pre66, Zo2. II, c$ap,. 5: 1a&o Medici&e h 1e/ro2J o0y, X/&e I[[`, pp. N4OJN4`.

U]V

R. QG2yar, TQe&6or6 Ei,$ a Bioe2ec,ro&ic Co&&ec,io&,Y IEEE Sensors Journal (Special Issue), Zo2. 4, I[[4, pp. `KOJ`N@. doi:@[.@@[]^XQE1.I[[4.`]N][K

U@[V R. QG2yar,TA Co8p2eP o7 ,$e E2ec,ro8a0&e,ic Bio6e&6or6 Ei,$ a 1a&oEired PicG/p,Y Journal of Sensors, I[[], Ar,ic2e IM O@5`O[. doi:@[.@@OO^I[[]^O@5`O[ U@@V R. \2ai&er, M. \oe22e a&d D. S/dEi0 et al., TQ/perco&J d/c,i&0 i/a&,/8 I&,er7ere&ce Me>ice6: Q,a,e o7 ,$e Ar, a&d App2ica,io&6 (I&>i,ed Paper) ,Y Proceedings of the IEEE, Zo2. ]I, 1o. @[, I[[N, pp. @OKNJ@ON`. doi:@[.@@[]^XPRaC.I[[N.`KK5OO U@IV R. QG2yar, TT$e Me,$od o7 I&6,a&, A8p2i7ica,io& o7 ,$e MCdhMEd Qi0&a26,Y Proceedings TechConnect World Conference and Expo 2010, A&a$ei8, Ca2i7or&ia, X/&e I[@[, pp. N54JN4[.

U@KV M. baff$a66a&, Z. C$oda>arap/ a&d Q. M/6a22a8, T1e/ro MEMQ: &e/ra2 ProFe 8icro,ec$&o2o0ie6 (Re>ieE) ,Y Sensors, Zo2. `, I[[`, pp. 54[NJ54I5. doi:@[.KK][^6`@[54[N U@NV j. \. Qo&0, M. A. Bor,o& a&d Q. ParG, et al., TAc,i>e Microe2ec,ro&ic 1e/ro6e&6or Array6 7or I8p2a&,aF2e Brai& Co88/&ica,io& I&,er7ace6, Y IEEE Transactions on Neural Systems and Rehabilitation Engineering, Zo2. @4, I[[], pp. KK]JKNO. doi:@[.@@[]^T1QRE.I[[].I[INK@[ U@OV M. C. 10, T. 1aGa0aEa a&d T. Mi:/&o, et al., TI&,e0ra,ed I& Zi>o 1e/ra2 I8a0i&0 a&d I&,er7ace CMaQ Me>ice6: Me6i0&, PacGa0i&0, a&d I8p2e8e&,a,io&,Y IEEE Sensors Journal, Zo2. `, 1o. @, I[[`, pp. @I@J@K[. doi:@[.@@[]^XQE1.I[[4.]@I]I@ U@5V R. d/p,a a&d X. A6$e, Ta772i&e Mecodi&0 o7 E&dJPoi&, Dorce6 e6i&0 1e/ra2 E&6e8F2e6: App2ica,io& ,o a Brai&kMac$i&e I&,er7ace,Y IEEE Transactions on Neural Systems and Rehabilitation Engineering, Zo2. @4, 1o. K, I[[], pp. IONJI5I. doi:@[.@@[]^T1QRE.I[[].I[IKI][

UKV

A. Cer8a&, P. RipGa a&d P. \a!par, TPreci6e Ma0&e,ic Qe&6or6 a&d Ma0&e,o8e,er6 7or Mi2i,ary a&d Qpace ApJ p2ica,io&6,Y Sensors & Transducers Magazine, Zo2. K`, i66. @I, I[[K, pp. ONJO`.

UNV

M. X. Mapp6, TRe8o,e Ma0&e,ic Qe&6i&0 o7 Peop2e,Y Sensors and Actuators A, Zo2. @[5, I[[K!pp. KI@JKIO,. doi:@[.@[@5^Q[]INJNIN4([K)[[@]KJ5

U@4V M. \$a&, A. \. Qa2$a& a&d M. Ba&6a2, TA Rea2 Ti8e E8Fedded Qe, ep Ba6ed o& Mi0i,a2 Qi0&a2 Co&,ro22er 7or Me,ec,io& o7 BioJQi0&a26 e6i&0 Qe&6or6,Y Sensors & Transducers Journal, Zo2. @[O, i66. 5, I[[], pp. I5JKI.

UOV

d. Q. Pa,e2, A. Rai a&d Q. Pra6ad, TAr,i7icia22y Co&,ro22i&0 ,$e Si8F Mo>e8e&, o7 RoFo,ic Ar8 e6i&0 Mac$i&e I&J ,er7ace Ei,$ EMd Qe&6or,Y Sensors & Transducers Journal, Zo2. `], I66. K, Marc$ I[[`, pp. K]JO@.

U@`V b. Ra8a8/r,$y, B. Q. PraF$/ a&d R. dad$, et al., TgireJ 2e66 I&d/6,ria2 Mo&i,ori&0 a&d Co&,ro2 e6i&0 a Q8ar, Qe&6or P2a,7or8,Y IEEE Sensors Journal, Zo2. 4, I[[4, pp.

5@@J 5@4. doi:@[.@@[]^XQE1.I[[4.`]N@KO

U5V

M. baff$a66a&, Z. C$oda>arap/ a&d Q. M/6a22a8, T1e/ro MEMQ: 1e/ra2 proFe 8icro,ec$&o2o0ie6 (Re>ieE) ,YSensors, Zo2. `, I[[`, pp. 54[NJ54I5. doi:@[.KK][^6`@[54[N

U4V

B. do66e2i&, A. E. Ayo/F, X.JD. Roy a&d M. QaEa&, et al., TA MiPedJQi0&a2 M/2,ic$ip 1e/ra2 Recordi&0 I&,er7ace gi,$ Ba&dEid,$ Red/c,io&,Y IEEE Transactions on Biomedical Circuits and Systems, Zo2. K, 1o. K, I[[], pp. @I]J@N@. doi:@[.@@[]^TBCAQ.I[[].I[@K4@`

U@]V R. X. Pra&ce, T. M. C2arG, a&d b. Pra&ce, TCo8pac, Roo8JTe8pera,/re I&d/c,io& Ma0&e,o8e,er Ei,$ Q/J perco&d/c,i&0 i/a&,/8 I&,er7ere&ce Me>ice Se>e2 Die2d Qe&6i,i>i,y,Y Review of Scientific Instruments, Zo2.4N, 1o. `, I[[K, pp. K4KOJK4K]. doi:@[.@[5K^@.@O][4NO

U`V

R. QG2yar, TC1T a&d ar0a&ic DET6 Ba6ed TEoJgay

UI[V Q. Bo&&e,, a&d R. bl2io,, TA Ma0&e,o8e,erJBa6ed ApJ proac$ 7or Q,/dyi&0 b/8a& Mo>e8e&,6,Y IEEE Transactions on Biomedical Engineering, Zo2. ON, I[[4, pp. @KOKJ@KOO. doi:@[.@@[]^TBME.I[[4.`][4NI

Copyri0$, m I[@@ QciRe6.""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""POS

Table. The similar fragments which are highlighted in two attached articles. #

R Sklyar “Machine Perception Through Natural Intelligence”

1

title- Machine Perception Through Natural Intelligence

2

abstract- a)

Eric E. Thomson, Rafael Carra, & Miguel A.L. Nicolelis “Perceiving invisible light through a somatosensory cortical prosthesis”

title- Perceiving invisible light through a somatosensory cortical prosthesis

The sensing organs are exponentially better than any of abstract- a) Sensory neuroprostheses show great potential for alleviating analogous artificial ones. That is why using them in full scale is a perspective major sensory defcits. It is not known, however, whether such devices can augment the subject’s normal perceptual range. trend to the efficient (advanced) machine perception.

b)

On the other hand, limitations of sensing organs could be replaced by the perfect artificial ones with the subsequent training the nervous system on their output signals.

b) Here we show that adult rats can learn to perceive otherwise invisible

infrared light through a neuroprosthesis that couples the output of a headmounted infrared sensor to their somatosensory cortex via intracortical microstimulation. c) An attempt to lay down the foundations of biosensing by natural sensors c) Hence, sensory cortical prostheses, in addition to restoring normal and in addition to them by the artificial transducers of physical quantities, neurological functions, may serve to expand natural perceptual capabilities also with their expansion into space arrays and external/implantable in mammals. functioning in relation to the nervous system is performed.

3

Multiprocessor data fusion is in effect intrinsically performed by animals and Such results suggest that the function of a primary sensory area can dramatically change depending on the type of input it receives from the human beings to achieve amore accurate assessment of the processing environment. [p. 2] environment. [p. 74]

4

Alternatively, a superconducting field-effect transistor (SuFET) based In the present study, we test whether adult rats can incorporate a novel neurotransducer (SuFETTr) with carbon nanotubes (CNT) or pickup coil (PC) sensory modality into their perceptual repertoire. [p. 2] kind of input circuit for the nerve and neuronic impulse has been designed. [p.67]

5

A nanoSuFET with a high-temperature superconducting channel is Note that, in principle, this experimental paradigm could use any novel introduced into the nerve fibre or brain tissue for transducing their signals in stimulus (for example, magnetic or radio waves). [p. 4] both directions. As a result, we have achieved SuFETTr that is suitable for ascertaining the variety of values. [p. 67]

6

The described intelligent system is introducing a new multisensor-brain interface. [p. 74]

7

As a result living beings control drives by previously translated biosignals. In One potential application of the technology used in this study is in the

The mechanisms by which animals learn to use this new information source will also be an interesting avenue for future research, as such research should suggest how to accelerate sensory prosthetic acquisition. [p. 4] design of a new generation of motor neuroprostheses that, instead of simply

8

the other variant, biosignals from organs of the senses or brain transduce directly into intelligent or robotic systems which, in such a way, pick up environmental information. [p. 72]

sending a brain-derived motor control signal to move a prosthetic limb, would provide continuous sensory feedback to the user’s brain from the prosthesis. [p. 4]

5) between both sensors and actuators a mutual flow of information exists by means of the explained human- robot interface. It is presumed that the nerve- machine interface will allow the close monitoring of flow data which are restricting to the transducing ability of a biosensor of nerve impulses [p.76]

Such closed-loop bidirectional brain–machine–brain interaction could signifcantly improve reaction time, behavioural accuracy and likely aid the integration of the limb into the user’s internal body image. [p. 4]

Fig. 16 The living being-machine interface in the biorobotic perception system. [p. 73]

9

10

3) Recent developments in bioengineering, nanotechnology, and soft However, there is another aspect of the present work that has rarely been explored in the neuroprosthetics literature: the potential to expand or computing make it possible to create a new generation of BCI. There are developing opportunities for combining natural and artificial sensing abilities augment a species’ normal perceptual range. [p. 4] in the synthesized system. [p. 75] Two directions of SuFETTr function enable decoding of these signals by comparing the result of its reaction on some process or organ with an action on them of the simulated electrical or biochemical signal after their reverse transducing through the SuFETTr(s). [p. 67]

In that pursuit, we have implemented, as far as we can tell, the frst cortical neuroprosthesis capable of expanding a species’ perceptual repertoire to include the near IR electromagnetic spectrum, which is well outside the rat photoreceptors’ spectral sensitivity. Thus, by taking advantage of this novel paradigm, our rats were able to transcend the limitation of perceiving only those stimuli that can activate their bodies’ native sensory transducers. [p. 4]