
Abstract—Starting from human“sense of touch,”this paper reviews the state of tactile sensing in robotics.The physiology, coding,and transferring tactile data and perceptual importance of the“sense of touch”in humans are discussed.Following this, a number of design hints derived for robotic tactile sensing are presented.Various technologies and transduction methods used to improve the touch sense capability of robots are presented.Tactile sensing,focused tofingertips and hands until past decade or so,has now been extended to whole body,even though many issues remain open.Trend and methods to develop tactile sensing arrays for var-ious body sites are presented.Finally,various system issues that keep tactile sensing away from widespread utility are discussed.
Index Terms—Cutaneous sensing,extrinsic sensing,humanoid robots,robotic skin,tactile sensing,touch sensing system.
I.I NTRODUCTION
R OBOTIC devices,limited to the structured environment of manufacturing plants until few years ago,are slowly entering into human life in one form or another.This has led to emergence of interaction and learning issues—more so for humanoid robots.Humanoid robots,introduced as“mechanical knight”by Leonardo da Vinci in1495A.D.[1],will eventually work along humans if they understand human intelligence,rea-son,and act like humans.Since they are expected to simulate the human structure and behavior,they are more complex than other kinds of robots.For example,unlike industrial robots,a humanoid robot is expected to reach its goal while adapting to the changes in its environment—which requires autonomous learning and safe interaction,among many other things.Thus,it is important to study the ways and means of humanoid robot’s interaction with the environment.
What happens if we have all sensing modalities other than “sense of touch”?A simple experiment of exploring the ob-jects after putting hands on an ice block for a while can answer this question.One such experiment,performed by anesthetizing
Manuscript received November5,2008;revised June29,2009and September 22,2009.First published November20,2009;current version published February9,2010.This paper was recommended for publication by Associate Editor K.Hosoda and Editor K.Lynch upon evaluation of the reviewers’com-ments.This work was supported in part by the European Commission under Project RobotCub IST-FP6-004370and Project ROBOSKIN ICT-FP7-231500, and by the Italian Ministry for University Education and Research under Project PRIN2007“Tactile Sensing System for Humanoid Robots using Piezo-polymer-FET devices.”
R.S.Dahiya is with the Robotics,Brain,and Cognitive Sciences Department,Italian Institute of Technology,Genoa16163,Italy(e-mail: ravinder.dahiya@iit.it).
G.Metta and G.Sandini are with the Robotics,Brain,and Cognitive Sciences Department,Italian Institute of Technology,Genoa16163,Italy,and also with the Dipartimento di Informatica Sistemistica e Telematica,University of Genoa, Genoa16145,Italy(e-mail:giorgio.metta@iit.it).
M.Valle is with the Dipartimento di Ingegneria Biofisica ed Elettronica,Uni-versity of Genoa Genoa16145,Italy(e-mail:maurizio.valle@unige.it).
Color versions of one or more of thefigures in this paper are available online at http://ieeexplore.ieee.org.
Digital Object Identifier10.1109/TRO.2009.2033627the skin on the hands of a group of volunteers,demonstrates the difficulty of maintaining a stable grasp of objects[2].The movements become inaccurate and unstable when the“sense of touch”is lost.In another,rather unusual,experiment performed on astronauts at the International Space Station,the vibrotactile cues provided via“sense of touch”are found to be highly in-dicative of the direction and spatial disorientation[3].“Sense of touch”allows assessing object properties,e.g.,size,shape tex-ture,temperature,etc.It is needed to detect slip,to roll an object between thefingers without dropping it,to develop awareness of the body,and,hence,to differentiate“me”from“not me.”Thus,absence of the“sense of touch”(for that matter,any sens-ing modality)would widen the gap between what is sensed and what is perceived.
As in humans,touch sensing in humanoid robots would help in understanding the interaction behaviors of a real-world ob-ject,which depend on its weight and stiffness,on how its surface feels when touched,how it deforms on contact,and how it moves when pushed.Even though“sense of touch”is important,most humanoid projects have not paid any major attention to it vis-a-vis other sensory modalities—thereby strongly limiting their interaction and cognitive capabilities.This could partly be at-tributed to the complex and distributed nature of“sense of touch”and partly to the absence of satisfactory tactile sensors or“tax-els”that can be incorporated in humanoid robots.Over the past two decades or so,the pursuit to improve tactile sense capability of robots has resulted in many touch sensors,exploring nearly all modes of transduction[4]–[35].However,something like a tactile analogous a complementary metal-oxide-semiconductor (CMOS)optical array is yet to come.Production of tactile sen-sors with innovative designs still continues,but they largely remain unsatisfactory for robotics either because they are too big to be used without sacrificing dexterity or because they are slow,fragile,lack elasticity,lack mechanicalflexibility,and lack robustness,and,in some cases,because of their digital nature, i.e.,all or none.Some other reasons for neglecting tactile sensing in a general mechatronic systems are discussed in[36]. Design of a meaningful robotic tactile sensing system must be guided by a broad,but integrated,knowledge of how tactile information is encoded and transmitted at various stages of in-teraction.In this context,the studies on human“sense of touch”can be a good starting point.For centuries,biological systems have inspired engineers[37]and are now inspiring roboticists as well[38]–[40].Starting from a human“sense of touch,”this paper presents the role,importance,and current state of tactile sensing in robotics.This paper is organized as follows: Various terms associated with“sense of touch”are defined in Section II.Following a brief discussion on the physiology of hu-man“sense of touch,”its role and perceptual importance are pre-sented in Section III.Using these studies,various design hints for robotic tactile sensing are also presented in Section III.Various
1552-3098/$26.00©2009IEEEtechnologies developed to improve the touch-sensing capability of robots are presented in Section IV.Current trends and meth-ods for the development of tactile sensing arrays,for various body parts,are discussed in Section V.Various issues needed to be considered for the effective utility of tactile sensing in robotics have been highlighted in Section VI.Various open is-sues related to robotic tactile sensing are presented at appropriate places through out the text and are summarized in Section VII. II.S ENSE OF T OUCH—D EFINITIONS AND C LASSIFICATION “Sense of touch”is used as a layman’s term in previous section,and before proceeding further,it is imperative to define various terms associated with it.The“sense of touch”in humans comprises two main submodalities,i.e.,“cutaneous”and“kinesthetic,”characterized on the basis of the site of sensory inputs.The cutaneous sense receives sensory inputs from the receptors embedded in the skin,and the kinesthetic sense receives sensory inputs from the receptors within muscles,tendons,and joints[41],[42].It should be noted that sensory inputs are not only mechanical stimulations but also heat,cooling,and various stimuli that produce pain.
In context with the submodalities mentioned earlier,most researchers have distinguished among three sensory systems—cutaneous,kinesthetic,and haptic.According to Loomis and Lederman[41]and Klatzky and Lederman[43],a cutaneous system involves physical contact with the stimuli and provides awareness of the stimulation of the outer surface of body by means of receptors in the skin and associated somatosensory area of central nervous system(CNS).The kinesthetic system provides information about the static and dynamic body postures (relative positioning of the head,torso,limbs,and end effectors) on the basis of1)afferent information originating from the muscles,joints,and skin;and2)Efference copy,which is the correlate of muscle efference available to the higher brain.The involvement of afferent information from skin in kinesthetic sensing also indicates its dependence on cutaneous sensing.The haptic system uses significant information about objects and events both from cutaneous and kinesthetic systems[41],[43]. On the basis of sensory systems discussed earlier,the percep-tion of a stimulus can be categorized as cutaneous,kinesthetic, and haptic perception.According to Loomis and Lederman[41], the“tactile”perception refers to the perception mediated solely by variations in cutaneous stimulation.Kinesthetic perception is mediated exclusively,or nearly so,by the variations in kines-thetic stimulation.Interestingly,humanoids outperform humans in kinesthetic perception[44].All perceptions mediated by cu-taneous and/or kinesthetic sensibility are referred to as tactual perception.The properties of peripheral nervous system are in-vestigated either with a moving object touching an observer or by the purposive exploration of objects by the observer.Accord-ingly,the“sense of touch”is classified as passive and active. Loomis and Lederman[41]made a distinction between passive and active touch by adding the motor control inputs to the affer-ent information,as shown in Fig.1.In an everyday context,the touch is active as the sensory apparatus is present on the body structures that produce
movements.Fig.1.Components of tactual perception[41].Dotted line represents the partial dependence of kinesthetic perception on stimulus mediated by receptors in the skin.
Using various terms associated with the human“sense of touch,”a parallel can be drawn for robotic tactile sensing.Gen-erally,robotic tactile sensing is related to the measurement of forces in a predetermined area.Jayawant[45]defined it as the continuous detection of forces in an array.Crowder[46]defined it as the detection and measurement of perpendicular forces in a predetermined area and subsequent interpretation of the spa-tial information.However,this definition is narrow for not in-cluding contact parameters other than perpendicular forces and broad for including the“interpretation”of spatial information, which is basically perception and,hence,includes the role of both cutaneous sensing and the corresponding area of analysis in somatosensory cortex of CNS.In this context,the definition of a tactile sensor—a device or system that can measure a given property of an object through contact in the world—by Lee and Nicholls[13]is more appropriate.Studies on cutaneous sensing show that receptors are not just transducers.Both individually and collectively they locally process the stimulus[47]–[49]. Thus,tactile sensing can be defined as detection and measure-ment of contact parameters in a predetermined contact area and subsequent preprocessing of the signals at the taxel level,i.e., before sending tactile data to higher levels for perceptual in-terpretation.On similar lines,touch sensing can be termed as tactile sensing at single contact point.
Robotic tactile sensing is broadly classified in Fig.2.Based on the tasks to be accomplished,robotic tactile sensing is catego-rized in two ways—“perception for action”(as in grasp control, dexterous manipulation,etc.)and“action for perception”(as in object recognition,modeling,exploration,etc.).In addition to these,“haptics”(not shown in Fig.2)could be the third category. Haptics involves both action and reaction,i.e.,two-way trans-fer of touch information.Based on the body site,where tactile sensors are located,robotic tactile sensing can be categorized as intrinsic and extrinsic tactile sensing.Intrinsic sensors,which are placed within the mechanical structure of the robot,derive the contact information like magnitude of force using force sen-sors.Extrinsic sensors or arrays that are mounted at or near the contact interface deal with tactile data from localized regions. Extrinsic and intrinsic tactile sensing are analogous to cutaneousDAHIY A et al.:TACTILE SENSING—FROM HUMANS TO HUMANOIDS
3
Fig.2.Classification of robotic tactile sensing.
and kinesthetic sensing,respectively.Like a cutaneous system (see Fig.1),extrinsic tactile sensing and the computational unit of robots can be termed as an extrinsic tactile sensing system. Similarly,an intrinsic tactile sensing system and haptic system can also be defined.
The extrinsic tactile sensing is further categorized in two ways—first,for highly sensitive parts(e.g.,fingertips),and sec-ond,for less sensitive parts(e.g.,palm).Whereas former re-quires tactile sensing arrays with high density and spatiotem-poral response(∼1-mm spatial resolution and response time of the order of few milliseconds),such constraints can be relaxed for the latter.Both extrinsic and intrinsic tactile sensing can be further classified(not shown in Fig.2)on the basis of the working principle and the physical nature of the sensors.The working principle of tactile sensors can be resistive,capacitive, inductive,optical,magnetic,piezoelectric,ultrasonic,magne-toelectric,etc.Similarly,the physical nature of the sensors can beflexible,compliant,stiff and rigid,etc.These classifications are discussed in detail in the following section.This paper is primarily focused on extrinsic tactile sensing,and hereafter,it is simply termed as tactile sensing.
III.H UMAN T ACTILE S ENSING—A B ASIS FOR R OBOTIC
T ACTILE S ENSING
Scientific studies like hand movements for optimum explo-ration,object recognition,active and passive perception,se-lective attention,sensory guided motor control,etc.,have ad-dressed many issues that are challenging to roboticists as well. In the absence of any rigorous robotic tactile-sensing theory, such studies may be helpful in specifying important parameters like sensor density,resolution,location,bandwidth,etc.They may also bring up new ideas of raising the level of tactile sen-sitivity and acuity of robots to the human range.Following a brief discussion on cutaneous/tactile sensing in humans,this section presents some design hints for robotic tactile system. For a detailed study on touch sense modality and its perceptual importance in humans,see[43],[50],and[51].
A.Neurophysiology and Human Touch System
The human sense of touch deals with the spatiotempo-ral perception of external stimuli through a large number of receptors(e.g.,mechanoreceptors—for pressure/vibration, thermoreceptors—for temperature,and nocioceptors—for pain/damage[52])that are distributed all over the body with variable density.The response to mechanical stimulus is me-diated by mechanoreceptors that are embedded in the skin at different depths.Their number,per square centimeter area,is estimated to be241in thefingertips and58in the palm of adult humans[53].The classification,functions,and location of these receptors are shown in Fig.3.They have different receptive fields—the extent of body area to which a receptor responds—and different rates of adaptation.A fast-adapting(FA)receptor responds with bursts of action potentials when its preferred stimulus isfirst applied and when it is removed.In contrast,a slow-adapting(SA)receptor remains active throughout the pe-riod during which the stimulus is in contact with its receptive field.SA-I mechanoreceptors exhibit fully tunable“stochastic resonance”[54]—a process whereby a nonlinear system is able to detect an otherwise undetectable signal(e.g.,subthreshold stimulus)by adding a random stimulus or noise to the input. The response to thermal stimulus is believed to be mediated by separate“warm”and“cold”thermoreceptor population in the skin.Nociceptor units in the skin are primarily responsible for sensation of pain;however,they also respond to extremes in temperature and sometimes to mechanical stimulation[43]. The nature of electrical discharge from various receptors in response to the external stimuli—studied in vitro and in vivo on human skin samples—is found to be pyroelectric and piezoelec-tric[55].Comparative experiments on epidermis samples of skin show a marked phenomenological analogy with of piezoelectric materials[56].
B.Tactile Information Encoding and Transfer
From the moment skin is stimulated until the resulting percep-tion,a variety of complex mechanical,perceptual,and cognitive phenomena take place.Fig.3shows a sequence of events dur-ing tactile signal transfer.On contact with an object,the skin conforms to its surface,maintains the same local contour,and thus projects the deformation to a large number of mechanore-ceptors.Each mechanoreceptor thus represents a small portion of the object and encodes the spatiotemporal tactile informa-tion as spikes of action potentials—voltage pulses generated when the stimulus is greater than a threshold.The amplitude of the stimulus is then transformed to a train of action poten-tials[51]—a step similar to digitizing and coding analog signals by an analog-to-digital(A/D)convertor.
The contact event related information is transmitted to the CNS for higher level processing and interpretation via multiple nerves up to the spinal cord and via two major pathways: spinothalmic and dorsal-column-medial-lemniscal(DCML)4IEEE TRANSACTIONS ON ROBOTICS,VOL.26,NO.1,FEBRUARY
2010
Fig.3.(a)Section of glabrous skin showing physical location and classification of various mechanoreceptors[50],[51],[57]–[60].(b)Tactile signal transmission—fromfingertips to somatosensory area of brain(modified from[61]).(c)Functional events during tactile signal transmission from contact point to the brain.For simplicity,the signalflow is unidirectional.In general,the information transfer is bidirectional as the same path is used by motor signals.
thereafter,as shown in Fig.3.The spinothalamic pathway is slower and carries temperature and pain-related information. DCML,on other hand,quickly conveys pressure/vibration related information to the brain and helps in spatial and temporal comparisons of the stimuli.The tactile information is processed at various data transfer stages before it reaches the CNS.For example,during natural manipulations,humans can perceive independently the curvature and the direction of force fromfirst spikes of the ensembles of primary sensory neurons in the terminal phalanx[47],[48].This reduces the computational burden of CNS and lets it perform some higher level process-ing like disentangling the interactions between information obtained from ensemble offirst spikes and other parameters like rate of change of contact force,temperature,change in viscoelastic properties of thefingertip,etc.[62].The tactile information transfer to brain is also subjected to an intense process of selection[63].For example,the tactile information is transferred when attention is paid to“which part of the body is being stroked.”How the CNS combines the information from the large number of receptors to get a coherent image of objects is not discussed here;see[50],[51],and[]for further details.
C.Spatiotemporal Sensitivities of Human Tactile Sensing Spatiotemporal limits and sensitivity to mechanical stimulus directly affect the object recognition capability[41]and direc-tional sensitivity[65],etc.The pattern-sensing capability of the cutaneous sense is limited by both its spatial and temporal sensitivities,as they quantify the information loss or blurring of stimulus by spatiotemporalfiltering at early stage of cuta-neous processing[41].Such effects can be used to define the “crosstalk”limits of robotic tactile sensors.
Spatial acuity is an important parameter that gives an idea of spatial resolution—the smallest separation at which one can tell if he/she has been touched at two points.Two points thresh-old[66]and grating orientation method[67]show that the spatial acuity varies across the body—from highest atfingertips,face, toes,etc.,to lowest at thigh,belly,etc.The spatial resolution at the palm is about seven times smaller than that at thefin-gertips[68].One can resolve two points as close as1mm on thefingertips[69]and up to30mm on the belly[50].These results place the tactile acuity somewhere between vision and audition—worse than vision but better than audition[50].Be-sides body site,the ability to perceive afine spatial structure also depends on the temporal properties of stimulus(namely, its vibration frequency).The spatial acuity decreases if vibra-tory frequency is increased[70].The spatial acuity in the torso, measured with vibrotactile stimuli,has been reported to be20–30mm[71].Skin microstructures like intermediate ridges—the undulating epidermal tissues that descend into the epidermal–dermal junction(shown in Fig.3)—also enhance the tactile spatial acuity by transmitting magnified signals from surface of skin to the mechanoreceptors[72].DAHIY A et al.:TACTILE SENSING—FROM HUMANS TO HUMANOIDS5
When it comes to temporal resolution,humans are capable of detecting vibrations up to700Hz,i.e.,they can detect a single temporal interval of about1.4ms[43].Comparing temporal acuity of touch with that of vision(upper limit of50Hz for a flickering light)and audition(20kHz),touch again lies between vision and audition,but this time,audition is better[50].Tem-poral separation of two contact events,at different locations, is also needed as it helps in detecting the presence of multi-ple events.The critical temporal separation for two events at different locations onfingertips is found to be on the order of 30–50ms[73].
The pressure threshold and skin deformation are other com-mon intensive measures of absolute tactile sensitivity.The higher the pressure threshold,the lower the sensitivity of the body part.Controlled pressure sensitive studies show that pres-sure thresholds vary with body site.Whereas normal mean threshold values average about0.158g on the palm and about 0.055g on thefingertips of men,the corresponding values for women are0.032g and0.019g,respectively,[74].
The temperature sensitivity also varies with the body parts. For example,from a baseline temperature of33◦C,changes as small as0.16and0.12◦C for warmth and cold,respectively,can be detected at thefingertips[75].Corresponding values at volar base of thumb are0.11and0.07◦C.
D.Tactile Sensing in Perception
Humans are excellent at recognizing common objects by touch alone[76],and cues like material properties,shape,etc., are critical to this endeavor.Both cutaneous and kinesthetic sensing contribute to the perception of such cues.Tactile sens-ing in humans is better adapted to feel the material properties of objects than to feel their shapes—particularly when the object is large enough to extend beyond thefingertip[50].Perhaps this is the reason why most of the studies on tactile sensibility in humans and other primates have reported sensory perception in the context of exploratory tasks[49].
Shape detection of objects small enough to be within the con-tact area(7–12mm)of thefingertips is an important function of the mechanoreceptors.Experiments involving vertical indenta-tion and stroking of skin,with the force equal to that exerted by humans during natural manipulation(15–90g wt.),indicate that the object shape and orientation are signaled by the spatiotem-poral responses of the afferentfiber populations,particularly those of the SAs[77]–[81].The curvature and force direction can also be perceived from these signals[62].These experi-ments reveal that thefiring rate of an SA is a function of the vertical displacement,vertical velocity,and the amount and the rate of change of curvature of the skin.However,SAs become silent in the event of negative rate of change of curvature.In the case of FA,thefiring rate is a function of the vertical velocity and the rate of change of curvature at the most sensitive part of the receptivefield.These studies give a direct relation between the stimuli and neural signals that code them.Thus,assuming skin to be a“blackbox,”the relation between the stimuli(e.g., the shape)and the output(e.g.,thefiring rate)of afferentfibers can be written as
f SA=a1R−1+a2
dR−1
dt
+a3∆Z+a4
dZ
dt
(1)
f FA=b2
dR−1
dt
+b4
dZ
dt
(2) where f SA and f FA are thefiring rates of SA and FA receptors, respectively,R−1is the skin curvature at contact point,∆Z is the vertical displacement,and a1,a2,a3,a4,b2,and b4are the constants.The edge sensitivity is a special case of sensitiv-ity to changes in skin curvatures.As can be noticed from(1) and(2),FA and SA receptors respond simultaneously at edges and boundaries,and at other points,FA receptors are silent.The response of SA receptors is higher at edges than at a uniform sur-face because of high compressive strain at such points.The edge detection sensitivity of SA I receptors has also been attributed to the presence of Merkel cells on the tips of the epidermal part of intermediate ridges.Intermediate ridges are believed to magnify the tactile signals from the surface of the skin to the mechanoreceptors by way of microlever action[82],[83].The role of intermediate ridges studied through continuum mechan-ics orfinite element modeling also show that the concentration of stress on the ridge tips improves the capability to differen-tiatefiner details[84].Surprisingly,the mechanoreceptors are located close to the points where stress is concentrated.Sensi-tivity of receptors to the rate of change of curvature,in addition to the curvature,also enhances the contrast at the edges of ob-jects,where curvature changes abruptly.From a robotics point of view,these results highlight the importance of having sensors that respond to both static and dynamic stimuli.A combination of capacitive/resistive and piezoelectric transduction could be one of the many possible solutions.
Roughness-smoothness is another important perceptual di-mension.Neurophysiological studies suggest that the tactile roughness perception is accurately predicted by spatial varia-tions of discharge of SA afferents,and hence,it is a function of multiple tactile elements.Contrary to the general belief that the temporal parameters have little effect on roughness percep-tion[85],recent studies show that they indeed contribute[86]. Fingerprints or papillary ridges,shown in Fig.3,also enhance the tactile sensitivity of Pacinian corpuscles and,hence,help in feelingfine textures[87].Discrimination of surface roughness is also enhanced when tangential movement exists between the surface and skin[88],and this is independent of the mode(active or passive)of touch[].In other words,this property is salient to cutaneous/tactile sensing.Roughness of objects is signifi-cantly correlated with friction as well.The correlation is much stronger when the variations and rate of change of the tangen-tial forces are considered.This is evident from the experiments where subjects maintained a steady normal force,rather than reducing it,to allow the tangential force to initiate and maintain sliding while scanning a surface with higher friction[90],[91]. These facts point towards the importance of tangential force and that its knowledge,in addition to the normal forces,can be useful for robotic applications.
Detection of slip can be viewed as the coding of motion by the receptors in the skin.Slip or relative movement between6IEEE TRANSACTIONS ON ROBOTICS,VOL.26,NO.1,FEBRUARY2010
a surface and the skin is important for perception of roughness
[85],[91],[92],hardness[93],and shape[94],[95].Slip plays an important role in grip force control by acting as an error signal. All these,except static contact associated with thermal sensing, involvefinger movements and thus highlight the importance of dynamic tactile sensing[96].
Tactile feedback from the contact surface of an object influ-ences the perception of force used to support it.Experiments studying the effect of tactile sensing on the perception of force demonstrate underestimation of forces produced by muscles when tactile sensory feedback from hand is constrained[97]. Interestingly,complete elimination of tactile feedback by anes-thetizing skin results in an opposite perception of force,i.e., increase in the perceived force or heaviness[98]and decrease in the maximum force that thefingers can produce[99].Further, the effect of eliminating the tactile sensing from variousfingers is also different.Elimination of cutaneous sensing from thumb and indexfinger results in an increase of perceived heaviness by40%and13%,respectively[98].In addition to magnitude, the direction of force is also critical for handling objects with irregular shapes while maintaining the desired orientation.Tac-tile afferents from the terminal phalanx offinger contribute to the encoding of direction offingertip forces.The directionality is also thought to be due to different strains produced at the receptor site by forces applied in different directions[49].
In context with motor control,tactile information plays an important role in controlling the execution of reaching to grasp movements.The contribution of cutaneous receptors for con-trolling prehensile force during object manipulation has been studied extensively in[52],[100],and[101].Tactile informa-tion is used to ascertain the actual shear or load force,which then helps in optimally adjusting the grip force[52],[99],[100]. Cutaneous feedback also gives the actual state of the system;in the absence of it,internal models(of objects)underlying antic-ipatory control mechanisms are no longer updated during tasks like grasping[99],[102].Various phases of a grasping action, namely,reaching,loading,lifting,holding,replacing,and un-loading,are characterized as discrete sensory events by specific tactile afferent responses.In other words,signals from tactile af-ferents mark transitions between consecutive action phases.The planning and control of manipulation in the brain is centered on the mechanical events that mark transitions between consecutive action phases[47].This means impaired tactile sensibility will make manipulation difficult as the brain lacks the information about mechanical contact.The touch information(along with kinesthetic,vision,and motor feedback signals)is needed to obtain the“body schema,”which is an internal representation of body’s structure[42].
The correct grasp of an object requiresfine control of not only the strength offinger muscle activation but also of its temporal course or duration in various phases of grasp.Lack of tactile sensing lengthens the duration of thefinger opening phase of the grasp,thereby impairing the control of grasp[103].Thus, tactile information is possibly used in getting minimal duration or,in other words,in time optimization of various phases.The discharge from specific receptors at the beginning and end of a movement can be used to compute grasp time for various phases,and thus,grasp temporal parameters can be optimized[52].In this context,taxels that are able to record dynamic events could be helpful in robotics.Tactile information fromfingertips has also been shown to contribute to the control of timing in sequen-tial actions such as playing a piano or tapping in synchrony to an external signal[104].Thus,a variety of information about real-world objects is obtained through cutaneous sensing. However,it should be noted that the human system is a com-plete,multilevel,integrated system,and the“sense of touch”is not isolated.Multiple sensory information from several sensory modalities like touch,vision,hearing,etc.,is needed to perceive a stimulus[51].Sometimes,the sensory modalities compete (e.g.,in presence of attention),and at other times,the whole is an integrated combination of the different sensory inputs.Even if a single modality is involved,the perception of an object can be due to a combined contribution of its sub modalities.The combination and integration of sensory information from mul-tiple sources is key to robust perception,as it maximizes the information derived from the different sensory modalities and improves the reliability of the sensory estimate.For example,the perception of size[105]and shape[106]obtained with visual and haptic information,integrated into a statistically optimal fashion,is more reliable than the unimodal estimate.Similarly, frequency content of auditory feedback can help in perceiving roughness and moistness of surfaces[107].Both vision and pro-prioception provide information about the position of the hand in space[108].Haptically and visually acquired size-related infor-mation may influence the feed-forward or anticipatory control of forces during loading and transitional phases of precision grip[109],[110].Thus,the design of a robotic tactile-sensing system should take into account the presence of other sensing modalities and their combined role in achieving a common goal.
E.Skin Mechanics and Tactile Sensing
Skin acts as a medium through which contact indentations are converted into stresses/strains.Human skin is multilayered, nonlinear,nonhomogeneous,and viscoelastic.It is a complex structure supported on a deformable system of muscles and fat[83].Various skin layers have different stiffness.The base epidermis layer,having Young’s modulus10–10000times that of dermis,is considerably stiffer than the dermis[84].With such properties,the skin mechanics is bound to play an important role in the tactile perception.The presence of physical interlocking between the epidermis and dermis layers of skin helps in resist-ing any tendency of their relative sliding over each other and creates afiltering mechanism that distributes forces and stresses from their point of application[111].Such afiltering mecha-nism also has considerable impact on the spatial resolution.The presence of intermediate ridges and their role in magnifying the tactile signals by way of microlever action has already been dis-cussed.Intermediate ridges,which are shown in Fig.3,should not be confused with papillary ridges orfingerprints that are basically the external parallel whorls.However,the center of each papillary ridge protuberance lies directly above the cen-ter of each intermediate ridge[84].Papillary ridges are known to improve gripping[112]and tactile acuity by microlever
mechanism[82],[83].However,finite-element studies indicate very little involvement of papillary ridges in such a mecha-nism[113].Fingerprints might improve the tactile sensitivity of pacinian corpuscles and,hence,help us feelfine texture[87].A number of attempts have been made to model and study the me-chanical behaviors of the skin;see[57],[84],[114],and[112].
F.Hints for the Design of Robotic Tactile Sensing System Following previous discussion,some basic design criteria can be formulated for tactile sensing in a general robotic system.A few such attempts have earlier been reported in[12]–[15],and [115],and some of theirfindings are also included in following design hints.
1)The presence of varied and distributed receptors with sharp
division of functions calls for using different kinds of miniaturized sensors—each optimally measuring a partic-ular contact parameter(though they may help detecting other parameters as well).It is desirable to have multi-functional sensors,like contact force and hardness de-tection[116],and tactile and thermal sensors[117]that measure more than one contact parameter.The number of such sensing elements may depend on the body site where they are intended to be placed.
2)The spatial resolution of the tactile sensors,distributed or
arranged in an array,should be based on the body site.
Forfingertips,it should be about1mm—which translates to an approximately15×10element grid on afingertip sized area—and for less-sensitive parts like the palm and shoulders,it can be as high as5mm.
3)The sensors should demonstrate high sensitivity and wide
dynamic range.Normal manipulation involves forces in the range of15–90g wt.[77],[78].Considering involve-ment of taxels in various exploratory tasks,a force sen-sitivity range of1–1000g wt.and a dynamic range of 1000:1are desirable[118].The touch sensors should also be able to measure the direction of force.This is important because robots,in general,do not have a prior model of real world objects.
4)Taxels should be able to detect and measure both static and
dynamic contact events.More than one mode of transduc-tion may be required to meet such requirements.
5)The robotic tactile sensors should respond quickly.This
is particularly important,if tactile feedback is used in robotic control.Involving tactile sensing in control loop of robotic applications is important due to insufficient contact information available from artificial muscles or kinesthetic sense alone.The signal frequency range to which different mechanoreceptors in human skin respond can be used to set the response time requirements of sensors.In general, for real time contacts,each touch element should respond as fast as1ms.The same is also true for an array of tactile sensing elements.However,such conditions can be somewhat relaxed in the case of whole body skin-type distributed taxels.
6)In humans,the tactile data is not directly sent to the brain.
Instead,some processing is done at various levels tofit the limited throughput of the nervous system.Thus,to
reduce the amount of information transfer to the central processing unit,it is important for large tactile arrays or modules to have some level of preprocessing(data selec-tion,local computation,etc.)at the sensory location.Such an architecture would free“robot’s brain”for more intel-ligent works.Alternately,it would allow scaling up the system to practically any number of sensors.
7)The contact information should be transferred via differ-
ent paths with different transfer rates.The signals(me-chanical)that require urgent attentions(e.g.,in feedback control)can be transferred via faster path.However,such an arrangement would probably increase the number of wires—which is undesirable in robotics.
8)The taxels may also be embedded into or covered with
elastic material just like the receptors in the skin that lie under different layers of skin.Although embedding the sensors in elastic material may introduce some blurring or filtering effects;the increase in contact area,as a result of such elastic covering,is helpful in manipulation.
9)The elastic covering of the sensors may be designed
to have structures like intermediate and papillary ridges present in the skin.By concentrating the stresses on the sensing elements,such structures can also compensate the blurring effect of elastic cover.A textured pattern like papillary ridges on the surface of elastic material increases detectability[87],[119].
10)Biological sensors can derive information like detailed
contours of objects,because the skin is compliant and conforms to object.Thus,robotic taxels should be robust,flexible,conformable,stretchable,and soft,and therefore, they can withstand harsh conditions of temperature,hu-midity,chemical stresses,electricfield,sudden force,etc.
When distributed over the body,they should not signifi-cantly increase the diameter/thickness of robot link/part.
11)Linearity and low hysteresis are also desired.Although
nonlinearity can be taken care by inverse compensation, the same is difficult for hysteresis.The output of taxels should be stable,monotonic,and repeatable.It is inter-esting to note that the human tactile sensing is hysteric, nonlinear,time varying,and slow.However,the presence of large number of“technologically poor”receptors en-ables the CNS to extract useful information. Requirements mentioned above are also application depen-dent and thus should not be considered definitive.Some of the above-mentioned design cues seem to be technologically chal-lenging.Thus,technological and manufacturing issues like pro-duction of many sensing devices with similar performance(re-peatability across different fabrications),type and number of in-terconnects,and repeatability of response over time,etc.,should also be considered while designing robotic tactile sensors.
IV.T ACTILE S ENSOR T YPES
Tactile information is useful in robotics in a number of ways. In manipulative tasks,tactile information is used as a control parameter[120]–[122],and the required information typically includes contact point estimation,surface normal and curvature measurement,and slip detection[123]through measurementof normal static forces.A measure of the contact forces al-lows grasp force control,which is essential for maintaining stable grasps[124].The grasp force along with manipulator displacement is also needed in compliant manipulators[125]. In addition to magnitude,the direction of force is also critical,in dexterous manipulation,to regulate the balance between normal and tangential forces,and hence to ensure grasp stability—the so-called friction cone[126].For full grasp force and torque determination,shear information is also required[127],[128]. The need for shear stress information is also supported byfi-nite element analysis(FEA)[129],[130].Shear information is useful to determine the coefficient of friction and in getting a unique surface stress profile when the sensor is covered with elastomeric layer[131].Importance of shear force in humans has already been discussed.While interacting with objects,a significant information such as shape[132]–[134],surface tex-ture[16],[135],slip[135]–[138],etc.,comes through normal and shear forces.However,a real-world interaction,involving both manipulation and exploration,also requires measuring ma-terial properties such as hardness[116],temperature[17],etc. Taxels based on design hints presented in previous section, can possibly help in achieving some of the above objectives. Some of these design guidelines have been explored and tactile sensors exist with variable stiffness elastic layers[139],finger-print like structures[140],and the mechanical properties and dis-tributed touch receptors like human skin[141].However,their number and the type of contact parameters obtained from them are still insufficient.For example,the interaction of robots with environment through tactile sensing has largely been limited to the measurement of static interaction forces,whereas real-world interaction involves both static and dynamic.Similarly,most of the sensors are designed to measure static pressure or forces, from which,it is difficult to obtain information like stickiness, texture,hardness,elasticity,etc.Recently,the importance of dy-namic events has been recognized,and sensors are being devel-oped for detecting stress changes[9],[96],incipient slip[140], strain changes[142],and other temporal contact events.A range of sensors that can detect object shape,size,position,forces,and temperature have been reported in[12]–[14],[143].Few exam-ples of sensors that could detect surface texture[16],[135], hardness or consistency[18],[116],and friction[144]are also described in the literature.Very few examples of sensors that can detect force as well its direction have been reported[4],[145]. Tactile sensors using nearly all modes of transduction namely, resistive/piezoresistive,Tunnel effect,capacitive,optical,ul-trasonic,magnetic,piezoelectric,etc.,have been reported in [4]–[35].The way they work is described in[146],and the rel-ative advantages and disadvantages of some of them are given in[147].Selected examples of robotic tactile sensors based on various transduction methods and the physical/mechanical na-ture are discussed in the following.
A.Tactile Sensors Based on Various Transduction Principle
1)Resistive Sensors:Tactile sensors based on resistive mode of transduction have resistance values depending on a)the contact location and b)the applied force or,in other words,piezoresistance.Resistive touch sensors are generally sensitive and economic but consume lot of power.Their other limitation is that they measure only one contact location.An improved design using parallel analog resistive sensing strips,which is reported in [19],allows measuring many contact points.However,the lack of contact force measurement still remains a critical problem. Piezoresistive touch sensors are made of materials whose resistance changes with force/pressure.The touch sensing system using this mode has been used in anthropomorphic hands[10].Piezoresistive tactile sensing is particularly popular among microelectromechanical systems(MEMS)and silicon (Si)-based tactile sensors[20],[21].The force-sensing resistor (FSR),which is widely used in pointing and position sensing devices such as joysticks,are also based on piezoresistive sens-ing technology.Commercially available from Interlink[22], they have been used in many experimental tactile systems and advanced robotic hands[148],[149].FSRs are appealing, because of low cost,good sensitivity,low noise,and simple electronics.However,the requirement of serial or manual assembly,relatively stiff backing,nonlinear response,and large hysteresis are some of the drawbacks of FSRs.
2)Tunnel Effect Tactile Sensors:Tactile sensors based on quantum tunnel composites(QTC)have come up recently.Com-mercially available from Peratech[150],QTC has the unique capability of transforming from a virtually perfect insulator to a metal like conductor when deformed by compressing,twisting, or stretching.In QTC,the metal particles never come into con-tact;instead,they get so close that quantum tunneling(of elec-trons)takes place between the metal particles.Robotic hands with QTC-based taxels have been reported in[151]and[152].
A highly sensitive sensor based on electron tunneling principle is also reported in[16].The device directly converts stress into electroluminescent light and modulates local current density—both being linearly proportional to local stress.With thinfilm, having metal and semiconducting nanoparticles,the sensor is 2.5cm2in size and attains a spatial resolution of40µm—far better than that of humanfingertips.However,using charge-coupled device(CCD)camera,in current form,adds to the sensor size and makes its integration difficult on the robot.
3)Capacitive Sensor:Capacitive taxels have been widely used in robotics[6],[9],[23].They can be made very small—which allows the construction of dense sensor arrays.An array of capacitive sensors which couples to the object by means of little brushes offibers is reported in[9].The sensor elements on the array are reportedly very sensitive(with a threshold of about 5mN)and robust enough to withstand forces during grasping. An8×8capacitive tactile sensing array with1mm2area and spatial resolution at least ten times better than humans is reported in[6].Capacitive sensing is also popular among the tactile sen-sors based on MEMS and Si micromachining[4],[6],[7],[9]. Commercially available touch sensors such as“RoboTouch”and“DigiTacts”from pressure profile systems[153]and“iPod-touch”[154]are all based on capacitive technology.Availabil-ity of commercial“capacitance to digital convertor”chip like “AD7147:CapTouch”from Analog Devices[155]has made it easier to design thin and reliable contemporary touch controls for sensors that use capacitive technology.The utility of sucha chip in getting the digitized data corresponding to change in capacitance at the contact point has been demonstrated in[156]. Touch sensors based on capacitive mode of transduction are very sensitive,but stray capacity and severe hysteresis are ma-jor drawbacks.
4)Optical Sensors:Tactile sensors with optical mode of transduction use the change in light intensity,at media of differ-ent refractive indices,to measure the pressure.Opticalfiber-based taxel capable of measuring normal forces is reported in[11].The sensor can measure forces as low as1mN with the spatial resolution of5mm.An optical three axial taxel capable of measuring normal and shear forces is reported in[8].Some cases of large area skin based on LEDs have been reported in[157]and [158]as well.Commercial taxels using optical mode of trans-duction are also available,e.g.,“KINOTEX”[159].Optical-based taxels are immune to electromagnetic interference,are flexible,sensitive,and fast but at times they are bulky.For exam-ple,even after miniaturization,the optical taxel reported in[24] has diameter32mm,length60mm,and a weight of100g.Loss of light by microbending and chirping,which cause distortion in the signal,are some other issues associated with optical sensors.
5)Ultrasonics-Based Sensors:Acoustic ultrasonics is yet another technology used for developing tactile sensors.The microphones,based on ultrasonics,have been used to detect surface noise occurring at the onset of motion and during slip. A2×2tactile array of polyvinylidenefluoride(PVDF),which is described in[160],senses contact events from their ultrasonic emission at the contact point.Here,PVDF polymer is used as re-ceiver to localize the contact point on a silicone rubber-sensing dome.The sensor is reportedly very effective in detecting slip and surface roughness during movement.Another simple and elastic tactile sensor,utilizing acoustic resonance frequency,to detect contact parameters like principal stress,friction,and slip is described in[161]and[162].The resonant frequency of piezo-electric materials changes when they come in contact with the objects having different acoustic impedances[163],[1].This property has been utilized to detect hardness and/or softness[18] and force/pressure[25].Ultrasonic-based taxels have fast dy-namic response and good force resolution.However,many such sensors use materials like lead zirconate titanate(PZT),which are difficult to process in miniaturized circuits.Using piezoelec-tric polymers can greatly simply such difficulties.
6)Magnetism-Based Sensors:Such tactile sensors measure the change influx density as a result of the applied force. Theflux measurement can be made either by Hall-effect de-vice[145],[165]or a magnetoresistive device[26].The taxels based on magnetic principle have a number of advantages that include high sensitivity,good dynamic range,no measurable mechanical hysteresis,a linear response,and physical robust-ness.However,their usage is limited to nonmagnetic mediums.
7)Piezoelectric Sensors:The piezoelectric materials gen-erate charge in proportion to the applied force/pressure.Piezo-electric materials like PZT,PVDF,etc.,are suitable for dynamic tactile sensing.Though quartz and ceramics(e.g.,PZT)have better piezoelectric properties;the polymers such as PVDF are preferred in touch sensors due to their excellent features like flexibility,workability,and chemical stability[101].The use of PVDF for tactile sensing was reported forfirst time in[14],and thereafter,a number of works based on PVDF or its copolymers have been reported in[5],[17],and[28]–[31].Temperature sen-sitivity of piezoelectric materials is a major cause of concern.
B.Sensors Based on different Physical/Mechanical Nature Most of the devices,reported in past,relied on fairly rigid materials for their construction.Perhaps this was the natural choice to start,as rigid systems are simpler and there are fewer variables to control or design.From the studies on human cu-taneous sensing and the physical nature of the tissues and skin, it seems that softer materials may have much to offer.Elastic overlays and compliant contact surfaces are often advocated for their frictional and other properties,even if they exhibit low-passfiltering behavior.After examining a range of mate-rials,with different consistencies,for impact and strain energy dissipation,conformability,hysteresis,etc.it is found that soft surfaces have more desirable characteristics for contact surfaces than hard materials[33].
Softer materials such as rubber,fluids,and powders,are now examined for tactile sensing.Among soft materials,the gels are better than plastic,rubber,sponge,or paste,with powders being the second best.Some commercial touch sensors,like those from Tekscan[179],using pressure sensitive ink or rubber are already available.A number of touch sensors using conductive rubber as transducer have also been reported[180]–[183].However,pres-ence of hysteresis and nonlinearity are some of their drawbacks. Conductive gels have been considered for their remarkable soft-ness showing a20%change in impedance for pressure0–400 kgf/cm2[32].A different use of gels involves electrorheological effects,in which,the application of a strong electricfield across a suitable gel changes it from afluid to a plastic solid.A tactile actuator on this principle together with a matching sensor is reported in[35].A simple touch sensor,using piezoelectric ef-fect exhibited by polyelectrolyte gels and lighting a photo diode array in response to the mechanical deformation,is reported in[34].The fact that human tissues are also composed of elec-trolytic materials with very similar mechanical properties sug-gests intriguing possibilities for new designs of sensingfingers.
V.D ISTRIBUTED T ACTILE S ENSING
Robot’s guidance and force based control has mainly de-pended on intrinsic triaxial or6-D force sensors.They have also been used to get the contact locations both for rigid and soft contacts[184],[185].However,such methods are sensi-tive to the accuracy of force/torque sensor calibration and can provide erroneous information because of unmodeled dynamic forces[147].Further,the compliance and inertia of manipu-lator may also interfere in such cases.Such problems can be reduced by having the sensors close to the contact point.In other words,by equipping robot’s hands with tactile sensing arrays or extrinsic sensors distributed in a specific manner.For safe interaction,it is also desirable to have taxels all over the body.Other complementary strategies for safe interaction are the torque control[186],variable stiffness actuators[187],and soft robotic components[188].Whole-body tactile sensing is also a
TABLE I
T ACTILE S ENSING A RRAYS FOR P ARTS L IKE FINGERTIPS WITH H IGH D ENSITY R ECEPTORS [4]–[9],[117],
[166]–[178]
TABLE II
T ACTILE S ENSING A RRAYS FOR P ARTS L IKE L ARGE A REA S KIN WITH L OW D ENSITY OF R ECEPTORS [10],[11],[156],[157],[180],
[192]–[198]
prerequisite for sensor-based motion planning algorithms [1].Artifacts like occlusion,a typical problem with vision-based devices,can also be avoided by having taxels all over the robot’s body.A number of experiments showing safe human–manipulator interaction (e.g.,ballerina dance with a manipula-tor covered with proximity sensors)have been reported in [1]and [190].Another experiment with a full-body sensing suit,that has electrically conductive flexible fabric based taxels,is described in [191].
Over the years,many tactile sensing arrays or distributed tac-tile sensors schemes have been reported.Some of these works,classified on the basis of spatial resolution,are given in Tables I and II.Table I reports sensors with good spatial resolution (∼1mm)—suitable for high sensor density body sites like fin-gertips.On the other hand,Table II reports sensors with rela-tively poorer spatial resolution—suitable for low-sensor-density body sites like the palm,belly,etc.Based on the manufacturing process,the tactile sensing arrays (both,for fingertips as well
as large area skin)can be grouped in two broad categories:The first involves standard miniaturization techniques,and the sec-ond does not involve them.Miniaturized taxels are generally the MEMS and field effect transistor (FET)-based sensors,re-alized on the rigid (e.g.,Si)or flexible (e.g.,plastic)substrates.The tactile sensing arrays not involving any miniaturization use off-the-shelf components distributed on flexible printed circuit boards (PCB)or embedded into a flexible substrates.Following this classification,some selected works reported in literature are discussed in the following.
A.Distributed Tactile Sensing Without Using Standard Minia-turization Techniques
By covering a manipulator with taxels,their effective usage in motion planning is demonstrated in [192]and [158].Each of the five sensor modules used in [158]and [192]has 16sensor pairs of phototransistors and infrared LED (IRLED).Scanning time
A32-element lightweight,conformable,and scalable large area skin using optical mode of transduction is presented in [157].Each taxel consists of photoreflector covered by urethane foam.The light scattered by urethane foam upon deformation gives the measure of mechanoelectrical transduction.Scan time of each sensor element is0.2ms,and spatial resolution is ap-proximately3cm.A major disadvantage of this method is the large current needed by LEDs(∼50mA per sensing element). Tactile sensors using similar method are also commercially available from KINOTEX[159].Another optical-based3×3 tactile sensing array,using wavelength division multiplexing (WDM)technology to quantify the stimuli,is reported in[11]. In WDM,the shift in wavelength of the returned signal gives a measure of the stimuli.
A stress-component-selective tactile sensing array,based on piezoelectric polymers is presented in[193].This multicom-ponent touch sensing array consists of an assembly of seven elemental subarrays,each consisting of six miniaturized sen-sors,supported by a polyimide sheet and sandwiched between two elastic layers.
Stretchable tactile distributed sensors based on electrical impedance tomography(EIT)—a noninvasive technique used in medical applications—is presented in[199].In this method, a conductive material with electrodes on its boundaries is used as taxel.On injection of current via electrodes,the pressure-sensitive sheet translates the pressure distribution over its sur-face into impedance distribution,which is then measured using EIT.A thin,flexible,and stretchable taxel,which is suitable for movable joints,can be obtained with this method.The reported tactile sensing arrays are capable of detecting stroking,pinch-ing,and grabbing and can be used to detect forces as small as 1N.However,the requirement of continuous current injection (and hence loss of energy)is a major concern that will hin-der effective utility of this approach,especially in the case of autonomous robots that rely on battery power.
A16×3array of taxels,with the wire electrodes stitched into the pressure conductive rubber,is reported in[181].A pitch of3mm has been obtained.The delay between input and output is reported to be1ms.However,it is expected to go up if the time taken by rubber to regain the original shape is also considered.Further,pressure conductive rubbers have nonlinear relation between the applied load and resistance. Conformable sensor patches that can be interconnected to cre-ate a networked structure are presented in[156]and[198].Both the triangular-shaped patches(each with12capacitive touch sensors)reported in[156]and thepressure-sensing element patch reported in[198]have been realized onflexible PCBs.In these works,the transducers and signal conditioning electronics wrap the robot surface and microcontroller units are installed in the inner body.Off-the-shelf components are used for em-bedded electronics.The proposed sensor patch in[156]has low power consumption(∼5W/m2).However,the3–5-mm-thick silicone foam needed in[156]and5-mm-thick elastic sheet used in[198]blurs the tactile information.
B.Tactile Sensing Arrays Involving Standard Miniaturization The tactile sensing arrays involving standard miniaturization can be further categorized as
1)those developed with“MEMS on Si”[172],[177],[196],
[200],[201]and“MEMS on plastic”[195];
2)those with Organic FETs(OFETs)/FETs/thinfilm transis-
tors(TFTs)realized on organic/Si/elastomeric substrates
[5],[178],[180],[181],[202],[203],and tightly coupled
with the transducers.
MEMS-based tactile sensors generally use a capacitive[4], [6],[173],[200],[204],[205]or piezoresistive[172],[177], [206]mode of transduction.While piezoresistive devices offer higher linearity,the capacitive devices are an order of magnitude more sensitive.The early works on piezoresistive and capacitive micromachined sensors,like those presented in[207]and[208], have produced arrays of force sensors using diaphragms or can-tilevers as the sensing elements.MEMS-based tactile sensing array,with taxels connected in a piezoresistive bridge arrange-ment,have been used to detect the shear force[172].MEMS devices realized by Si micromachining are quite sensitive and result in higher spatial resolution.However,inherent fragile and brittle nature of Si limits their utility in practical robotic systems[11]because they cannot withstand the forces/pressure experienced during normal manipulation.Packaging of MEMS-based taxels has also been a challenging issue.A Si-based piezoresistive force sensor that addresses the problems of ro-bust packaging,small size,and overload tolerance is reported in[20].The sensor measures the force applied to a4mm raised dome on the device surface exhibits a linear response,good re-peatability,and low hysteresis and has aflexible and durable packaging.Another drawback of MEMS approach is the diffi-culties involved in realizingflexible tactile sensing arrays on a Si substrate.A novel method of obtaining MEMS-basedflex-ible sensing device is reported in[177].In this work,the Si diaphragm has sensing pixel array on it and a pressure chamber beneath.The diaphragm is swollen like a balloon by the pressur-ized air provided to the chamber through the hole.The stiffness of the diaphragm is thus controlled by the air pressure.This way, contact forces in the range of2.1–17.6gf are measured with air pressure in the range of5–kPa.However,the extra provisions for air supply and its monitoring are quite cumbersome and as such the arrangement is unsuitable for robotics.
Recent technological advances allow us to realize MEMS-based devices on plastic substrates—an alternate way for obtainingflexible MEMS sensors.Multimodal tactile sensor arrays able to measure hardness,thermal conductivity,tem-perature,and thefilm curvature have been realized usingplastic-MEMS[195].The sensing array reported in[195]is an attempt towards measuring contact parameters other than force/pressure.However,like many others,these arrays too suf-fer from the wiring complexity,and the utility is limited by the scalability of the wiring interconnects.
An interesting development in the area of tactile sensing is the concept of“sense and process at same site.”Traces of this concept can be found in technologies like extended gate[203], [209],polymer or organic electronics[180],[195],and thin-film Si circuits(e.g.,TFTs)on foils or elastomeric substrates[203], [210].Besides improving the signal to noise ratio,the approach has potential of reducing the number of wires—a key robotics issue.Though potential use of some of these technologies has been demonstrated in a number of applications likeflexible displays,smart fabrics,etc.,their use in sensitive skin has been limited.Some of these works are discussed in the following.
A32×32element,OFET-based touch-sensing array real-ized onflexible polymer substrate is reported in[180].The taxels,using pressure sensitive rubber as transducer,have a pitch of2.54mm.Response time of each OFET is30ms,and that of pressure sensitive rubber is typically of the order of hundreds of milliseconds.Thus,taxels do not respond to the higher frequency signals.Replacing pressure-sensitive rubber on OFET with polymers like PVDF can improve the trans-ducer related performance.However,the overall response time and the pitch will still be quite high with respect to those ob-tained from standard IC technology based devices.The large time response of OFETs is due to inherently low charge-carrier mobility—best organics have a mobility of about1cm2/(V·s) versus85cm2/(V·s)for MOS technology[210].If such an ar-ray is thus placed on thefingertips,then both high pitch and the requirement of fast response would limit the number of tax-els on the array.However,features like physicalflexibility and lower fabrication cost make them good candidates for large-area skin[211],[212].This is also true in view of the fact that spatiotemporal requirements can be somewhat relaxed for body parts other thanfingertips.
Piezoelectric polymers are also widely used due to their high sensitivity and availability in form of thinfilms of var-ious thicknesses.A tactile sensing array(9200×7900µm2), with symmetrical8×8matrix of electrodes(400×400µm2 each),epoxy adhered with a40-µm PVDFfilm is reported in[5] and[209].The method is essentially an extended gate approach, similar to one reported in[167],[213],and[214],where elec-trodes are directly coupled to the gate of MOSFET amplifiers (ON or OFF the chip having electrodes).The spatial resolution of these arrays is less than1mm,the taxels have linear re-sponse for loads spanning0.8–135gf(0.008–1.35N),and the response bandwidth of25Hz is reported.These sensing arrays also possessed minimal on-chip processing circuitry—single MOS transistor with each transducer—and used an external electronic multiplexer to scan the array in less than50ms.The problem of response stability and reproducibility,which is tra-ditionally associated with piezoelectric-based tactile sensors,is taken care by a precharge bias technique[28],which involves initializing the sensors before each cycle.Using a similar ap-proach,32-element tactile sensing arrays,epoxy-adhered with 25-,50-,and100-µm piezoelectric polymerfilm(PVDF-TrFE), are reported in[178].The arrays reportedly have1mm spatial resolution,and the taxels have been tested for dynamic forces up to5N in the frequency range of2–5000Hz.The capability of tactile arrays to identify objects based on their hardness also has been demonstrated.
The extended gate approach brings the sensor and analog front-end closer,and hence,overall response is better than a conventional approach,in which the sensor and analog sensors front-end are separated by some distance.However,the ex-tended gates also introduce a large substrate capacitance,which in turn,significantly attenuates the charge/voltage generated by the sensor and increases the propagation delay[1].In this context,the tactile sensing arrays using an advanced piezoelec-tric oxide semiconductorfield-effect transistor(POSFET)tech-nology are expected to be better.In POSFET-based approach, piezoelectric polymer is directly deposited on the gate of MOS devices[215],[216].
Like MEMS on Si,the lack of physicalflexibility is a ma-jor disadvantage of tactile sensing arrays realized on Si,using standard IC technology.Due to this reason,the touch sensing arrays presented in[178],[1],and[209]are more suitable forfingertips.However,they can also be used like skin over larger area by making a conformable electronics surface with a soft and compliant polymer substrate,having mechanically integrated but otherwise distinct and stiff sub circuit islands of sensors connected to each other byflexible and stretchable metal interconnects.Other possible trade off could be the introduction of mechanical compliance by covering the chip with an elas-tic layer of silicone.Low thermal conductivity of such elastic materials also reduces the noise(if any)introduced by ambient temperature variations.However,a careful study is needed as such materials suffer from creep,hysteresis,and,in practice, work as low passfilters[182],[217].In addition,the presence of elastic layers aggravates the inversion problem by offering more than one solution during the process of regenerating the stress distribution at the contact area.
Advances in Si-based thin-film technology makes it possible to fabricate lightweight,stretchable,and foldable integrated cir-cuits from rigid semiconductor wafers with performance equal to established technologies[202],[210].CMOS inverters and ring oscillators with such properties have been fabricated by integrating inorganic electronic materials,including aligned ar-rays of nanoribbons of single crystalline Si with ultrathin plastic (polyimide)and elastomeric[Polydimethyl siloxane(PDMS)] substrate[202].Thefirst elastic and stretchable transistor cir-cuit,an inverter prepared by mounting TFTs made on polyimide foil islands,on elastomeric substrates and configured with pat-terns of stretchable metallization,is reported in[203].These implementations demonstrate the feasibility of fabricating high performance,elastic,stretchable,and foldable Si active circuits on electronic skin.With transducers like piezoelectric poly-mers,such active circuits can offer many interesting solutions, like distributed computing,for the sensitive skin.
Circuits using OTFTs[180]areflexible and conformable but are not known to fold or stretch like those based on Si[202].In terms of performance,OTFTs and other
nontransistor-based[157]tactile sensing arrays are inferior to their Si-transistor-based counterparts.However,they are bet-ter placed in terms of fabrication cost.While some real-time robotic applications may require high performing(e.g.,faster taxel response as well as reading the tactile data in a time lesser than update rate of controllers)taxels,for others,the perfor-mance may not be the real issue.Different technologies have their respective advantages and disadvantages in terms of fabri-cation cost,performance,physical,and mechanical properties, etc.There is no unique technology that can meet all requirements of whole body skin and a combination of different technologies should be pursued.A kind of merge,with elements from various sensing technologies integrated in a single electronic skin,will be an interesting development.
VI.T ACTILE S ENSING S YSTEM—I SSUES AND D ISCUSSION Tactile sensing,which is limited tofingertips and hands until the last decade or so,has been extended to the whole body,as is evident from the increasing number of tactile sensing arrays that are reportedly more suitable for whole body skin.In this transition fromfingertips to whole body,many unsolved issues have been left behind.While good strides have been made in robotic hand design[39],[152],[218],in reality,the tactile sensory information required even for dexterous manipulation lags behind the mechanical capability of the hands.
Despite innovative designs,a large number of taxels have been rendered“bench top,”as the emphasis has been on the sensors, and the system has largely been ignored.This is evident from Tables I and II,which show only few tactile sensing arrays with any kind of electronic circuitry on chip with sensors[5],[166], [167],[169],[170],[172],[173],[175],[177],[209].Those hav-ing any,possess circuitry with minimal complexity,e.g.,a single MOS transistor associated with each transducer[172],[209]. Very few tactile sensing arrays with mixed mode(analog and digital)implementation have been reported[166],[169],[170]. The design of taxels andfinally their integration on the robot is a result of many tradeoffs.Instead of inventing“yet another touch sensor,”one should aim for the tactile sensing system. While new tactile sensing arrays are designed to beflexible, conformable,and stretchable,very few mention system con-straints like those posed by other sensors,by the robot con-troller,and by other system aspects like embedded electronics, distributed computing,networking,wiring,power consumption, robustness,manufacturability,and maintainability.Such issues are important for effective integration and usage of the taxels on a robotic system.While some of these issues have been dis-cussed in[157],[1],[190],[194],[219],and[220],others arising out of existing hardware and software,especially in case of humanoid robots,are discussed here.
A general hierarchical functional and structural block dia-gram of a tactile sensing system is shown in Fig.4.The complex tactile sensing process has been systematically divided into sub-processes,which helps in designing different parts to a desired level of complexity.The levels from bottom-to-top depict the sensing,perception,and,ultimately,action.The arrows from bottom-to-top showflow of contact information and from
top-Fig.4.Hierarchical functional and structural block diagram of robotic tactile sensing system[219].
to-bottom shows the addressing of various sensors.Addressing of taxels is helpful in experiments such as the study of the cog-nitive behavior of a robot when“attention”is paid to a particular body site.Theflow of signals in the functional block diagram is somewhat similar to that of human tactile sensing system.The system constraints,at various levels of Fig.4,are discussed in the following paragraphs of this section.
Transduction of contact data constitutes the lowest level of the tactile sensing system shown in Fig.4.It involves measurements like magnitude and direction of forces,distribution of force in space,stress and stress rate,temperature,etc.An accurate re-construction of contact details requires a sufficient number of sensing elements within the available space,which places a constraint on the choice of the transduction method.Measuring multiple contact parameters may require simultaneous use of more than one mode of transduction.For example,both stress and stress rate can be measured with a sensor that is a combina-tion of capacitive/resistive and piezoelectric transduction.The choice of transduction method is also important in terms of time response.A poor choice of a transduction medium can result in a sluggish response of the tactile sensing arrays,as in[166] and[180]—where the need to use piezoelectric materials is felt to improve the response time.Existing sensors,e.g.,joint force/torque sensor,vision sensor,etc.,and the update rate of thecontroller on the robot may also set the limits of time response. The transduction method also places a constraint on the number of sensors that can be used in an array.For example,the pressure conductive rubber used in[180]has a time response of the order of few hundreds of milliseconds and OFETs have a response time of30ms.With an active matrix and scanning of one word line at a time adopted in[180],an array with16×16sensing elements can be scanned in480ms,which is comparable to the response time of the transducer,and hence,16×16is the upper limit of the elements in the array.Power requirements also influ-ence the choice of transduction method.Ideally,the transducer should not consume any power.Consumption of large amount of power,as in optical transduction-based sensing arrays reported in[157],is definitely a cause of concern when using such arrays on an autonomous robot that relies on battery power.
The need for a suitable signal conditioning circuitry,to pro-cess the analog data,has always been felt.The right choice of transduction method and conditioning circuit is important as they set the bandwidth limits of the data accessed by the higher levels of the tactile sensing system.Barring capacitive touch sensors,for which small A/D convertor chips are commercially available,e.g.,AD7147[155],dedicated A/D convertors chips are not available for tactile sensors using other transduction modes.The analog sensor front end and digital core(see Fig.4) needed to process and digitize the analog data are essential parts of the tactile sensing system.Design of these components greatly depend on the chosen transduction method.Processing the large amount of data from distributed taxels has oftenfigured among the major reasons for neglecting tactile sensing vis-a-vis other sense modalities[36].In humans,as discussed earlier,the brain does not receive the raw contact data from receptors;in-stead,part of it is processed at receptor level—indicating the presence of“sense and process at same site”scheme.In a simi-lar manner,the analog sensor front end and digital core can be designed to perform some low-level computations like simple scaling,segregation of data from different kind of touch sensors, (e.g.,force,temperature,etc.),linearization,compensation(like temperature compensation,if sensor performance changes with temperature),compressing of information,slip detection,and texture recognition,etc.Such distributed computing architec-ture would reduce the amount of data and help in optimum usage of the limited throughput of robot’s processing unit.This will free the“robot’s brain”for more intelligent works.Other-wise,it allows scaling up the system to practically any number of sensors.A system on chip(SoC)or system in package(SiP) would be ideal in such a case.Besides improving the perfor-mance,the SoC/SiP approach can also help in reducing the number of wires.It will also result in a tactile analog of CMOS optical arrays/imagers.CMOS imagers have played a signifi-cant role in bringing vision sensing to satisfactory levels,and the same can be expected for tactile sensing.While the SoC/SiP approach has benefited closely related application domains like smart fabric[221]and smart vision[222],it is surprising that robotic tactile sensing has largely remained untouched.
The amount of wires needed to read and transmit the data from a large number of taxels is another key issue.The number of wires has some inverse relation with dexterity and some direct relation with the time needed to scan a set of taxels or array.Fewer wires call for the serial access of data,which is slower than parallel access—that requires a large number of wires.If the real-time contact profile or image is of interest, then serial data access may fail to produce a“snap-shot”of the image,and the image may be distorted—if the real time contact conditions change faster than the scan rate.Reading dynamic contact events is also difficult if the transducers have fast decay time,as in piezoelectric transducers.Novel techniques like using local memory,as in“active pixel”of CMOS visual imagers [223],can help in improving the scan rate while reading the data serially.The amount of improvement in the scan time can be gauged from the fact that with“active taxels”—analogous of active pixel—an array of16×16sensing elements in[180] could be read in480ms(reading one word per line with30ms for each row),which can otherwise be as high as7.68s,when read serially one after another.The read-out time of other sensors in the control loop and the update rate of the controller may also be used to set the limits to read a set of taxels.
The transmission of tactile data is normally done with serial buses.The desired operation speed,noise,and number of wires put a constraint on the type of communication channel used to interact with higher levels.The buses using a controller area network(CAN)protocol are generally preferred due to better real-time capabilities,high reliability,and availability on most microcontrollers.However,CAN buses have moderate trans-mission bandwidth(up to1Mb/s),which either results in slow transmission of large tactile data or puts a cap on the number of taxels.Alternate solutions include using buses with higher trans-mission bandwidth(e.g.,FlexRay with up to10Mb/s[224]) or more buses in parallel—which is undesirable.Transmission issues can be reduced by judiciously placing the sensors and re-stricting their number without compromising the kind of tactile information they record[225].
Wireless data transmission would be an ideal solution to the wiring complexity.It will also make it easy to use stretchable andflexible touch sensing arrays,which otherwise requireflex-ible and stretchable interconnects.Although some progress has been made onflexible interconnects,like goldfilm conductors on nanopatterned elastomeric substrate[226],it is still insuffi-cient for large area sensing applications like whole body skin. Very few works using wireless communication for touch sens-ing have been reported in[227]and[228].On theflip side,the interference among large number of closely placed taxels and large amount of power are issues with wireless transmission.
A wireless power transmission,as inflexible wireless power transmission sheets[229],may prove to be handy.Despite all technological advances in wireless communication,the safety issues,when robots and humans work alongside each other,pose a big hindrance and question its reliability over the wired data transfer.Connection schemes like net structured taxels[183] provide alternative solutions to wiring complexity.
Data selection is another way of reducing or optimally using the tactile data.Data from all taxels may not be useful,and hence,redundant data should be rejected.For example,a grasp may not involve all thefingers,and hence,the data obtained from thefingers other than those involved in the grasp can berejected.As shown in Fig.4,data selection can be performed somewhere between the lower hardware intensive functional levels and the upper computational intensive levels.
To construct the world model,the data from different sensory modalities needs to be integrated,as is done in humans[105]. In humanoids the data could come from touch,vision,or audio sensors or a combination of any of these[230]–[232].Correct integration of the signals from different sensors is important for perception—which calls for compatibility among the sens-ing hardware.As mentioned earlier,efficient vision,audio,and intrinsic force sensors are commercially available.Thus,as-suming theirfixed configuration,a compatibility constraint is placed on tactile sensors.In general,transducer materials suffer from fatigue,which results in a changed response over a period of time.Such variations result in calibration issues which can be mathematicallyfixed,using suitable algorithms,at the high-est computational intensive levels of Fig.4.This way,the life of the sensors can also be increased.For a reliable control of complex tasks,parameters like sensor density,resolution,and location are particularly important,and thus,low levels must be designed keeping these in mind.
Besides these,the manufacturing of reliable,economic,and flexible tactile system having compact wiring etc.are other technological issues.A modular approach[157],[1],[194]—with components like transducers,read out,analog sensors front end,and digital core in each module—can be an economical and reliable solution.Maintenance is also easier with a modular approach,as only malfunctioning modules need replacement. Due to variability in functional and spatiotemporal requirements of various body sites,location specific modules can be useful—though components like communication interface can be similar, to contain the overall cost.
VII.C ONCLUSION
A number of studies have been described,showing how tac-tile signals are used by the brain to explore,perceive,and learn the objects that eventually help in manipulation and control.The ways in which biological systems process sensory information to control behavior may not always lead to the best engineering solutions for robots;nevertheless,they provide useful insights into how behaving organisms respond to dynamically changing environments and also provide a comprehensive multilevel con-ceptual framework within which to organize the overall task of designing the sensors for robotic systems.Hence,some design cues—inspired from human tactile sensing system—have been presented and used as desiderata for the robotic tactile sensors, for arrays,and more generally to build an electronic skin.A number of technologies and transduction principles that have been used for the development of tactile sensing for robots have been presented.It is felt that despite experimenting with a broad spectrum of transduction technologies and innovative designs, tactile sensing has not made much headway.This could be due to the lack of a system approach and a mix of technological difficul-ties.The technology often does not scale up to complete systems (multichannel,distributed,flexible,resilient),and consequently, the realization of a full-blown skin is not even considered.While mechanicallyflexible,conformable,and stretchable taxels and sensing arrays are in vogue,the emphasis has still remained on the sensor development rather than on the system development. System aspects like embedding electronics,distributed comput-ing power,networking,wiring,power consumption,robustness, manufacturability,and maintainability also need attention.In particular,wiring remains a key issue.The absence of any tac-tile analog to the CMOS optical array has often been felt as one of reasons for the slow development of tactile sensing vis-a-vis other sense modalities[147].A successful implementation of tactile sensors arrays with promising approaches like“sense and process at same site”and SoC/SiP can possibly provide a tactile analog of CMOS optical arrays.
Overall system performance is dictated not only by the iso-lated quality of the individual system elements but also by the way they integrate.In the words of Aristotle,“the whole is more than some of its parts.”Taking into account various sys-tem constraints while designing the tactile sensing devices can be very useful in theirfinal integration with a robot.This re-quires understanding of the sensor system architecture at var-ious levels—right from sensing the external stimulus until the action as a result of the stimulus.Much work needs to be done at the system level before artificial touch can be used in a real-world environment.Inclusion of signals from tactile arrays in the control loop of a robot will help in exploring deeper issues involved in exploration,manipulation,and control.This will serve as a basis for the development of practical and economic tactile-sensing systems in the future.An effective inclusion of touch sensors on touch-sense-impoverished robots will not only advance research in robotics but will also help understand the human interaction with the environment.
R EFERENCES
[1]W.Gates,“A robot in every home,”Scientific Amer.Rep.,vol.18,no.1,
pp.4–11,2008.
[2]G.Westling and R.S.Johannson,“Factors influencing the force control
during precision grip,”Exp.Brain Res.,vol.53,pp.277–284,1984. [3]J.B.F.V.Erp and H.A.H.C.V.Veen,“Touch down:The effect of
artificial touch cues on orientation in mircogravity,”Neurosci.Lett., vol.404,pp.78–82,2006.
[4]Z.Chu,P.M.Sarro,and S.Middelhoek,“Silicon three-axial tactile
sensor,”Sens.Actuators A,vol.54,pp.505–510,1996.
[5] E.S.Kolesar,C.S.Dyson,R.R.Reston,R.C.Fitch,D.G.Ford,and
S.D.Nelms,“Tactile integrated circuit sensor realized with a piezo-electric polymer,”in Proc.8th IEEE Int.Conf.Innovative Syst.Silicon, Austin,TX,1996,pp.372–381.
[6] B.L.Gray and R.S.Fearing,“A surface micromachined microtactile
sensor array,”in Proc.Int.Conf.Robot.Automat.,Minneapolis,MN, 1996,vol.1,pp.1–6.
[7]R.J.D.Souza and K.D.Wise,“A very high density bulk micromachined
capacitive tactile imager,”in Proc.Int.Conf.Solid-State Sens.Actuators, Transducers,Chicago,IL,1997,pp.1473–1476.
[8]M.Ohka,H.Kobayashi,J.Takata,and Y.Mitsuya,“Sensing precision of
an optical three-axis tactile sensor for a roboticfinger,”in Proc.15th Int.
Symp.Robot Human Interactive Commun.“RO-MAN,”Hatfield,U.K., 2006,pp.214–219.
[9]P.A.Schmidt,E.Mael,and R.P.Wurtz,“A sensor for dynamic tac-
tile information with applications in human-robot interaction&object exploration,”Robot.Autonomous Syst.,vol.54,pp.1005–1014,2006.
[10]K.Weiss and H.Worn,“Tactile sensor system for an anthropomorphic
robotic hand,”in Proc.IEEE Int.Conf.Manipulation Grasping,Genoa, Italy,2004,pp.1–6.
[11]J.-S.Heo,J.-H.Chung,and J.-J.Lee,“Tactile sensor arrays usingfiber
bragg grating,”Sens.Actuators A,vol.126,pp.312–327,2006.[12]R.D.Howe,“Tactile sensing and control of robotic manipulation,”J.
Adv.Robot.,vol.8,no.3,pp.245–261,1994.
[13]M.H.Lee and H.R.Nicholls,“Tactile sensing for mechatronics—a state
of the art survey,”Mechatron.,vol.9,pp.1–31,1999.
[14]P.Dario and D.de Rossi,“Tactile sensors and gripping challenge,”IEEE
Spectrum,vol.22,no.8,pp.46–52,Aug.1985.
[15]J.Dargahi and S.Najarian,“Human tactile perception as a standard for
artificial tactile sensing—A review,”Int.J.Med.Robot.Comput.Assist.
Surg.,vol.1,no.1,pp.23–35,2004.
[16]V.Maheshwari and R.F.Saraf,“High-resolution thin-film device to sense
texture by touch,”Science,vol.312,pp.1501–1504,2006.
[17]J.Yuji and C.Sonoda,“A PVDF tactile sensor for static contact force and
contact temperature,”in Proc.IEEE Sens.,Korea,2006,pp.738–741.
[18]S.Omata,Y.Murayama,and C.E.Constantinou,“Real time robotic tac-
tile system for development of the physical properties of biomaterials,”
Sens.Actuators A,vol.112,pp.278–285,2004.
[19]H.Zhang and E.So,“Hybrid resitive tactile sensing,”IEEE Trans.Syst.,
Man,Cybern.B,vol.32,no.1,pp.57–65,Feb.2002.
[20] D.J.Beebe,A.S.Hsieh,D.D.Denton,and R.G.Radwin,“A silicon
force sensor for robotics and medicine,”Sens.Actuators A,vol.50, pp.55–65,1995.
[21]M.R.Wolffenbuttel and P.P.L.Regtien,“Polysilicon bridges for the
realization of tactile sensors,”Sens.Actuators A,vol.A26,no.1–3, pp.257–2,1991.
[22]FSR Sensors.(2008).[Online].Available:http://www.
interlinkelectronics.com/force_sensors/technologies/fsr.html
[23]S.Miyazaki and A.Ishida,“Capacitive transducer for continuous mea-
surement of vertical foot force,”Med.Biol.Eng.Comput.,vol.22, pp.309–316,1984.
[24]H.Maekawa,K.Tanie,K.Komoriya,M.Kaneko,C.Horiguchi,and
T.Sugawara,“Development of afinger-shaped tactile sensor and its evaluation by active touch,”in Proc.IEEE Int.Conf.Robot.Autom.,vol.
2,Nice,France,1992,pp.1327–1334.
[25]G.M.Krishna and K.Rajanna,“Tactile sensor based on piezoelectric
resonance,”IEEE Sens.J.,vol.4,no.5,pp.691–697,Oct.2004. [26]T.J.Nelson,R.B.V.Dover,S.Jin,S.Hackwood,and G.Beni,“Shear-
sensitive magnetoresistive robotic tactile sensor,”IEEE Trans.Magn., vol.MAG-22,no.5,pp.394–396,Mar.1986.
[27]W.C.Nowlin,“Experimental results on bayesian algorithms for inter-
preting compliant tactile sensing data,”in Proc.IEEE Int.Conf.Robot.
Autom.,CA,1991,vol.1,pp.378–383.
[28] E.S.Kolesar,R.R.Reston,D.G.Ford,and R.C.Fitch,“Multiplexed
piezoelectric polymer tactile sensor,”J.Robot.Syst.,vol.9,no.1, pp.37–63,1992.
[29]J.Dargahi,M.Parameswaran,and S.Payandeh,“A micromachined
piezoelectric tactile sensor for an endoscopic grasper—theory,fabrica-tion and experiments,”J.Microelectromech.Syst.,vol.9,no.3,pp.329–335,2000.
[30]Y.Yamada,T.Maeno,I.Fujimoto,T.Morizono,and Y.Umetani,“Iden-
tification of incipient slip phenomena based on the circuit output signals of PVDFfilm strips embedded in artificialfinger ridges,”in Proc.SICE Annu.Conf.,2002,pp.3272–3277.
[31] B.Choi,H.R.Choi,and S.Kang,“Development of tactile sensor for
detecting contact force and slip,”in Proc.IEEE/RSJ Int.Conf.Intell.
Robots Syst.,2005,pp.2638–23.
[32]R.Kageyama,S.Kagami,M.Inaba,and H.Inoue,“Development of soft
and distributed tactile sensors and the application to a humanoid robot,”
in Proc.IEEE Int.Conf.Syst.,Man,Cybern.,1999,vol.2,pp.981–986.
[33]K.B.Shimoga and A.A.Goldenberg,“Soft materials for robotfingers,”
in Proc.IEEE Int.Conf.Robot.Autom.,Nice,France,1992,pp.1300–1305.
[34]K.Sawahata,J.P.Gong,and Y.Osada,“Soft and wet touch-sensing
system made of hydrogel,”Macromolecular Rapid Commun.,vol.16, pp.713–716,1995.
[35]R.M.V oyles,G.Fedder,and P.K.Khosla,“Design of a modular tactile
sensor and actuator based on an electrorheological gel,”in Proc.IEEE Int.Conf.Robot.Autom.,vol.1,Minneapolis,MN,1996,pp.13–17. [36]M.H.Lee,“Tactile sensing:New directions,new challenges,”Int.J.
Robot.Res.,vol.19,no.7,pp.636–3,2000.
[37]T.D.Crouch,Wings:A History of Aviation From Kites to the Space Age.
New York:Norton,2003.
[38]R.Pfeifer,M.Lungarella,and F.Lida,“Self-organization,embodiment,
and biologically inspired robotics,”Science,vol.318,pp.1088–1093, 2007.[39]G.Bekey,Autonomous Robots:From Biological Inspiration to Imple-
mentation and Control.Cambridge,MA:MIT Press,2005.
[40]R.A.Brooks,“New approaches to robotics,”Science,vol.253,pp.1227–
1232,1991.
[41]J.M.Loomis and S.J.Lederman,“Cognitive processes performances,”
in Tactual Perceptio(vol.2,Handbook of Perception and Human Perfor-mances Series).New York:Wiley,1986.
[42]M.S.A.Graziano and M.M.Botvinick,“How the brain represents
the body:Insights from neurophysiology and psychology,”in Com-mon Mechanisms in Perception and Action:Attention and Performance, W.Prinz and B.Hommel,Eds.London,U.K.:Oxford Univ.Press, 2002,pp.136–157.
[43]R.L.Klatzky and S.J.Lederman,“Touch,”in Experimental Psychology
(Handbook of Psychology Series),A.F.Healy and R.W.Proctor,Eds.
New York:Wiley,2003,vol.4,pp.147–176.
[44] F.J.Clark and K.W.Horch,“Kinesthesia,”in Handbook of Percep-
tion and Human Performance,vol.1,R.B.Kenneth,L.Kaufman,and J.P.Thomas,Eds.New York:Wiley,1986,pp.1–62.
[45] B.V.Jayawant,“Tactile sensing in robotics,”J.Phys.E:Sci.Instrum.,
vol.22,pp.684–692,19.
[46]R.M.Crowder.(1998).“Automation and robotics,”[Online].Available:
http://www.soton.ac.uk/∼rmc1/robotics/artactile.htm
[47]R.S.Johannson and J.R.Flanagan,“Coding and use of tactile signals
from thefingertips in object manipulation tasks,”Nature Rev.Neurosci., vol.Advance Online Publication,pp.1–15,2009.
[48]R.S.Johannson and I.Birznieks,“First spikes in ensembles of human
tactile afferents code complex spatialfingertip events,”Nature Neurosci., vol.7,no.2,pp.170–177,2004.
[49]I.Birznieks,P.Jenmalm,A.W.Goodwin,and R.S.Johannson,“En-
coding of direction offingertip forces by human tactile afferents,”J.
Neurosci.,vol.21,no.20,pp.8222–8237,2001.
[50]J.M.Wolfe,K.R.Kluender,D.M.Levi,L.M.Bartoshuk,R.S.
Herz,R.L.Klatzky,and S.J.Lederman,Sensation and Perception.
Sunderland,MA:Sinauer,2006.
[51] E.R.Kandel,J.H.Schwartz,and T.M.Jessell,Principles of Neural
Science,4th ed.New York:McGraw-Hill Medical,2000.
[52]R.S.Johansson and G.Westling,“Roles of glabrous skin receptors and
sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects,”Exp.Brain Res.,vol.56,pp.550–5, 1984.
[53]R.S.Johannson and A.B.Vallbo,“Tactile sensibility in the human hand:
Relative and absolute densities of four types of mechanoreceptive units in glabrous skin,”J.Physio.,vol.286,pp.283–300,1979.
[54]J.B.Fallon and D.L.Morgan,“Fully tuneable stochastic resonance in
cutaneous receptors,”J.Neurophsio.,vol.94,pp.928–933,2005. [55]H.Athenstaedt,H.Claussen,and D.Schaper,“Epidermis of human skin:
pyroelectric and piezoelectric sensor layer,”Science,vol.216,pp.1018–1020,1982.
[56] D.De Rossi and C.Domenici,“Piezoelectric properties of dry human
skin,”IEEE Trans.Electr.Insul.,vol.EI-21,no.3,pp.511–517,Jun.
1986.
[57]J.R.Phillips and K.O.Johnson,“Tactile spatial resolution iii—A
continuum mechacnics model of skin predicting mechanoreceptors re-sponses to bars,edges,and gratings,”J.Neurophsiol.,vol.46,no.6, pp.1204–1225,1981.
[58]R.S.Johansson,U.Landstrom,and R.Lundstorm,“Responses of
mechanoreceptors afferent units in the glabrous skin of the human hand to sinusoidal skin displacements,”Brain Res.,vol.244,pp.17–25, 1982.
[59] A.B.Vallbo and R.S.Johansson,“Properties of cutaneous mechanore-
ceptors in the human hand related to touch sensation,”Human Neuro-biol.,vol.3,pp.3–14,1984.
[60] D.Purves,G.J.Augustine,D.Fitzpatrick,W.C.Hall,A.-S.LaMantia,
J.O.McNamara,and L.E.White,Neuroscience,4th ed.Sunderland, MA:Sianuer,2008.
[61]H.Chen,T.J.Lamer,R.H.Rho,K.A.Marshall,B.T.Sitzman,
S.M.Ghazi,and R.P.Brewer,“Contemporary management of neu-ropathic pain for the primary care physician,”Mayo Clin.Proc.,vol.79, no.12,pp.1533–1545,2004.
[62]P.Jenmalm,I.Birznieks,A.W.Goodwin,and R.S.Johannson,“In-
fluence of object shape on responses of human tactile afferents under conditions characteristics of manipulation,”Eur.J.Neurosci.,vol.18, pp.1–176,2003.
[63] A.Berthoz,The Brain’s Sense of Movement.Cambridge,MA/London,
U.K.:Harvard Univ.Press,2000.[] B.E.Stein and M.A.Meredith,The Merging of the Senses.Cambridge,
MA:MIT Press,1993.
[65]H.B.Wasling,U.Norrsell,K.G¨o thner,and H.Olausson,“Tactile di-
rectional sensitivity and postural control,”Exp.Brain Res.,vol.166, pp.147–156,2005.
[66]K.O.Johanson and J.R.Phillips,“Tactile spatial resolution.i.Two-point
discrimination,gap detection,grating resolution,and letter recognition,”
J.Neurophsiol.,vol.46,pp.1177–1192,1981.
[67]J.C.Craig,“Grating orientation as a measure of tactile spatial acuity,”
Somatosens.Motor Res.,vol.16,no.3,pp.197–206,1999.
[68]J.C.Craig and K.B.Lyle,“A comparison of tactile spatial sensitivity on
the palm andfingerpad,”Percept.Phychophys.,vol.63,no.2,pp.337–347,2001.
[69]J.C.Craig and J.M.Kisner,“Factors affecting tactile spatial acuity,”
Somatosens.Motor Res.,vol.15,no.1,pp.29–45,1998.
[70]S.J.Bensmaia,J.C.Craig,and K.O.Johanson,“Temporal factors in tac-
tile spatial acuity:Evidence for ra interference infine spatial processing,”
J.Neurophsiol.,vol.95,pp.1783–1791,2006.
[71]J.B.F.V.Erp,“Vibrotactile spatial acuity on the torso:effect of location
and timing parameters,”in Proc.1st Joint Eurohaptics Conf.Haptic Interfaces Virtual Environ.Teleoperator Sys.,2005,pp.80–85.
[72]S.J.Lederman,“Heightening tactile impressions of surface texture,”in
Active Touch:The Mechanicsm of Recognition of Objects by Manipula-tion.An Interdisciplinary Approach.,G.Gordon,Ed.Oxford,U.K.: Pergamon,1978,pp.205–214.
[73]J.C.Craig and X.Baihua,“Temporal order and tactile patterns,”Percept.
Phychophys.,vol.47,no.1,pp.22–34,1990.
[74]L.A.Jones and S.J.Lederman,“Tactile sensing,”in Human Hand
Function.Cambridge,MA:Oxford Univ.Press,2006,pp.44–74. [75]J.C.Stevens and K.K.Choo,“Temperature sensitivity of the body
surface over the life span,”Somatosens.Motor Res.,vol.15,pp.13–28, 1998.
[76]R.L.Klatzky,S.J.Lederman,and V.A.Metzger,“Identifying objects
by touch:An‘expert system,’”Percept.Psychophys.,vol.37,no.4, pp.299–302,1985.
[77]R.H.LaMotte and M.A.Srinivasan,“Tactile discrimination of shape:
Responses of slowly adapting mechanoreceptive afferents to a step stroked across the monkeyfingerpad,”J.Neurosc.,vol.7,no.6, pp.1655–1671,1987.
[78]R.H.LaMotte and M.A.Srinivasan,“Tactile discrimination of shape:
Responses of rapidly adapting mechanoreceptive afferents to a step stroked across the monkeyfingerpad,”J.Neurosci.,vol.7,no.6, pp.1672–1681,1987.
[79]M.A.Srinivasan,R.H.LaMotte,“Tactile discrimination of shape:Re-
sponses of slowly and rapidly adapting mechanoreceptive afferents to a step indented into the monkeyfingerpad,”J.Neurosci.,vol.7,no.6, pp.1682–1697,1987.
[80] A.W.Goodwin,V.G.Macefield,and J.W.Bisley,“Encoding of object
curvature by tactile afferents from humanfingers,”J.Neurophsiol., vol.78,no.6,pp.2881–2888,1997.
[81]P.S.Khalsa,R.M.Friedman,and M.A.Srinivasan,R.H.LaMotte,
“Encoding of shape and orientation of objects indented into the monkey fingerpad by populations of slowly and rapidly adapting mechanorecep-tors,”J.Neurophsiol.,vol.79,pp.3238–3251,1998.
[82]N.Cauna,“Nature and functions of the papillary ridges of the digital
skin,”Anat.Record,vol.119,pp.449–468,1954.
[83]S.J.Lederman and D.T.Pawluk,“Lessons from the study of biological
touch for robotic tactile sensing,”in Advanced Tactile Sensing for Robots, ser.Robotics and Automated Systems,H.R.Nicholls,Ed.Singapore: World Scientific,1992,vol.5,pp.151–192.
[84]G.J.Gerling and G.W.Thomas,“The effect offingertip mircostructures
on tactile edge perception,”in Proc.First Joint Eurohaptics Conf.Symp.
Haptic Interfaces Virtual Environ.Teleoperator Syst.,2005,pp.63–72.
[85] E.M.Meftah,L.Belingard,and C.E.Chapman,“Relative effects of
the spatial and temporal characteristics of scanned surfaces on human perception of tactile roughness using passive touch,”Exp.Brain Res., vol.132,pp.351–361,2000.
[86] C.J.Cascio and K.Sathian,“Temporal cues contribute to tactile per-
ception of roughness,”J.Neurosci.,vol.21,no.14,pp.52–5296, 2001.
[87]J.Scheibert,S.Leurent,A.Prevost,and G.Debregeas,“The role of
fingerprints in the coding of tactile information probed with a biomimetic sensor,”Science,vol.323,pp.1503–1506,2009.
[88]J.W.Morley,A.W.Goodwin,and I.Darian-Smith,“Tactile discrimina-
tion of gratings,”Exp.Brain Res.,vol.49,pp.291–299,1983.
[]S.J.Lederman,“The perception of surface roughness by active and
passive touch,”Bull.Psychon.Soc.,vol.18,pp.253–255,1981. [90] A.M.Smith,G.Gosselin,and B.Houde,“Deployment offingertip forces
in tactile exploration,”Exp.Brain Res.,vol.147,pp.209–218,2002.
[91] A.M.Smith,C.E.Chapman,M.Deslandes,J.S.Langlais,and M.P.Thi-
bodeau,“Role of friction and tangential force variation in the subjective scaling of tactile roughness,”Exp.Brain Res.,vol.144,pp.211–223, 2002.
[92]K.O.Johnson and S.S.Hsiao,“Neural mechanisms of tactual form and
texture perception,”Annu.Rev.Neurosci.,vol.15,pp.227–250,1992.
[93]M.A.Srinivasan and R.H.LaMotte,“Tactual discrimination of softness,”
J.Neurophsiol.,vol.73,pp.88–101,1995.
[94] F.Binkofski,E.Kunesch,J.Classen,R.J.Seitz,and H.J.Freund,“Tac-
tile apraxia—Unimodal apractic disorder of tactile object recognition associated with parietal lobe lesions,”Brain,vol.124,pp.132–144, 2001.
[95] A.Bodeg˚a rd,A.Ledberg,S.Geyer,E.Naito,K.Zilles,and P.E.Roland,
“Object shape differences reflected by somatosensory cortical activation in human,”J.Neurosci.,vol.20,no.RC51,pp.1–5,2000.
[96]R.D.Howe and M.R.Cutkosky,“Dynamic tactile sensing:Perception
offine surface features with stress rate sensing,”IEEE Trans.Robot.
Autom.,vol.9,no.2,pp.140–151,Apr.1993.
[97]L.A.Jones and E.Piateski,“Contribution of tactile feedback from the
hand to the perception of force,”Exp.Brain Res.,vol.168,pp.298–302, 2006.
[98]S.L.Kilbreath,K.Refshauge,and S.C.Gandevia,“Differential control
of digits in human hand:Evidence from digital anaesthesia and weight matching,”Exp.Brain Res.,vol.117,pp.507–511,1997.
[99] A.S.Augurelle,A.M.Smith,T.Lejeune,and J.L.Thonnard,“Impor-
tance of cutaneous feedback in maintaining a secure grip during manip-ulation of hand-held objects,”J.Neurophsiol.,vol.,pp.665–671, 2003.
[100]G.Cadoret and A.M.Smith,“Friction,not texture,dictates grip forces during object manipulation,”J.Neurophsiol.,vol.75,pp.1963–1969, 1996.
[101]J.R.Flanagan and A.M.Wing,“Modulation of grip force with load force during point-to-point arm movements,”Exp.Brain Res.,vol.95, pp.131–143,1993.
[102] E.Oliver,M.Davare,M.Andres,and L.Fadiga,“Precision grasping in humans:From motor control to cognition,”Curr.Opin.Neurobiol., vol.17,pp.4–8,2007.
[103]M.Gentilucci,I.Toni,E.Daprati,and M.Gangitano,“Tactile input of the hand and the control of reaching to grasp movements,”Exp.Brain Res.,vol.114,pp.130–137,1997.
[104]W.Goebl and C.Palmer,“Tactile feedback and timing accuracy in piano performance,”Exp.Brain Res.,vol.186,pp.471–479,2008. [105]M.O.Ernst and M.S.Banks,“Humans integrate visual and haptic information in a statistically optimal fashion,”Nature,vol.415,pp.429–433,2002.
[106]H.B.Helbig and M.O.Ernst,“Optimal integration of shape information from vision and touch,”Exp.Brain Res.,vol.179,pp.595–606,2007. [107]S.Guest,C.Catmur,D.Lloyd,and C.Spence,“Audiotactile interactions in roughness perception,”Exp.Brain Res.,vol.146,pp.161–171,2002. [108]R.J.V.Beers and D.M.Wolpert,“When feeling is more important than seeing in sensorimotor adaptation,”Curr.Biol.,vol.12,pp.834–837, 2002.
[109] A.M.Gordon,H.Forssberg,R.S.Johansson,and G.Westling,“Integra-tion of sensory information during the programming of precision grip: comments on the contributions of size cues,”Exp.Brain Res.,vol.85, pp.226–229,1991.
[110] A.M.Gordon,H.Forssberg,R.S.Johansson,and G.Westling,“The integration of haptically acquired size information in the programming of precision grip,”Exp.Brain Res.,vol.83,pp.483–488,1991. [111]T.A.Quilliam,“The structure offingerprint skin,”in Active Touch:The Mechanisms of Recognition of Objects by Manipulation,G.Gordon,Ed.
London,U.K.:Pergamon,1978,pp.1–18.
[112]T.Maeno,K.Kobayashi,and N.Yamazaki,“Relationship between the structure of humanfinger tissue and the location of tactile receptors,”
Bull.JSME Int.J.,vol.41,no.1,pp.94–100,1998.
[113]G.J.Gerling and G.W.Thomas,“Fingerprint lines may not directly affect SA I mechanoreceptor response,”Somatosens.Motor Res.,vol.25,no.1, pp.61–76,2008.
[114]K.Dandekar,B.I.Raju,and M.A.Srinivasan,“3-Dfinite-element-models of human and monkeyfingertips to investigate the mechanics of tactile sensing,”J.Biomech.Eng.,vol.125,no.5,pp.682–691,2003.[115] B.V.Jayawant and J.D.M.Watson,“Array sensor for tactile sensing in robotic applications,”in Proc.IEE Colloquium Solid State Smart Sens., London,U.K.,1988,pp.8/1–8/4.
[116]M.Shikida,T.Shimizu,K.Sato,and K.Itoigawa,“Active tactile sensor for detecting contact force and hardness of an object,”Sens.Actuators A,vol.103,pp.213–218,2003.
[117] F.Castelli,“An integrated tactile-thermal robot sensor with capacitive tactile array,”IEEE Trans.Ind.Appl.,vol.38,no.1,pp.85–90,Jan./Feb.
2002.
[118]P.Dario,“Tactile sensing for robots:Present and future,”in Robotics Review1,O.Khatib,J.Craig,and T.Lozano-Perez,Eds.Cambridge, MA:MIT Press,19,pp.133–146.
[119]R.S.Fearing and J.M.Hollerbach,“Basic solid mechanics for tactile sensing,”in Proc.IEEE Int.Conf.Robot.Automat.,1984,vol.1,pp.266–275.
[120]Z.Li,P.Hsu,and S.Sastry,“Grasping and coordinated manipulation by
a multifingered robot hand,”Int.J.Robot.Res.,vol.8,no.4,pp.33–50,
Aug.19.
[121]R.D.Howe and M.R.Cutkosky,“Integrating tactile sensing with control for dextrous manipulation,”in Proc.IEEE Int.Workshop Intell.Motion Control,Istanbul,Turkey,Aug.1990,vol.1,pp.369–374.
[122] A.D.Berger and P.K.Khosla,“Using tactile data for real-time feedback,”
Int.J.Robot.Res.,vol.10,no.2,pp.88–102,1991.
[123]R.S.Fearing,“Tactile sensing mechanisms,”Int.J.Robot.Res.,vol.9, no.3,pp.3–23,1990.
[124] A.Bicchi,J.K.Salisbury,and P.Dario,“Augmentation of grasp ro-bustness using intrinsic tactile sensing,”in Proc.IEEE Int.Conf.Robot.
Autom.,AZ,May19,vol.1,pp.302–307.
[125]M.R.Cutkosky and I.Kao,“Computing and controlling the compliance of a robotic hand,”IEEE Trans.Robot.Autom.,vol.5,no.2,pp.151–165, Apr.19.
[126]R.M.Murray,Z.Li,and S.S.Sastry,A Mathematical Introduction to Robotic Manipulation,1st ed.Boca Raton,FL:CRC,1994. [127] C.Domenici,D.D.Rossi,A.Bicchi,and S.Bennati,“Shear stress de-tection in an elastic layer by a piezoelectric polymer tactile sensor,”
IEEE Trans.Electr.Insulation,vol.24,no.6,pp.1077–1081,Dec.
19.
[128] D.D.Rossi,G.Canepa,G.Magenes,F.Germagnoli,A.Caiti,and T.Parisini,“Skin-like tactile sensor arrays for contact stressfield extrac-tion,”Mater.Sci.Eng.,vol.C1,pp.23–36,1993.
[129]S.L.Ricker and R.E.Ellis,“2-Dfinite element models of tactile sensors,”
in Proc.IEEE Int.Conf.Robot.Autom.,Atlanta,GA,1993,pp.941–947. [130]R.E.Ellis and M.Qin,“Singular-value andfinite-element analysis of tactile shape recognition,”in Proc.IEEE Int.Conf.Robot.Autom.,San Diego,CA,May1994,pp.2529–2535.
[131]J.L.Novak,“Initial design and analysis of a capacitive sensor for shear and normal force measurement,”in Proc.IEEE Int.Conf.Robot.Autom., Scottsdale,AZ,19,pp.137–145.
[132]R.S.Fearing and T.O.Binford,“Using a cylindrical tactile sensor for determining curvature,”IEEE Tran.Robot.Autom.,vol.7,no.6, pp.806–817,Dec.1991.
[133]R.A.Russell and S.Parkinson,“Sensing surface shape by touch,”in Proc.IEEE Int.Conf.Robot.Autom.,Atlanta,GA,1993,pp.423–428. [134]M.Charlebois,K.Gupta,and S.Payandeh,“On estimating local shape using contact sensing,”J.Robot.Syst.,vol.17,no.12,pp.3–658, 2000.
[135]R.M.Crowder,“Toward robots that can sense texture by touch,”Science, vol.312,pp.1478–1479,2006.
[136]R.D.Howe and M.R.Cutkosky,“Sensing skin acceleration for slip and texture perception,”in Proc.IEEE Int.Conf.Robot.Autom.,Scottsdale, AZ,19,pp.145–150.
[137]P.R.Basu,R.A.Russell,and G.Trott,“Extracting3-dimensional surface features from tactile data,”in Proc.Int.Symp.Expo.Robots,Sydney, Australia,1988,pp.908–920.
[138]M.Tremblay and M.R.Cutkosky,“Estimating friction using incipient slip sensing during a manipulation task,”in Proc.IEEE Int.Conf.Robot.
Autom.,Atlanta,GA,1993,pp.429–434.
[139]K.Hosoda,Y.Tada,and M.Asada,“Anthropomorphic robotic softfin-gertip with randomly distributed receptors,”Robot.Auton.Syst.,vol.54, no.2,pp.104–109,2006.
[140] D.Yamada,T.Maeno,and Y.Yamada,“Artificialfinger skin having ridges and distributed tactile sensors used for grasp force control,”J.
Robot.Mechatron.,vol.14,no.2,pp.140–146,2002.
[141]N.Wettels,V.J.Santos,R.S.Johansson,and L.G.E.,“Biomimetic tactile sensor array,”Adv.Robot.,vol.22,pp.829–849,2008.[142]R.Kikuuwe,A.Sano,H.Mochiyama,N.Takesue,and H.Fujimoto,“A tactile sensor capable of mechanical adaptation and its use as a surface deflection detector,”in Proc.IEEE Sens.,2004,pp.256–259. [143]J.Rossiter and T.Mukai,“An led-based tactile sensor for multi-sensing over large areas,”in Proc.IEEE Sens.,Korea,2006,pp.835–838. [144]T.Maeno,T.Kawamura,and S.Cheng,“Friction estimation by pressing an elasticfinger-shaped sensor against a surface,”IEEE Trans.Robot.
Autom.,vol.20,no.2,pp.222–228,Apr.2004.
[145] E.Torres-Jara,I.Vasilescu,and R.Coral,“A soft touch:Compliant tactile sensors for sensitive manipulation,”CSAIL,Mass.Inst.Technol., Cambridge,MA,Tech.Rep.MIT-CSAIL-TR-2006-014,2006. [146]R.A.Russell,Robot Tactile Sensing.Englewood Cliffs,NJ:Prentice-Hall,1990.
[147]M.R.Cutkosky,R.D.Howe,and W.Provancher,“Force and tactile sen-sors,”in Springer Handbook of Robotics. B.Siciliano and O.Khatib, Eds.Berlin/Heidelberg,Germany:Springer-Verlag,2008,pp.455–476.
[148]H.Liu,P.Meusel,and G.Hirzinger,“A tactile sensing system for the DLR three-finger robot hand,”in Proc.Int.Symp.Meas.Control Robot., 1995,pp.91–96.
[149]M.A.Diftler,R.Platt,Jr.,C.J.Culbert,R.O.Ambrose,and W.J.
Bluethmann,“Evolution of the nasa/darpa robonaut control system,”in Proc.IEEE Int.Conf.Robot.Autom.,2003,pp.2543–2548.
[150] D.Bloor,K.Donnelly,P.J.Hands,P.Laughlin,and D.Lussey,“A metal-polymer composite with unusal properties,”J.Phys.D:Appl.Phys., vol.38,no.16,pp.2851–2860,2005.
[151]R.Walker,“Developments in dextrous hands for advanced robotic ap-plications,”presented at the10th Int.Symp.Robot.App.,Spain,2004. [152]Shadow Robot Co.,“Design of a dextrous hand for advanced clawarap-plications,”in Climbing and Walking Robots and the Supporting Tech-nologies for Mobile Machines,pp.691–698(2003).[Online].Available: http://www.shadowrobot.com/
[153]Pressure Profile Systems Inc.,Robotouch—Overview(2007).[Online].
Available:http://www.pressureprofile.com/products-robotouch [154]Apple Inc.,iPod Touch Technology(2009).[Online].Available: http://www.apple.com/ipodtouch/features/technology.html
[155]Analog Devices Inc.,CapTouch Programmable Controller for Single-Electrode Capacitance Sensors—AD7147(2007).[Online].Available: http://www.analog.com/static/imported-files/Data_Sheets/AD7147.pdf [156]M.Maggiali,G.Cannata,P.Maiolino,G.Metta,M.Randazzao,and
G.Sandini,“Embedded tactile sensor modules,”presented at the11th
Mechatron.Forum Biennial Int.Conf.,Limerick,Ireland,2008. [157]Y.Ohmura,Y.Kuniyoshi,and A.Nagakubo,“Conformable and scalable tactile sensor skin for curved surfaces,”in Proc.IEEE Int.Conf.Robot.
Autom.,Orlando,FL,2006,pp.1348–1353.
[158] E.Cheung and V.L.Lumelsky,“A sensitive skin system for motion control of robot arm manipulators,”J.Robot.Auton.Syst.,vol.10, pp.9–32,1992.
[159] E.M.Reimer and L.Danisch,“Pressure sensor based on illumination of
a deformable integrating cavity,”U.S.Patent5917180,1999. [160]S.Ando and H.Shinoda,“Ultrasonic emission tactile sensing,”IEEE Control Syst.Mag.,vol.15,no.1,pp.61–69,Feb.1995.
[161]H.Shinoda,K.Matsumoto,and S.Ando,“Tactile sensing based on acoustic resonance tensor cell,”in Proc.TRANSDUCERS,Int.Conf.
Solid-State Sens.Actuators,1997,pp.129–132.
[162]K.Nakamura and H.Shinoda,“A tactile sensor instantaneously eval-uating friction coefficients,”in Proc.TRANSDUCERS,1997Int.Conf.
Solid-State Sens.Actuators,2001,pp.1430–1433.
[163]R.S.Dahiya,M.Valle,and L.Lorenzelli,“Spice model of lossy piezo-electric polymers,”IEEE Trans.Ultrason.,Ferroelectr.Freq.Control, vol.56,no.2,pp.387–396,Feb.2009.
[1]R.S.Dahiya,M.Valle,G.Metta,and L.Lorenzelli,“POSFET based tactile sensor arrays,”in Proc.IEEE ICECS,14th Int.Conf.Electron., Circuits Syst.,2007,pp.1075–1078.
[165]L.Jamone,G.Metta,F.Nori,and G.Sandini,“James:A humanoid robot acting over an unstructured world,”in Proc.6th IEEE-RAS Int.Conf.
Humanoid Robots,Genoa,Italy,2006,pp.143–150.
[166]M.H.Raibert,“An all digital VLSI tactile array sensor,”in Proc.IEEE Int.Conf.Robot.Autom.,1984,vol.1,pp.314–319.
[167] D.L.Polla,W.T.Chang,R.S.Muller,and R.M.White,“Integrated Zinc oxide on-silicon tactile-sensor array,”in Proc.Int.Elect.Devices Meeting,1985,pp.133–136.
[168]K.Suzuki,K.Najafi,and K.D.Wise,“A1024-element high-performance silicon tactile imager,”in Proc.IEEE Elect.Devices Meeting,1988, pp.674–677.
DAHIY A et al.:TACTILE SENSING—FROM HUMANS TO HUMANOIDS19
[169]S.Sugiyama,K.Kawahata,M.Yoneda,and I.Igarashi,“Tactile image detection using a1K—Element silicon pressure sensor array,”Sens.
Actuators A,vol.A21–A23,pp.397–400,1990.
[170]L.Liu,X.Zheng,and L.Zhijian,“An array tactile sensor with piezore-sistive single-crystal silicon diaphragm,”Sens.Actuators A,vol.35, pp.193–196,1993.
[171]Y.Audet and G.H.Chapman,“Design of a large area magneticfield sensor array,”in Proc.IEEE Int.Conf.Wafer Scale Integr.,San Francisco, CA,1994,pp.272–281.
[172] B.J.Kane,M.R.Cutkosky,and G.T.A.Kovacs,“A traction stress sensor array for use in high-resolution robotic tactile imaging,”J.Mi-croelectromech.Syst.,vol.9,no.4,pp.425–434,2000.
[173]M.Leineweber,G.Pelz,M.Schmidt,H.Kappert,and G.Zimmer,“New tactile sensor chip with silicone rubber cover,”Sens.Actuators A,vol.84, pp.236–245,2000.
[174]G.Hellard and R.A.Russell,“A robust,sensitive and economical tac-tile sensor for a robotic manipulator,”in Proc.Australian Conf.Robot.
Autom.,Auckland,New Zealand,2002,pp.100–104.
[175]Z.Wen,Y.Wu,Z.Zhang,S.Xu,S.Huang,and Y.Li,“Development of an integrated vaccuum microelectronic tactile sensor array,”Sens.
Actuators A,vol.103,pp.301–306,2003.
[176] B.Choi,S.Kang,and H.Choi,“Development offingertip tactile sensor for detecting normal force and slip,”presented at the Int.Conf.Control, Autom.Syst.,Gyeong Gi,Korea,2005.
[177]H.Takao,K.Sawada,and M.Ishida,“Monolithic silicon smart tactile image sensor with integrated strain sensor array on pneumatically swollen single-diaphragm structure,”IEEE Trans.Electron.Devices,vol.53, no.5,pp.1250–1259,May2006.
[178]R.S.Dahiya,M.Valle,and G.Metta,“Development offingertip tac-tile sensing chips for humanoid robots,”in Proc.5th IEEE Int.Conf.
Mechatron.,Malaga,Spain,2009,pp.1–6.
[179]Pressure Sensitive Ink.(2008).[Online].Available:http://www.
tekscan.com/
[180]T.Someya,T.Sekitani,S.Iba,Y.Kato,H.Kawaguchi,and T.Sakurai,“A large-area,flexible pressure sensor matrix with organicfield-effect transistors for artificial skin applications,”Proc.Nat.Acad.Sci.,vol.101, no.27,pp.9966–9970,2004.
[181]M.Shimojo,A.Namiki,M.Ishikawa,R.Makino,and K.Mabuchi,“A tactile sensor sheet using pressure conductive rubber with electrical-wires stitched method,”IEEE Sens.J.,vol.4,no.5,pp.5–596,Oct.
2004.
[182]M.Shimojo,M.Ishikawa,and K.Kanaya,“Aflexible high resolution tactile imager with video signal output,”in Proc.IEEE Int.Conf.Robot.
Autom.,1991,vol.1,pp.384–3.
[183]M.Shimojo,T.Araki,S.Teshigawara,A.Ming,and M.Ishikawa,“A net-structure tactile sensor covering free-form surface and ensuring high-speed response,”in Proc.IEEE/RSJ Int.Conf.Intell.Robots Syst.,2007, vol.1,pp.670–675.
[184]J.K.Salisbury,“Interpretation of contact geometries from force mea-surements,”in Robotics Res.The First Int.Symp.,M.Brady and R.P.Paul,Eds.Cambridge,MA:MIT Press,1984.
[185] A.Bicchi,J.K.Salisbury,and D.L.Brock,“Contact sensing from force and torque measurements,”Int.J.Robot.Res.,vol.12,no.3,pp.249–262,1993.
[186]G.Hirzinger,N.Sporer,M.Schedl,J.Butterfab,and M.Grebenstein,“Torque-controlled lightweight arms and articulated hands:Do we reach technological limits now?,”Int.J.Robot.Res.,vol.23,no.4-5,pp.331–340,2004.
[187] A.Bicchi,G.Tonietti,M.Bavaro,and M.Piccigallo,“Variable stiff-ness actuators for fast and safe motion control,”in Springer Tracts in Adv.Robotics.vol.15/2005.Berlin,Germany:Springer-Verlag,2005, pp.527–536.
[188] A.M.Dollar and R.D.Howe,“A robust compliant grasper via shape deposition manufacturing,”IEEE/ASME Trans.Mechatron.,vol.11, no.2,pp.154–161,Apr.2006.
[1]V.L.Lumelsky,Sensing,Intelligence,Motion:How Robots and Humans Move in an Unstructured World.Hoboken,NJ:Wiley,2006. [190]V.L.Lumelsky,M.S.Shur,and S.Wagner,“Sensitive skin,”IEEE Sens.J.,vol.1,no.1,pp.41–51,Apr.2001.
[191]M.Inaba,Y.Hoshino,K.Nagasaka,T.Ninomiya,S.Kagami,and
H.Inoue,“A full-body tactile sensor suit using electrically conductive
fabric and strings,”in Proc.IEEE/RSJ Int.Conf.Intell.Robots Syst., Osaka,Japan,Nov.1996,pp.450–457.
[192] E.Cheung and V.L.Lumelsky,“Proximity sensing in robot manipula-tor motion planning:System and implementation issues,”IEEE Trans.
Robot.Autom.,vol.5,no.6,pp.740–751,Dec.19.[193] C.Domenici and D.D.Rossi,“A stress-component-selective tactile sensor array,”Sens.Actuators A,vol.31,pp.97–100,1992.
[194] D.Um,B.Stankovic,K.Giles,T.Hammond,and V.L.Lumelsky,“A modularized sensitive skin for motion planning in uncertain environ-ments,”in Proc.IEEE Int.Conf.Robot.Autom.,Leuven,Belgium,1998, pp.7–12.
[195]J.Engel,J.Chen,Z.Fan,and C.Liu,“Polymer micromachined multi-modal tactile sensors,”Sens.Actuators A,vol.117,pp.50–61,2005. [196]J.H.Shan,T.Mei,L.Sun,D.Y.Kong,Z.Y.Zhang,L.Ni,M.Meng,and J.R.Chu,“The design and fabrication of aflexible three-dimensional force sensor skin,”in Proc.IEEE/RSJ Int.Conf.Intell.Robots Syst., 2005,pp.1818–1823.
[197]J.-H.Kim,W.-C.Choi,and H.-J.Kwon,“Development of tactile sen-sor with functions of contact force and thermal sensing for attachment to intelligent robotfinger tip,”in Proc.IEEE Sens.,2006,pp.1468–1472.
[198]T.Mukai,M.Onishi,T.Odashima,S.Hirano,and Z.Luo,“Development of the tactile sensor system of a human-interactive robot‘RI-MAN,’”
IEEE Trans.Robot.,vol.24,no.2,pp.505–512,Apr.2008.
[199]H.Alirezaei,A.Nagakubo,and Y.Kuniyoshi,“A highly stretchable tactile distribution sensor for smooth surfaced humanoids,”in Proc.7th IEEE-RAS Int.Conf.Humanoid Robots,Pittsburgh,PA,2007,pp.167–173.
[200]K.Suzuki,K.Najafi,and K.D.Wise,“A1024-element high-performance silicon tactile imager,”IEEE Trans.Electron.Devices,vol.37,no.8, pp.1852–1860,Aug.1990.
[201]S.Yoshida,T.Mizota,and H.Noma,“Development of an integrated multi-axis tactile sensor:Distributed preprocessing for tactile recogni-tions,”in Proc.IEEE Virtual Reality Conf.,Charlotte,NC,2007,pp.281–282.
[202] D.-H.Kim,J.-H.Ahn,W.M.Choi,H.-S.Kim,T.-H.Kim,J.Song, Y.Y.Huang,Z.Liu, C.Lu,and J. A.Rogers,“Stretchable and foldable silicon integrated circuits,”Science,vol.320,pp.507–511, 2008.
[203]S.P.Lacour,C.Tsay,and S.Wagner,“An elastically stretchable tft circuit,”IEEE Electron.Device Lett.,vol.25,no.12,pp.792–794,Dec.
2004.
[204]H.-K.Lee,S.I.Chang,and E.Yoon,“Aflexible polymer tactile sensor: Fabrication and modular expandability for large area deployment,”J.
Microelectromech.Sys.,vol.15,no.6,pp.1681–1686,2006.
[205]U.Paschen,M.Leineweber,J.Amelung,M.Schmidt,and G.Zimmer,“A novel tactile sensor system for heavy load applications based on an integrated capacitive pressure sensor,”Sens.Actuators A,vol.68, pp.294–298,1998.
[206]M.Adam,E.Vazsonyi,I.Barsony,and C.S.Ducso,“Three dimensional single crystalline force sensor by porous Si micromachining,”in Proc.
IEEE Sensors,2004,pp.501–504.
[207]M.R.Wolffenbuttel and P.P.L.Regtien,“Design considerations for
a silicon capacitive tactile cell,”Sens.Actuators A,vol.A24,no.3,
pp.187–190,1990.
[208]M.R.Woffenbuttel and P.P.L.Regtien,“Polysilicon bridges for the realization of tactile sensors,”Sens.Actuators A-Phys.,vol.26,pp.257–2,1991.
[209] E.S.Kolesar and C.S.Dyson,“Object imaging with a piezoelectric robotic tactile sensor,”J.Microelectromech.Sys.,vol.4,no.2,pp.87–96,1995.
[210] D.-H.Kim,J.-H.Ahn,H.-S.Kim,K.J.Lee,T.-H.Kim,C.-J.Yu, R.G.Nuzzo,and J.A.Rogers,“Complementary logic gates and ring oscillators on plastic substrates by use of printed ribbons of single-crystalline silicon,”IEEE Electron.Devices Lett.,vol.29,no.1,pp.73–76,Jan.2008.
[211]H.Klauk,U.Zschieschang,J.Pflaum,and M.Halik,“Ultralow-power organic complemetary circuits,”Nature,vol.445,pp.745–748, 2007.
[212]S.R.Forrest,“The path to ubiquitous and low-cost organic electronic appliances on plastic,”Nature,vol.428,pp.911–918,2004.
[213]R.R.Swartz and J.D.Plummer,“Integrated silicon-pvf2acoustic trans-ducer arrays,”IEEE Trans.Electron.Devices,vol.ED-26,no.12, pp.1921–1931,Dec.1979.
[214] A.S.Fiorillo,J.D.Spiegel,P.E.Bloomfield,and D.Esmail-Zandi,“A P(VDF-TrFE)based integrated ultrasonic transducer,”Sens.Actuators A,vol.A21–A23,pp.719–725,1990.
[215]R.S.Dahiya,M.Valle,G.Metta,L.Lorenzelli,and A.Adami,“Design and fabrication of POSFET devices for tactile sensing,”in Proc.TRANS-DUCERS,15th IEEE Int.Conf.Solid-State Sens.,Actuators Microsyst., Denver,CO,2009,pp.1881–1884.
20IEEE TRANSACTIONS ON ROBOTICS,VOL.26,NO.1,FEBRUARY 2010
[216]R.S.Dahiya,G.Metta,M.Valle,L.Lorenzelli,and A.Adami,“Piezo-electric oxide semiconductor field effect transistor touch sensing de-vices,”Appl.Phys.Lett.,vol.95,pp.034105-1–034105-3,2009.
[217]M.Shimojo,“Mechanical filtering effect of elastic cover for tactile sen-sor,”IEEE Trans.Robot.Autom.,vol.13,no.1,pp.128–132,Feb.1997.
[218](2007).“The i-limb hand,”[Online].Available:http://www.touchbionics.
com/
[219]R.S.Dahiya,M.Valle,and G.Metta,“System approach-a paradigm for
robotic tactile sensing,”in Proc.10th IEEE Int.Workshop Adv.Motion Control ,vol.1,Trento,Italy,2008,pp.110–115.
[220]S.C.Jacobsen,I.D.McCammon,K.B.Biggers,and R.P.Phillips,
“Design of tactile sensing systems for dextrous manipulators,”IEEE Control Syst.Mag.,vol.8,no.1,pp.3–13,Feb.1988.
[221]M.Sergio,F.Manaresi,F.Campi,R.Canegallo,M.Tartagni,and R.Guer-rieri,“A dynamically reconfigurable monolithic cmos pressure sensor for smart fabric,”IEEE J.Solid State Circuits ,vol.38,no.6,pp.966–975,Jun.2003.
[222]W.-C.Fang,“A system-on-a-chip design of a low-power smart vision
system,”in Proc.IEEE Workshop Signal Process.Syst.,1998,pp.63–72.
[223]M.Bigas,E.Cabruja,J.Forest,and J.Salvi,“Review of CMOS image
sensors,”Microelectron.J.,vol.37,pp.433–451,2006.
[224]N.Navet,Y .Song,F.Simonot-Lion,and C.Wilwert,“Trends in automo-tive communication systems,”Proc.IEEE ,vol.93,no.6,pp.1204–1223,Jun.2005.
[225]K.Matsuo,K.Murakami,T.Hasegawa,and R.Kurazume,“A decision
method for the placement of tactile sensors for manipulation task recog-nition,”in Proc.IEEE Int.Conf.Robot.Autom.,2008,pp.11–16.[226]P.Mandlik,S.P.Lacour,J.W.Li,S.Y .Chou,and S.Wagner,“Fully
elastic interconnects on nanopatterned elastomeric substrates,”IEEE Electron.Device Lett.,vol.27,no.8,pp.650–652,Aug.2006.
[227]H.Shinoda and H.Oasa,“Wireless tactile sensing element using stress-sensitive resonator,”IEEE/ASME Trans.Mechatron.,vol.5,no.3,pp.258–265,Sep.2000.
[228]H.Shinoda,N.Asamura,M.Hakozaki,and X.Wang,“Two-dimensional
signal transmission technology for robotics,”in Proc.IEEE Int.Conf.Robot.Autom.,2003,pp.3207–3212.
[229]T.Sekitani,M.Takamiya,Y .Noguchi,S.Nakano,Y .Kato,T.Sakurai,
and T.Someya,“A large-area wireless power-transmission sheet using printed organic transistors and plastic mems switches,”Nature Mater.,vol.6,pp.413–417,2007.
[230]G.Milighetti,T.Emter,H.B.Kuntze,D.Bechler,and K.Kroschel,
“Combined visual-acoustic grasping for humanoid robots,”in Proc.IEEE Int.Conf.Multisens.Fusion Integar.Intelll.Syst.,Heidelberg,Germany,2006,pp.1–6.
[231]P.K.Allen,A.Miller,P.Y .Oh,and B.Leibowitz,“Integration of vision,
force and tactile sensing for grasping,”Int.J.Intell.Mach.,vol.4,no.1,pp.129–149,1999.
[232]Y .Tada and K.Hosoda,“Acquisition of multi-modal expression of slip
through pick-up experiences,”Adv.Robot.,vol.21,no.5,pp.601–617,
2007.
Ravinder S.Dahiya (M’05)was born in Sonepat,Haryana,India.He received the B.Tech.(Hons.)de-gree in electrical engineering from Kurukshetra Uni-versity,Kurukshetra,India,in 1999,the M.Tech.de-gree in control engineering from the Indian Institute of Technology,Delhi,India,in 2001,and the Ph.D.degree in humanoid technologies from the University of Genoa,Genoa,Italy,in 2009.
In 2001,he joined Netaji Subhas Institute of Tech-nology,Delhi,as a Lecturer.He is currently a Post-doctoral Researcher with the Robotics,Brain,and
Cognitive Sciences Department,Italian Institute of Technology,Genoa.He holds one patent and is the author or coauthor of more than 30scientific pa-pers in journals and national/international conference proceedings.His research interests include tactile sensing,flexible sensors and electronics,robotics,and microsystems.
Dr.Dahiya received the University Gold Medal in 1999.He was twice nominated for the Commonwealth Scholarship and received the Japanese Gov-ernment (Monbukagakusho:MEXT)scholarship in 2006.He is also a recipient of best paper awards on two occasions at IEEE-sponsored national and interna-tional conferences in 1998and 2007,
respectively.
Giorgio Metta received the M.S.degree (Hons.)in 1994and the Ph.D.degree in 2000,both in electronic engineering,from the University of Genoa,Genoa,Italy.
From 2001to 2002,he was a Postdoctoral As-sociate with the Artificial Intelligence Laboratory,Massachusetts Institute of Technology,Cambridge,where he worked on various humanoid robotic plat-forms.He has been an Assistant Professor with the Dipartimento di Informatica Sistemistica e Telemat-ica,University of Genoa,since 2005,where he has
been teaching courses on anthropomorphic robotics and intelligent systems.Since 2006,he has also been a Senior Scientist with the Robotics,Brain,and Cognitive Sciences Department,Italian Institute of Technology,Genoa.His cur-rent research interests include biologically motivated humanoid robotics and,in particular,the development of artificial systems that show some of the abili-ties of natural systems.His research has been developed in collaboration with leading European and international scientists from different disciplines like neuroscience,psychology,and robotics.He is the author of more than 100pub-lications.He has also been engaged as a Principal Investigator and Research Scientist in several international and national funded projects.He has been re-viewer of international journals and the journals of European
Commission.
Maurizio Valle (M’01)received the Master’s degree in electronic engineering and the Ph.D.degree in elec-tronic engineering and computer science (curricu-lum Microelectronics)from the University of Genoa,Genoa,Italy in 1985and 1990,respectively.
In 1992,he joined the Department of Biophys-ical and Electronic Engineering (DIBE),University of Genoa,as an Assistant Professor.Since January 2007,he has been an Associate Professor of elec-tronic engineering with the DIBE.He has also been in charge of the Microelectronics section of the DIBE
Research Laboratory since 2002.He has been and is in charge of many research projects funded on the local,national,and European levels and by Italian and foreign companies in the field of electronic and microelectronic systems.His current research interests include embedded electronic and microelectronic sys-tems,integrated sensors circuit interfaces,wireless sensors networks,and tactile sensing systems for robots.He is the author or coauthor of more than 130scien-tific papers published in national and international conference proceedings and
journals.
Giulio Sandini received the Bachelor’s degree in electronic engineering (bioengineering)from the University of Genoa,Genoa,Italy,in 1976.
He was a Research Fellow and Assistant Professor with the Scuola Normale Superiore,Pisa,Italy,during 1984.In 1984,he joined the University of Genoa as an Associate Professor.In 1990,he founded the Lab-oratory for Integrated Advanced Robotics,University of Genoa.He has been a visiting Research Associate with the Department of Neurology,Harvard Medical School,Boston,MA,and a visiting Scientist with the
Artificial Intelligence Laboratory,Massachusetts Institute of Technology,Cam-bridge.He is currently the Director of Research with the Robotics,Brain,and Cognitive Sciences Department,Italian Institute of Technology,Genoa.He is also a Full-time Professor of bioengineering with the Dipartimento di Informat-ica Sistemistica e Telematica,University of Genoa,from which he has been on leave since July 2006.His research interests include biological and artificial vi-sion,computational and cognitive neuroscience,and robotics with the objective of understanding the neural mechanisms of human sensory-motor coordination and cognitive development from a biological and an artificial perspective.He is the author of more than 300publications and holds five international patents.
