The Location of Representations: Grandmother, Cardinal, Pontifical and Other Cells

Jonathan CW Edwards

 

Any theory that tries to integrate basic neurophysiology with real-life brain-dependent activities like parking a car is likely to invoke the idea of representation, in some form or other. To park, the car and parking space would seem to need to be 'represented' in some way in the brain processes that determine successful parking (Kosslyn,   ). What physical processes might constitute 'representations' and what sort of location they might have are, however, less clear, at least partly because of ambiguities in the concept of representation itself.

 

The nature of representations

Representations might be defined simply as patterns of brain activity which arise in response to sensory signals encoding patterns in the world and which are specific to a particular external pattern. Thus, to a first approximation, a representation of a nine of diamonds card would consist of those activities in the brain arising in response to a nine of diamonds card that would differ if it were a three of clubs. The problem with such as definition is that the depolarisation of photoreceptors in the retinae is already such a representation and there may be at least a dozen further levels of representation in lateral geniculate bodies, right and left primary and secondary visual cortices, temporal, parietal and frontal lobes, en route to a behavioural response. All of these are likely to determine specifically the nine of diamonds and may do so in the absence of at least some of the others. Thus it may be appropriate to talk of many representations at many levels rather than a single representation.

 

Many representations at many levels may be a satisfactory account of the situation, and will be returned to later. However, as indicated below, there are reasons to be more stringent about criteria for what constitutes a representation. Moreover, at least within psychology, representations are often implicitly or explicitly considered to be associated with reportable experience. These may be a 'percept', as when something is viewed or heard, or a 'mental image', as when retrieving memories, thinking of a scene or sound, or, most vividly, in dreams and hypnogogic states. Moreover, there is a general assumption that there is only one instance of this type of representation at a time, and there has been debate in several different disciplines over the last forty years over whether such a single representation is local or distributed (ref). This debate remains unresolved, and it is suggested here that this may reflect a degree of confusion about what we should expect the biophysical processes underlying a representation, of the 'percept' type, to consist of and where they might be.

 

The purpose of this article is to explore the proposal that however difficult the question of precise location of the representations that underlie percepts may be it is a legitimate question and one that may be answerable, at least to a better approximation than we have at present. It may be necessary to use rather different methods from those of traditional neurophysiology to reach an answer, but having at least an approximate answer may be essential to the programme of understanding how neural connectivity generates intelligent behaviour. There is an alternative view that percepts are part of a 'functional' level of explanation that cannot be tied to a specific physical location. However, in all other contexts we consider that representations must have a physical location in order to be causally effective. (Since a 'functional description' explicitly invokes a causal chain, it is perhaps ironic that functional explanations often appear to be seen as not needing to be bound to any specific causal path.) Thus, to fulfil the original objective of linking neurophysiology to real life activity it would seem appropriate to maintain the idea that the representations that form the basis of reportable percepts have a physical location.

 

 

General neurobiological principles

Unless there are good reasons to do otherwise, an account of a physical location for a representation in a brain should follow general principles already established in neurophysiology. Two such principles are particularly relevant. The first is the neuron doctrine. The second is that the content of a percept will be encoded in signals that form inputs to the physical domain associated with the percept.

 

The neuron doctrine dates from the time of Ramon y Cajal and, in essence, is the principle that all brain function can ultimately be explained by the interactions of separate cellular units. For present purposes, it can be summarised as follows: Each neuron is a discrete computational (in the broad sense of something with rule-based input-output relations) unit, obeying, as a unit, classical biophysical laws. The timing of firing of a neuron is entirely determined by the interaction between chemical and electrical influences from immediately surrounding brain and the physical state of the cell. Firing can be affected by traditional synaptic transmission, by electrical effects at tight junctions, by diffusible factors with generalised effects on membrane potential and by aspects of the cellÕs physical state such as temperature and metabolism, but it is not otherwise causally linked to activity in other cells.

 

It has recently been suggested that the neuron doctrine should be replaced by a description of brain function at a more 'global' level (Gold and Stoljar). However, since the causal biophysical pathways of the neuron doctrine are not seriously in doubt it is unclear that a more global description can be in any sense an alternative, rather than just an attempt to extract useful commonalities in rules for massively parallel events that may allow approximate accounts of overall dynamics. It is difficult to see how such commonalities are relevant to specific representational content, rather in the way that it is difficult to see how changes in times of postal delivery would influence the content of people's mail. In particular it is unclear that a desire to see ÔdecisionsÕ as being ÔtakenÕ by groups of cells showing, for instance, synchronisation of behaviour, rather than by individual cells is based on any sound computational theory. A 'higher order' description of neuronal events in terms of systems theory or non-linear dynamics cannot contravene lower order biophysical laws. In simple terms, ten cells cannot be said to influence ten other cells in the way that ten men can lift ten rocks in a sling through pulling on a single rope. As far as we know there is no way to circumvent the causal bottleneck of the individual neuron (Barlow 1994).

 

The second premise is equally fundamental to neuroscientific explanation, but is rarely overtly articulated. It relates to Rosenberg's concept of receptivity (Rosenberg 200..) and is laid out in an explicit neurological context in a recent discussion of the basis of the qualia of experience by Orpwood. The representations we call percepts must be based on the availability of certain data to some neuron-based entity or domain, i.e. they must be the inputs to such a domain, which will also generate outputs in response that will allow the percept to be 'reported'. Something has to receive the signals that allow it to support a percept, whether these are derived originally from sense organs or other sources as in dreams.

 

This might seem self-evident. However, this second premise is worth emphasising because literature on perception and consciousness from disciplines outside neurology frequently appears to take a radically different view of the basis of percepts. Percepts may be seen as arising from, or being associated with, computational or Ôinformation processingÕ operations, which involve not inputs but input-output relations - the essence of ÔfunctionalismÕ. This appears to imply that if percepts belong to physical entities then those entities are in some way privy to their outputs as well as their inputs. One of the most robust findings of neuroscience is that this is not so, and indeed in a sense it is self-contradictory. Moreover, as will be discussed below, if this involves access to the meaning of these outputs a paradox arises, since for a signal to have a meaning, as Orpwood points out, it must have a recipient to interpret it, for which it must be an input.

 

 

Representations are based on inputs

In other words, a representation must be a representation to something. Although it is commonly suggested that there are no 'inner receiving entities' for representations in a brain this is inconsistent with our understanding of causality. To be part of a causal chain, and thus reportable, the information encoded in a representation must be made available to something that generates a response. A word of text in a forgotton language embedded in an opaque medium that cannot be removed without destroying the text cannot usefully be called a representation. Similarly, a pattern of lines of cellular activity in the visual cortex of a monkey in its normal environment which bears a homotopic relation to a pattern of tree trunks the monkey is viewing is not in a meaningful sense a spatial representation, either to a scientific observer or to any part of the monkey since no part of the monkey, including the cells themselves, is informed of the spatial relations of cells with and without activity. The cells will represent sense data to other parts of the monkey's brain through patterns of downstream synaptic transmission, but the homotopy of the spatial relations of their cell bodies is of no causal consequence.

 

There is no doubt that treating representations as being based on inputs to some neural structure raises difficulties. However, available neurobiological evidence seems to indicate that our intuitive association of 'knowing' with an input to something is valid. It might be argued that this only applies at the peripheries of the system and that in between things must be viewed differently, but it is unclear why this should be so. Historically, neurobiological observation has suggested that we can push the concept of ÔinputÕ as far into the nervous system as interpretable observation will allow. Pressure from an intervertebral disc on a fifth lumbar nerve root gives pain in the big toe. Cochlear implants give severely deaf people an experience of sound. Stimulation of cerebral cortex in the awake individual can evoke sensations and memories. These observations indicate that sensory pathways, at all points up to that where a percept is experienced, are simply providing inputs to the next stage, that could be triggered artefactually without any change in the nature of the percept experienced. (Artefactual interventions are often associated with clues that allow us to know that the percept is aberrant, but it seems likely that in principle these could be avoided, as with an ideal virtual reality apparatus.)

 

The work of David Hubel (vision) and many others has shown that the process of acquisition and collation of sense data can be tracked quite far into the brain. Cells that respond to lines at particular angles, lines of limited length, or colour contrasts can be demonstrated. It might be argued that the absence of much analysis beyond this level could indicate that signals enter a Ôblack boxÕ in which percepts are no longer associated with inputs, but rather with input-output relations. However, the simpler explanation is that beyond this level collation is so sophisticated that it is difficult to know how to set up an experiment to analyse it. The more recent work of Koch and colleagues showing that individual cortical cells respond to the faces of specific individuals suggests that this is so and that such difficulties can sometimes be overcome.

 

In summary, despite trends in other directions in some fields of study, the two assumptions of the neuron doctrine and the doctrine of percepts as based on inputs to perceiving entities appear to be on a sound footing.

 

 

 

Possible domains for representations

Armed with this basic logical standpoint, it is possible to ask some general questions about the location of the representations we call percepts and the nature of the entities to which these representations are available.

 

The starting premise is that our introspection tells us that at least one entity exists in a waking brain that has an experience correlated with the input from the sense organs of a certain human being. The validity of this could be denied, but to deny it would be a pity if this premise can yield certain badly needed clues to the way the brain dictates behaviour. To be useful we need to be able to describe such an entity in dynamic physical terms. The prima facie case is that it will consist of a dynamic domain in one or more neurons receiving inputs derived from all sensory modalities, and other internally generated signals, and sending a sequence of outputs to all, or most, motor pathways.

 

Following OrpwoodÕs exposition of premises relating to meaning, the next premise is that if the entity that has the percept is a domain in one or more cells, in accordance with the neuron doctrine the input will be of signals leading to patterns of electrical depolarisation of cell membrane which will, either directly or indirectly, be associated with an interpretation which is a percept. Since we are considering input this ought to be a pattern in dendrites afferent to the cell soma. Depolarisation of efferent axons will correspond to stereotyped output signals that cannot be expected to give rise to an interpretation in the cells in which they arise.

 

The term 'interpretation' may need clarifying here. It is not meant in the sense that sensory signals encoding four legs, a tail, pointed ears, red fur and a toothy snout are interpreted as a fox. That would imply at least one computation involving an input-output relation. Interpretation is used here to mean simply the correspondence of an input, (of electrical or chemical signals based on collation amongst sensory data and with data from memory) to a meaningful 'percept'. 'Manifestation' might be a better term, since it implies no computation, nor any physical interaction, but simply a correspondence between physical input and its meaning, or 'appearance', to the receiving entity. Interpretation of this sort must presumably occur at the final point of input since there is no means by which interpretation could be 'carried forward' from previous events in input pathways. (Since the 'cone' of past events contributing to any causal interaction is immeasurably complex the idea that 'interpretations' or 'manifestations' occurring earlier should be carried forward in causal chains is as absurd as it is inconsistent with experience.)

 

 

Representational domains cannot be based on traffic

The next step takes us beyond the initial assumptions in a rather more obvious way. It is that the percept must be an interpretation both of signals arising from membrane excitation and counterfactuals or Ônon-signalsÕ corresponding to sites where membrane might have been excited but is not at that time. Unless signals are interpreted in the context of all possible signals in a particular domain we lose any sense of information encoded in relations of signal to non-signal. A summation of all and only the black spots of a set of printed words has effectively only one meaning: black. Moreover, it becomes arbitrary whether the spots included are on one page, or in one book or in a whole library. Only if the white areas are included do we have diverse meaning and bounded domains of meaning. Thus, in vision, a 'line' of uniform colour within a block of uniform colour is not interpreted as a line. The interpretation of a line implies the absence of signals encoding similar colour on either side of the line.

 

This last premise has an important consequence. It means that the domain that supports a percept cannot be defined by a pattern of signal traffic; it cannot be defined in terms of where signals are occurring. It must include counterfactual non-signals, so there must be some intrinsically defined dynamic structural domain within which signals and non-signals are co-interpreted as percept. The domain receiving signals, interpreted as a percept, cannot be a ÔcircuitÕ or ÔnetworkÕ in the sense of a set of pathways currently carrying signal traffic. There may also be an important distinction here between the processing units in a brain and in a computer. In a computer there are ÔgatesÕ in which electrical signals ÔopenÕ or ÔcloseÕ connections between units, forming and breaking electrical circuits. The brain does not have gates in this sense. Connections remain unchanged, at least over periods of hours, regardless of traffic. The processing units are integrators but not gates.

 

 

Problems with 'self-reference'

The implausibility of representational domains being defined by traffic patterns and the inability of domains to know their output, together raise difficulties for concepts of self-reference and its relation to perception. Orpwood makes the suggestion that a cell or group of cells that has an output that connects back to their input might support the qualia of experience because they are in some way self-referent. The problem here is that all cells within the cortex probably have the ability to indirectly influence their inputs through outputs and this must be considered just as much true if they influence their inputs by null outputs, as by substantive outputs. Thus the possibility of self-influence does not appear to help in defining perceptual domains. Moreover, since a domain cannot know its output and inputs do not provide an indication of their source of origin (as mentioned above) there is no way that a self-influencing domain can know that it is self-influenced, rather than influenced by, for instance, similar domains nearby, or at a mirror-image site in the other hemisphere.

 

Although the idea that re-entrant pathways might be crucial to perceptual experience is popular, these considerations cast doubt on such an idea in principle. It implies knowledge that is not provided by the available causal pathways and as such violates normal precepts of 'naturalistic' descriptions of the world. As implied by Hume, self-reference may be more of a virtual cultural construct than a true reflection of brain dynamics.

 

 

Localised versus distributed representations

The idea that the domain of a perceptual representation is defined by a structure rather than a pattern of signal traffic means that the issues about localisation and distribution of percepts raised by people like Lashley have to be taken seriously. Percepts, if in a degraded form, appear to survive damage to almost any part of, or any amount of, cortex. Removal of certain specific areas can produce predictable and well-defined defects, but does not appear to remove the capacity to have percepts, even if there is agnosia in the sense of not be aware that the percept is defective. The inference is that if the type of entity supporting the representations of percepts being sought is indeed cortical then there is no single local entity. That leaves the possibility of one very extended entity or multiple local entities.

 

The idea that a percept is an interpretation of the inputs to neuronal membranes over a wide area of brain generates a range of problems. Many neurones would appear to be involved in ÔhousekeepingÕ activity such as suppression of vision during saccades, early collation of sensory inputs, or motor activity. The inputs to such cells do not appear to figure in percepts; the biological advantage of percepts would appear to be that they reflect the input to a very select cell population involved in conscious attention. In this context, it is unclear why the inputs to certain cells and not others should figure in a percept. Nor is it clear why there should be a perception of a single copy of sense data when most if not all signals arising from cellular activity in sensory pathways are being sent to form inputs to many cells through widely ramifying axonal branches.

 

These and related concerns were probably the impetus to the proposal by Pribram (erf) that the cortex carries information somewhat in the manner of a hologram. In a hologram every part of a spatial array carries a version of the entire pattern of information being handled, but in a low-resolution format, with higher resolution emerging as larger proportions of the array are sampled. However, the problem with the holographic model is that it is not clear what the entity or entities with inputs corresponding to high-resolution percepts are to be. A simpler but related idea is that sense data are sent to many locations in the cortex and each of these has the potential to interpret its input as percept. This would seem to be in keeping with the experiments of Koch in which visual sense data often gave rise to excitation in many sampled cortical cells. In some cases cells were highly restricted in their responses to images, but others were more promiscuous. At least there is little doubt that sensory stimuli lead to signals being sent widely to many cells.

 

The above discussion suggests that the question of what domain supports a perceptual representation boils down to what it perhaps must always have been: a question of which cell or cells. Its formulation may, however, need to be slightly more subtle; How many of which sort of neuron have a perceptual representation encoded in their input(s) and do they constitute a single domain of a single representation of this type at any one time or are there multiple domains, supporting multiple representations based on the same sensory data? (The latter would not give rise to any sense of multiplicity since such multiplicity would not itself be represented or perceived by anything.)

 

 

Pontifical, grandmother and cardinal cells

The simplest hypothesis for the domain of a perceptual representation, now largely regarded as a null hypothesis, is that of the pontifical cell, as entertained in the nineteenth century and discussed by William James. The idea dates back at least to Leibniz, writing shortly after neurons were first observed. This form of pontifical cell is the single cell that supports all representational percepts of all sensory inputs. It is the 'me' cell. All other cells act as conduits of information to and from this central cell, collating inputs and delegating outputs. James considers that they might also support 'percepts', but of a meaner sort than that which we report as being 'mine'. The attraction of this idea is that a cell is a single functional unit, which has an intrinsically delimited input domain and human experience appears to be 'single'. However, the idea that one neuron should have this highly specialised function is implausible on a range of grounds and, as indicated above, the argument that experience seems to be 'single' is non sequitur, since there would be no reason for there to be representation (and thus perception) of multiplicity, or a sense of 'other copies', within each of multiple representations.

 

At this point it is useful to raise what may be a confusion in the perception literature between sites of representation and sites of recognition. (For the time being the discussion will be continued in relation to the domains of individual cells for ease of illustration of general principles.) Sherrington (1940ish) appears to have invoked a concept of a rather different sort of 'pontifical' cell in an attempt to explain recognition. Sensory data relating to an object such as a dog enters through many thousands of receptors. Recognition would appear to require sequential stages of discrimination, each leading to a reduction in the number of possible interpretations of the input pattern. This might be expected to take the form of a 'pyramid' with an order of magnitude fewer cells at each stage until the input finally converged on a single cell that had the specific responsibility of recognising a dog. In this case there would be a pontifical cell for a dog, another for a cat and yet another for a grandmother.

 

The important point here is that we have no particular reason to think that only the cell that has the job of recognising a dog will receive input signals relating to features of a dog. If a hundred cells each recognised a different mammal we would not expect the presence of a dog to lead to input to only one of these cells. We would expect all the cells to receive signals indicating features of a dog but only one (or some) to fire. It could be argued that synapses receiving signals encoding pointed ears will have been lost or rendered impotent on koala-recognising cells but the very function of a dog-recognising cell depends on a response to a specific combination of features none of which are in themselves specific for dogs.

 

Thus if a representation is based on an input pattern we do not expect sites of representation and recognition to be commensurate. This emphasises the need to consider a causal chain as potentially involving many levels of representation with multiplicity at each level. It highlights the fact that a representation is always a step in a causal chain and is thus always a representation to a domain at a particular point in that chain. Thus a pattern of data, perhaps encoding legs, fur and muzzle, would represent a dog to a 'dog-pontifical cell' as well as to a lot of cells tuned to other creatures. In turn the firing of the dog-pontifical cell and not of its neighbours would represent the presence of dog to the rest of the brain. The two types of representation would be entirely different. Moreover, intuition tells us that whatever domain has a percept of a dog of the sort normally discussed it must have an input encoding both the diagnostic features of a dog - legs, fur etc. - and the sense of these being part of a dog, apparently putting the relevant domain downstream of the site of dog-recognition with additional parallel input encoding the original upstream sense data.

 

It has become increasingly clear that recognition does not use a pyramidal system with fewer and fewer cells at each stage. Sequential stages involve as many, if not more, cells as at the beginning - rather as implied by the above discussion. Recognition is signalled by the firing of one or a few cells in the context of 'counterfactual' non-firing of many more cells. At all stages representations are thus widespread, but it needs to be established whether this is because individual representations are extended or because of multiplicity.

 

This issue is relevant to Barlow's classic 1972 paper in Perception (Barlow 1972). Barlow takes as his object a grandmother, following Jerry Letvin (196-) and discusses the likelihood of there being a 'grandmother cell' in the sense of a single cell that fires with 100% sensitivity and specificity for grandmother. This bears some relation to Sherrington's pontifical cell but not to that of Leibniz or James. Barlow suggested that grandmother was probably not important enough to have a cell to herself and that it was more likely that grandmother would be encoded by the activity of perhaps a thousand 'cardinal' cells, each representing an aspect of grandmother such as a mouth or nose, any of which might presumably contribute to encoding other faces in other combinations. These elements of the percept are then seen as combining rather in the way words combine in a sentence (an analogy also used by David Marr in 'Vision'). Note that Barlow is not proposing a redundancy-for-safety strategy with information being distributed in a 'holographic' way amongst several cells each with a sensitivity and specificity for a percept of less than 100%. He is giving each cell a separate and specific job.

 

The odd thing here is that Barlow appears to be describing the activity of cells upstream of a site of recognition of grandmother. If each of these cells is responding to signals which together encode a feature not entirely specific and sensitive for grandmother then grandmother can only be recognised, and appropriate social responses activated, by a group of cells receiving inputs from these thousand cells, some of which will fire and some not. It would be these next cells whose inputs would encode all grandmother's features and it would therefore be their domains that we could expect to support a 'percept' of granny in the sense of manifestation of all of grandmother's features, whether or not they fired. And it would be the pattern of firing and non-firing of these latter cells that would 'represent' to domains in the rest of the brain the presence, but not the pattern of features, of this individual. Whether or not within this latter group of cells there are cells with 100% sensitivity and specificity for grandmother is a different issue that does not necessarily bear on the search for the domains supporting the representations known as percepts.

 

The above discussion emphasises a number of issues relating to this key question. Representations in the brain must be multiple and diverse. At each level many cells will be involved in representation. Representation and recognition are not likely to be commensurate. So far the discussion has been in terms of individual cells despite the general assumption in the literature that representations in brains each involve at least a few cells and perhaps thousands. This issue needs to be revisited in the light of the preceding arguments.

 

 

A return to the neuron doctrine.

The term representation suffers from a number of weaknesses. It has already been noted that to be useful in the context of perception the term has to imply a step in a dynamic causal chain and its content ought to be encoded in the input of signals to some domain. It is also very difficult to see how a representation can have a meaning, or interpretation, of the sort associated with percepts, unless its content is encoded in the co-temporal input of a pattern of signals and non-signals to some domain.

 

It should be recognised that representations of this sort do not occur within computers. Stored data in a computer can represent something meaningful to an external operator capable of accessing it via a screen display but no representation based on a pattern of co-temporal input occurs to anything within the machine itself beyond the trivial input options to an electronic gate of on/on, on/off, off/on and off/off. Moreover, we have no reason to think that anything in a computer interprets, or attributes meaning, to any input signals, only outside observers need do that. It might be argued that a sequence of signals passing through a gate might constitute a representation to that gate. However, since each signal contributes to a separate computation this would appear to be invalid. There is no sense in which a sequence of incoming signals are subjected as a whole to a computation, other than as arbitrarily defined by an outside computer programmer. Within the machine any 'chunking' of serial signals into 'representations' adds nothing to the causal account and at the gate in question no such chunking would be apparent.

 

Within a brain there are units that do receive complex patterns co-temporally, in the form of individual neurons. Moreover, they are the only units that receive patterns as far as we now. Barlow's 1000 cardinal cells are not a unit receiving a pattern of 1000 features of grandmother. Each has a separate input encoding one feature. For all the 1000 features to contribute to a causally effective representation the 1000 cardinal cells must send signals that all converge on at least one neuronal unit downstream (well within the known range of neuronal inputs). If representations are to be based on co-temporal inputs and causally effective then they have to go through the causal bottleneck of the individual neuron, as indicted above. The neuron doctrine, as was probably evident to Leibniz, entails the very simple but surprising premise that representations in brains can only be in individual neurons. There may be very large numbers of such representations, all encoding the same sensory data, distributed over a wide area of cortex, but each representation must be tied to the receiving unit that is the neuron.

 

This conclusion immediately resolves the paradox of localisation and distribution of representation in the brain, since it implies that local representations are distributed widely. Thus although the phenomenon of representation is widespread in the brain any individual representation must be available locally to a single cell, just as the distribution of a newspaper is widespread but can only convey news if all the words of a news story are present in each copy read by an individual. To suggest that a representation can be available to several cells is equivalent to suggesting that the news can be understood by a group of people each of which only receives one word of the story.

 

The conclusion also resolves the question of precisely where in the brain are the representations that determine behaviour. The answer is that there are many all over the brain. Even the question of where in the brain are the representations that determine considered verbalised behaviour has the same answer. However, it seems reasonable to attach some special signficance to representations to cells with multimodal inputs that would allow both the visual and auditory features and the concept of a dog to contribute to a 'percept' of a dog.

 

Putting representations in individual cells may appear implausible. However, it is difficult to identify reasons why representations in individual cells should be more implausible with representations in many cells. The apparent problem may simply reflect the fact that if a specific location for such representations is proposed our lack of understanding of the rules of interpretation are brought into sharp focus. This may be no bad thing.  

 

Another attraction of the idea that representations are to the single computational (rule based input-output) units that are neurons is that it implies that the brain does not perform operations on 'atomic' (structureless) symbols, but rather it performs operations on 'molecular' representations. That is to say that the basic data units that the brain operates on are irreducibly complex, with many degrees of freedom. This begins to address the bind of how the manipulation of symbols can be associated with an experience of complex patterns that reflect the complexity of their referents. It also provides a reason why, as appears to be increasingly recognised, syntax and semantics cannot be totally dissociated when considering meaning. The complexity of individual data elements allows computational rules to be content sensitive rather than purely syntactic.

 

 

Conclusion

Mainstream neuroscience prides itself in being rigorously physicalist, in the sense of adhering to the basic precepts of natural science and our understanding of causality. A consideration of representations in such a rigorous causal framework leads to the conclusion that all representations in the brain, including those that may form the basis of percepts must be based on the inputs to individual neurons. These representations will therefore occur at multiple levels of sensory processing and will be multiple at all levels, including the level attributed to percepts. Such a model is counterintuitive but resolves certain important problems relating to the distributed nature of representation and to linguistics.