Preface Acknowledgements 1. Introduction 2. Interactive artefacts 3. Plans 4. Situated actions 5. Communicative resources 6. Case and methods 7. Human-machine communication 8. Conclusion References Indices.

Plans and situated actions: the problem of human-machine communication

Prior to the twentieth century, theories of knowledge were inherently perceptual. Since then, developments in logic, statis- tics, and programming languages have inspired amodal theories that rest on principles fundamentally different from those underlying perception. In addition, perceptual approaches have become widely viewed as untenable because they are assumed to implement record- ing systems, not conceptual systems. A perceptual theory of knowledge is developed here in the context of current cognitive science and neuroscience. During perceptual experience, association areas in the brain capture bottom-up patterns of activation in sensory-motor areas. Later, in a top-down manner, association areas partially reactivate sensory-motor areas to implement perceptual symbols. The stor- age and reactivation of perceptual symbols operates at the level of perceptual components - not at the level of holistic perceptual expe- riences. Through the use of selective attention, schematic representations of perceptual components are extracted from experience and stored in memory (e.g., individual memories of green, purr, hot). As memories of the same component become organized around a com- mon frame, they implement a simulator that produces limitless simulations of the component (e.g., simulations of purr). Not only do such simulators develop for aspects of sensory experience, they also develop for aspects of proprioception (e.g., lift, run) and introspec- tion (e.g., compare, memory, happy, hungry). Once established, these simulators implement a basic conceptual system that represents types, supports categorization, and produces categorical inferences. These simulators further support productivity, propositions, and ab- stract concepts, thereby implementing a fully functional conceptual system. Productivity results from integrating simulators combinato- rially and recursively to produce complex simulations. Propositions result from binding simulators to perceived individuals to represent type-token relations. Abstract concepts are grounded in complex simulations of combined physical and introspective events. Thus, a per- ceptual theory of knowledge can implement a fully functional conceptual system while avoiding problems associated with amodal sym- bol systems. Implications for cognition, neuroscience, evolution, development, and artificial intelligence are explored.

/pdf/perceptual-symbol-systems-4spsk97r61.pdf

Perceptual symbol systems.

SECI, Ba and Leadership: a Unified Model of Dynamic Knowledge Creation

From the Publisher:
The old opposition of matter versus mind stubbornly persists in the way we study mind and brain. In treating cognition as problem solving, Andy Clark suggests, we may often abstract too far from the very body and world in which our brains evolved to guide us. Whereas the mental has been treated as a realm that is distinct from the body and the world, Clark forcefully attests that a key to understanding brains is to see them as controllers of embodied activity. From this paradigm shift he advances the construction of a cognitive science of the embodied mind.

/pdf/being-there-putting-brain-body-and-world-together-again-31tt4y51ml.pdf

Being There: Putting Brain, Body, and World Together Again

Virtual reality (VR) is typically defined in terms of technological hardware. This paper attempts to cast a new, variable-based definition of virtual reality that can be used to classify virtual reality in relation to other media. The defintion of virtual reality is based on concepts of “presence” and “telepresence,” which refer to the sense of being in an environment, generated by natural or mediated means, respectively. Two technological dimensions that contribute to telepresence, vividness and interactivity, are discussed. A variety of media are classified according to these dimensions. Suggestions are made for the application of the new definition of virtual reality within the field of communication research.

https://faculty.washington.edu/farkas/TC510-Fall2011/SteuerMediaRichnessTheory.pdf

Edwin William

Papers

Understanding Computers and Cognition: A New Founda- tion for Design