Vijayakumar, Sethu

Johansson, Roland

Series, Peggy

Saal, Hannes

Engineering and Physical Sciences Research Council (EPSRC)

2012-01-18T10:41:38Z

2012-01-18T10:41:38Z

2011-11-24

The human sense of touch integrates feedback from a multitude of touch receptors, but how this information is represented in the neural responses such that it can be extracted quickly and reliably is still largely an open question. At the same time, dexterous robots equipped with touch sensors are becoming more common, necessitating better methods for representing sequentially updated information and new control strategies that aid in extracting relevant features for object manipulation from the data. This thesis uses information theoretic methods for two main aims: First, the neural code for tactile processing in humans is analyzed with respect to how much information is transmitted about tactile features. Second, machine learning approaches are used in order to influence both what data is gathered by a robot and how it is represented by maximizing information theoretic quantities. The first part of this thesis contains an information theoretic analysis of data recorded from primary tactile neurons in the human peripheral somatosensory system. We examine the differences in information content of two coding schemes, namely spike timing and spike counts, along with their spatial and temporal characteristics. It is found that estimates of the neurons’ information content based on the precise timing of spikes are considerably larger than for spikes counts. Moreover, the information estimated based on the timing of the very first elicited spike is at least as high as that provided by spike counts, but in many cases considerably higher. This suggests that first spike latencies can serve as a powerful mechanism to transmit information quickly. However, in natural object manipulation tasks, different tactile impressions follow each other quickly, so we asked whether the hysteretic properties of the human fingertip affect neural responses and information transmission. We find that past stimuli affect both the precise timing of spikes and spike counts of peripheral tactile neurons, resulting in increased neural noise and decreased information about ongoing stimuli. Interestingly, the first spike latencies of a subset of afferents convey information primarily about past stimulation, hinting at a mechanism to resolve ambiguity resulting from mechanical skin properties. The second part of this thesis focuses on using machine learning approaches in a robotics context in order to influence both what data is gathered and how it is represented by maximizing information theoretic quantities. During robotic object manipulation, often not all relevant object features are known, but have to be acquired from sensor data. Touch is an inherently active process and the question arises of how to best control the robot’s movements so as to maximize incoming information about the features of interest. To this end, we develop a framework that uses active learning to help with the sequential gathering of data samples by finding highly informative actions. The viability of this approach is demonstrated on a robotic hand-arm setup, where the task involves shaking bottles of different liquids in order to determine the liquid’s viscosity from tactile feedback only. The shaking frequency and the rotation angle of shaking are optimized online. Additionally, we consider the problem of how to better represent complex probability distributions that are sequentially updated, as approaches for minimizing uncertainty depend on an accurate representation of that uncertainty. A mixture of Gaussians representation is proposed and optimized using a deterministic sampling approach. We show how our method improves on similar approaches and demonstrate its usefulness in active learning scenarios. The results presented in this thesis highlight how information theory can provide a principled approach for both investigating how much information is contained in sensory data and suggesting ways for optimization, either by using better representations or actively influencing the environment.

http://hdl.handle.net/1842/5737

en

The University of Edinburgh

Saal HP, Vijayakumar S, and Johansson RS. Information about complex fingertip parameters in individual human tactile afferent neurons. J Neurosci (2009) vol. 29 (25) pp. 8022-31.

Saal HP, Ting J, and Vijayakumar S. Active sequential learning with tactile feedback. 13th International Conference on Artificial Intelligence and Statistics (AISTATS), Chia Laguna, Italy, JMLR: W&CP 9 (2010).

Saal HP, Ting J, and Vijayakumar S. Active estimation of object dynamics parameters with tactile sensors. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Taipei, Taiwan (2010) pp. 916 - 921.

Saal, H. P., Heess, N. M. O., and Vijayakumar, S. (2011). Multimodal nonlinear filtering using Gauss-Hermite quadrature. In Proc. European Conference on Machine Learning (ECML).

Strohmayr, M. W., Saal, H. P., Potdar, A. H., and van der Smagt, P. (2010). The DLR touch sensor I: A flexible tactile sensor for robotic hands based on a crossed-wire approach. In Proc. 2010 IEEE/RSJ International Conference on Intelligent Robotics and Systems (IROS), pages 897–903.

machine learning

tactile processing

primary tactile neurons

spike counts

spike timing

Gaussians representation

Information theoretic approach to tactile encoding and discrimination

Thesis or Dissertation

Doctoral

PhD Doctor of Philosophy