Electronic proprioception

Augmented reality devices such as Smart Glasses are destined to be an integral part of our information intensive society, assisting us to acquire data and process information in an ever faster paced society. Although impressive in their realization and demonstrations, an often-neglected drawback of conventional optics-based motion detection systems is their bulkiness, energy inefficiency and the stringent requirement to be at line of sight with any object. We envision that future augmented reality systems will rely on compliant wearable and on-skin interactive electronics. When equipped with motion tracking sensory systems, electronic skins would offer complimentary information on the surrounding and enable novel means of manipulating physical or even virtual objects.
We demonstrate electronic skins capable of perceiving direction in space. Our highly compliant magnetosensory system enables real time tracking of the position of a body in space as well as the touchless manipulation of (virtual) objects based on the interaction with magnetic fields exclusively. We foresee exciting possibilities not only for business or gaming industries but also for safety and security applications, where the somatic manipulation of objects, e.g. turning regulation knobs located in a restricted environment, is undesirable or even prohibited.