With the advent of deep learning and the availability of big data, it is now possible to train machine learning algorithms for a multitude of visual tasks, such as tagging personal image collections in the cloud, recognizing faces, and 3D shape scanning with phones. However, each of these tasks currently requires training a neural network on a very large image dataset specifically collected and labelled for that task. The resulting networks are good experts for the target task, but they only understand the 'closed world' experienced during training and can 'say' nothing useful about other content, nor can they be applied to other tasks without retraining, nor do they have an ability to explain their decisions or to recognise their limitations. Furthermore, current visual algorithms are usually 'single modal', they 'close their ears' to the other modalities (audio, text) that may be readily available. The core objective of the Programme is to develop the next generation of audio-visual algorithms that does not have these limitations. We will carry out fundamental research to develop a Visual Transformer capable of visual analysis with the flexibility and interpretability of a human visual system, and aided by the other 'senses' - audio and text. It will be able to continually learn from raw data streams without requiring the traditional 'strong supervision' of a new dataset for each new task, and deliver and distill semantic and geometric information over a multitude of data types (for example, videos with audio, very large scale image and video datasets, and medical images with text records). The Visual Transformer will be a key component of next generation AI, able to address multiple downstream audio-visual tasks, significantly superseding the current limitations of computer vision systems, and enabling new and far reaching applications. A second objective addresses transfer and translation. We seek impact in a variety of other academic disciplines and industry which today greatly under-utilise the power of the latest computer vision ideas. We will target these disciplines to enable them to leapfrog the divide between what they use (or do not use) today which is dominated by manual review and highly interactive analysis frame-by-frame, to a new era where automated visual analytics of very large datasets becomes the norm. In short, our goal is to ensure that the newly developed methods are used by industry and academic researchers in other areas, and turned into products for societal and economic benefit. To this end open source software, datasets, and demonstrators will be disseminated on the project website. The ubiquity of digital images and videos means that every UK citizen may potentially benefit from the Programme research in different ways. One example is smart audio-visual glasses, that can pay attention to a person talking by using their lip movements to mask out other ambient sounds. A second is an app that can answer visual questions (or retrieve matches) for text-queries over large scale audio-visual collections, such as a person's entire personal videos. A third is AI-guided medical screening, that can aid a minimally trained healthcare professional to perform medical scans.

Quantum information science and technologies offer a completely new and powerful approach to processing and transmitting information by combining two of the great scientific discoveries of the 20th century - quantum mechanics and information theory. By encoding information in quantum systems, quantum information processing promises huge computation power, while quantum communications is already in its first stages of commercialisation, and offers the ultimate in information security. However, for quantum technologies to have as big an impact on science, technology and society as anticipated, a practical scalable integration platform is required where all the key components can be integrated to a single micro-chip technology, very much akin to the development of the first microelectronic integrated circuits. Of the various approaches to realising quantum technologies, single particles of light (photons) are particularly appealing due to their low-noise properties and ease of manipulation at the single qubit level. It is possible to harness the quantum mechanical properties of single photons, taking advantage of strange quantum properties such as superposition and entanglement to provide new ways to encode, process and transmit information. Quantum photonics promises to be a truly disruptive technology in information processing, communications and sensing, and for deepening our understanding of fundamental quantum physics and quantum information science. However, current approaches are limited to simple optical circuits with low photon numbers, inefficient detectors and no clear routes to scalability. For quantum optic information science to go beyond current limitations, and for quantum applications to have a significant real-world impact, there is a clear and urgent need to develop a fully integrated quantum photonic technology platform to realise large and complex quantum circuits capable of generating, manipulating and detecting large photon-number states. This Fellowship will enable the PI and his research team to develop such a technology platform, based on silicon photonics. Drawing from the advanced fabrication technologies developed for the silicon microelectronics industry, state of the art silicon quantum photonic devices will enable compact, large-scale and complex quantum circuits, experiments and applications. This technology platform will overcome the current 8-photon barrier in a scalable way, enable circuits of unprecedented complexity, and will be used to address important fundamental questions, develop new approaches to quantum communications, enhance the performance of quantum sensing, provide a platform for new routes to quantum simulations, and achieve computational complexities that can challenge the limits of conventional computing. This multidisciplinary research programme will bring together engineers, physicists and industrial partners to tackle these scientific and technological challenges.