The world, society and education are constantly evolving, and to respond to these changes, the main governmental institutions have been proposing different global strategies to focus efforts in the same direction. Currently, the United Nations and its 17 Sustainable Development Goals (SDG) have presented a series of indicators that could help to minimise the environmental, economic and social instability we are experiencing. In this sense, Education for Sustainable Development (ESD) has been described as a fundamental factor. Specifically, in previous work, we argued that physical education (PE) could be a good tool to contribute to SDGs. Based on this, no research analysing the voices of Physical Education Teachers (PET) on how this contribution could be made has been identified in previous literature. Therefore, the objectives of this research are: (1) to analyse the voices and opinions of active PETs in terms of the knowledge they have about Sustainable Development (SD); (2) to determine their opinions about the contribution that PE could make to SDGs; and finally, (3) to identify the challenges and limitations of pedagogical action of SD in PE. For this purpose, a qualitative analysis through a semi-structured interview with 41 active PETs was carried out. The main findings will be presented and discussed around four themes: (a) agreement on the concept of sustainability; (b) PE can contribute to the achievement of SDGs; (c) ambiguity in applying SDGs to PE lessons; and (d) teachers’ constraints on how to implement SDGs in PE. It seems to indicate that PETs do not have a multidimensional vision of sustainable development. While they recognise the potential of PE to contribute to SDGs through awareness raising and student learning, they point to its pedagogical and formative constraints as the main barriers to being able to contribute. They pointed to a lack of knowledge on how to do so, guidelines on how to integrate ESD, lack of involvement, shortage of time or resources in school physical education.