Optimization models can support decision-makers in the synthesis and operation of multi-sector energy systems. To identify the optimal design and operation of a low-carbon system, we need to consider high temporal and spatial variability in the electricity supply, sector coupling, and environmental impacts over the whole life cycle. Incorporating such aspects in optimization models is demanding. To avoid redundant research efforts and enhance transparency, the developed models and used data sets should be shared openly. In this work, we present the SecMOD framework for multi-sector energy system optimization incorporating life-cycle assessment (LCA). The framework allows optimizing multiple sectors jointly, ranging from industrial production and their linked energy supply systems to sector-coupled national energy systems. The framework incorporates LCA to account for environmental impacts. We hence provide the first open-source framework to consistently include a holistic life-cycle perspective in multi-sector optimization by a full integration of LCA. We apply the framework to a case-study of the German sector-coupled energy system. Starting with few base technologies, we demonstrate the modular capabilities of SecMOD by the stepwise addition of technologies, sectors and existing infrastructure. Our modular open-source framework SecMOD aims to accelerate research for sustainable energy systems by combining multi-sector energy system optimization and life-cycle assessment.