Interstitial lung disease (ILD) associated with rheumatoid arthritis or with connective tissue diseases such as systemic sclerosis can be collectively named systemic autoimmune rheumatic disease-associated ILDs (SARD-ILDs) or rheumatic musculoskeletal disorder-associated ILDs. SARD-ILDs result in substantial morbidity and mortality, and there is a high medical need for effective therapies that target both fibrotic and inflammatory pathways in SARD-ILD. Phosphodiesterase 4 (PDE4) hydrolyses cyclic AMP, which regulates multiple pathways involved in inflammatory processes. PDE4 is overexpressed in peripheral blood monocytes from patients with inflammatory diseases. However, clinical data on pan-PDE4 inhibition in fibrotic conditions are lacking. The PDE4B subtype is highly expressed in the brain, lungs, heart, skeletal muscle and immune cells. As such, inhibition of PDE4B may be a novel approach for fibrosing ILDs such as idiopathic pulmonary fibrosis (IPF) and SARD-ILD. Preclinical data for PDE4B inhibition have provided initial evidence of both anti-inflammatory and antifibrotic activity, with reduced potential for gastrointestinal toxicity compared with pan-PDE4 inhibitors. In a proof-of-concept phase II trial in patients with IPF, nerandomilast (BI 1015550), the only PDE4B inhibitor currently in clinical development, prevented a decline in lung function over 12 weeks compared with placebo. The potential clinical benefit of PDE4B inhibition is now being investigated in the phase III setting, with two trials evaluating nerandomilast in patients with IPF (FIBRONEER-IPF) or with progressive pulmonary fibrosis other than IPF (FIBRONEER-ILD). Here, we review the preclinical and clinical data that provide rationale for PDE4B inhibition as a treatment strategy in patients with SARD-ILD.