Despite technological advances, normal tissue sparing in photon beam irradiation is still challenging. Since in esophageal cancer this may inflict damage on the lungs, heart and bone marrow, possibly impacting on outcome, the aim of this study was to investigate the association of normal tissue dose and blood parameters on the survival of patients having undergone neoadjuvant radiochemotherapy (RCTx) followed by surgery. This retrospective study included 125 patients irradiated to 40–41.4 Gy with photons or protons combined with concurrent chemotherapy. On initial and restaging 18F-FDG-PET/CT, the lungs and heart were contoured as organs at risk for which standardized uptake values (SUV) were evaluated. The mean radiation dose (D_mean) to the lungs and heart, the volume of the lungs receiving at least 20 Gy (V_{20Gy_lung}) and various pre- and per-treatment blood parameters were included in the Cox regression analyses. Results: The median follow-up time was 19.8 months and median overall survival 37 months (95% confidence interval: 16–58.9 months). In multivariate analysis, higher radiation doses to the lungs and heart were statistically significantly associated with decreased overall survival (D_{mean_lung}: p < 0.001; V_{20Gy_lung}: p < 0.002; D_{mean_heart}: p = 0.005). Neither the 18F-FDG-PET nor blood parameters were predictive for overall survival. In patients with locally advanced esophageal cancer treated with RCTx, the radiation dose to the heart and lungs was significantly associated with overall survival.