Head and neck squamous cell carcinoma (HNSCC) is one of the most common tumor entities worldwide, with human papillomavirus (HPV) infection contributing to cancer development. Conventional therapies achieve only limited efficiency, especially in recurrent or metastatic HNSCC. As the immune landscape decisively impacts the survival of patients and treatment efficacy, this study comprehensively investigated the immunological tumor microenvironment (TME) and its association with patient outcome, with special focus on several dendritic cell (DC) and T lymphocyte subpopulations. Therefore, formalin-fixed paraffin-embedded tumor samples of 56 HNSCC patients, who have undergone resection and adjuvant radiotherapy, were analyzed by multiplex immunohistochemistry focusing on the detailed phenotypic characterization and spatial distribution of DCs, CD8⁺ T cells, and T-helper cell subsets in different tumor compartments. Immune cell densities and proportions were correlated with clinical characteristics of the whole HNSCC cohort and different HPV- or hypoxia-associated subcohorts. Tumor stroma was highly infiltrated by plasmacytoid DCs and T lymphocytes. Among the T-helper cells and CD8⁺ T cells, stromal regulatory T cells and intraepithelial exhausted CD8⁺ T cells expressing programmed cell death protein-1 (PD-1⁺) and/or lymphocyte-activation gene-3 (LAG-3⁺) were the predominant phenotypes, indicating an immunosuppressive TME. HPV-associated tumors showed significantly higher infiltration of type I and type II conventional DCs (cDC1, cDC2) as well as several CD8⁺ T cell phenotypes including exhausted, activated, and proliferating T cells. On the contrary, tumors with hypoxia-associated gene signatures exhibited reduced infiltration for these immune cells. By multivariate Cox regression, immune-related prognostic factors were identified. Patient clusters defined by high infiltration of DCs and T lymphocytes combined with HPV positivity or low hypoxia showed significantly prolonged survival. Thereby, cDC1 and CD8⁺ T cells emerged as independent prognostic factors for local and distant recurrence. These results might contribute to the implementation of an immune cell infiltration score predicting HNSCC patients’ survival and such patient stratification might improve the design of future individualized radiochemo-(immuno)therapies.