We report on the simple fabrication of Ag NP films via thermal evaporation and subsequent annealing. The NPs are formed on indium tin oxide electrodes, coated with PEDOT:PSS and implemented into PCPDTBT:PC70BM solar cells. Scanning electron microscopy and atomic force microscopy are used to determine the size distributions and surface coverage of the NP film. We apply finite-difference time-domain techniques to model the optical properties of different nanoparticle films and compare this with the absorption properties of the organic active layer. The simulations demonstrate that the absorption and scattering efficiency of the particles are very sensitive to particle geometry. Solar cells prepared with window electrodes containing NP layers with less surface coverage, show a 14.8% improvement in efficiency. We discuss variations in the external quantum efficiency of the devices in terms of forward scattering and parasitic absorption losses induced by the NP layer.