In this article we study determinantal representations of adjoint hypersurfaces of polytopes. We prove that adjoint polynomials of all polygons can be represented as determinants of tridiagonal symmetric matrices of linear forms with the matrix size being equal to the degree of the adjoint. We prove a sufficient combinatorial condition for a surface in the projective three-space to have a determinantal representation and use it to show that adjoints of all three-dimensional polytopes with at most eight facets and a simple facet hyperplane arrangement admit a determinantal representation. This includes all such polytopes with a smooth adjoint. We demonstrate that, starting from four dimensions, adjoint hypersurfaces may not admit linear determinantal representations. Along the way we prove that, starting from three dimensions, adjoint hypersurfaces are typically singular, in contrast to the two-dimensional case. We also consider a special case of interest to physics, the ABHY associahedron named after Arkani-Hamed, Bai, He and Yan. We construct a determinantal representation of its universal adjoint in three dimensions and show that in higher dimensions a similarly structured representation does not exist.