Quantum many-body systems are commonly considered as quantum chaotic if their spectral statistics, such as the level spacing distribution, agree with those of random matrix theory (RMT). Using the example of the kicked Ising chain we demonstrate that even if both level spacing distribution and eigenvector statistics agree well with random matrix predictions, the entanglement entropy deviates from the expected RMT behavior, i.e., the Page curve. To explain this observation we propose a quantity that is based on the effective Hamiltonian of the kicked system. Specifically, we analyze the distribution of the strengths of the effective spin interactions and compare them with analytical results that we obtain for circular ensembles. Thereby we group the effective spin interactions corresponding to the number k of spins which contribute to the interaction. By this the deviations of the entanglement entropy can be attributed to significantly different behavior of the k-spin interactions compared with RMT.