With the construction of the ESS, the European neutron user community is eagerly awaiting the commissioning of the brightest neutron source worldwide in 2021. Parallel to this, there is however the ongoing development of neutron science being undertaken at a dwindling number of neutron facilities worldwide. The Jülich Centre for Neutron Science has started a project to develop and design compact accelerator-driven high brilliance neutron sources as an efficient and cost effective alternative to the current low- and medium-flux reactor and spallation sources with the potential to offer science and industry access to neutrons. The project aims to deliver a high brilliance neutron source (HBS), consisting of a compact neutron production and moderator system which provides thermal and cold neutrons with high brilliance efficiently extracted in an optimized neutron transport system. By shaping the experiment holistically from the source to the detector, neutron experiments could be set-up for specific scientific requirements in a flexible and efficient way for the neutron user.