The principle of trained immunity represents innate immune memory due to sustained, mainly epigenetic, changes triggered by endogenous or exogenous stimuli in bone marrow (BM) progenitors (central trained immunity) and their innate immune cell progeny, thereby triggering elevated responsiveness against secondary stimuli. BM progenitors can respond to microbial and sterile signals, thereby possibly acquiring trained immunity-mediated long-lasting alterations that may shape the fate and function of their progeny, for example, neutrophils. Neutrophils, the most abundant innate immune cell population, are produced in the BM from committed progenitor cells in a process designated granulopoiesis. Neutrophils are the first responders against infectious or inflammatory challenges and have versatile functions in immunity. Together with other innate immune cells, neutrophils are effectors of peripheral trained immunity. However, given the short lifetime of neutrophils, their ability to acquire immunological memory may lie in the central training of their BM progenitors resulting in generation of reprogrammed, that is, “trained”, neutrophils. Although trained immunity may have beneficial effects in infection or cancer, it may also mediate detrimental outcomes in chronic inflammation. Here, we review the emerging research area of trained immunity with a particular emphasis on the role of neutrophils and granulopoiesis.