Contractile forces in the actomyosin cortex are required for cellular morphogenesis. This includes the invagination of the cell membrane during division, where filaments of nonmuscle myosin II (NMII) are responsible for generating contractile forces in the cortex. However, how NMII heterohexamers form filaments in vivo is not well understood. To quantify NMII filament assembly dynamics, we imaged the cortex of Caenorhabditis elegans embryos at high spatial resolution around the time of the first division. We show that during the assembly of the cytokinetic ring, the number of NMII filaments in the cortex increases and more NMII motors are assembled into each filament. These dynamics are influenced by two proteins in the RhoA GTPase pathway, the RhoA-dependent kinase LET-502 and the myosin phosphatase MEL-11. We find that these two proteins differentially regulate NMII activity at the anterior and at the division site. We show that the coordinated action of these regulators generates a gradient of free NMII in the cytoplasm driving a net diffusive flux of NMII motors toward the cytokinetic ring. Our work highlights how NMII filament assembly and disassembly dynamics are orchestrated over space and time to facilitate the up-regulation of cortical contractility during cytokinesis.