If the brain is deprived of input from one or more senses during development, functional and structural reorganization of the deprived regions takes place. However, little is known about how sensory deprivation affects large-scale brain networks. In the present study, we use data-driven independent component analysis (ICA) to characterize large-scale brain networks in 15 deaf early signers and 24 hearing non-signers based on resting-state functional MRI data. We found differences between the groups in independent components representing the left lateralized control network, the default network, the ventral somatomotor network, and the attention network. In addition, we showed stronger functional connectivity for deaf compared to hearing individuals from the middle and superior temporal cortices to the cingulate cortex, insular cortex, cuneus and precuneus, supramarginal gyrus, supplementary motor area, and cerebellum crus 1, and stronger connectivity for hearing non-signers to hippocampus, middle and superior frontal gyri, pre- and postcentral gyri, and cerebellum crus 8. These results show that deafness induces large-scale network reorganization, with the middle/superior temporal cortex as a central node of plasticity. Cross-modal reorganization may be associated with behavioral adaptations to the environment, including superior ability in some visual functions such as visual working memory and visual attention, in deaf signers.