The neural plasticity underlying language learning is a process rather than a single event. However, the dynamics of training - induced brain reorganization have rarely been examined, especially using a multimodal magnetic resonance imaging approach, which allows us to study the relationship between functional and structural changes. We focus on sign language acquisition in hearing adults who underwent an 8‐month long course and five neuroimaging sessions. We assessed what neural changes occurred as participants learned a new language in a different modality - as reflected by task‐based activity, connectivity changes, and co‐occurring structural alterations. Major changes in the activity pattern appeared after just 3 months of learning, as indicated by increases in activation within the modality‐independent perisylvian language network, together with increased activation in modality‐dependent parieto‐occipital, visuospatial and motion‐sensitive regions. Despite further learning, no alterations in activation were detected during the following months. However, enhanced coupling between left‐lateralized occipital and inferior frontal regions was observed as the proficiency increased. Furthermore, an increase in gray matter volume was detected in the left inferior frontal gyrus which peaked at the end of learning. Overall, these results showed complexity and temporal distinctiveness of various aspects of brain reorganization associated with learning of new language in different sensory modality.