This paper explores a complex mode of architectural restoration that restores the historic clarity of a building by a mode of ‘improvisation’ — a constant demolition and constant creation of a built fabric. This is conducted through drawing parallels with the complex restorative procedures performed by Carlo Scarpa in the “Museo Civico di Castelvecchio” (Castelvecchio museum) with that performed by jazz musicians in the improvisation process over an existing musical piece. Such cross-examination with the improvisative restoration in jazz offers a lens to elucidate the complex restorative scheme performed in the Castelvecchio museum in which was conducted by three acts of alterations.