Reconfiguring Colloidal Solids with Defects Using Active Matter