The mother of a convicted robber who killed an autistic man with a single punch has described his crime as “not a big deal”.