Can I delete saved registry backup files from computer and keep only the last backup?
Yes.
Keep in mind that registry related issues may not be very obvious, it could be weeks or months before you encounter an issue because of registry cleaning. Although at that point the backup might be of no use.
the backup is only the removed items, it is not a full backup of your registry