If those entries points directly to programs that you don't got anymore, then it's safe to delete. If you are unsure, you can always make a backup of that entry (right click>Export).
Yes, registry cleaners are unable to find all invalid entries from your registry. I have also deleted many entries manually. You bumped to them from time to time...