I found some old bits in a tool box with aluminum embedded in them, I’d rather clean them up than buy new ones. Are there any methods for this that won’t damage the tool themselves?

Caustic soda or toilet bowl cleaner for a few hours should work - just make sure the tools don’t have any coating, or that will be dissolved too.