Your die isn't scratched, it has brass galling on the steel. (Powder carbon has nothing significant to do with it, if that were true a bore would hardly last a hundred rounds.)
Galling is caused by rubbing two metals together under high pressure without sufficent lubracant. It starts with dry microscopic bits of the softer metal adhering to the harder as firmly as if welded. Once it starts each successive sizing pass adds more metal and the build up accelerates. Casual removal efforts with normal cleaning materials cannot remove the solid bits of brass but a few days soaking in a copper disolving bore cleaner containing ammonia might do it.
What I have done, many times, is to make a neck cleaning "lap" with a proper diameter and short lenth of wood dowel wrapped with a tightly wound bit of a green 3M 'pot scrubber" pad stolen from my wife. Chuck the lap in an electric drill motor, wet the pad with a squit of any light oil and push it into the die for a couple of minutes, remove, clean the die and size a case to see if you've cleared the galling. If not, repeat until you do. (4/0 steel wool will do it too but not as quickly as the 3M pads.) Don't worry about dulling the die's mirror finish, a matt finish holds lubracant better and therefore ******* a recurrance of the galling.
You will NOT materially enlarge the die with this method. Sizers are case hardened and it takes a grinder or sander to change one; a file or hacksaw won't touch it.
When you get it clean, use enough case lube to prevent recurrance or you'll be cleaning it again soon. Or, better yet, get a Lee collet neck die and forget about lubing at all. And you'll probably obtain straighter necks too. lightbulb