I just post a code I use to find stuff associated with entities:
https://www.theswamp.org/index.php?topic=51751.0This will allow you to select an entity and step though the stuff that makes it up. For you, select an entity, then in the dialog select the extension dictionary (this is the first ename coded by number 360), then select the ename under "AcDbContextDataManager", as this is the name of the dictionary but the ename is the item after it in the list, then you will see a dictionary title "ACDB_ANNOTATIONSCALES" and you will select the ename after that. Then you will see a list of all the annotation scales, but you will have to look at them as they are named crypticly.
Once you find how to get there, I think you can use the 'dictremove' lisp function to remove one or more annoscales from the entity.
I don't use annoscales, but I hope this helps.