We use a custom property field to group nodes to specific applications so our alerts are easier to manage. The value in one of these property fields was somehow deleted for one node. That node failed due to lack of disk space and no alerts generated because the 'system name' was not equal to the application referenced in the alert. Does anyone know how this could be deleted if not by an administrator?
I went back through our alerts from even a week ago to ensure it did previously have that data entered, and it did. We do scrape against other information sources to keep Orion up to date, but this particular property field was chosen specifically because it is not used anywhere else (AD, SIM, SCOM...). We're running APM v3.5 (with NPM v10.0) and we haven't seen this before. If anyone else has seen this, or has a suggestion as to what may have caused it, please let us know. It's possible that this has happened before and we just never noticed. We noticed it this morning because there was a failure that we failed to alert on in advance.