Impact

At least one group experienced problems adding new git roots via ZTNA into the Scope section of the Platform (at UTC-5 22-09-13 15:28 to 23-11-20 09:30 | Time to recover was 3.7 days). The incident was reported proactively (at UTC-5 23-11-16 16:43 | Time to detect was 14.1 Months) through our help desk [1] by a member of the experience team, who was setting up a PoC.

Cause

The problem originated during a migration, not considering inactive elements within the organization due to group deletion. The migration focused only on active group elements, leaving out the roots of the deleted groups. As a result, these group roots missed out on receiving the new attributes [2].

Solution

The team performed a new migration to add the missing data to the incomplete git roots [3].

Conclusion

Currently, there is no way to test this type of migration to ensure the completeness of the data, becoming prone to overlooking crucial elements, as observed in this instance. The team is working on new strategies to guarantee the integrity of the data after any migration to avoid these issues. DATA_QUALITY < FAILED_MIGRATION < MISSIGN_TEST