What happened
What this says
Current to 11 Oct 26Three to five shipper accounts appeared twice with identical data, residue from initial sync. Root cause was retry logic that did not check for existing records. Solved 30 Mar 2026.
Problem: Bas Vermeulen reported duplicate shipper account records appearing in searches, estimated three to five accounts affected. He suspected residue from the initial connector sync rather than an ongoing issue.
Handling: Bethan Lister and Ewan Pryce investigated. The source CRM had no duplicates; BB-Demo's ingestion service retry logic created them during import. Fixed in the ingestion service and a re-index cleaned the data. Solved on 30 Mar 2026.
Watch: This was a one-time historical data quality issue, not an ongoing problem, and was resolved cleanly. Data quality investigation was thorough and the root cause was fixed at the platform level.
Details
Updated 9 Oct 26Trail
- created · Bas Vermeulen 6 Mar 2026 08:38We're seeing duplicate shipper records in the brain. Some accounts are appearing twice with all the same fields. When I query for a shipper I sometimes get multiple results for the same entity. Is this a known issue? How do we clean this up?
- public_reply · Bethan Lister 6 Mar 2026 15:03Thanks for reporting that. Just so I've got this right: you're seeing multiple records for the same shipper account with identical data in all fields. Is that right? And can you tell me roughly how many shipper accounts are affected?
- public_reply · Bas Vermeulen 10 Mar 2026 10:00I'd estimate about a handful of accounts, maybe between three and five. The duplicates look like they came in from the initial sync. I can list them out if you need, but it seems like a historical data quality issue rather than something happening now.
- public_reply · Bethan Lister 11 Mar 2026 16:10That's helpful. It sounds like during the initial connector setup, some records came through twice. I'm going to check the CRM source to see whether those duplicates exist there too, or whether they were created during the import.
- internal_note · Bethan Lister 13 Mar 2026 10:58Checked the source CRM. The shipper accounts don't duplicate there. The duplicate records were created during the initial connector sync. Root cause was a retry logic that didn't check for existing records. Fixed in the ingestion service. Running a re-index now to clean up the duplicates.
- public_reply · Bas Vermeulen 13 Mar 2026 15:45Brilliant, that's sorted. The duplicates are gone and the shipper search is clean now. Thanks for the quick fix.
- status_change · 3 Apr 2026 23:59