Data not refreshing overnight
Ticketclosed
Fenmoor Specialty Underwriting: documents · Data not refreshing overnight
Submissions data was not refreshing overnight; the refresh job timed out and then hung on the submissions table. Bethan Lister restarted the job and confirmed data would be complete by 15:30.
What happened
What this says
Current to 10 Oct 26Submissions data was not refreshing overnight; the refresh job timed out and then hung on the submissions table. Bethan Lister restarted the job and confirmed data would be complete by 15:30.
Problem: The overnight refresh failed to complete by 07:00; the submissions data was showing as of yesterday morning instead of yesterday end of day. Handling: Bethan checked the refresh logs and found the previous night's job had timed out at 23:47. After a restart at 05:30, the job hung on the submissions table, indicating a performance issue. She escalated to the platform team and restarted the refresh, confirming completion by 15:30. Watch: Data freshness SLA was missed.
Details
Updated 9 Oct 26Trail
created · Callum Reid 15 Apr 2025 12:08Hi, We're running a daily reconciliation with the capacity providers and the submissions data in the brain is showing as of yesterday morning, not yesterday end of day. The refresh should be complete by 07:00 but we're still looking at stale data. Can you check what's happening with the overnight refresh? We need to confirm the data is working properly before we run our reports.- public_reply · Bethan Lister 15 Apr 2025 13:47Hi Callum, Thanks for flagging this. Just so I've got this right – you're expecting data from yesterday evening, but the brain is showing yesterday morning as the latest. And the overnight refresh should be complete by 07:00? Let me check the refresh logs for you. In the meantime, can you tell me if you're seeing the stale data across all submission records or just some specific ones? Bethan
- public_reply · Callum Reid 16 Apr 2025 11:47The stale data is across all submissions – none have refreshed from yesterday. We need to sort this out today for our reporting, otherwise we'll have to pull the data manually and reconcile outside the brain. What's the status on your investigation?
- internal_note · Bethan Lister 16 Apr 2025 11:57Checked refresh logs. Previous night's job timed out at 23:47, restarted at 05:30 but hit a hang on the submissions table. Escalating to platform – likely a data volume or performance issue.
- public_reply · Callum Reid 16 Apr 2025 14:27Any update? We're closing out the daily report soon and we need to decide whether to use the brain data or pull the data manually. Let me know.
- public_reply · Bethan Lister 16 Apr 2025 14:52Callum, We've restarted the refresh job and it's running now. We should have yesterday's data refreshed and complete by 15:30. Once that's done the brain will have the full submissions dataset and you'll be able to run your reconciliation. Let me know once you've checked it through. Bethan
- status_change · 20 Apr 2025 23:59