Archived Companywide outage

Status
Not open for further replies.
taytay said:
Not fully known at this time. Major shutdown was due to the services running in stores not responding appropriately which lead to the registers and myDevices calling HQ as a backup but suddenly every register enterprise wide was calling the central service which was not designed for every register calling at the same time which broke that service.
Click to expand...
Thanks for the explanation though and keep us posted if/when cause is determined
 
taytay said:
Not fully known at this time. Major shutdown was due to the services running in stores not responding appropriately which lead to the registers and myDevices calling HQ as a backup but suddenly every register enterprise wide was calling the central service which was not designed for every register calling at the same time which broke that service.
Click to expand...

That explains why returns were going through without issue, and why if you scanned an item 30-50 times it would finally ring up.

Seems like we need region or group based backup servers. This was absolutely nuts.
 
lifeblows10 said:
That explains why returns were going through without issue, and why if you scanned an item 30-50 times it would finally ring up.

Seems like we need region or group based backup servers. This was absolutely nuts.
Click to expand...
Region based would make sense or when something like this happens limit each store to only 3-4 registers. Target was just not prepared for this
 
taytay said:
Not fully known at this time. Major shutdown was due to the services running in stores not responding appropriately which lead to the registers and myDevices calling HQ as a backup but suddenly every register enterprise wide was calling the central service which was not designed for every register calling at the same time which broke that service.
Click to expand...
Explains why Price Change, ePick and Revlog Pulls still continued to scan properly. Thanks for updating us.
 
Don’t know about any other store but for us, we’ll the store I am at, this nightmare started yesterday when the, well to be honest no idea what exactly failed but fail it did in a spectacular fashion, bit that controls auofils and mancafs just decided to phone it in. Pulls that are normally in 60s to 80s were in the 20s. Then today the poor sod pulling market had 7 full tubs with only GRC1, GRC2, and GRC3. No idea if they got done pulling before it all went down.

Then today complete meltdown. So Sunday will be painful for who ever has to pull.
 
taytay said:
Not fully known at this time. Major shutdown was due to the services running in stores not responding appropriately which lead to the registers and myDevices calling HQ as a backup but suddenly every register enterprise wide was calling the central service which was not designed for every register calling at the same time which broke that service.
Click to expand...
There's definitely servers that are able to respond to that much requests, Targets are just under powered?
 
PotatoTomato said:
My ETL has the genius idea of doing order pickups for all the guests. This is not going to work and will probably make things worse.
Click to expand...

We were up and picking but orders couldn't be processed for pick up.. It was one of the apps along with my work that crashed. We were the only ones not dealing with the shit show.
 
Status
Not open for further replies.

Similar threads

E
Outage 1/5/2023
Replies
16
Views
1K
HInbound
H
E
  • Locked
Outage tracker
Replies
4
Views
2K
Hardlinesmaster
Hardlinesmaster
T
ESIM
Replies
15
Views
848
HInbound
H
E
Phone outage 1/16/23
Replies
10
Views
997
FlowTeamChick
F
E
Is there an outage?
Replies
9
Views
3K
versionDefect
versionDefect
Back
Top