Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 164083 reports (Page 3187 of 3282)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX]
duration:
30.031098661s
FAIL (2025-06-26 06:08:19 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
iece_id=XCDEYSOUIIXRRK3U6KT4LRPLGRSMQ3VOPAF55K3I27JOYL4EDF7A, seg_pos={0 0}, upload=55347]: Uploading piece...
Jun 26 06:07:49.241458801 (68h56m16.167753487s) [noise=true , address=77.90.31.13:4626     , piece_id=C5N6PUVWR6E4NZGOBENZPXTMWMC7ADMUWC6Z2LHMQSWTNRQYJVSQ, seg_pos={0 0}, upload=55347]: Uploading piece...
Jun 26 06:07:49.241800555 (68h56m16.168095248s) [noise=true , address=77.90.31.17:4772     , piece_id=3WWORRAIQ55V6XNAYTJQ2INOXABI3UY4B2FWOH3TG5OSY5UE2XLA, seg_pos={0 0}, upload=55347]: Uploading piece...
Jun 26 06:07:49.241816528 (68h56m16.168111224s) [noise=true , address=45.91.116.6:4974     , piece_id=J7Z364IRCN53JESS5WUVEFMSR2GAJLF2CXSCIELPL4G6YGJ3HWYQ, seg_pos={0 0}, upload=55347]: Uploading piece...
Jun 26 06:07:49.242183501 (68h56m16.168478197s) [noise=true , address=104.36.82.3:4767     , piece_id=FADUUPOJIPRYWDQUBJGEBSOEKRY6MNJ5XVQLRNZPY6FOZWBPOXHQ, seg_pos={0 0}, upload=55347]: Uploading piece...
Jun 26 06:07:49.242364633 (68h56m16.168659325s) [noise=true , address=77.90.31.19:4843     , piece_id=EW7MTAHMW4QQKZ5O6RRKXZWD7HVY5T7I7O5QCTE3U7X5CAIGQXSA, seg_pos={0 0}, upload=55347]: Uploading piece...
Jun 26 06:07:49.242677644 (68h56m16.168972319s) [noise=true , address=45.91.116.13:4155    , piece_id=T5WDVSQDJGK33QHY3YNQU2DCYKKGTMP7SKSMUTINR777SATU7LCA, seg_pos={0 0}, upload=55347]: Uploading piece...
Jun 26 06:07:49.242808205 (68h56m16.169102894s) [noise=true , address=104.36.82.15:4259    , piece_id=DS4QQHVFUVHWTJ4HRU3WLPUH7IHCPYP3XFIQIZZNSBRLGFGC6NSQ, seg_pos={0 0}, upload=55347]: Uploading piece...
Jun 26 06:07:49.243262517 (68h56m16.169557203s) [noise=true , address=77.90.31.16:4734     , piece_id=B3LL363SGYXHBCMHXA5YIF5DKAZ7SDRYHEO6KL3XEJ63MWAHH6VQ, seg_pos={0 0}, upload=55347]: Uploading piece...
Jun 26 06:07:49.243745014 (68h56m16.170039706s) [noise=true , address=77.90.31.21:4878     , piece_id=NSFJJJTQWIF723LXBGVC2JLBW7PIHTDVB7AFELB7IETPHBKOTCEA, seg_pos={0 0}, upload=55347]: Uploading piece...
Jun 26 06:07:49.244186879 (68h56m16.170481568s) [noise=true , address=77.90.31.10:4520     , piece_id=RQCQK4L4LQJYXZF43K6Q5YHZEPSXBZ3CVBHMDPAG2DDJWVYMDFTA, seg_pos={0 0}, upload=55347]: Uploading piece...
Jun 26 06:07:49.244565443 (68h56m16.170860135s) [noise=true , address=45.91.116.10:4082    , piece_id=7S5UAYTUZNEJ22RXBTBICPYQQ6L3NRIMRBYDED4NQWULQGYYMYKQ, seg_pos={0 0}, upload=55347]: Uploading piece...
Jun 26 06:07:49.244973355 (68h56m16.171268044s) [noise=true , address=77.90.31.12:4592     , piece_id=V5YHUH5PX6EMNNE7BVQ3ULR2ADKMAXYHWCVJUIUK2P2BTW5MKVHA, seg_pos={0 0}, upload=55347]: Uploading piece...
Jun 26 06:07:49.245405608 (68h56m16.171700299s) [noise=true , address=104.36.82.12:4151    , piece_id=ONVL476GHECF6YM5FNA56YJPKUXPB4TEAUGD7A6QDY7I4Y2BSFIQ, seg_pos={0 0}, upload=55347]: Uploading piece...
Jun 26 06:07:49.248196877 (68h56m16.174491556s) [noise=true , address=77.90.31.18:4807     , piece_id=B43MHNVOAKQNY4RFN5REU5USIM7QBDB74AV423TWNDGML762L3ZA, seg_pos={0 0}, upload=55347]: Uploading piece...
Jun 26 06:07:49.332800764 (68h56m16.259095451s) [upload=55347]: Next returned nil segment
Jun 26 06:07:49.332815258 (68h56m16.259109944s) [upload=55347]: Waiting for error group managing segments...
Jun 26 06:07:49.339858293 (68h56m16.266152972s) [noise=true , address=104.36.82.15:4259    , piece_id=DS4QQHVFUVHWTJ4HRU3WLPUH7IHCPYP3XFIQIZZNSBRLGFGC6NSQ, seg_pos={0 0}, upload=55347]: Done uploading piece. err: <nil>
Jun 26 06:07:49.341015012 (68h56m16.26730969s) [noise=true , address=104.36.82.11:4113    , piece_id=XCDEYSOUIIXRRK3U6KT4LRPLGRSMQ3VOPAF55K3I27JOYL4EDF7A, seg_pos={0 0}, upload=55347]: Done uploading piece. err: <nil>
Jun 26 06:07:49.341626983 (68h56m16.267921662s) [noise=true , address=104.36.82.12:4151    , piece_id=ONVL476GHECF6YM5FNA56YJPKUXPB4TEAUGD7A6QDY7I4Y2BSFIQ, seg_pos={0 0}, upload=55347]: Done uploading piece. err: <nil>
Jun 26 06:07:49.342115651 (68h56m16.268410334s) [noise=true , address=104.36.82.3:4767     , piece_id=FADUUPOJIPRYWDQUBJGEBSOEKRY6MNJ5XVQLRNZPY6FOZWBPOXHQ, seg_pos={0 0}, upload=55347]: Done uploading piece. err: <nil>
Jun 26 06:08:19.135259338 (68h56m46.061554015s) [noise=true , address=77.90.31.12:4592     , piece_id=V5YHUH5PX6EMNNE7BVQ3ULR2ADKMAXYHWCVJUIUK2P2BTW5MKVHA, seg_pos={0 0}, upload=55347]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 06:08:19.135337684 (68h56m46.061632359s) [noise=true , address=77.90.31.11:4554     , piece_id=3557RWJQ45UKR6CTRNLT2AV2T4RTSQCJANHUYBSOTQEPYGOVEKPQ, seg_pos={0 0}, upload=55347]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: rpc: dial tcp 77.90.31.11:4554: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 06:08:19.135413354 (68h56m46.061708031s) [noise=true , address=77.90.31.13:4626     , piece_id=C5N6PUVWR6E4NZGOBENZPXTMWMC7ADMUWC6Z2LHMQSWTNRQYJVSQ, seg_pos={0 0}, upload=55347]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 06:08:19.135479186 (68h56m46.061773866s) [noise=true , address=77.90.31.19:4843     , piece_id=EW7MTAHMW4QQKZ5O6RRKXZWD7HVY5T7I7O5QCTE3U7X5CAIGQXSA, seg_pos={0 0}, upload=55347]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: rpc: dial tcp 77.90.31.19:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 06:08:19.135553159 (68h56m46.061847836s) [noise=true , address=77.90.31.16:4734     , piece_id=B3LL363SGYXHBCMHXA5YIF5DKAZ7SDRYHEO6KL3XEJ63MWAHH6VQ, seg_pos={0 0}, upload=55347]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 159.223.143.39:35196->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 06:08:19.135606860 (68h56m46.061901536s) [noise=true , address=77.90.31.10:4520     , piece_id=RQCQK4L4LQJYXZF43K6Q5YHZEPSXBZ3CVBHMDPAG2DDJWVYMDFTA, seg_pos={0 0}, upload=55347]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: rpc: dial tcp 77.90.31.10:4520: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 06:08:19.135655149 (68h56m46.061949829s) [noise=true , address=77.90.31.21:4878     , piece_id=NSFJJJTQWIF723LXBGVC2JLBW7PIHTDVB7AFELB7IETPHBKOTCEA, seg_pos={0 0}, upload=55347]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: write tcp 159.223.143.39:37892->77.90.31.21:4878: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 06:08:19.135686878 (68h56m46.061981568s) [noise=true , address=77.90.31.17:4772     , piece_id=3WWORRAIQ55V6XNAYTJQ2INOXABI3UY4B2FWOH3TG5OSY5UE2XLA, seg_pos={0 0}, upload=55347]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:58138->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 06:08:19.135720102 (68h56m46.062014778s) [noise=true , address=45.91.116.10:4082    , piece_id=7S5UAYTUZNEJ22RXBTBICPYQQ6L3NRIMRBYDED4NQWULQGYYMYKQ, seg_pos={0 0}, upload=55347]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 159.223.143.39:47532->45.91.116.10:4082: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 06:08:19.135757433 (68h56m46.062052106s) [noise=true , address=45.91.116.6:4974     , piece_id=J7Z364IRCN53JESS5WUVEFMSR2GAJLF2CXSCIELPL4G6YGJ3HWYQ, seg_pos={0 0}, upload=55347]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 159.223.143.39:45450->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 06:08:19.135779990 (68h56m46.062074669s) [noise=true , address=77.90.31.18:4807     , piece_id=B43MHNVOAKQNY4RFN5REU5USIM7QBDB74AV423TWNDGML762L3ZA, seg_pos={0 0}, upload=55347]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 159.223.143.39:53946->77.90.31.18:4807: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 06:08:19.135796777 (68h56m46.062091455s) [noise=true , address=45.91.116.13:4155    , piece_id=T5WDVSQDJGK33QHY3YNQU2DCYKKGTMP7SKSMUTINR777SATU7LCA, seg_pos={0 0}, upload=55347]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 159.223.143.39:34020->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 06:08:19.135837560 (68h56m46.062132242s) [seg_pos={0 0}, upload=55347]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Jun 26 06:08:19.164364757 (68h56m46.09065944s) [upload=55347]: Done uploading segments...
Jun 26 06:08:19.164412307 (68h56m46.090706994s) [upload=55347]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 30.031112601s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................]
duration:
630.188399ms
FAIL (2025-06-26 06:07:58 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 630.220189ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration:
177.111199ms
FAIL (2025-06-26 06:07:53 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 177.136811ms edge authservice http bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.037774132s
FAIL (2025-06-26 06:07:49 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
PA, seg_pos={0 0}, upload=55325]: Done uploading piece. err: <nil>
Jun 26 06:06:18.077213217 (68h54m45.003507897s) [seg_pos={0 0}, upload=55325]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 26 06:06:18.077290751 (68h54m45.003585441s) [upload=55325]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 26 06:06:18.077295752 (68h54m45.003590445s) [upload=55325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 26 06:06:18.143317897 (68h54m45.069612578s) [upload=55325]: Done uploading segments...
Jun 26 06:06:18.143336818 (68h54m45.069631495s) [upload=55325]: Upload finished. err: <nil>
Jun 26 06:07:19.035622859 (68h55m45.961917554s) [upload=55340]: Starting upload
Jun 26 06:07:19.035739692 (68h55m45.962034383s) [upload=55340]: Done starting upload
Jun 26 06:07:19.035842835 (68h55m45.962137577s) [upload=55340]: Uploading segments...
Jun 26 06:07:19.036194093 (68h55m45.962488784s) [upload=55340]: Got next segment. Inline: false
Jun 26 06:07:19.036269272 (68h55m45.962563951s) [upload=55340]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 26 06:07:19.036276108 (68h55m45.962570804s) [upload=55340]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 26 06:07:19.068289708 (68h55m45.994584413s) [seg_pos={0 0}, upload=55340]: Begin upload segment...
Jun 26 06:07:19.068360168 (68h55m45.994654864s) [seg_pos={0 0}, upload=55340]: Done begin upload segment.
Jun 26 06:07:19.068410263 (68h55m45.994704959s) [noise=true , address=104.36.82.2:4729     , piece_id=HAQYG2XGC2KUIJIFTU63IZGM66P6RPU5VIBIOD4VEFFIFWDCI3UA, seg_pos={0 0}, upload=55340]: Uploading piece...
Jun 26 06:07:19.068887226 (68h55m45.995181919s) [noise=true , address=104.36.82.15:4257    , piece_id=FZS4DV3UN5SFXZKMPZWJP5LMB363JFHRQPQLWZRDLCPWNFOKOSJQ, seg_pos={0 0}, upload=55340]: Uploading piece...
Jun 26 06:07:19.068956232 (68h55m45.995250929s) [noise=true , address=104.36.82.10:4077    , piece_id=MW5ISEZ5GOUOYBYIBMZO2VA4BKDBAX3TRJHQB3M6NMOMDZAMD5CA, seg_pos={0 0}, upload=55340]: Uploading piece...
Jun 26 06:07:19.069285875 (68h55m45.995580569s) [noise=true , address=104.36.82.12:4150    , piece_id=OQTRN3INEZJCXTHGMNYI6DISEAN44ZWNURC3QPET7YQ35VV3QITQ, seg_pos={0 0}, upload=55340]: Uploading piece...
Jun 26 06:07:19.069495525 (68h55m45.995790219s) [noise=true , address=104.36.82.6:4873     , piece_id=KQBAAC6MSJHQJNNLTR23ZT7R3X3TFN3ON7L52LASDPKOKWZH6EMQ, seg_pos={0 0}, upload=55340]: Uploading piece...
Jun 26 06:07:19.069666084 (68h55m45.995960786s) [noise=true , address=104.36.82.11:4113    , piece_id=67TFOQFYFTNZD4U7H23ROPKLJITJLEIBSH27YRHVVT7ZUL3RO2RA, seg_pos={0 0}, upload=55340]: Uploading piece...
Jun 26 06:07:19.069965522 (68h55m45.996260215s) [noise=true , address=77.90.31.15:4698     , piece_id=Z46O3RZZVGRLMCSLMUPICQZU5XAHMGDTF4YAQ6FWTKTAR64GP5GA, seg_pos={0 0}, upload=55340]: Uploading piece...
Jun 26 06:07:19.070065098 (68h55m45.996359794s) [noise=true , address=104.36.82.13:4187    , piece_id=IEUC24VTX65EM2FLHTQSTOZKMJKNGMARGBI7JRK2WREBZIWT5I4Q, seg_pos={0 0}, upload=55340]: Uploading piece...
Jun 26 06:07:19.070504022 (68h55m45.996798709s) [noise=true , address=104.36.82.14:4223    , piece_id=GL6CEWVGCXJBKKZYSJNJC6TYUOMCSRP7UVVF7LZSNCLLYKTJE3VQ, seg_pos={0 0}, upload=55340]: Uploading piece...
Jun 26 06:07:19.070525898 (68h55m45.996820598s) [noise=true , address=45.91.116.5:5298     , piece_id=AVSMEAQ3JGQGU2BBI5HC7PDXVBKJRGC4TNS2AQZQLHXMG2U3ZGFA, seg_pos={0 0}, upload=55340]: Uploading piece...
Jun 26 06:07:19.070936299 (68h55m45.997231103s) [noise=true , address=104.36.82.7:4912     , piece_id=XDPISLDHANLXGIWZMGMF4EHTSOZKAOYKTER6BHXWTNODTOI7ZZEA, seg_pos={0 0}, upload=55340]: Uploading piece...
Jun 26 06:07:19.070951453 (68h55m45.997246146s) [noise=true , address=45.91.116.12:5226    , piece_id=JM3RHVN6KG6YQYP7GTVYAG64GKUMUOO3TY6BKRAMSSONFVTJ5H7A, seg_pos={0 0}, upload=55340]: Uploading piece...
Jun 26 06:07:19.071383223 (68h55m45.997677926s) [noise=true , address=77.90.31.12:4589     , piece_id=GVFFI23232D4XAICJF5Z2JML3EWGACZXP56KE3MKMJWEXFMIZZDA, seg_pos={0 0}, upload=55340]: Uploading piece...
Jun 26 06:07:19.071414399 (68h55m45.997709089s) [noise=true , address=104.36.82.8:4969     , piece_id=CUA4QFNEI42SQOLYQILYIEPNJJ5V3HESAWLBMSDVJOZIH5NQEINA, seg_pos={0 0}, upload=55340]: Uploading piece...
Jun 26 06:07:19.071863449 (68h55m45.998158145s) [noise=true , address=104.36.82.3:4765     , piece_id=JI5YRABHVN5W7OE6C7SN4VMAFVNQWTNFZ5JIDRFKXDP7OR6BW37A, seg_pos={0 0}, upload=55340]: Uploading piece...
Jun 26 06:07:19.072258167 (68h55m45.99855286s) [noise=true , address=77.90.31.16:4735     , piece_id=I6AB2Z6MV4GSNS4Y2QNUVPNRN2TJQW5ZWNTH3LL6E22TDWFTVRFA, seg_pos={0 0}, upload=55340]: Uploading piece...
Jun 26 06:07:19.188330371 (68h55m46.114625094s) [upload=55340]: Next returned nil segment
Jun 26 06:07:19.188363363 (68h55m46.11465806s) [upload=55340]: Waiting for error group managing segments...
Jun 26 06:07:19.195212013 (68h55m46.12150671s) [noise=true , address=104.36.82.10:4077    , piece_id=MW5ISEZ5GOUOYBYIBMZO2VA4BKDBAX3TRJHQB3M6NMOMDZAMD5CA, seg_pos={0 0}, upload=55340]: Done uploading piece. err: <nil>
Jun 26 06:07:19.195811737 (68h55m46.122106411s) [noise=true , address=104.36.82.7:4912     , piece_id=XDPISLDHANLXGIWZMGMF4EHTSOZKAOYKTER6BHXWTNODTOI7ZZEA, seg_pos={0 0}, upload=55340]: Done uploading piece. err: <nil>
Jun 26 06:07:19.195858757 (68h55m46.122153431s) [noise=true , address=104.36.82.3:4765     , piece_id=JI5YRABHVN5W7OE6C7SN4VMAFVNQWTNFZ5JIDRFKXDP7OR6BW37A, seg_pos={0 0}, upload=55340]: Done uploading piece. err: <nil>
Jun 26 06:07:19.196319433 (68h55m46.122614109s) [noise=true , address=104.36.82.8:4969     , piece_id=CUA4QFNEI42SQOLYQILYIEPNJJ5V3HESAWLBMSDVJOZIH5NQEINA, seg_pos={0 0}, upload=55340]: Done uploading piece. err: <nil>
Jun 26 06:07:19.196448853 (68h55m46.122743539s) [noise=true , address=104.36.82.13:4187    , piece_id=IEUC24VTX65EM2FLHTQSTOZKMJKNGMARGBI7JRK2WREBZIWT5I4Q, seg_pos={0 0}, upload=55340]: Done uploading piece. err: <nil>
Jun 26 06:07:19.196873842 (68h55m46.12316853s) [noise=true , address=104.36.82.6:4873     , piece_id=KQBAAC6MSJHQJNNLTR23ZT7R3X3TFN3ON7L52LASDPKOKWZH6EMQ, seg_pos={0 0}, upload=55340]: Done uploading piece. err: <nil>
Jun 26 06:07:19.196935394 (68h55m46.123230067s) [noise=true , address=104.36.82.14:4223    , piece_id=GL6CEWVGCXJBKKZYSJNJC6TYUOMCSRP7UVVF7LZSNCLLYKTJE3VQ, seg_pos={0 0}, upload=55340]: Done uploading piece. err: <nil>
Jun 26 06:07:19.197457053 (68h55m46.123751726s) [noise=true , address=104.36.82.11:4113    , piece_id=67TFOQFYFTNZD4U7H23ROPKLJITJLEIBSH27YRHVVT7ZUL3RO2RA, seg_pos={0 0}, upload=55340]: Done uploading piece. err: <nil>
Jun 26 06:07:19.197510895 (68h55m46.123805585s) [noise=true , address=104.36.82.15:4257    , piece_id=FZS4DV3UN5SFXZKMPZWJP5LMB363JFHRQPQLWZRDLCPWNFOKOSJQ, seg_pos={0 0}, upload=55340]: Done uploading piece. err: <nil>
Jun 26 06:07:19.197925745 (68h55m46.124220417s) [noise=true , address=104.36.82.12:4150    , piece_id=OQTRN3INEZJCXTHGMNYI6DISEAN44ZWNURC3QPET7YQ35VV3QITQ, seg_pos={0 0}, upload=55340]: Done uploading piece. err: <nil>
Jun 26 06:07:19.198099537 (68h55m46.12439422s) [noise=true , address=104.36.82.2:4729     , piece_id=HAQYG2XGC2KUIJIFTU63IZGM66P6RPU5VIBIOD4VEFFIFWDCI3UA, seg_pos={0 0}, upload=55340]: Done uploading piece. err: <nil>
Jun 26 06:07:49.008944931 (68h56m15.935239631s) [noise=true , address=45.91.116.12:5226    , piece_id=JM3RHVN6KG6YQYP7GTVYAG64GKUMUOO3TY6BKRAMSSONFVTJ5H7A, seg_pos={0 0}, upload=55340]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:5226): protocol: rpc: dial tcp 45.91.116.12:5226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 06:07:49.009193698 (68h56m15.935488394s) [noise=true , address=77.90.31.16:4735     , piece_id=I6AB2Z6MV4GSNS4Y2QNUVPNRN2TJQW5ZWNTH3LL6E22TDWFTVRFA, seg_pos={0 0}, upload=55340]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: rpc: dial tcp 77.90.31.16:4735: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 06:07:49.009332694 (68h56m15.935627383s) [noise=true , address=45.91.116.5:5298     , piece_id=AVSMEAQ3JGQGU2BBI5HC7PDXVBKJRGC4TNS2AQZQLHXMG2U3ZGFA, seg_pos={0 0}, upload=55340]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:5298): protocol: write tcp 159.223.143.39:52494->45.91.116.5:5298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 06:07:49.009461287 (68h56m15.93575596s) [noise=true , address=77.90.31.12:4589     , piece_id=GVFFI23232D4XAICJF5Z2JML3EWGACZXP56KE3MKMJWEXFMIZZDA, seg_pos={0 0}, upload=55340]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:39176->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 06:07:49.009509372 (68h56m15.935804045s) [noise=true , address=77.90.31.15:4698     , piece_id=Z46O3RZZVGRLMCSLMUPICQZU5XAHMGDTF4YAQ6FWTKTAR64GP5GA, seg_pos={0 0}, upload=55340]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: write tcp 159.223.143.39:57642->77.90.31.15:4698: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 06:07:49.009528353 (68h56m15.935823063s) [seg_pos={0 0}, upload=55340]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Jun 26 06:07:49.041471570 (68h56m15.967766251s) [upload=55340]: Done uploading segments...
Jun 26 06:07:49.041559110 (68h56m15.96785381s) [upload=55340]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 30.037800663s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration:
691.395803ms
FAIL (2025-06-26 06:07:34 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 691.968625ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.001438767s
FAIL (2025-06-26 06:07:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001466949s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration:
912.23403ms
FAIL (2025-06-26 06:07:03 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 912.258919ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
161.482433ms
FAIL (2025-06-26 06:06:43 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 161.509405ms edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
198.771598ms
FAIL (2025-06-26 06:06:17 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 198.934ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
712.087757ms
FAIL (2025-06-26 06:06:14 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 712.140288ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
751.227462ms
FAIL (2025-06-26 06:05:28 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 751.253014ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
134.708834ms
FAIL (2025-06-26 06:05:25 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 134.740356ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
894.678534ms
FAIL (2025-06-26 06:04:53 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 895.212241ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration:
171.369284ms
FAIL (2025-06-26 06:04:30 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 171.398177ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration:
784.022944ms
FAIL (2025-06-26 06:04:13 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 784.073844ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration:
698.305753ms
FAIL (2025-06-26 06:03:36 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 698.332226ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration:
179.564124ms
FAIL (2025-06-26 06:03:17 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 179.633156ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................]
duration:
870.643965ms
FAIL (2025-06-26 06:03:12 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 870.66644ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
824.971911ms
FAIL (2025-06-26 06:02:54 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 824.995979ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................]
duration:
173.562219ms
FAIL (2025-06-26 06:02:38 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 173.587455ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
670.776858ms
FAIL (2025-06-26 06:01:45 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 670.807494ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
155.708972ms
FAIL (2025-06-26 06:01:43 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 155.731502ms edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
204.783422ms
FAIL (2025-06-26 06:00:47 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 204.809096ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
780.651675ms
FAIL (2025-06-26 06:00:35 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 780.737264ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
982.84522ms
FAIL (2025-06-26 06:00:19 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 982.874059ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
1.236803436s
FAIL (2025-06-26 06:00:13 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 1.236845415s edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
198.470986ms
FAIL (2025-06-26 05:59:45 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 198.499849ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
669.326738ms
FAIL (2025-06-26 05:59:04 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 669.626321ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
186.198262ms
FAIL (2025-06-26 05:58:54 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 186.226142ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
753.048716ms
FAIL (2025-06-26 05:58:24 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 753.097381ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
666.251773ms
FAIL (2025-06-26 05:57:55 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 666.326806ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
164.852851ms
FAIL (2025-06-26 05:57:44 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 164.915382ms edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
136.03881ms
FAIL (2025-06-26 05:57:00 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 136.064136ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
742.333705ms
FAIL (2025-06-26 05:56:59 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 742.358276ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
160.538994ms
FAIL (2025-06-26 05:56:43 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 160.564622ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
819.896505ms
FAIL (2025-06-26 05:56:41 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 819.936101ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
944.241649ms
FAIL (2025-06-26 05:55:42 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 944.351801ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
318.646276ms
FAIL (2025-06-26 05:55:39 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 318.669176ms edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
289.329034ms
FAIL (2025-06-26 05:54:40 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 289.352899ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
879.993359ms
FAIL (2025-06-26 05:54:38 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 880.029773ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
176.821765ms
FAIL (2025-06-26 05:53:54 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 176.912177ms edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
204.150079ms
FAIL (2025-06-26 05:53:35 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 204.173893ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
895.243025ms
FAIL (2025-06-26 05:53:28 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 895.266778ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
136.859048ms
FAIL (2025-06-26 05:53:05 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 136.885265ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
782.679537ms
FAIL (2025-06-26 05:52:40 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 782.737188ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
211.977599ms
FAIL (2025-06-26 05:52:38 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 212.002293ms edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
205.219055ms
FAIL (2025-06-26 05:52:06 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 205.24354ms edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
363.903538ms
FAIL (2025-06-26 05:51:38 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 363.932105ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
785.114835ms
FAIL (2025-06-26 05:51:37 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 785.136791ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
195.860372ms
FAIL (2025-06-26 05:50:41 UTC)
orbiter warning: unexpected status code "500 Internal Server Error"
"\n"
Duration: 195.885473ms edge authservice http bgp us1