Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.98232ms remote:
"tcp:45.38.24.2:443" response headers:
Date=Tue, 03 Mar 2026 19:41:46 GMT Vary=Origin X-Amz-Request-Id=18996C35DF0F158F X-Request-Id=bJ88Myfm38z Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/65184bc3a09dd3a5
FAIL (2026-03-03 19:41:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C35DF0F158F</RequestId><HostId></HostId></Error>"
Duration: 28.006654ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
227.330379ms trace:
https://jaeger.dev.storj.io/trace/47b2d030c986ec21
FAIL (2026-03-03 19:41:44 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Mar 3 19:31:17.587953606 (335h15m18.39131278s) [upload=348657]: Starting upload Mar 3 19:31:17.588026796 (335h15m18.391385973s) [upload=348657]: Done starting upload Mar 3 19:31:17.588112394 (335h15m18.391471563s) [upload=348657]: Uploading segments... Mar 3 19:31:17.588167884 (335h15m18.391527068s) [upload=348657]: Got next segment. Inline: true Mar 3 19:31:17.588175400 (335h15m18.391534578s) [upload=348657]: Waiting for error group managing segments... Mar 3 19:31:17.588238529 (335h15m18.391597705s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 3 19:31:17.588245800 (335h15m18.391604976s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Mar 3 19:31:17.588249553 (335h15m18.391608728s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Mar 3 19:31:17.639512934 (335h15m18.442872128s) [upload=348657]: Done uploading segments... Mar 3 19:31:17.639534605 (335h15m18.442893789s) [upload=348657]: Upload finished. err: <nil>
Duration: 227.352101ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.583357ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18996C335B5A7D4D X-Xss-Protection=1; mode=block Date=Tue, 03 Mar 2026 19:41:36 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=Usavc7bMWPD Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/49b9a6a89d3e2a71
FAIL (2026-03-03 19:41:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C335B5A7D4D</RequestId><HostId></HostId></Error>"
Duration: 11.633066ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.188378ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18996C31CC03AB5A X-Request-Id=2NDCEF8Nysp Date=Tue, 03 Mar 2026 19:41:29 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/62ed42bc05aa6b43
FAIL (2026-03-03 19:41:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C31CC03AB5A</RequestId><HostId></HostId></Error>"
Duration: 14.213734ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
228.091406ms trace:
https://jaeger.dev.storj.io/trace/47b2d030c986ec21
FAIL (2026-03-03 19:41:28 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Mar 3 19:31:17.587953606 (335h15m18.39131278s) [upload=348657]: Starting upload Mar 3 19:31:17.588026796 (335h15m18.391385973s) [upload=348657]: Done starting upload Mar 3 19:31:17.588112394 (335h15m18.391471563s) [upload=348657]: Uploading segments... Mar 3 19:31:17.588167884 (335h15m18.391527068s) [upload=348657]: Got next segment. Inline: true Mar 3 19:31:17.588175400 (335h15m18.391534578s) [upload=348657]: Waiting for error group managing segments... Mar 3 19:31:17.588238529 (335h15m18.391597705s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 3 19:31:17.588245800 (335h15m18.391604976s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Mar 3 19:31:17.588249553 (335h15m18.391608728s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Mar 3 19:31:17.639512934 (335h15m18.442872128s) [upload=348657]: Done uploading segments... Mar 3 19:31:17.639534605 (335h15m18.442893789s) [upload=348657]: Upload finished. err: <nil>
Duration: 228.119103ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.168752ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18996C2F639678DB X-Request-Id=4czzKWYUXyv X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Date=Tue, 03 Mar 2026 19:41:19 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1c6fc4468ef3d9ee
FAIL (2026-03-03 19:41:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C2F639678DB</RequestId><HostId></HostId></Error>"
Duration: 10.180113ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.351781ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Vary=Origin X-Request-Id=Bm4bncRN3j5 Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18996C2BBC7E3063 X-Xss-Protection=1; mode=block Date=Tue, 03 Mar 2026 19:41:03 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/12255c10a2d2c7
FAIL (2026-03-03 19:41:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C2BBC7E3063</RequestId><HostId></HostId></Error>"
Duration: 9.373311ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
225.549911ms trace:
https://jaeger.dev.storj.io/trace/47b2d030c986ec21
FAIL (2026-03-03 19:40:59 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Mar 3 19:31:17.587953606 (335h15m18.39131278s) [upload=348657]: Starting upload Mar 3 19:31:17.588026796 (335h15m18.391385973s) [upload=348657]: Done starting upload Mar 3 19:31:17.588112394 (335h15m18.391471563s) [upload=348657]: Uploading segments... Mar 3 19:31:17.588167884 (335h15m18.391527068s) [upload=348657]: Got next segment. Inline: true Mar 3 19:31:17.588175400 (335h15m18.391534578s) [upload=348657]: Waiting for error group managing segments... Mar 3 19:31:17.588238529 (335h15m18.391597705s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 3 19:31:17.588245800 (335h15m18.391604976s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Mar 3 19:31:17.588249553 (335h15m18.391608728s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Mar 3 19:31:17.639512934 (335h15m18.442872128s) [upload=348657]: Done uploading segments... Mar 3 19:31:17.639534605 (335h15m18.442893789s) [upload=348657]: Upload finished. err: <nil>
Duration: 225.574631ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.146994ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Date=Tue, 03 Mar 2026 19:40:56 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18996C2A06F1C1B0 X-Request-Id=QYWZLY3kGAV target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2a094b6200bf057b
FAIL (2026-03-03 19:40:56 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C2A06F1C1B0</RequestId><HostId></HostId></Error>"
Duration: 9.181167ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
16.0112ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Xss-Protection=1; mode=block Date=Tue, 03 Mar 2026 19:40:40 GMT Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=18996C265302CDFE X-Request-Id=WbXUvianxdC Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/223d13ca48fd67fc
FAIL (2026-03-03 19:40:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C265302CDFE</RequestId><HostId></HostId></Error>"
Duration: 16.047317ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.198979ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=MbPAU4MogZk X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 Vary=Origin X-Amz-Request-Id=18996C256E62ABF4 Date=Tue, 03 Mar 2026 19:40:36 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3c2dbd477f3b04c3
FAIL (2026-03-03 19:40:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C256E62ABF4</RequestId><HostId></HostId></Error>"
Duration: 27.284608ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.142251ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=eYhCEEuKRJ6 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=18996C1FC9713C7D Date=Tue, 03 Mar 2026 19:40:12 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6a3b7bf0853ab42b
FAIL (2026-03-03 19:40:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C1FC9713C7D</RequestId><HostId></HostId></Error>"
Duration: 14.163085ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
251.858832ms trace:
https://jaeger.dev.storj.io/trace/47b2d030c986ec21
FAIL (2026-03-03 19:40:05 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Mar 3 19:31:17.587953606 (335h15m18.39131278s) [upload=348657]: Starting upload Mar 3 19:31:17.588026796 (335h15m18.391385973s) [upload=348657]: Done starting upload Mar 3 19:31:17.588112394 (335h15m18.391471563s) [upload=348657]: Uploading segments... Mar 3 19:31:17.588167884 (335h15m18.391527068s) [upload=348657]: Got next segment. Inline: true Mar 3 19:31:17.588175400 (335h15m18.391534578s) [upload=348657]: Waiting for error group managing segments... Mar 3 19:31:17.588238529 (335h15m18.391597705s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 3 19:31:17.588245800 (335h15m18.391604976s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Mar 3 19:31:17.588249553 (335h15m18.391608728s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Mar 3 19:31:17.639512934 (335h15m18.442872128s) [upload=348657]: Done uploading segments... Mar 3 19:31:17.639534605 (335h15m18.442893789s) [upload=348657]: Upload finished. err: <nil>
Duration: 251.886315ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.014983ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18996C1C4360996F X-Request-Id=3U8JMVYGbWv X-Xss-Protection=1; mode=block Content-Length=284 Date=Tue, 03 Mar 2026 19:39:56 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/e845fbb8232b2bb
FAIL (2026-03-03 19:39:56 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C1C4360996F</RequestId><HostId></HostId></Error>"
Duration: 29.035045ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.552591ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=UTvqL9agLfT Date=Tue, 03 Mar 2026 19:39:55 GMT Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=18996C1BD482ABD0 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2c29b3b852791cc3
FAIL (2026-03-03 19:39:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C1BD482ABD0</RequestId><HostId></HostId></Error>"
Duration: 9.588674ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.248545ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 03 Mar 2026 19:39:37 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18996C17D67C4F90 X-Request-Id=MdUvV5goHvG Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/78b212339391e922
FAIL (2026-03-03 19:39:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C17D67C4F90</RequestId><HostId></HostId></Error>"
Duration: 13.272058ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.358565ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=Nr8UGByEW11 X-Xss-Protection=1; mode=block Date=Tue, 03 Mar 2026 19:39:15 GMT Accept-Ranges=bytes Server=Storj X-Amz-Request-Id=18996C127CCACA6E target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/484b40a545b8d152
FAIL (2026-03-03 19:39:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C127CCACA6E</RequestId><HostId></HostId></Error>"
Duration: 10.384945ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
247.563599ms trace:
https://jaeger.dev.storj.io/trace/47b2d030c986ec21
FAIL (2026-03-03 19:39:00 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Mar 3 19:31:17.587953606 (335h15m18.39131278s) [upload=348657]: Starting upload Mar 3 19:31:17.588026796 (335h15m18.391385973s) [upload=348657]: Done starting upload Mar 3 19:31:17.588112394 (335h15m18.391471563s) [upload=348657]: Uploading segments... Mar 3 19:31:17.588167884 (335h15m18.391527068s) [upload=348657]: Got next segment. Inline: true Mar 3 19:31:17.588175400 (335h15m18.391534578s) [upload=348657]: Waiting for error group managing segments... Mar 3 19:31:17.588238529 (335h15m18.391597705s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 3 19:31:17.588245800 (335h15m18.391604976s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Mar 3 19:31:17.588249553 (335h15m18.391608728s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Mar 3 19:31:17.639512934 (335h15m18.442872128s) [upload=348657]: Done uploading segments... Mar 3 19:31:17.639534605 (335h15m18.442893789s) [upload=348657]: Upload finished. err: <nil>
Duration: 247.588508ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.065312ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Date=Tue, 03 Mar 2026 19:38:57 GMT Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18996C0E6EB65185 X-Request-Id=W3rwb4dbbFK target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/116998cdd3777c73
FAIL (2026-03-03 19:38:57 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C0E6EB65185</RequestId><HostId></HostId></Error>"
Duration: 9.128389ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.510573ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Vary=Origin X-Request-Id=81ppriac9iy Date=Tue, 03 Mar 2026 19:38:51 GMT Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18996C0CF0C91144 X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2b0c36af8e146bbf
FAIL (2026-03-03 19:38:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C0CF0C91144</RequestId><HostId></HostId></Error>"
Duration: 10.531659ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.137395ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=HkxS6eL1Feh X-Xss-Protection=1; mode=block Date=Tue, 03 Mar 2026 19:38:50 GMT Content-Type=application/xml Server=Storj X-Amz-Request-Id=18996C0CC6F0ACEC target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/32758baec2260641
FAIL (2026-03-03 19:38:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C0CC6F0ACEC</RequestId><HostId></HostId></Error>"
Duration: 29.156962ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.995655ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=18996C0C618075B9 Date=Tue, 03 Mar 2026 19:38:48 GMT Vary=Origin X-Request-Id=HhGY1hHES7u X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1f7f35626dc95582
FAIL (2026-03-03 19:38:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C0C618075B9</RequestId><HostId></HostId></Error>"
Duration: 14.018212ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.49452ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Server=Storj X-Amz-Request-Id=18996C0AD7980D04 X-Request-Id=E41gmKc7UUn Date=Tue, 03 Mar 2026 19:38:42 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2e7ef4c97afd3702
FAIL (2026-03-03 19:38:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C0AD7980D04</RequestId><HostId></HostId></Error>"
Duration: 13.535924ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
275.887555ms trace:
https://jaeger.dev.storj.io/trace/47b2d030c986ec21
FAIL (2026-03-03 19:38:14 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Mar 3 19:31:17.587953606 (335h15m18.39131278s) [upload=348657]: Starting upload Mar 3 19:31:17.588026796 (335h15m18.391385973s) [upload=348657]: Done starting upload Mar 3 19:31:17.588112394 (335h15m18.391471563s) [upload=348657]: Uploading segments... Mar 3 19:31:17.588167884 (335h15m18.391527068s) [upload=348657]: Got next segment. Inline: true Mar 3 19:31:17.588175400 (335h15m18.391534578s) [upload=348657]: Waiting for error group managing segments... Mar 3 19:31:17.588238529 (335h15m18.391597705s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 3 19:31:17.588245800 (335h15m18.391604976s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Mar 3 19:31:17.588249553 (335h15m18.391608728s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Mar 3 19:31:17.639512934 (335h15m18.442872128s) [upload=348657]: Done uploading segments... Mar 3 19:31:17.639534605 (335h15m18.442893789s) [upload=348657]: Upload finished. err: <nil>
Duration: 275.911706ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.791545ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18996C0456256A33 Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Request-Id=XZ7JmieYSno X-Xss-Protection=1; mode=block Date=Tue, 03 Mar 2026 19:38:14 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/62b5223c8cfd20fb
FAIL (2026-03-03 19:38:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996C0456256A33</RequestId><HostId></HostId></Error>"
Duration: 8.819691ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
267.425468ms trace:
https://jaeger.dev.storj.io/trace/47b2d030c986ec21
FAIL (2026-03-03 19:37:56 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Mar 3 19:31:17.587953606 (335h15m18.39131278s) [upload=348657]: Starting upload Mar 3 19:31:17.588026796 (335h15m18.391385973s) [upload=348657]: Done starting upload Mar 3 19:31:17.588112394 (335h15m18.391471563s) [upload=348657]: Uploading segments... Mar 3 19:31:17.588167884 (335h15m18.391527068s) [upload=348657]: Got next segment. Inline: true Mar 3 19:31:17.588175400 (335h15m18.391534578s) [upload=348657]: Waiting for error group managing segments... Mar 3 19:31:17.588238529 (335h15m18.391597705s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 3 19:31:17.588245800 (335h15m18.391604976s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Mar 3 19:31:17.588249553 (335h15m18.391608728s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Mar 3 19:31:17.639512934 (335h15m18.442872128s) [upload=348657]: Done uploading segments... Mar 3 19:31:17.639534605 (335h15m18.442893789s) [upload=348657]: Upload finished. err: <nil>
Duration: 267.564926ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.560873ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Tue, 03 Mar 2026 19:37:54 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=i1tmAUDdvC5 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18996BFFBE947E2F target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/14323790eaf39a2e
FAIL (2026-03-03 19:37:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BFFBE947E2F</RequestId><HostId></HostId></Error>"
Duration: 12.583126ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.942544ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=W6UuSn3eFm7 Date=Tue, 03 Mar 2026 19:37:39 GMT Content-Length=284 Server=Storj Vary=Origin X-Amz-Request-Id=18996BFC59F3F851 X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/1df7126ef3fb4b06
FAIL (2026-03-03 19:37:39 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BFC59F3F851</RequestId><HostId></HostId></Error>"
Duration: 28.960851ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.049269ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Tue, 03 Mar 2026 19:37:29 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18996BFA0234791C X-Request-Id=SAMJTipfLtG X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/14c59700a8a64b1f
FAIL (2026-03-03 19:37:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BFA0234791C</RequestId><HostId></HostId></Error>"
Duration: 10.134293ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.869992ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=18996BF9A7F67C6D X-Request-Id=Cp9wNuHFYKL Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Xss-Protection=1; mode=block Date=Tue, 03 Mar 2026 19:37:28 GMT Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7445403d45f11bc7
FAIL (2026-03-03 19:37:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BF9A7F67C6D</RequestId><HostId></HostId></Error>"
Duration: 9.890596ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
214.10308ms trace:
https://jaeger.dev.storj.io/trace/47b2d030c986ec21
FAIL (2026-03-03 19:37:16 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Mar 3 19:31:17.587953606 (335h15m18.39131278s) [upload=348657]: Starting upload Mar 3 19:31:17.588026796 (335h15m18.391385973s) [upload=348657]: Done starting upload Mar 3 19:31:17.588112394 (335h15m18.391471563s) [upload=348657]: Uploading segments... Mar 3 19:31:17.588167884 (335h15m18.391527068s) [upload=348657]: Got next segment. Inline: true Mar 3 19:31:17.588175400 (335h15m18.391534578s) [upload=348657]: Waiting for error group managing segments... Mar 3 19:31:17.588238529 (335h15m18.391597705s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 3 19:31:17.588245800 (335h15m18.391604976s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Mar 3 19:31:17.588249553 (335h15m18.391608728s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Mar 3 19:31:17.639512934 (335h15m18.442872128s) [upload=348657]: Done uploading segments... Mar 3 19:31:17.639534605 (335h15m18.442893789s) [upload=348657]: Upload finished. err: <nil>
Duration: 214.12829ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.701412ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Date=Tue, 03 Mar 2026 19:37:10 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18996BF57E66E22D X-Request-Id=2B4atHTRiNa target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7349addc5ff1bf4c
FAIL (2026-03-03 19:37:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BF57E66E22D</RequestId><HostId></HostId></Error>"
Duration: 30.721882ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.61103ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Tue, 03 Mar 2026 19:36:55 GMT Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18996BF21B01058F Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=bY3X8EvL8bi X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3ab912767b43af8d
FAIL (2026-03-03 19:36:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BF21B01058F</RequestId><HostId></HostId></Error>"
Duration: 13.634032ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.892947ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18996BEF41A8FEA4 X-Request-Id=iuu2kdamBir Date=Tue, 03 Mar 2026 19:36:43 GMT Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/3e3c4ba9d3747b4f
FAIL (2026-03-03 19:36:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BEF41A8FEA4</RequestId><HostId></HostId></Error>"
Duration: 10.91887ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.769971ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Server=Storj Vary=Origin X-Request-Id=dC5wvNY56y9 Date=Tue, 03 Mar 2026 19:36:34 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18996BED2F187B84 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/4a3bb633dae2417e
FAIL (2026-03-03 19:36:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BED2F187B84</RequestId><HostId></HostId></Error>"
Duration: 9.785813ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.112012ms remote:
"tcp:45.38.24.2:443" response headers:
Date=Tue, 03 Mar 2026 19:36:24 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18996BEAD6CB25E4 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Vary=Origin X-Request-Id=R6WeHEXyicu target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/58a2c5d285c6c980
FAIL (2026-03-03 19:36:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BEAD6CB25E4</RequestId><HostId></HostId></Error>"
Duration: 31.13585ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
280.143416ms trace:
https://jaeger.dev.storj.io/trace/47b2d030c986ec21
FAIL (2026-03-03 19:36:23 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Mar 3 19:31:17.587953606 (335h15m18.39131278s) [upload=348657]: Starting upload Mar 3 19:31:17.588026796 (335h15m18.391385973s) [upload=348657]: Done starting upload Mar 3 19:31:17.588112394 (335h15m18.391471563s) [upload=348657]: Uploading segments... Mar 3 19:31:17.588167884 (335h15m18.391527068s) [upload=348657]: Got next segment. Inline: true Mar 3 19:31:17.588175400 (335h15m18.391534578s) [upload=348657]: Waiting for error group managing segments... Mar 3 19:31:17.588238529 (335h15m18.391597705s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 3 19:31:17.588245800 (335h15m18.391604976s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Mar 3 19:31:17.588249553 (335h15m18.391608728s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Mar 3 19:31:17.639512934 (335h15m18.442872128s) [upload=348657]: Done uploading segments... Mar 3 19:31:17.639534605 (335h15m18.442893789s) [upload=348657]: Upload finished. err: <nil>
Duration: 280.168153ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.097854ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18996BE985F903B3 Date=Tue, 03 Mar 2026 19:36:19 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=45dc8695ZxT X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7ee54158dbda2ef4
FAIL (2026-03-03 19:36:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BE985F903B3</RequestId><HostId></HostId></Error>"
Duration: 9.118191ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.156292ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Request-Id=4Adstvhn369 Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18996BE71540AD86 X-Xss-Protection=1; mode=block Date=Tue, 03 Mar 2026 19:36:08 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/130b0e4be52aeb9a
FAIL (2026-03-03 19:36:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BE71540AD86</RequestId><HostId></HostId></Error>"
Duration: 13.179796ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.471234ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=18996BE2367A919F X-Request-Id=NPEnsvcjXrn X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Date=Tue, 03 Mar 2026 19:35:47 GMT Accept-Ranges=bytes Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/3359f3c306081973
FAIL (2026-03-03 19:35:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BE2367A919F</RequestId><HostId></HostId></Error>"
Duration: 10.495187ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
262.533814ms trace:
https://jaeger.dev.storj.io/trace/47b2d030c986ec21
FAIL (2026-03-03 19:35:41 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Mar 3 19:31:17.587953606 (335h15m18.39131278s) [upload=348657]: Starting upload Mar 3 19:31:17.588026796 (335h15m18.391385973s) [upload=348657]: Done starting upload Mar 3 19:31:17.588112394 (335h15m18.391471563s) [upload=348657]: Uploading segments... Mar 3 19:31:17.588167884 (335h15m18.391527068s) [upload=348657]: Got next segment. Inline: true Mar 3 19:31:17.588175400 (335h15m18.391534578s) [upload=348657]: Waiting for error group managing segments... Mar 3 19:31:17.588238529 (335h15m18.391597705s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 3 19:31:17.588245800 (335h15m18.391604976s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Mar 3 19:31:17.588249553 (335h15m18.391608728s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Mar 3 19:31:17.639512934 (335h15m18.442872128s) [upload=348657]: Done uploading segments... Mar 3 19:31:17.639534605 (335h15m18.442893789s) [upload=348657]: Upload finished. err: <nil>
Duration: 262.558305ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.805543ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=18996BDC45A7AAA8 Date=Tue, 03 Mar 2026 19:35:22 GMT Content-Type=application/xml X-Request-Id=AFyp7fUWaVK X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7fb53cd5a2103956
FAIL (2026-03-03 19:35:22 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BDC45A7AAA8</RequestId><HostId></HostId></Error>"
Duration: 26.832315ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
294.909199ms trace:
https://jaeger.dev.storj.io/trace/47b2d030c986ec21
FAIL (2026-03-03 19:35:19 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Mar 3 19:31:17.587953606 (335h15m18.39131278s) [upload=348657]: Starting upload Mar 3 19:31:17.588026796 (335h15m18.391385973s) [upload=348657]: Done starting upload Mar 3 19:31:17.588112394 (335h15m18.391471563s) [upload=348657]: Uploading segments... Mar 3 19:31:17.588167884 (335h15m18.391527068s) [upload=348657]: Got next segment. Inline: true Mar 3 19:31:17.588175400 (335h15m18.391534578s) [upload=348657]: Waiting for error group managing segments... Mar 3 19:31:17.588238529 (335h15m18.391597705s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 3 19:31:17.588245800 (335h15m18.391604976s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Mar 3 19:31:17.588249553 (335h15m18.391608728s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Mar 3 19:31:17.639512934 (335h15m18.442872128s) [upload=348657]: Done uploading segments... Mar 3 19:31:17.639534605 (335h15m18.442893789s) [upload=348657]: Upload finished. err: <nil>
Duration: 294.937978ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.031984ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=bZDHWfgcZCg X-Xss-Protection=1; mode=block Date=Tue, 03 Mar 2026 19:35:18 GMT Content-Type=application/xml Server=Storj X-Amz-Request-Id=18996BDB533AEA38 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2e6c266075a742bb
FAIL (2026-03-03 19:35:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BDB533AEA38</RequestId><HostId></HostId></Error>"
Duration: 10.053554ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.837367ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=hNPS3b6uLNy X-Xss-Protection=1; mode=block Date=Tue, 03 Mar 2026 19:35:15 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18996BDAB7A9F4F5 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/3d3ed05eddca77bf
FAIL (2026-03-03 19:35:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BDAB7A9F4F5</RequestId><HostId></HostId></Error>"
Duration: 12.926951ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.169201ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18996BD73B697673 Content-Type=application/xml X-Request-Id=Exvv28MsCfn X-Xss-Protection=1; mode=block Date=Tue, 03 Mar 2026 19:35:00 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3114c365be68b302
FAIL (2026-03-03 19:35:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BD73B697673</RequestId><HostId></HostId></Error>"
Duration: 11.192029ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.309146ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18996BD33E672898 X-Xss-Protection=1; mode=block X-Request-Id=MuCngqJc5VP Date=Tue, 03 Mar 2026 19:34:43 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3c0914ea7c646fc1
FAIL (2026-03-03 19:34:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BD33E672898</RequestId><HostId></HostId></Error>"
Duration: 29.32851ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.531264ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=P3a8PBbWVMN Date=Tue, 03 Mar 2026 19:34:28 GMT Content-Type=application/xml X-Amz-Request-Id=18996BCFB5E63466 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/22f9d6787f7a3166
FAIL (2026-03-03 19:34:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BCFB5E63466</RequestId><HostId></HostId></Error>"
Duration: 10.55659ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
265.606313ms trace:
https://jaeger.dev.storj.io/trace/47b2d030c986ec21
FAIL (2026-03-03 19:34:20 UTC)
orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context canceled ======LOGS====== Mar 3 19:31:17.587953606 (335h15m18.39131278s) [upload=348657]: Starting upload Mar 3 19:31:17.588026796 (335h15m18.391385973s) [upload=348657]: Done starting upload Mar 3 19:31:17.588112394 (335h15m18.391471563s) [upload=348657]: Uploading segments... Mar 3 19:31:17.588167884 (335h15m18.391527068s) [upload=348657]: Got next segment. Inline: true Mar 3 19:31:17.588175400 (335h15m18.391534578s) [upload=348657]: Waiting for error group managing segments... Mar 3 19:31:17.588238529 (335h15m18.391597705s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 3 19:31:17.588245800 (335h15m18.391604976s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Mar 3 19:31:17.588249553 (335h15m18.391608728s) [upload=348657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Mar 3 19:31:17.639512934 (335h15m18.442872128s) [upload=348657]: Done uploading segments... Mar 3 19:31:17.639534605 (335h15m18.442893789s) [upload=348657]: Upload finished. err: <nil>
Duration: 265.634733ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.960849ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=VUAE3Du2DZZ Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Xss-Protection=1; mode=block Date=Tue, 03 Mar 2026 19:34:15 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18996BCCD6EB3D8F target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/68428dee9ca00e47
FAIL (2026-03-03 19:34:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18996BCCD6EB3D8F</RequestId><HostId></HostId></Error>"
Duration: 13.983449ms
edge
gateway
vhost
bgp
eu1
|