Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [.......................................................XXXXX] duration:
5.002834434s trace:
https://jaeger.dev.storj.io/trace/5f708cfbe5653ba7
FAIL (2026-04-02 00:00:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.002902657s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [........................................................XXXX] duration:
5.014212874s trace:
https://jaeger.dev.storj.io/trace/4a53565d44dff3f9
FAIL (2026-04-01 23:59:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.014235934s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
1m0.001378529s trace:
https://jaeger.dev.storj.io/trace/4c7886afaf3278d
FAIL (2026-04-01 23:59:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Apr 1 23:58:43.788824056 (636h58m41.385595079s) [upload=713315]: Starting upload Apr 1 23:58:43.788982769 (636h58m41.385753842s) [upload=713315]: Done starting upload Apr 1 23:58:43.789035548 (636h58m41.385806565s) [upload=713315]: Uploading segments... Apr 1 23:58:43.789148425 (636h58m41.385919439s) [upload=713315]: Got next segment. Inline: true Apr 1 23:58:43.789183350 (636h58m41.385954377s) [upload=713315]: Waiting for error group managing segments... Apr 1 23:58:43.789353534 (636h58m41.386124557s) [upload=713315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Apr 1 23:58:43.789360979 (636h58m41.386132003s) [upload=713315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Apr 1 23:58:43.789365289 (636h58m41.386136313s) [upload=713315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Apr 1 23:59:43.714593027 (636h59m41.311364061s) [upload=713315]: Done uploading segments... Apr 1 23:59:43.714650653 (636h59m41.311421685s) [upload=713315]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1m0.001390274s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................................XX.] duration:
13.221332961s trace:
https://jaeger.dev.storj.io/trace/6145fda5277eae07
FAIL (2026-04-01 23:59:32 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Apr 1 23:58:19.418184610 (636h58m17.014955633s) [upload=713306]: Starting upload
Apr 1 23:58:19.418245684 (636h58m17.015016716s) [upload=713306]: Done starting upload
Apr 1 23:58:19.418534657 (636h58m17.015305673s) [upload=713306]: Uploading segments...
Apr 1 23:58:19.418591802 (636h58m17.015362834s) [upload=713306]: Got next segment. Inline: false
Apr 1 23:58:19.418624451 (636h58m17.015395475s) [upload=713306]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Apr 1 23:58:19.418629479 (636h58m17.015400501s) [upload=713306]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Apr 1 23:58:28.050488073 (636h58m25.647259123s) [seg_pos={0 0}, upload=713306]: Begin upload segment...
Apr 1 23:58:28.050573855 (636h58m25.647344886s) [seg_pos={0 0}, upload=713306]: Done begin upload segment.
Apr 1 23:58:28.050618823 (636h58m25.647389835s) [noise=true , address=64.49.13.169:4715 , piece_id=UJSU6KGACES43HBJGSF3XB5H6HGHDCCZIIW7PGOTFY572CKLYRLA, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.059712420 (636h58m25.656483467s) [noise=true , address=45.91.116.5:4314 , piece_id=2U42CMLNSY3CI5ZAIVUOGBFA6GBLRFZRG57I5C2S5YVMOLGFC3LA, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.061898148 (636h58m25.658669182s) [noise=true , address=193.149.164.70:4109 , piece_id=52XBGDNUO3E3QY6YVUXSHB4W2JUEXRAPLH5RMEFVYEHM3FAXVL5Q, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.063805290 (636h58m25.660576317s) [noise=true , address=45.91.116.11:4139 , piece_id=VQK7WDUNPIP2RCU6WGGKDEJVNBSKPTLBIESQ2EH2RX2SLBO5VZWQ, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.067407896 (636h58m25.664178929s) [noise=true , address=167.17.72.69:4724 , piece_id=KHJLBV5QQ6FMJGCWVP4KXH6ZECOACBBQ6DQVORNEJCLX3BVYV4BQ, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.067607771 (636h58m25.664378794s) [noise=true , address=77.90.31.11:4581 , piece_id=GWDSFC3TAYTGQ3AAFWKSQ64HR6H35NPJH5AN7BPGOMS5SJPINKIQ, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.069237044 (636h58m25.66600807s) [noise=true , address=45.91.116.10:4108 , piece_id=OI2SEPHGOB2E7GJMPQ5BPKYUTGVMRVLN2ZP7X4TJRPSCHMGX2ZKA, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.070931254 (636h58m25.667702284s) [noise=true , address=193.149.164.71:4298 , piece_id=WZQGPSZWQYCXRLFJL4MIMVIFZKFHKZW6T24AT7IGZXQYCPYTQPVA, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.071055728 (636h58m25.667826762s) [noise=true , address=167.17.72.68:4652 , piece_id=CJMAZS4JJWAUJOC7JEAF4OSTCYVXW2D7AT5IAGHIICSHXHTWFB7Q, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.072641869 (636h58m25.669412891s) [noise=true , address=193.149.164.67:4019 , piece_id=XRXS37TMCR42KDOYR64W2LKCYRPL3UJ3NJC635MP2M2DNWOLEVUQ, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.073373673 (636h58m25.6701447s) [noise=true , address=167.17.72.70:4769 , piece_id=3AVBQHQWOKUO3AUGMPMGOT7VE7LJAPLCZ42G4FQ7P2DBHLA3SFPA, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.074228191 (636h58m25.670999215s) [noise=true , address=77.90.31.19:4849 , piece_id=3272QW7VYIGEHOLU4IKQTTAJL6FZUMVCEZHA4UYAMXC3ELBSFIAQ, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.075518926 (636h58m25.672289956s) [noise=true , address=193.149.164.69:4083 , piece_id=LZER7JT7POSJIXKZBNICF5CY62RCOWPK7OD7PZK5YHYK2ZNL3J6A, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.077023110 (636h58m25.673794144s) [noise=true , address=193.149.164.68:4056 , piece_id=PE4L2NRKXDSS76XO55IVXIPF3N4HNPZ6AOG3DPC5HXH7WLERN3KQ, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.081670528 (636h58m25.678441566s) [noise=true , address=45.91.116.8:4064 , piece_id=UYV3L7HIUPVFCRROGXGSLBMUKEZA7Q4GHTABVYBB3SCCNI46Q44A, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.084750752 (636h58m25.681521918s) [noise=true , address=145.79.227.14:4860 , piece_id=4KRYOX6MYEDVUIHKIT7JI5G3FTGTOEPYTZVYTBGGYPMNWZXD3JYQ, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.087970236 (636h58m25.684741269s) [noise=true , address=193.149.164.143:4697 , piece_id=IK7J7OXPDFYLTTMKBTHKMY3HGP3PPL2NTWFF4NBQFAGG55B6MKCQ, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.089823359 (636h58m25.686594382s) [noise=true , address=145.79.227.52:4469 , piece_id=6SSQ3LANT4Z5WJHI564MKJMNQR5S3HYTL7EWPUUGV7HUJYM4HLXA, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.137118440 (636h58m25.733889453s) [upload=713306]: Next returned nil segment
Apr 1 23:58:28.137136414 (636h58m25.733907444s) [upload=713306]: Waiting for error group managing segments...
Apr 1 23:58:28.140278792 (636h58m25.737049805s) [noise=true , address=77.90.31.11:4581 , piece_id=GWDSFC3TAYTGQ3AAFWKSQ64HR6H35NPJH5AN7BPGOMS5SJPINKIQ, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.141120735 (636h58m25.737891748s) [noise=true , address=45.91.116.5:4314 , piece_id=2U42CMLNSY3CI5ZAIVUOGBFA6GBLRFZRG57I5C2S5YVMOLGFC3LA, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.141398676 (636h58m25.7381697s) [noise=true , address=45.91.116.8:4064 , piece_id=UYV3L7HIUPVFCRROGXGSLBMUKEZA7Q4GHTABVYBB3SCCNI46Q44A, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.143135669 (636h58m25.739906696s) [noise=true , address=77.90.31.19:4849 , piece_id=3272QW7VYIGEHOLU4IKQTTAJL6FZUMVCEZHA4UYAMXC3ELBSFIAQ, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.146399042 (636h58m25.743170069s) [noise=true , address=145.79.227.52:4469 , piece_id=6SSQ3LANT4Z5WJHI564MKJMNQR5S3HYTL7EWPUUGV7HUJYM4HLXA, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.157725887 (636h58m25.754496917s) [noise=true , address=45.91.116.10:4108 , piece_id=OI2SEPHGOB2E7GJMPQ5BPKYUTGVMRVLN2ZP7X4TJRPSCHMGX2ZKA, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.160292776 (636h58m25.757063795s) [noise=true , address=45.91.116.11:4139 , piece_id=VQK7WDUNPIP2RCU6WGGKDEJVNBSKPTLBIESQ2EH2RX2SLBO5VZWQ, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.167963049 (636h58m25.764734073s) [noise=true , address=145.79.227.14:4860 , piece_id=4KRYOX6MYEDVUIHKIT7JI5G3FTGTOEPYTZVYTBGGYPMNWZXD3JYQ, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.438510708 (636h58m26.035281743s) [noise=true , address=167.17.72.68:4652 , piece_id=CJMAZS4JJWAUJOC7JEAF4OSTCYVXW2D7AT5IAGHIICSHXHTWFB7Q, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.440743447 (636h58m26.03751447s) [noise=true , address=167.17.72.69:4724 , piece_id=KHJLBV5QQ6FMJGCWVP4KXH6ZECOACBBQ6DQVORNEJCLX3BVYV4BQ, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.499538644 (636h58m26.096309661s) [noise=true , address=167.17.72.70:4769 , piece_id=3AVBQHQWOKUO3AUGMPMGOT7VE7LJAPLCZ42G4FQ7P2DBHLA3SFPA, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.649180715 (636h58m26.245951749s) [noise=true , address=193.149.164.67:4019 , piece_id=XRXS37TMCR42KDOYR64W2LKCYRPL3UJ3NJC635MP2M2DNWOLEVUQ, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.657209831 (636h58m26.253980865s) [noise=true , address=193.149.164.70:4109 , piece_id=52XBGDNUO3E3QY6YVUXSHB4W2JUEXRAPLH5RMEFVYEHM3FAXVL5Q, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.658252977 (636h58m26.255024005s) [noise=true , address=64.49.13.169:4715 , piece_id=UJSU6KGACES43HBJGSF3XB5H6HGHDCCZIIW7PGOTFY572CKLYRLA, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.658274651 (636h58m26.255045678s) [seg_pos={0 0}, upload=713306]: Satisfied cohort requirements after 14 pieces
Apr 1 23:58:28.658922832 (636h58m26.255693857s) [noise=true , address=193.149.164.71:4298 , piece_id=WZQGPSZWQYCXRLFJL4MIMVIFZKFHKZW6T24AT7IGZXQYCPYTQPVA, seg_pos={0 0}, upload=713306]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k3m3UTMxkUpEVokCfQzWz1xWxbX58yJ7E5WdnQ65q3yLCqgyN): protocol: expected piece hash; context canceled; EOF
Apr 1 23:58:28.658936781 (636h58m26.255707808s) [noise=true , address=193.149.164.71:4298 , piece_id=WZQGPSZWQYCXRLFJL4MIMVIFZKFHKZW6T24AT7IGZXQYCPYTQPVA, seg_pos={0 0}, upload=713306]: Long tail cancellation due to optimal threshold
Apr 1 23:58:28.659423909 (636h58m26.256194936s) [noise=true , address=193.149.164.68:4056 , piece_id=PE4L2NRKXDSS76XO55IVXIPF3N4HNPZ6AOG3DPC5HXH7WLERN3KQ, seg_pos={0 0}, upload=713306]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yb3ovMJVyNsCY361tpT7TwfZFhjYyr8TGgcoGawmqZmZYQZYN): protocol: expected piece hash; context canceled; EOF
Apr 1 23:58:28.659436506 (636h58m26.256207537s) [noise=true , address=193.149.164.68:4056 , piece_id=PE4L2NRKXDSS76XO55IVXIPF3N4HNPZ6AOG3DPC5HXH7WLERN3KQ, seg_pos={0 0}, upload=713306]: Long tail cancellation due to optimal threshold
Apr 1 23:58:28.659489249 (636h58m26.256260281s) [noise=true , address=193.149.164.143:4697 , piece_id=IK7J7OXPDFYLTTMKBTHKMY3HGP3PPL2NTWFF4NBQFAGG55B6MKCQ, seg_pos={0 0}, upload=713306]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF
Apr 1 23:58:28.659496005 (636h58m26.256267037s) [noise=true , address=193.149.164.143:4697 , piece_id=IK7J7OXPDFYLTTMKBTHKMY3HGP3PPL2NTWFF4NBQFAGG55B6MKCQ, seg_pos={0 0}, upload=713306]: Long tail cancellation due to optimal threshold
Apr 1 23:58:28.659754145 (636h58m26.25652518s) [noise=true , address=193.149.164.69:4083 , piece_id=LZER7JT7POSJIXKZBNICF5CY62RCOWPK7OD7PZK5YHYK2ZNL3J6A, seg_pos={0 0}, upload=713306]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ADz3t5f76V5WXsLkLKpfKzQZ6teDh5Kd2fZsvdNsBiAT9fwpF): protocol: expected piece hash; context canceled; EOF
Apr 1 23:58:28.659764502 (636h58m26.256535536s) [noise=true , address=193.149.164.69:4083 , piece_id=LZER7JT7POSJIXKZBNICF5CY62RCOWPK7OD7PZK5YHYK2ZNL3J6A, seg_pos={0 0}, upload=713306]: Long tail cancellation due to optimal threshold
Apr 1 23:58:28.659848723 (636h58m26.256619744s) [seg_pos={0 0}, upload=713306]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 1 23:58:28.659984338 (636h58m26.25675537s) [upload=713306]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 1 23:58:28.659991406 (636h58m26.256762437s) [upload=713306]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 1 23:58:37.339647549 (636h58m34.936418571s) [upload=713306]: Done uploading segments...
Apr 1 23:58:37.339677788 (636h58m34.936448823s) [upload=713306]: Upload finished. err: <nil>
Duration: 13.221374432s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
1m0.003135037s trace:
https://jaeger.dev.storj.io/trace/6145fda5277eae07
FAIL (2026-04-01 23:59:19 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Apr 1 23:58:19.418184610 (636h58m17.014955633s) [upload=713306]: Starting upload
Apr 1 23:58:19.418245684 (636h58m17.015016716s) [upload=713306]: Done starting upload
Apr 1 23:58:19.418534657 (636h58m17.015305673s) [upload=713306]: Uploading segments...
Apr 1 23:58:19.418591802 (636h58m17.015362834s) [upload=713306]: Got next segment. Inline: false
Apr 1 23:58:19.418624451 (636h58m17.015395475s) [upload=713306]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Apr 1 23:58:19.418629479 (636h58m17.015400501s) [upload=713306]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Apr 1 23:58:28.050488073 (636h58m25.647259123s) [seg_pos={0 0}, upload=713306]: Begin upload segment...
Apr 1 23:58:28.050573855 (636h58m25.647344886s) [seg_pos={0 0}, upload=713306]: Done begin upload segment.
Apr 1 23:58:28.050618823 (636h58m25.647389835s) [noise=true , address=64.49.13.169:4715 , piece_id=UJSU6KGACES43HBJGSF3XB5H6HGHDCCZIIW7PGOTFY572CKLYRLA, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.059712420 (636h58m25.656483467s) [noise=true , address=45.91.116.5:4314 , piece_id=2U42CMLNSY3CI5ZAIVUOGBFA6GBLRFZRG57I5C2S5YVMOLGFC3LA, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.061898148 (636h58m25.658669182s) [noise=true , address=193.149.164.70:4109 , piece_id=52XBGDNUO3E3QY6YVUXSHB4W2JUEXRAPLH5RMEFVYEHM3FAXVL5Q, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.063805290 (636h58m25.660576317s) [noise=true , address=45.91.116.11:4139 , piece_id=VQK7WDUNPIP2RCU6WGGKDEJVNBSKPTLBIESQ2EH2RX2SLBO5VZWQ, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.067407896 (636h58m25.664178929s) [noise=true , address=167.17.72.69:4724 , piece_id=KHJLBV5QQ6FMJGCWVP4KXH6ZECOACBBQ6DQVORNEJCLX3BVYV4BQ, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.067607771 (636h58m25.664378794s) [noise=true , address=77.90.31.11:4581 , piece_id=GWDSFC3TAYTGQ3AAFWKSQ64HR6H35NPJH5AN7BPGOMS5SJPINKIQ, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.069237044 (636h58m25.66600807s) [noise=true , address=45.91.116.10:4108 , piece_id=OI2SEPHGOB2E7GJMPQ5BPKYUTGVMRVLN2ZP7X4TJRPSCHMGX2ZKA, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.070931254 (636h58m25.667702284s) [noise=true , address=193.149.164.71:4298 , piece_id=WZQGPSZWQYCXRLFJL4MIMVIFZKFHKZW6T24AT7IGZXQYCPYTQPVA, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.071055728 (636h58m25.667826762s) [noise=true , address=167.17.72.68:4652 , piece_id=CJMAZS4JJWAUJOC7JEAF4OSTCYVXW2D7AT5IAGHIICSHXHTWFB7Q, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.072641869 (636h58m25.669412891s) [noise=true , address=193.149.164.67:4019 , piece_id=XRXS37TMCR42KDOYR64W2LKCYRPL3UJ3NJC635MP2M2DNWOLEVUQ, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.073373673 (636h58m25.6701447s) [noise=true , address=167.17.72.70:4769 , piece_id=3AVBQHQWOKUO3AUGMPMGOT7VE7LJAPLCZ42G4FQ7P2DBHLA3SFPA, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.074228191 (636h58m25.670999215s) [noise=true , address=77.90.31.19:4849 , piece_id=3272QW7VYIGEHOLU4IKQTTAJL6FZUMVCEZHA4UYAMXC3ELBSFIAQ, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.075518926 (636h58m25.672289956s) [noise=true , address=193.149.164.69:4083 , piece_id=LZER7JT7POSJIXKZBNICF5CY62RCOWPK7OD7PZK5YHYK2ZNL3J6A, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.077023110 (636h58m25.673794144s) [noise=true , address=193.149.164.68:4056 , piece_id=PE4L2NRKXDSS76XO55IVXIPF3N4HNPZ6AOG3DPC5HXH7WLERN3KQ, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.081670528 (636h58m25.678441566s) [noise=true , address=45.91.116.8:4064 , piece_id=UYV3L7HIUPVFCRROGXGSLBMUKEZA7Q4GHTABVYBB3SCCNI46Q44A, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.084750752 (636h58m25.681521918s) [noise=true , address=145.79.227.14:4860 , piece_id=4KRYOX6MYEDVUIHKIT7JI5G3FTGTOEPYTZVYTBGGYPMNWZXD3JYQ, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.087970236 (636h58m25.684741269s) [noise=true , address=193.149.164.143:4697 , piece_id=IK7J7OXPDFYLTTMKBTHKMY3HGP3PPL2NTWFF4NBQFAGG55B6MKCQ, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.089823359 (636h58m25.686594382s) [noise=true , address=145.79.227.52:4469 , piece_id=6SSQ3LANT4Z5WJHI564MKJMNQR5S3HYTL7EWPUUGV7HUJYM4HLXA, seg_pos={0 0}, upload=713306]: Uploading piece...
Apr 1 23:58:28.137118440 (636h58m25.733889453s) [upload=713306]: Next returned nil segment
Apr 1 23:58:28.137136414 (636h58m25.733907444s) [upload=713306]: Waiting for error group managing segments...
Apr 1 23:58:28.140278792 (636h58m25.737049805s) [noise=true , address=77.90.31.11:4581 , piece_id=GWDSFC3TAYTGQ3AAFWKSQ64HR6H35NPJH5AN7BPGOMS5SJPINKIQ, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.141120735 (636h58m25.737891748s) [noise=true , address=45.91.116.5:4314 , piece_id=2U42CMLNSY3CI5ZAIVUOGBFA6GBLRFZRG57I5C2S5YVMOLGFC3LA, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.141398676 (636h58m25.7381697s) [noise=true , address=45.91.116.8:4064 , piece_id=UYV3L7HIUPVFCRROGXGSLBMUKEZA7Q4GHTABVYBB3SCCNI46Q44A, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.143135669 (636h58m25.739906696s) [noise=true , address=77.90.31.19:4849 , piece_id=3272QW7VYIGEHOLU4IKQTTAJL6FZUMVCEZHA4UYAMXC3ELBSFIAQ, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.146399042 (636h58m25.743170069s) [noise=true , address=145.79.227.52:4469 , piece_id=6SSQ3LANT4Z5WJHI564MKJMNQR5S3HYTL7EWPUUGV7HUJYM4HLXA, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.157725887 (636h58m25.754496917s) [noise=true , address=45.91.116.10:4108 , piece_id=OI2SEPHGOB2E7GJMPQ5BPKYUTGVMRVLN2ZP7X4TJRPSCHMGX2ZKA, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.160292776 (636h58m25.757063795s) [noise=true , address=45.91.116.11:4139 , piece_id=VQK7WDUNPIP2RCU6WGGKDEJVNBSKPTLBIESQ2EH2RX2SLBO5VZWQ, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.167963049 (636h58m25.764734073s) [noise=true , address=145.79.227.14:4860 , piece_id=4KRYOX6MYEDVUIHKIT7JI5G3FTGTOEPYTZVYTBGGYPMNWZXD3JYQ, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.438510708 (636h58m26.035281743s) [noise=true , address=167.17.72.68:4652 , piece_id=CJMAZS4JJWAUJOC7JEAF4OSTCYVXW2D7AT5IAGHIICSHXHTWFB7Q, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.440743447 (636h58m26.03751447s) [noise=true , address=167.17.72.69:4724 , piece_id=KHJLBV5QQ6FMJGCWVP4KXH6ZECOACBBQ6DQVORNEJCLX3BVYV4BQ, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.499538644 (636h58m26.096309661s) [noise=true , address=167.17.72.70:4769 , piece_id=3AVBQHQWOKUO3AUGMPMGOT7VE7LJAPLCZ42G4FQ7P2DBHLA3SFPA, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.649180715 (636h58m26.245951749s) [noise=true , address=193.149.164.67:4019 , piece_id=XRXS37TMCR42KDOYR64W2LKCYRPL3UJ3NJC635MP2M2DNWOLEVUQ, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.657209831 (636h58m26.253980865s) [noise=true , address=193.149.164.70:4109 , piece_id=52XBGDNUO3E3QY6YVUXSHB4W2JUEXRAPLH5RMEFVYEHM3FAXVL5Q, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.658252977 (636h58m26.255024005s) [noise=true , address=64.49.13.169:4715 , piece_id=UJSU6KGACES43HBJGSF3XB5H6HGHDCCZIIW7PGOTFY572CKLYRLA, seg_pos={0 0}, upload=713306]: Done uploading piece. err: <nil>
Apr 1 23:58:28.658274651 (636h58m26.255045678s) [seg_pos={0 0}, upload=713306]: Satisfied cohort requirements after 14 pieces
Apr 1 23:58:28.658922832 (636h58m26.255693857s) [noise=true , address=193.149.164.71:4298 , piece_id=WZQGPSZWQYCXRLFJL4MIMVIFZKFHKZW6T24AT7IGZXQYCPYTQPVA, seg_pos={0 0}, upload=713306]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k3m3UTMxkUpEVokCfQzWz1xWxbX58yJ7E5WdnQ65q3yLCqgyN): protocol: expected piece hash; context canceled; EOF
Apr 1 23:58:28.658936781 (636h58m26.255707808s) [noise=true , address=193.149.164.71:4298 , piece_id=WZQGPSZWQYCXRLFJL4MIMVIFZKFHKZW6T24AT7IGZXQYCPYTQPVA, seg_pos={0 0}, upload=713306]: Long tail cancellation due to optimal threshold
Apr 1 23:58:28.659423909 (636h58m26.256194936s) [noise=true , address=193.149.164.68:4056 , piece_id=PE4L2NRKXDSS76XO55IVXIPF3N4HNPZ6AOG3DPC5HXH7WLERN3KQ, seg_pos={0 0}, upload=713306]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yb3ovMJVyNsCY361tpT7TwfZFhjYyr8TGgcoGawmqZmZYQZYN): protocol: expected piece hash; context canceled; EOF
Apr 1 23:58:28.659436506 (636h58m26.256207537s) [noise=true , address=193.149.164.68:4056 , piece_id=PE4L2NRKXDSS76XO55IVXIPF3N4HNPZ6AOG3DPC5HXH7WLERN3KQ, seg_pos={0 0}, upload=713306]: Long tail cancellation due to optimal threshold
Apr 1 23:58:28.659489249 (636h58m26.256260281s) [noise=true , address=193.149.164.143:4697 , piece_id=IK7J7OXPDFYLTTMKBTHKMY3HGP3PPL2NTWFF4NBQFAGG55B6MKCQ, seg_pos={0 0}, upload=713306]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: expected piece hash; context canceled; EOF
Apr 1 23:58:28.659496005 (636h58m26.256267037s) [noise=true , address=193.149.164.143:4697 , piece_id=IK7J7OXPDFYLTTMKBTHKMY3HGP3PPL2NTWFF4NBQFAGG55B6MKCQ, seg_pos={0 0}, upload=713306]: Long tail cancellation due to optimal threshold
Apr 1 23:58:28.659754145 (636h58m26.25652518s) [noise=true , address=193.149.164.69:4083 , piece_id=LZER7JT7POSJIXKZBNICF5CY62RCOWPK7OD7PZK5YHYK2ZNL3J6A, seg_pos={0 0}, upload=713306]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ADz3t5f76V5WXsLkLKpfKzQZ6teDh5Kd2fZsvdNsBiAT9fwpF): protocol: expected piece hash; context canceled; EOF
Apr 1 23:58:28.659764502 (636h58m26.256535536s) [noise=true , address=193.149.164.69:4083 , piece_id=LZER7JT7POSJIXKZBNICF5CY62RCOWPK7OD7PZK5YHYK2ZNL3J6A, seg_pos={0 0}, upload=713306]: Long tail cancellation due to optimal threshold
Apr 1 23:58:28.659848723 (636h58m26.256619744s) [seg_pos={0 0}, upload=713306]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 1 23:58:28.659984338 (636h58m26.25675537s) [upload=713306]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 1 23:58:28.659991406 (636h58m26.256762437s) [upload=713306]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 1 23:58:37.339647549 (636h58m34.936418571s) [upload=713306]: Done uploading segments...
Apr 1 23:58:37.339677788 (636h58m34.936448823s) [upload=713306]: Upload finished. err: <nil>
Duration: 1m0.003163677s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [.........................................................XXX] duration:
5.001150173s trace:
https://jaeger.dev.storj.io/trace/11598a3023f4af72
FAIL (2026-04-01 23:58:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.00117569s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.001042045s trace:
https://jaeger.dev.storj.io/trace/6f72d9de60f110fc
FAIL (2026-04-01 23:58:43 UTC)
orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Apr 1 23:57:43.682534071 (636h57m41.279305096s) [upload=713298]: Starting upload Apr 1 23:57:43.682581072 (636h57m41.2793521s) [upload=713298]: Done starting upload Apr 1 23:57:43.682686329 (636h57m41.279457342s) [upload=713298]: Uploading segments... Apr 1 23:57:43.682737495 (636h57m41.279508527s) [upload=713298]: Got next segment. Inline: true Apr 1 23:57:43.682742830 (636h57m41.279513843s) [upload=713298]: Waiting for error group managing segments... Apr 1 23:57:43.682791131 (636h57m41.279562154s) [upload=713298]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Apr 1 23:57:43.682797795 (636h57m41.279568821s) [upload=713298]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Apr 1 23:57:43.682801495 (636h57m41.279572519s) [upload=713298]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Apr 1 23:58:21.190660968 (636h58m18.787431992s) [upload=713298]: Done uploading segments... Apr 1 23:58:21.190681803 (636h58m18.787452826s) [upload=713298]: Upload finished. err: <nil>
Duration: 1m0.001078645s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.003274479s trace:
https://jaeger.dev.storj.io/trace/7f996237f034a2c8
FAIL (2026-04-01 23:58:08 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Apr 1 23:57:08.291791968 (636h57m5.888562982s) [upload=713290]: Starting upload
Apr 1 23:57:08.291853191 (636h57m5.888624207s) [upload=713290]: Done starting upload
Apr 1 23:57:08.292073583 (636h57m5.888844593s) [upload=713290]: Uploading segments...
Apr 1 23:57:08.292433089 (636h57m5.889204103s) [upload=713290]: Got next segment. Inline: false
Apr 1 23:57:08.292535867 (636h57m5.889306889s) [upload=713290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Apr 1 23:57:08.292543087 (636h57m5.889314111s) [upload=713290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Apr 1 23:57:15.562300806 (636h57m13.159071831s) [seg_pos={0 0}, upload=713290]: Begin upload segment...
Apr 1 23:57:15.562436000 (636h57m13.159207023s) [noise=true , address=45.91.116.8:4077 , piece_id=KGKD5QYIJTSE5GCOX3YXALJAYOE4224YBXUIQ2ZXAWZK5RGLSS6A, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.563125680 (636h57m13.159896721s) [seg_pos={0 0}, upload=713290]: Done begin upload segment.
Apr 1 23:57:15.563231042 (636h57m13.160002066s) [noise=true , address=193.149.164.67:4031 , piece_id=RPHSQLG6LXSB4XE3Z6T3YWEUJTTADOKLP2AQ456WYCA7ABYZC4PA, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.563286426 (636h57m13.160057453s) [noise=true , address=45.91.116.10:4106 , piece_id=4NZL3VQCH2O4U6YRWDD7TAAAQQQI4TKIYIHZ5O5ZVGYEW6YQH65A, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.563776163 (636h57m13.160547187s) [noise=true , address=5.231.73.5:4023 , piece_id=KMDC65CQVBJVY6A2AFOV2CTTU666DFVA5PGX5NBGPVZXYBTB4MVQ, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.563790606 (636h57m13.160561635s) [noise=true , address=45.91.116.5:4321 , piece_id=BVJLGBADAVOCD7334ZSYQFTTOZZRORCVDLKYWA36KZUY7ZMPQPYA, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.565074295 (636h57m13.161845329s) [noise=true , address=64.49.13.27:4957 , piece_id=FNHBLRC7WW7ZKVDGLLS463HYU3YIBFFZAYB3O5K75PCLO3FFFWUA, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.565570870 (636h57m13.162341899s) [noise=true , address=145.79.227.25:4634 , piece_id=GURYKILYFAXCJXLVTXJWH7N2SLRRA4LHVALUEK7ZKHX5NHJ3EG3A, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.565761044 (636h57m13.162532067s) [noise=true , address=64.49.13.154:4930 , piece_id=2D2FHXGMK6OQXEMZDXLJCEPH6VNG43LXGXIKPUVFGU2FHPNHNCGA, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.566852709 (636h57m13.163623737s) [noise=true , address=145.79.227.28:4750 , piece_id=XYJUAUC3QVKHVJBT6DDLXYF32DKDFOCG7HSRQINSP53RH6KZYEEQ, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.567669276 (636h57m13.164440309s) [noise=true , address=167.17.72.71:4809 , piece_id=PH3G4FPSHHWVHAHB32YLLNBZURJSJURAIOU3CKOP6FREC4QEOJSA, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.568484908 (636h57m13.165255941s) [noise=true , address=167.17.72.70:4760 , piece_id=6EWYQBA34L2SGSGNUURG2FQTVQTF727I2N4S62IXCWBL7LV5LXWA, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.568928040 (636h57m13.165699054s) [noise=true , address=45.91.116.4:4971 , piece_id=DJAN5LNKYK3IYAYI4MGEHQ4EHTEQDACV25CZMVEPTILMYORERRCQ, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.569509810 (636h57m13.166280832s) [noise=true , address=145.79.227.13:4817 , piece_id=CHC7NR5GW4NACUIQ3P7H2BESMH2N4G26WXTNCGVIOVVLRTXQDGFQ, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.569724151 (636h57m13.166495183s) [noise=true , address=45.91.116.6:4992 , piece_id=HPEH7STAI6LVZCOQNGZ2WUOJZGCYEHJBKXHXWZYIFL3UVVXUAEVA, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.570422723 (636h57m13.167193759s) [noise=true , address=167.17.72.68:4656 , piece_id=PP3RXSFNYJDLGTMOMW3PD5U45P5FHMQGWLXLCB4C7CXFA5ZPVGSA, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.570641053 (636h57m13.167412077s) [noise=true , address=167.17.72.69:4725 , piece_id=5TE3UE5FSBISQU24MGQ5ZC33J23PKUH7BTOSGPLE7EP4PRR2FPJA, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.571521005 (636h57m13.168292018s) [noise=true , address=145.79.227.29:4952 , piece_id=7EJ34RRFPGHXM2P4Y2HGX6QZXIHGBZWQN32DJE5KW7RRCK5ERQUQ, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.573331866 (636h57m13.1701029s) [noise=true , address=64.49.13.137:4493 , piece_id=D6BJ23VFWA6U5FROAY5BTG3IIJQIYJXF7XH7ISSFFRRATUS7DW2A, seg_pos={0 0}, upload=713290]: Uploading piece...
Apr 1 23:57:15.662208057 (636h57m13.258979092s) [upload=713290]: Next returned nil segment
Apr 1 23:57:15.662226339 (636h57m13.258997374s) [upload=713290]: Waiting for error group managing segments...
Apr 1 23:57:15.666121798 (636h57m13.262892822s) [noise=true , address=45.91.116.8:4077 , piece_id=KGKD5QYIJTSE5GCOX3YXALJAYOE4224YBXUIQ2ZXAWZK5RGLSS6A, seg_pos={0 0}, upload=713290]: Done uploading piece. err: <nil>
Apr 1 23:57:15.668037786 (636h57m13.26480881s) [noise=true , address=45.91.116.4:4971 , piece_id=DJAN5LNKYK3IYAYI4MGEHQ4EHTEQDACV25CZMVEPTILMYORERRCQ, seg_pos={0 0}, upload=713290]: Done uploading piece. err: <nil>
Apr 1 23:57:15.668920283 (636h57m13.26569131s) [noise=true , address=45.91.116.10:4106 , piece_id=4NZL3VQCH2O4U6YRWDD7TAAAQQQI4TKIYIHZ5O5ZVGYEW6YQH65A, seg_pos={0 0}, upload=713290]: Done uploading piece. err: <nil>
Apr 1 23:57:15.669625062 (636h57m13.26639609s) [noise=true , address=145.79.227.28:4750 , piece_id=XYJUAUC3QVKHVJBT6DDLXYF32DKDFOCG7HSRQINSP53RH6KZYEEQ, seg_pos={0 0}, upload=713290]: Done uploading piece. err: <nil>
Apr 1 23:57:15.670346039 (636h57m13.267117103s) [noise=true , address=145.79.227.25:4634 , piece_id=GURYKILYFAXCJXLVTXJWH7N2SLRRA4LHVALUEK7ZKHX5NHJ3EG3A, seg_pos={0 0}, upload=713290]: Done uploading piece. err: <nil>
Apr 1 23:57:15.686435681 (636h57m13.28320671s) [noise=true , address=145.79.227.13:4817 , piece_id=CHC7NR5GW4NACUIQ3P7H2BESMH2N4G26WXTNCGVIOVVLRTXQDGFQ, seg_pos={0 0}, upload=713290]: Done uploading piece. err: <nil>
Apr 1 23:57:15.687328957 (636h57m13.284099971s) [noise=true , address=45.91.116.6:4992 , piece_id=HPEH7STAI6LVZCOQNGZ2WUOJZGCYEHJBKXHXWZYIFL3UVVXUAEVA, seg_pos={0 0}, upload=713290]: Done uploading piece. err: <nil>
Apr 1 23:57:15.688996249 (636h57m13.285767283s) [noise=true , address=145.79.227.29:4952 , piece_id=7EJ34RRFPGHXM2P4Y2HGX6QZXIHGBZWQN32DJE5KW7RRCK5ERQUQ, seg_pos={0 0}, upload=713290]: Done uploading piece. err: <nil>
Apr 1 23:57:15.690924352 (636h57m13.287695376s) [noise=true , address=45.91.116.5:4321 , piece_id=BVJLGBADAVOCD7334ZSYQFTTOZZRORCVDLKYWA36KZUY7ZMPQPYA, seg_pos={0 0}, upload=713290]: Done uploading piece. err: <nil>
Apr 1 23:57:15.765941067 (636h57m13.36271208s) [noise=true , address=5.231.73.5:4023 , piece_id=KMDC65CQVBJVY6A2AFOV2CTTU666DFVA5PGX5NBGPVZXYBTB4MVQ, seg_pos={0 0}, upload=713290]: Done uploading piece. err: <nil>
Apr 1 23:57:15.926282933 (636h57m13.523053947s) [noise=true , address=167.17.72.68:4656 , piece_id=PP3RXSFNYJDLGTMOMW3PD5U45P5FHMQGWLXLCB4C7CXFA5ZPVGSA, seg_pos={0 0}, upload=713290]: Done uploading piece. err: <nil>
Apr 1 23:57:15.960629302 (636h57m13.557400314s) [noise=true , address=167.17.72.70:4760 , piece_id=6EWYQBA34L2SGSGNUURG2FQTVQTF727I2N4S62IXCWBL7LV5LXWA, seg_pos={0 0}, upload=713290]: Done uploading piece. err: <nil>
Apr 1 23:57:15.974412758 (636h57m13.571183782s) [noise=true , address=167.17.72.69:4725 , piece_id=5TE3UE5FSBISQU24MGQ5ZC33J23PKUH7BTOSGPLE7EP4PRR2FPJA, seg_pos={0 0}, upload=713290]: Done uploading piece. err: <nil>
Apr 1 23:57:16.145550312 (636h57m13.742321341s) [noise=true , address=167.17.72.71:4809 , piece_id=PH3G4FPSHHWVHAHB32YLLNBZURJSJURAIOU3CKOP6FREC4QEOJSA, seg_pos={0 0}, upload=713290]: Done uploading piece. err: <nil>
Apr 1 23:57:16.145574963 (636h57m13.742345986s) [seg_pos={0 0}, upload=713290]: Satisfied cohort requirements after 14 pieces
Apr 1 23:57:16.145919290 (636h57m13.74269032s) [noise=true , address=64.49.13.154:4930 , piece_id=2D2FHXGMK6OQXEMZDXLJCEPH6VNG43LXGXIKPUVFGU2FHPNHNCGA, seg_pos={0 0}, upload=713290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kNK8y5et7MiiWNDT6iaC8YBAk3PX6WX1XSuU4QMSFBp3KymBb): protocol: expected piece hash; context canceled; EOF
Apr 1 23:57:16.145932737 (636h57m13.742703762s) [noise=true , address=64.49.13.154:4930 , piece_id=2D2FHXGMK6OQXEMZDXLJCEPH6VNG43LXGXIKPUVFGU2FHPNHNCGA, seg_pos={0 0}, upload=713290]: Long tail cancellation due to optimal threshold
Apr 1 23:57:16.145937683 (636h57m13.742708704s) [noise=true , address=193.149.164.67:4031 , piece_id=RPHSQLG6LXSB4XE3Z6T3YWEUJTTADOKLP2AQ456WYCA7ABYZC4PA, seg_pos={0 0}, upload=713290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mKDysn1zmhbJtJjUbMy9VjwVHU2Z6gDZHsUvdft17aanEXdnL): protocol: expected piece hash; context canceled; EOF
Apr 1 23:57:16.145963225 (636h57m13.742734235s) [noise=true , address=193.149.164.67:4031 , piece_id=RPHSQLG6LXSB4XE3Z6T3YWEUJTTADOKLP2AQ456WYCA7ABYZC4PA, seg_pos={0 0}, upload=713290]: Long tail cancellation due to optimal threshold
Apr 1 23:57:16.146150147 (636h57m13.742921171s) [noise=true , address=64.49.13.27:4957 , piece_id=FNHBLRC7WW7ZKVDGLLS463HYU3YIBFFZAYB3O5K75PCLO3FFFWUA, seg_pos={0 0}, upload=713290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD): protocol: expected piece hash; context canceled; EOF
Apr 1 23:57:16.146170731 (636h57m13.742941754s) [noise=true , address=64.49.13.27:4957 , piece_id=FNHBLRC7WW7ZKVDGLLS463HYU3YIBFFZAYB3O5K75PCLO3FFFWUA, seg_pos={0 0}, upload=713290]: Long tail cancellation due to optimal threshold
Apr 1 23:57:16.146182881 (636h57m13.742953914s) [noise=true , address=64.49.13.137:4493 , piece_id=D6BJ23VFWA6U5FROAY5BTG3IIJQIYJXF7XH7ISSFFRRATUS7DW2A, seg_pos={0 0}, upload=713290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12N91KV4t7yYJvKLFMaXHjByCZpsNgWFnYyZHJE7BqEYBGMLAi9): protocol: expected piece hash; context canceled; EOF
Apr 1 23:57:16.146192735 (636h57m13.742963768s) [noise=true , address=64.49.13.137:4493 , piece_id=D6BJ23VFWA6U5FROAY5BTG3IIJQIYJXF7XH7ISSFFRRATUS7DW2A, seg_pos={0 0}, upload=713290]: Long tail cancellation due to optimal threshold
Apr 1 23:57:16.146220375 (636h57m13.742991384s) [seg_pos={0 0}, upload=713290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Apr 1 23:57:16.146315961 (636h57m13.743086996s) [upload=713290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Apr 1 23:57:16.146323111 (636h57m13.743094148s) [upload=713290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Apr 1 23:57:25.583979309 (636h57m23.180750333s) [upload=713290]: Done uploading segments...
Apr 1 23:57:25.584000351 (636h57m23.180771375s) [upload=713290]: Upload finished. err: <nil>
Duration: 1m0.003302417s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [..........................................................XX] duration:
5.002010051s trace:
https://jaeger.dev.storj.io/trace/2393dee1265e645
FAIL (2026-04-01 23:57:35 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.002035571s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................................................X] duration:
5.000947364s trace:
https://jaeger.dev.storj.io/trace/6476406c03d0837c
FAIL (2026-04-01 23:56:46 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000974258s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
4.552255202s trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 20:04:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.552301288s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [XX..........................................................] duration:
712.96753ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 20:04:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 713.001386ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [XXX.........................................................] duration:
477.625031ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 20:02:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 477.654178ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [.XXX........................................................] duration:
460.65476ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 20:01:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 460.684129ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [..XXX.......................................................] duration:
777.101404ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 20:01:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 777.21611ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [...XXX......................................................] duration:
392.068181ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 20:00:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 392.164875ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [X...XXX.....................................................] duration:
797.340823ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:59:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 797.368699ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
4 out of 60 is failed (threshold=6) [.X...XXX....................................................] duration:
992.17932ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:59:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 992.264223ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [X.X...XXX...................................................] duration:
1.003767763s trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:58:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.003789206s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [.X.X...XXX..................................................] duration:
747.787436ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:57:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 747.819896ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
5 out of 60 is failed (threshold=6) [..X.X...XXX.................................................] duration:
904.788223ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:57:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 904.844862ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
6 out of 60 is failed (threshold=6) [X..X.X...XXX................................................] duration:
619.981479ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:56:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 620.005145ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
6 out of 60 is failed (threshold=6) [.X..X.X...XXX...............................................] duration:
499.783987ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:55:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 499.8445ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
7 out of 60 is failed (threshold=6) [X.X..X.X...XXX..............................................] duration:
526.207561ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:54:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 526.294704ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
8 out of 60 is failed (threshold=6) [XX.X..X.X...XXX.............................................] duration:
589.465635ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:53:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 589.494977ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [XXX.X..X.X...XXX............................................] duration:
425.893344ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:52:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 425.916959ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [.XXX.X..X.X...XXX...........................................] duration:
651.529052ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:52:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 651.558916ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [..XXX.X..X.X...XXX..........................................] duration:
442.637926ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:51:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 442.672421ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [...XXX.X..X.X...XXX.........................................] duration:
665.541718ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:50:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 665.575905ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [....XXX.X..X.X...XXX........................................] duration:
808.549265ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:50:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 808.582775ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [.....XXX.X..X.X...XXX.......................................] duration:
426.349942ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:48:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 426.423369ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [......XXX.X..X.X...XXX......................................] duration:
503.882422ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:47:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 503.915452ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [.......XXX.X..X.X...XXX.....................................] duration:
603.328966ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:47:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 603.359071ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [........XXX.X..X.X...XXX....................................] duration:
463.18833ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:46:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 463.220117ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [.........XXX.X..X.X...XXX...................................] duration:
583.187249ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:45:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 583.268116ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [..........XXX.X..X.X...XXX..................................] duration:
572.167078ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:44:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 572.208873ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [...........XXX.X..X.X...XXX.................................] duration:
437.368715ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:43:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 437.476156ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [............XXX.X..X.X...XXX................................] duration:
636.721944ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:42:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 636.74927ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [.............XXX.X..X.X...XXX...............................] duration:
603.815268ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:42:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 603.851238ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [..............XXX.X..X.X...XXX..............................] duration:
542.084721ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:41:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 542.118658ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [...............XXX.X..X.X...XXX.............................] duration:
616.783364ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:40:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 616.813729ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [................XXX.X..X.X...XXX............................] duration:
600.210997ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:39:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 600.319558ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [.................XXX.X..X.X...XXX...........................] duration:
493.114327ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:38:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 493.196241ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [..................XXX.X..X.X...XXX..........................] duration:
711.619517ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:37:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 711.66311ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [...................XXX.X..X.X...XXX.........................] duration:
549.944106ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:36:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 550.491897ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [....................XXX.X..X.X...XXX........................] duration:
571.717567ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:36:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 571.758771ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [.....................XXX.X..X.X...XXX.......................] duration:
486.409786ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:35:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 486.442034ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [......................XXX.X..X.X...XXX......................] duration:
1.721896429s trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:35:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.721946139s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [.......................XXX.X..X.X...XXX.....................] duration:
544.27341ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:34:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 544.309495ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
9 out of 60 is failed (threshold=6) [........................XXX.X..X.X...XXX....................] duration:
519.816933ms trace:
https://jaeger.dev.storj.io/trace/61abfb6305d0aff7
FAIL (2026-04-01 19:33:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 519.878108ms
core
uplink
us-select-1
us1-placement-20
|