Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 1.273547471s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 10:52:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.273641348s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 571.828097ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 10:52:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 571.857308ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.......................................XXX..................] duration: 542.144407ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:52:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 542.213453ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 1.232985707s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 10:51:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.23301908s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [........................................XXX.................] duration: 663.617069ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:51:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 663.640595ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 1.259183088s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 10:51:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.259273064s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 634.886351ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 10:51:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 634.913585ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.........................................XXX................] duration: 620.984696ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:51:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 621.015618ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.264743825s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 10:50:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.264791756s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..........................................XXX...............] duration: 463.745234ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:50:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 463.852451ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...........................................XXX..............] duration: 486.927312ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:50:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 486.983551ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 609.492061ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 10:50:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 609.557312ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 1.216764547s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 10:49:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.216794485s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [............................................XXX.............] duration: 484.489036ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:49:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 484.554334ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.............................................XXX............] duration: 439.427934ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:49:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 439.475441ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 749.991804ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 10:49:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 750.037389ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.58348001s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 10:48:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.583516347s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..............................................XXX...........] duration: 529.170234ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:48:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 529.280089ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 773.49816ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 10:48:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 773.556379ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 819.42644ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 10:47:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 819.467181ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.212208292s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 10:47:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.21227201s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...............................................XXX..........] duration: 495.012429ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:47:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 495.12987ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [................................................XXX.........] duration: 667.916865ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:47:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 667.94589ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.233852855s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 10:46:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.233874754s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 582.726362ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 10:46:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 582.779587ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.................................................XXX........] duration: 623.762656ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:46:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 623.792064ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 789.427076ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 10:46:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 789.455938ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..................................................XXX.......] duration: 659.710126ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:46:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 659.74884ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.233694948s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 10:46:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.233737384s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 611.969238ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 10:45:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 612.054133ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...................................................XXX......] duration: 504.465029ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:45:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 504.502401ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.22364025s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 10:45:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.223673324s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.247734016s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 10:44:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.247762608s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 755.37213ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 10:44:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 755.45647ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [....................................................XXX.....] duration: 697.344784ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:44:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 697.407792ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.294629783s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 10:44:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.294661323s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.....................................................XXX....] duration: 607.808505ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:43:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 607.838699ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 701.495739ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 10:43:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 701.519305ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.278910577s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 10:42:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.278947727s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.280253974s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 10:42:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.280272191s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [......................................................XXX...] duration: 708.067996ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:42:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 708.129063ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 597.364528ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 10:42:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 597.487919ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.247300273s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 10:41:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.24731876s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 551.476198ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 10:41:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 551.552176ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.......................................................XXX..] duration: 436.467777ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:40:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 436.554736ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 647.077398ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 10:40:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 647.09299ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 50.772369706s trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 10:40:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 50.772399323s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.718303581s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 10:40:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.718325917s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [........................................................XXX.] duration: 1.548162761s trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 10:40:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.548194248s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.02463538s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 10:40:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.024674088s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)