Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 1.253310284s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 11:19:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.253339244s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 1.250269803s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 11:18:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.250299667s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 609.336772ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 11:18:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 609.374061ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.......XXX..................................................] duration: 969.538735ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 11:18:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 969.589059ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [........XXX.................................................] duration: 460.421231ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 11:18:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 460.473078ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 551.03554ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 11:18:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 551.173387ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.323216842s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 11:17:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.323256447s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.........XXX................................................] duration: 488.055552ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 11:17:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 488.18192ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 748.291433ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 11:17:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 748.34178ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.376202656s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 11:16:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.376291144s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..........XXX...............................................] duration: 595.664787ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 11:16:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 595.694453ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 607.820843ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 11:16:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 607.935129ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.349385761s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 11:15:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.349418526s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...........XXX..............................................] duration: 514.412169ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 11:15:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 514.446897ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 817.996284ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 11:15:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 818.031731ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 784.855119ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 11:15:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 784.88774ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [............XXX.............................................] duration: 453.948179ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 11:14:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 453.976546ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 1.283100282s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 11:14:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.283131344s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 513.898019ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 11:14:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 513.947425ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 571.727216ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 11:14:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 571.790769ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.............XXX............................................] duration: 461.789506ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 11:13:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 461.820981ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 601.072317ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 11:13:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 601.099716ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 1.298551538s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 11:13:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.298580434s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..............XXX...........................................] duration: 449.984841ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 11:13:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 450.012171ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 547.124492ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 11:13:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 547.162ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...............XXX..........................................] duration: 467.295816ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 11:12:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 467.540815ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 1.269281498s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 11:12:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.269315658s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 610.405221ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 11:12:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 610.462543ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [................XXX.........................................] duration: 474.331419ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 11:12:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 474.358285ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 1.256925546s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 11:12:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.256957853s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.................XXX........................................] duration: 425.929066ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 11:11:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 426.001108ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 1.202881876s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 11:11:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.20295051s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 543.424146ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 11:11:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 543.454028ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 571.012561ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 11:10:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 571.052239ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.602129964s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 11:10:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.602178043s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..................XXX.......................................] duration: 693.81019ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 11:10:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 693.843048ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 1.289492742s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 11:10:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.289528358s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 646.435772ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 11:09:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 646.465657ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...................XXX......................................] duration: 478.496283ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 11:09:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 478.526166ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 1.700156362s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 11:09:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.700224518s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 588.124126ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 11:08:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 588.152728ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [....................XXX.....................................] duration: 423.138572ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 11:08:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 423.168964ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 1.32908345s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 11:07:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.329122441s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.....................XXX....................................] duration: 600.97262ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 11:07:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 601.00768ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 1.259160483s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 11:07:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.259191479s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 549.846955ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 11:07:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 549.88391ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 1.260571964s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 11:06:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.260606604s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [......................XXX...................................] duration: 617.954263ms trace: https://jaeger.dev.storj.io/trace/4736d76b51c361a3 FAIL (2026-04-06 11:06:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 617.989052ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 531.332577ms trace: https://jaeger.dev.storj.io/trace/7756830e434d8498 FAIL (2026-04-06 11:06:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 531.365523ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 1.5835409s trace: https://jaeger.dev.storj.io/trace/7e44fa01de290116 FAIL (2026-04-06 11:05:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== loading segments... Apr 6 10:39:12.293175658 (743h39m9.88994668s) [upload=832686]: Got next segment. Inline: false Apr 6 10:39:12.293210466 (743h39m9.889981489s) [upload=832686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 6 10:39:12.293215002 (743h39m9.889986025s) [upload=832686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 6 10:39:12.319174409 (743h39m9.915945433s) [seg_pos={0 0}, upload=832686]: Begin upload segment... Apr 6 10:39:12.319264769 (743h39m9.916035785s) [seg_pos={0 0}, upload=832686]: Done begin upload segment. Apr 6 10:39:12.319310748 (743h39m9.91608178s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319344730 (743h39m9.916115762s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.319839277 (743h39m9.916610309s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320290481 (743h39m9.917061503s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320450536 (743h39m9.917221562s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320733701 (743h39m9.917504727s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.320988084 (743h39m9.917759097s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321148099 (743h39m9.917919124s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321494813 (743h39m9.918265836s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321531682 (743h39m9.918302714s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.321879088 (743h39m9.918650182s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322027388 (743h39m9.918798417s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322241446 (743h39m9.919012475s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322546472 (743h39m9.919317502s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322583845 (743h39m9.919354868s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.322937532 (743h39m9.919708565s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323051576 (743h39m9.919822591s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.323474343 (743h39m9.920245373s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Uploading piece... Apr 6 10:39:12.386273803 (743h39m9.983044815s) [upload=832686]: Next returned nil segment Apr 6 10:39:12.386288014 (743h39m9.983059037s) [upload=832686]: Waiting for error group managing segments... Apr 6 10:39:12.392899406 (743h39m9.989670418s) [noise=true , address=77.90.31.17:4775 , piece_id=CFR7LFL2JZCVX4N7X2QQPJVJLZDSD6NZCNLNLSUJKU4DIZ7BBL3Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.393163291 (743h39m9.989934315s) [noise=true , address=145.79.227.41:4116 , piece_id=E43SWVMVKWDULRK4YV6SDVJBCHWSAHSFRNACXSZZZQM2IU5JJ4KA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.667307989 (743h39m10.264079022s) [noise=true , address=167.17.72.68:4665 , piece_id=H7Y37VGEKXJGRPEZ2G4NG6WXTNNJ6YQMQI4NRUZYJTWMWIVF246Q, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.714497903 (743h39m10.311268937s) [noise=true , address=167.17.72.69:4734 , piece_id=I7HV3YRWA4IH7VE2I7SQFA42VHSYJVZCKA2KP4XQ4KSRJ6S7KPLA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.734199134 (743h39m10.330970147s) [noise=true , address=167.17.72.70:4761 , piece_id=WFSQTX3PFW77TZQCSIUSHSD3LH74XTFKLYUMDNYG7MFERLUCSZHA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.896708412 (743h39m10.493479439s) [noise=true , address=193.149.164.69:4104 , piece_id=Q3VXWW73OASMNUYH77EZBCQU5GAGPG3X3TKRLED43F3R6MZYZ2DQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.899988929 (743h39m10.496759964s) [noise=true , address=193.149.164.67:4008 , piece_id=SJM4PFZHQJW7I5C3XWXIIAJF7DBXPQQYGHTB22AB7JKMG6VN7QZA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.908433760 (743h39m10.505204783s) [noise=true , address=193.149.164.70:4105 , piece_id=7CKN7FHVF6OXY6ZPFZPM4DYNDOJNHGGF3PF3VFM7V2FSTAURFGWA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.916130090 (743h39m10.512901122s) [noise=true , address=193.149.164.68:4055 , piece_id=ARLLKHKO3AQJG52QH6EWHE55IKPQIEYCIIOR4RMIMU55TGYXYGKQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:12.956247905 (743h39m10.553018928s) [noise=true , address=193.149.164.66:4985 , piece_id=A6YQDCH7PTS6CP3IFWYMQ3HJGKFX6OSYQBATKUAIOXELHAEE5WBA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.000961275 (743h39m10.597732326s) [noise=true , address=193.149.164.143:4694 , piece_id=GG3FQN4YC5QQVGFCFYWTZWOZPFQO5NL2XE4FJCSUKUCTY4L5EWMA, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.304880608 (743h39m10.90165162s) [noise=true , address=145.79.227.33:4878 , piece_id=YAEEULYYAHZP3RM6YAE55LC7S7DQLVV6JWIGYCY64GF6ITHJRQSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:39:13.307202541 (743h39m10.903973568s) [noise=true , address=145.79.227.37:4582 , piece_id=QFSMYYEUDOO5JURWQHBLBRLCOXYSP4M2OR4OBWKIZ5LCCXPXEJCQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: <nil> Apr 6 10:40:12.257884464 (743h40m9.854655494s) [noise=true , address=45.91.116.12:4257 , piece_id=GW7MFYT77HZYDY263WMUIABDAELV37MBKMBS57FFSFXCIUJ5JN7A, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ZQ5a1TwxdeuJ6UwsVm9VsWnpZEBKC6N5yYUjyNTBkriSjvYvE, address:45.91.116.12:4257): protocol: rpc: dial tcp 45.91.116.12:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258122811 (743h40m9.854893836s) [noise=true , address=45.91.116.9:4270 , piece_id=UZYXLU235ANTBCMIIQDUHM6LZUKAS64FUBJIY2NXGYTIAO776KFQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 159.223.143.39:53356->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258358693 (743h40m9.855129725s) [noise=true , address=45.91.116.6:4987 , piece_id=N2OUZHWZMNVIMAPTOHLIIT6NK5N3PVSHS6OX4ZGYSRUJIS5X3CDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12vPKcqLhopcpFxZ1LXwD8JXPLJB8a6HKfGnoyXsvKaL2oWUNao, address:45.91.116.6:4987): protocol: context deadline exceeded; context deadline exceeded Apr 6 10:40:12.258544102 (743h40m9.855315131s) [noise=true , address=45.91.116.11:4142 , piece_id=YAVLJVKDZWHWPN572Y5TX55ONWE2IDXVA6ABUF6KD7YRWCWR3YSQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:135mYyE4Gy1gcCXSocnb41e9u4z4MpqMjodmaRnrNs9AGS1YcX, address:45.91.116.11:4142): protocol: write tcp 159.223.143.39:34030->45.91.116.11:4142: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258881055 (743h40m9.855652086s) [noise=true , address=45.91.116.13:4166 , piece_id=CNVYP6YUT7E3VUCCSUR2ZWCDYU6QMOZL5GPZAMPQ5P2BVSD6HUDQ, seg_pos={0 0}, upload=832686]: Done uploading piece. err: ecclient: upload failed (node:12ajyozgSuf68kn8sUuEmuSfYCcxzU8Cwmg1EXVt9WV6dKSopy7, address:45.91.116.13:4166): protocol: write tcp 159.223.143.39:45960->45.91.116.13:4166: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 6 10:40:12.258934014 (743h40m9.855705039s) [seg_pos={0 0}, upload=832686]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 6 10:40:12.278983295 (743h40m9.875754318s) [upload=832686]: Done uploading segments... Apr 6 10:40:12.279076909 (743h40m9.875847939s) [upload=832686]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.583606657s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)