Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [..X...................X...................X....X......X.....] duration:
2.503220625s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:29:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.503246335s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [X..X...................X...................X....X......X....] duration:
2.520885818s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:28:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.520913193s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [.X..X...................X...................X....X......X...] duration:
2.045991107s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:26:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.04601422s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [..X..X...................X...................X....X......X..] duration:
2.458369129s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:26:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.458395514s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [...X..X...................X...................X....X......X.] duration:
2.144987549s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:25:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.145003701s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [....X..X...................X...................X....X......X] duration:
1m0.106364726s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:25:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 1m0.106386068s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [.....X..X...................X...................X....X......] duration:
3.731051702s trace:
https://jaeger.dev.storj.io/trace/51b83f0860b491b9
FAIL (2026-03-17 17:23:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
noise=true , address=81.171.14.70:4037 , piece_id=4WTB6GUSLWZ4D3HWL7FUEO6T7UAVYAMTDKEFYEIVTF5DSQI4SPNQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.711778607 (270h19m11.308549639s) [noise=true , address=89.149.201.147:4009 , piece_id=56VWQQ43ALAQPNJ4PP4SUIFPK4GGQOISMTTELS5RZBVPZXYM6A4A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.713548267 (270h19m11.310319298s) [noise=true , address=185.167.204.205:4019 , piece_id=I4UGPISUI33KH63AMZG7PQNDM6JMTVQNUTO4KK4RZER6WPIEH7ZQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.716726828 (270h19m11.313497861s) [noise=true , address=81.171.14.70:4045 , piece_id=YJCCRWLOVWCYZJCJ7IQPXLFLULFMKXJQYTDGDI5G2FZOWTEQ7MTA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.720214767 (270h19m11.3169858s) [noise=true , address=185.167.204.206:4045 , piece_id=TBPUTMLUVR3Z2NBXHHYOUM2YXQ23N2LKTGY435B4CHCFL7UT3PCA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.722290577 (270h19m11.319061612s) [noise=true , address=81.171.14.70:4035 , piece_id=3RUQ6HFQPCRL64ZNKHND3LXTB4HCMEWMMD6T76WXUSM6LRREIK4A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.724895764 (270h19m11.321666799s) [noise=true , address=185.167.204.206:4044 , piece_id=QR3TBCXQGZ7PAN3MM72ABRIC5MWMDHRJFYUTS6ERMWGNA6RKNP7A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.725990616 (270h19m11.322761652s) [noise=true , address=185.167.204.206:4067 , piece_id=GEDUAUCIEFVJGYTEDPTQ6IJNXC7IT4KMO62DBDJ6UICNXBNWHBNA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.727695395 (270h19m11.32446676s) [noise=true , address=89.149.201.147:4003 , piece_id=ZJ5ZT6ZXCNXTACAHHEEP76A2QU2BIBG4GUYNZH6T4QT4RPCITDUQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.728256708 (270h19m11.325027738s) [noise=true , address=81.171.14.70:4041 , piece_id=FWHFFJMBILFX44ECKDJOT5PXRL5IG7OLA6OW5KNQK37H445FRCRA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.730103257 (270h19m11.326874296s) [noise=true , address=185.167.204.206:4065 , piece_id=24FPZFB3YSCLLWRTVHVPFRU3335MO2F32PTUNO2ZKOKIULPITABA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.730269869 (270h19m11.3270409s) [noise=true , address=81.171.14.70:4048 , piece_id=A7HSB7T67CNR6X2UC2IJ3LAELTPIBN3DSH6EPYCZOJ46P4TBX37Q, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:14.111641867 (270h19m11.7084129s) [upload=302810]: Next returned nil segment
Mar 17 17:19:14.111659056 (270h19m11.708430086s) [upload=302810]: Waiting for error group managing segments...
Mar 17 17:19:14.301192475 (270h19m11.897963499s) [noise=true , address=185.167.204.206:4062 , piece_id=ILYJ3YMOSBE27TIT7GANMKA7RUV7XLSL5TCSHNEQ22UI443SFNYA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.305860767 (270h19m11.902631782s) [noise=true , address=81.171.14.70:4025 , piece_id=RVAEGVMBHBPZUNISGJVH4D7PPHCC3E6YXH3TQBHTB3VLYGOUFYOQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.310489769 (270h19m11.907260794s) [noise=true , address=81.171.14.70:4037 , piece_id=4WTB6GUSLWZ4D3HWL7FUEO6T7UAVYAMTDKEFYEIVTF5DSQI4SPNQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.324700968 (270h19m11.921471997s) [noise=true , address=81.171.14.70:4045 , piece_id=YJCCRWLOVWCYZJCJ7IQPXLFLULFMKXJQYTDGDI5G2FZOWTEQ7MTA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.331950639 (270h19m11.928721671s) [noise=true , address=81.171.14.70:4028 , piece_id=PEHCCKWOWS6NJDQ3EU7SNUKGPWSEYVUTFMZL6IR7PM5UHFMNRFKQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.335578577 (270h19m11.932349589s) [noise=true , address=185.167.204.205:4022 , piece_id=RYPAPDNXXOITXSKUQF2HSJC53O4HLAZUXOKREAM5RNR7CQ6RBOFQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.346852014 (270h19m11.94362304s) [noise=true , address=81.171.14.70:4047 , piece_id=VX3UPTQUMBJGXPAY5CAXTC6NKIN547SC2AHMREOMYCHDTFXMTQLA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.357166991 (270h19m11.95393802s) [noise=true , address=81.171.14.70:4048 , piece_id=A7HSB7T67CNR6X2UC2IJ3LAELTPIBN3DSH6EPYCZOJ46P4TBX37Q, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.364739399 (270h19m11.961510424s) [noise=true , address=89.149.201.147:4002 , piece_id=GI7LXP7RCEBD342AXBLHQQ4OHQQK5PPBPLXBNZMLGHAWD25TJB7Q, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.368420679 (270h19m11.965191714s) [noise=true , address=185.167.204.206:4048 , piece_id=YWFY7D6H55NYNORUOIIGHQVRCT7BB4ZXGN7MWQOXUQ63KG2EKXOA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.375962984 (270h19m11.972734019s) [noise=true , address=89.149.201.147:4009 , piece_id=56VWQQ43ALAQPNJ4PP4SUIFPK4GGQOISMTTELS5RZBVPZXYM6A4A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.381603821 (270h19m11.978374857s) [noise=true , address=185.167.204.205:4026 , piece_id=VB3LFMWBZCXGZHBTFNW6NEQ7NPWSS2WOHWLGLROI3RP6XXN6JLPA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.383932002 (270h19m11.980703028s) [noise=true , address=185.167.204.206:4038 , piece_id=ON3BMECFWQDCGX7WC4MHIQUPJKYVKE4SCZMEYHQ66TJCYGHRAHKQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.396581531 (270h19m11.993352547s) [noise=true , address=185.167.204.206:4045 , piece_id=TBPUTMLUVR3Z2NBXHHYOUM2YXQ23N2LKTGY435B4CHCFL7UT3PCA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.399274126 (270h19m11.996045153s) [noise=true , address=185.167.204.206:4067 , piece_id=GEDUAUCIEFVJGYTEDPTQ6IJNXC7IT4KMO62DBDJ6UICNXBNWHBNA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.400140554 (270h19m11.996911583s) [noise=true , address=185.167.204.205:4032 , piece_id=KTVK37N2HBEFVKM5HISGUPO7AHRPJELWXWCMJKFXYDXM4JXMKKJA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.400180999 (270h19m11.996952028s) [noise=true , address=185.167.204.205:4003 , piece_id=5B6WA37IPXRRJK7AXS6OKGIGOSREFZPP6OESISLTAAITNKKHFXPQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.417956341 (270h19m12.014727366s) [noise=true , address=185.167.204.205:4019 , piece_id=I4UGPISUI33KH63AMZG7PQNDM6JMTVQNUTO4KK4RZER6WPIEH7ZQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.423262806 (270h19m12.020033835s) [noise=true , address=185.167.204.206:4065 , piece_id=24FPZFB3YSCLLWRTVHVPFRU3335MO2F32PTUNO2ZKOKIULPITABA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.434540392 (270h19m12.031311428s) [noise=true , address=89.149.201.147:4018 , piece_id=GEOMWXWE2FXQPQL52XK5BPOFBCBRNBGEGO77TC4WAC23JOUAOZWA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.809003384 (270h19m12.405774397s) [noise=true , address=81.171.14.70:4035 , piece_id=3RUQ6HFQPCRL64ZNKHND3LXTB4HCMEWMMD6T76WXUSM6LRREIK4A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.836906643 (270h19m12.433677656s) [noise=true , address=81.171.14.70:4041 , piece_id=FWHFFJMBILFX44ECKDJOT5PXRL5IG7OLA6OW5KNQK37H445FRCRA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:16.594672767 (270h19m14.191443777s) [noise=true , address=185.167.204.205:4028 , piece_id=JP7H2NEDXX6ZBO4HQGJGP2KFZ3HX2CAPJWJWE6ORDKTFFJRQD6MQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:17.109237886 (270h19m14.706008912s) [noise=true , address=185.167.204.205:4020 , piece_id=N26LMOMRWZDV2EKUZ4UXBSLPFHUSTFP253P5OKSBSJKCC6PDTE7A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:17.791882843 (270h19m15.38865387s) [noise=true , address=185.167.204.206:4044 , piece_id=QR3TBCXQGZ7PAN3MM72ABRIC5MWMDHRJFYUTS6ERMWGNA6RKNP7A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:20:13.312468131 (270h20m10.909239165s) [noise=true , address=89.149.201.147:4003 , piece_id=ZJ5ZT6ZXCNXTACAHHEEP76A2QU2BIBG4GUYNZH6T4QT4RPCITDUQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: read tcp 159.223.143.39:33446->89.149.201.147:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312671303 (270h20m10.909442339s) [noise=true , address=89.149.201.147:4017 , piece_id=T5KUBI424NXF3PPU4F7VE2VIMDYHTNKG2DE72N2KZFEC2H4JA4XA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:39946->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312691602 (270h20m10.909462624s) [noise=true , address=89.149.201.147:4007 , piece_id=CRJPF2CFC6EOD2BVLIWPYMFLURFFE7NNGHQ66F67WPS4ZURC4PAA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 159.223.143.39:33938->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312735087 (270h20m10.909506099s) [seg_pos={0 0}, upload=302810]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 17:20:13.408199172 (270h20m11.004970204s) [upload=302810]: Done uploading segments...
Mar 17 17:20:13.408257252 (270h20m11.005028292s) [upload=302810]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 3.731076993s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [......X..X...................X...................X....X.....] duration:
3.028354336s trace:
https://jaeger.dev.storj.io/trace/51b83f0860b491b9
FAIL (2026-03-17 17:22:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
noise=true , address=81.171.14.70:4037 , piece_id=4WTB6GUSLWZ4D3HWL7FUEO6T7UAVYAMTDKEFYEIVTF5DSQI4SPNQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.711778607 (270h19m11.308549639s) [noise=true , address=89.149.201.147:4009 , piece_id=56VWQQ43ALAQPNJ4PP4SUIFPK4GGQOISMTTELS5RZBVPZXYM6A4A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.713548267 (270h19m11.310319298s) [noise=true , address=185.167.204.205:4019 , piece_id=I4UGPISUI33KH63AMZG7PQNDM6JMTVQNUTO4KK4RZER6WPIEH7ZQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.716726828 (270h19m11.313497861s) [noise=true , address=81.171.14.70:4045 , piece_id=YJCCRWLOVWCYZJCJ7IQPXLFLULFMKXJQYTDGDI5G2FZOWTEQ7MTA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.720214767 (270h19m11.3169858s) [noise=true , address=185.167.204.206:4045 , piece_id=TBPUTMLUVR3Z2NBXHHYOUM2YXQ23N2LKTGY435B4CHCFL7UT3PCA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.722290577 (270h19m11.319061612s) [noise=true , address=81.171.14.70:4035 , piece_id=3RUQ6HFQPCRL64ZNKHND3LXTB4HCMEWMMD6T76WXUSM6LRREIK4A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.724895764 (270h19m11.321666799s) [noise=true , address=185.167.204.206:4044 , piece_id=QR3TBCXQGZ7PAN3MM72ABRIC5MWMDHRJFYUTS6ERMWGNA6RKNP7A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.725990616 (270h19m11.322761652s) [noise=true , address=185.167.204.206:4067 , piece_id=GEDUAUCIEFVJGYTEDPTQ6IJNXC7IT4KMO62DBDJ6UICNXBNWHBNA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.727695395 (270h19m11.32446676s) [noise=true , address=89.149.201.147:4003 , piece_id=ZJ5ZT6ZXCNXTACAHHEEP76A2QU2BIBG4GUYNZH6T4QT4RPCITDUQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.728256708 (270h19m11.325027738s) [noise=true , address=81.171.14.70:4041 , piece_id=FWHFFJMBILFX44ECKDJOT5PXRL5IG7OLA6OW5KNQK37H445FRCRA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.730103257 (270h19m11.326874296s) [noise=true , address=185.167.204.206:4065 , piece_id=24FPZFB3YSCLLWRTVHVPFRU3335MO2F32PTUNO2ZKOKIULPITABA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.730269869 (270h19m11.3270409s) [noise=true , address=81.171.14.70:4048 , piece_id=A7HSB7T67CNR6X2UC2IJ3LAELTPIBN3DSH6EPYCZOJ46P4TBX37Q, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:14.111641867 (270h19m11.7084129s) [upload=302810]: Next returned nil segment
Mar 17 17:19:14.111659056 (270h19m11.708430086s) [upload=302810]: Waiting for error group managing segments...
Mar 17 17:19:14.301192475 (270h19m11.897963499s) [noise=true , address=185.167.204.206:4062 , piece_id=ILYJ3YMOSBE27TIT7GANMKA7RUV7XLSL5TCSHNEQ22UI443SFNYA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.305860767 (270h19m11.902631782s) [noise=true , address=81.171.14.70:4025 , piece_id=RVAEGVMBHBPZUNISGJVH4D7PPHCC3E6YXH3TQBHTB3VLYGOUFYOQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.310489769 (270h19m11.907260794s) [noise=true , address=81.171.14.70:4037 , piece_id=4WTB6GUSLWZ4D3HWL7FUEO6T7UAVYAMTDKEFYEIVTF5DSQI4SPNQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.324700968 (270h19m11.921471997s) [noise=true , address=81.171.14.70:4045 , piece_id=YJCCRWLOVWCYZJCJ7IQPXLFLULFMKXJQYTDGDI5G2FZOWTEQ7MTA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.331950639 (270h19m11.928721671s) [noise=true , address=81.171.14.70:4028 , piece_id=PEHCCKWOWS6NJDQ3EU7SNUKGPWSEYVUTFMZL6IR7PM5UHFMNRFKQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.335578577 (270h19m11.932349589s) [noise=true , address=185.167.204.205:4022 , piece_id=RYPAPDNXXOITXSKUQF2HSJC53O4HLAZUXOKREAM5RNR7CQ6RBOFQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.346852014 (270h19m11.94362304s) [noise=true , address=81.171.14.70:4047 , piece_id=VX3UPTQUMBJGXPAY5CAXTC6NKIN547SC2AHMREOMYCHDTFXMTQLA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.357166991 (270h19m11.95393802s) [noise=true , address=81.171.14.70:4048 , piece_id=A7HSB7T67CNR6X2UC2IJ3LAELTPIBN3DSH6EPYCZOJ46P4TBX37Q, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.364739399 (270h19m11.961510424s) [noise=true , address=89.149.201.147:4002 , piece_id=GI7LXP7RCEBD342AXBLHQQ4OHQQK5PPBPLXBNZMLGHAWD25TJB7Q, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.368420679 (270h19m11.965191714s) [noise=true , address=185.167.204.206:4048 , piece_id=YWFY7D6H55NYNORUOIIGHQVRCT7BB4ZXGN7MWQOXUQ63KG2EKXOA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.375962984 (270h19m11.972734019s) [noise=true , address=89.149.201.147:4009 , piece_id=56VWQQ43ALAQPNJ4PP4SUIFPK4GGQOISMTTELS5RZBVPZXYM6A4A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.381603821 (270h19m11.978374857s) [noise=true , address=185.167.204.205:4026 , piece_id=VB3LFMWBZCXGZHBTFNW6NEQ7NPWSS2WOHWLGLROI3RP6XXN6JLPA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.383932002 (270h19m11.980703028s) [noise=true , address=185.167.204.206:4038 , piece_id=ON3BMECFWQDCGX7WC4MHIQUPJKYVKE4SCZMEYHQ66TJCYGHRAHKQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.396581531 (270h19m11.993352547s) [noise=true , address=185.167.204.206:4045 , piece_id=TBPUTMLUVR3Z2NBXHHYOUM2YXQ23N2LKTGY435B4CHCFL7UT3PCA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.399274126 (270h19m11.996045153s) [noise=true , address=185.167.204.206:4067 , piece_id=GEDUAUCIEFVJGYTEDPTQ6IJNXC7IT4KMO62DBDJ6UICNXBNWHBNA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.400140554 (270h19m11.996911583s) [noise=true , address=185.167.204.205:4032 , piece_id=KTVK37N2HBEFVKM5HISGUPO7AHRPJELWXWCMJKFXYDXM4JXMKKJA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.400180999 (270h19m11.996952028s) [noise=true , address=185.167.204.205:4003 , piece_id=5B6WA37IPXRRJK7AXS6OKGIGOSREFZPP6OESISLTAAITNKKHFXPQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.417956341 (270h19m12.014727366s) [noise=true , address=185.167.204.205:4019 , piece_id=I4UGPISUI33KH63AMZG7PQNDM6JMTVQNUTO4KK4RZER6WPIEH7ZQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.423262806 (270h19m12.020033835s) [noise=true , address=185.167.204.206:4065 , piece_id=24FPZFB3YSCLLWRTVHVPFRU3335MO2F32PTUNO2ZKOKIULPITABA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.434540392 (270h19m12.031311428s) [noise=true , address=89.149.201.147:4018 , piece_id=GEOMWXWE2FXQPQL52XK5BPOFBCBRNBGEGO77TC4WAC23JOUAOZWA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.809003384 (270h19m12.405774397s) [noise=true , address=81.171.14.70:4035 , piece_id=3RUQ6HFQPCRL64ZNKHND3LXTB4HCMEWMMD6T76WXUSM6LRREIK4A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.836906643 (270h19m12.433677656s) [noise=true , address=81.171.14.70:4041 , piece_id=FWHFFJMBILFX44ECKDJOT5PXRL5IG7OLA6OW5KNQK37H445FRCRA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:16.594672767 (270h19m14.191443777s) [noise=true , address=185.167.204.205:4028 , piece_id=JP7H2NEDXX6ZBO4HQGJGP2KFZ3HX2CAPJWJWE6ORDKTFFJRQD6MQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:17.109237886 (270h19m14.706008912s) [noise=true , address=185.167.204.205:4020 , piece_id=N26LMOMRWZDV2EKUZ4UXBSLPFHUSTFP253P5OKSBSJKCC6PDTE7A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:17.791882843 (270h19m15.38865387s) [noise=true , address=185.167.204.206:4044 , piece_id=QR3TBCXQGZ7PAN3MM72ABRIC5MWMDHRJFYUTS6ERMWGNA6RKNP7A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:20:13.312468131 (270h20m10.909239165s) [noise=true , address=89.149.201.147:4003 , piece_id=ZJ5ZT6ZXCNXTACAHHEEP76A2QU2BIBG4GUYNZH6T4QT4RPCITDUQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: read tcp 159.223.143.39:33446->89.149.201.147:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312671303 (270h20m10.909442339s) [noise=true , address=89.149.201.147:4017 , piece_id=T5KUBI424NXF3PPU4F7VE2VIMDYHTNKG2DE72N2KZFEC2H4JA4XA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:39946->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312691602 (270h20m10.909462624s) [noise=true , address=89.149.201.147:4007 , piece_id=CRJPF2CFC6EOD2BVLIWPYMFLURFFE7NNGHQ66F67WPS4ZURC4PAA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 159.223.143.39:33938->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312735087 (270h20m10.909506099s) [seg_pos={0 0}, upload=302810]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 17:20:13.408199172 (270h20m11.004970204s) [upload=302810]: Done uploading segments...
Mar 17 17:20:13.408257252 (270h20m11.005028292s) [upload=302810]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 3.028375185s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [.......X..X...................X...................X....X....] duration:
2.696718735s trace:
https://jaeger.dev.storj.io/trace/51b83f0860b491b9
FAIL (2026-03-17 17:22:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
noise=true , address=81.171.14.70:4037 , piece_id=4WTB6GUSLWZ4D3HWL7FUEO6T7UAVYAMTDKEFYEIVTF5DSQI4SPNQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.711778607 (270h19m11.308549639s) [noise=true , address=89.149.201.147:4009 , piece_id=56VWQQ43ALAQPNJ4PP4SUIFPK4GGQOISMTTELS5RZBVPZXYM6A4A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.713548267 (270h19m11.310319298s) [noise=true , address=185.167.204.205:4019 , piece_id=I4UGPISUI33KH63AMZG7PQNDM6JMTVQNUTO4KK4RZER6WPIEH7ZQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.716726828 (270h19m11.313497861s) [noise=true , address=81.171.14.70:4045 , piece_id=YJCCRWLOVWCYZJCJ7IQPXLFLULFMKXJQYTDGDI5G2FZOWTEQ7MTA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.720214767 (270h19m11.3169858s) [noise=true , address=185.167.204.206:4045 , piece_id=TBPUTMLUVR3Z2NBXHHYOUM2YXQ23N2LKTGY435B4CHCFL7UT3PCA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.722290577 (270h19m11.319061612s) [noise=true , address=81.171.14.70:4035 , piece_id=3RUQ6HFQPCRL64ZNKHND3LXTB4HCMEWMMD6T76WXUSM6LRREIK4A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.724895764 (270h19m11.321666799s) [noise=true , address=185.167.204.206:4044 , piece_id=QR3TBCXQGZ7PAN3MM72ABRIC5MWMDHRJFYUTS6ERMWGNA6RKNP7A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.725990616 (270h19m11.322761652s) [noise=true , address=185.167.204.206:4067 , piece_id=GEDUAUCIEFVJGYTEDPTQ6IJNXC7IT4KMO62DBDJ6UICNXBNWHBNA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.727695395 (270h19m11.32446676s) [noise=true , address=89.149.201.147:4003 , piece_id=ZJ5ZT6ZXCNXTACAHHEEP76A2QU2BIBG4GUYNZH6T4QT4RPCITDUQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.728256708 (270h19m11.325027738s) [noise=true , address=81.171.14.70:4041 , piece_id=FWHFFJMBILFX44ECKDJOT5PXRL5IG7OLA6OW5KNQK37H445FRCRA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.730103257 (270h19m11.326874296s) [noise=true , address=185.167.204.206:4065 , piece_id=24FPZFB3YSCLLWRTVHVPFRU3335MO2F32PTUNO2ZKOKIULPITABA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.730269869 (270h19m11.3270409s) [noise=true , address=81.171.14.70:4048 , piece_id=A7HSB7T67CNR6X2UC2IJ3LAELTPIBN3DSH6EPYCZOJ46P4TBX37Q, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:14.111641867 (270h19m11.7084129s) [upload=302810]: Next returned nil segment
Mar 17 17:19:14.111659056 (270h19m11.708430086s) [upload=302810]: Waiting for error group managing segments...
Mar 17 17:19:14.301192475 (270h19m11.897963499s) [noise=true , address=185.167.204.206:4062 , piece_id=ILYJ3YMOSBE27TIT7GANMKA7RUV7XLSL5TCSHNEQ22UI443SFNYA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.305860767 (270h19m11.902631782s) [noise=true , address=81.171.14.70:4025 , piece_id=RVAEGVMBHBPZUNISGJVH4D7PPHCC3E6YXH3TQBHTB3VLYGOUFYOQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.310489769 (270h19m11.907260794s) [noise=true , address=81.171.14.70:4037 , piece_id=4WTB6GUSLWZ4D3HWL7FUEO6T7UAVYAMTDKEFYEIVTF5DSQI4SPNQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.324700968 (270h19m11.921471997s) [noise=true , address=81.171.14.70:4045 , piece_id=YJCCRWLOVWCYZJCJ7IQPXLFLULFMKXJQYTDGDI5G2FZOWTEQ7MTA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.331950639 (270h19m11.928721671s) [noise=true , address=81.171.14.70:4028 , piece_id=PEHCCKWOWS6NJDQ3EU7SNUKGPWSEYVUTFMZL6IR7PM5UHFMNRFKQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.335578577 (270h19m11.932349589s) [noise=true , address=185.167.204.205:4022 , piece_id=RYPAPDNXXOITXSKUQF2HSJC53O4HLAZUXOKREAM5RNR7CQ6RBOFQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.346852014 (270h19m11.94362304s) [noise=true , address=81.171.14.70:4047 , piece_id=VX3UPTQUMBJGXPAY5CAXTC6NKIN547SC2AHMREOMYCHDTFXMTQLA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.357166991 (270h19m11.95393802s) [noise=true , address=81.171.14.70:4048 , piece_id=A7HSB7T67CNR6X2UC2IJ3LAELTPIBN3DSH6EPYCZOJ46P4TBX37Q, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.364739399 (270h19m11.961510424s) [noise=true , address=89.149.201.147:4002 , piece_id=GI7LXP7RCEBD342AXBLHQQ4OHQQK5PPBPLXBNZMLGHAWD25TJB7Q, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.368420679 (270h19m11.965191714s) [noise=true , address=185.167.204.206:4048 , piece_id=YWFY7D6H55NYNORUOIIGHQVRCT7BB4ZXGN7MWQOXUQ63KG2EKXOA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.375962984 (270h19m11.972734019s) [noise=true , address=89.149.201.147:4009 , piece_id=56VWQQ43ALAQPNJ4PP4SUIFPK4GGQOISMTTELS5RZBVPZXYM6A4A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.381603821 (270h19m11.978374857s) [noise=true , address=185.167.204.205:4026 , piece_id=VB3LFMWBZCXGZHBTFNW6NEQ7NPWSS2WOHWLGLROI3RP6XXN6JLPA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.383932002 (270h19m11.980703028s) [noise=true , address=185.167.204.206:4038 , piece_id=ON3BMECFWQDCGX7WC4MHIQUPJKYVKE4SCZMEYHQ66TJCYGHRAHKQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.396581531 (270h19m11.993352547s) [noise=true , address=185.167.204.206:4045 , piece_id=TBPUTMLUVR3Z2NBXHHYOUM2YXQ23N2LKTGY435B4CHCFL7UT3PCA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.399274126 (270h19m11.996045153s) [noise=true , address=185.167.204.206:4067 , piece_id=GEDUAUCIEFVJGYTEDPTQ6IJNXC7IT4KMO62DBDJ6UICNXBNWHBNA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.400140554 (270h19m11.996911583s) [noise=true , address=185.167.204.205:4032 , piece_id=KTVK37N2HBEFVKM5HISGUPO7AHRPJELWXWCMJKFXYDXM4JXMKKJA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.400180999 (270h19m11.996952028s) [noise=true , address=185.167.204.205:4003 , piece_id=5B6WA37IPXRRJK7AXS6OKGIGOSREFZPP6OESISLTAAITNKKHFXPQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.417956341 (270h19m12.014727366s) [noise=true , address=185.167.204.205:4019 , piece_id=I4UGPISUI33KH63AMZG7PQNDM6JMTVQNUTO4KK4RZER6WPIEH7ZQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.423262806 (270h19m12.020033835s) [noise=true , address=185.167.204.206:4065 , piece_id=24FPZFB3YSCLLWRTVHVPFRU3335MO2F32PTUNO2ZKOKIULPITABA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.434540392 (270h19m12.031311428s) [noise=true , address=89.149.201.147:4018 , piece_id=GEOMWXWE2FXQPQL52XK5BPOFBCBRNBGEGO77TC4WAC23JOUAOZWA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.809003384 (270h19m12.405774397s) [noise=true , address=81.171.14.70:4035 , piece_id=3RUQ6HFQPCRL64ZNKHND3LXTB4HCMEWMMD6T76WXUSM6LRREIK4A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.836906643 (270h19m12.433677656s) [noise=true , address=81.171.14.70:4041 , piece_id=FWHFFJMBILFX44ECKDJOT5PXRL5IG7OLA6OW5KNQK37H445FRCRA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:16.594672767 (270h19m14.191443777s) [noise=true , address=185.167.204.205:4028 , piece_id=JP7H2NEDXX6ZBO4HQGJGP2KFZ3HX2CAPJWJWE6ORDKTFFJRQD6MQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:17.109237886 (270h19m14.706008912s) [noise=true , address=185.167.204.205:4020 , piece_id=N26LMOMRWZDV2EKUZ4UXBSLPFHUSTFP253P5OKSBSJKCC6PDTE7A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:17.791882843 (270h19m15.38865387s) [noise=true , address=185.167.204.206:4044 , piece_id=QR3TBCXQGZ7PAN3MM72ABRIC5MWMDHRJFYUTS6ERMWGNA6RKNP7A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:20:13.312468131 (270h20m10.909239165s) [noise=true , address=89.149.201.147:4003 , piece_id=ZJ5ZT6ZXCNXTACAHHEEP76A2QU2BIBG4GUYNZH6T4QT4RPCITDUQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: read tcp 159.223.143.39:33446->89.149.201.147:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312671303 (270h20m10.909442339s) [noise=true , address=89.149.201.147:4017 , piece_id=T5KUBI424NXF3PPU4F7VE2VIMDYHTNKG2DE72N2KZFEC2H4JA4XA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:39946->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312691602 (270h20m10.909462624s) [noise=true , address=89.149.201.147:4007 , piece_id=CRJPF2CFC6EOD2BVLIWPYMFLURFFE7NNGHQ66F67WPS4ZURC4PAA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 159.223.143.39:33938->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312735087 (270h20m10.909506099s) [seg_pos={0 0}, upload=302810]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 17:20:13.408199172 (270h20m11.004970204s) [upload=302810]: Done uploading segments...
Mar 17 17:20:13.408257252 (270h20m11.005028292s) [upload=302810]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.696741402s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [X.......X..X...................X...................X....X...] duration:
5.990003916s trace:
https://jaeger.dev.storj.io/trace/51b83f0860b491b9
FAIL (2026-03-17 17:21:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
noise=true , address=81.171.14.70:4037 , piece_id=4WTB6GUSLWZ4D3HWL7FUEO6T7UAVYAMTDKEFYEIVTF5DSQI4SPNQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.711778607 (270h19m11.308549639s) [noise=true , address=89.149.201.147:4009 , piece_id=56VWQQ43ALAQPNJ4PP4SUIFPK4GGQOISMTTELS5RZBVPZXYM6A4A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.713548267 (270h19m11.310319298s) [noise=true , address=185.167.204.205:4019 , piece_id=I4UGPISUI33KH63AMZG7PQNDM6JMTVQNUTO4KK4RZER6WPIEH7ZQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.716726828 (270h19m11.313497861s) [noise=true , address=81.171.14.70:4045 , piece_id=YJCCRWLOVWCYZJCJ7IQPXLFLULFMKXJQYTDGDI5G2FZOWTEQ7MTA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.720214767 (270h19m11.3169858s) [noise=true , address=185.167.204.206:4045 , piece_id=TBPUTMLUVR3Z2NBXHHYOUM2YXQ23N2LKTGY435B4CHCFL7UT3PCA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.722290577 (270h19m11.319061612s) [noise=true , address=81.171.14.70:4035 , piece_id=3RUQ6HFQPCRL64ZNKHND3LXTB4HCMEWMMD6T76WXUSM6LRREIK4A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.724895764 (270h19m11.321666799s) [noise=true , address=185.167.204.206:4044 , piece_id=QR3TBCXQGZ7PAN3MM72ABRIC5MWMDHRJFYUTS6ERMWGNA6RKNP7A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.725990616 (270h19m11.322761652s) [noise=true , address=185.167.204.206:4067 , piece_id=GEDUAUCIEFVJGYTEDPTQ6IJNXC7IT4KMO62DBDJ6UICNXBNWHBNA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.727695395 (270h19m11.32446676s) [noise=true , address=89.149.201.147:4003 , piece_id=ZJ5ZT6ZXCNXTACAHHEEP76A2QU2BIBG4GUYNZH6T4QT4RPCITDUQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.728256708 (270h19m11.325027738s) [noise=true , address=81.171.14.70:4041 , piece_id=FWHFFJMBILFX44ECKDJOT5PXRL5IG7OLA6OW5KNQK37H445FRCRA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.730103257 (270h19m11.326874296s) [noise=true , address=185.167.204.206:4065 , piece_id=24FPZFB3YSCLLWRTVHVPFRU3335MO2F32PTUNO2ZKOKIULPITABA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.730269869 (270h19m11.3270409s) [noise=true , address=81.171.14.70:4048 , piece_id=A7HSB7T67CNR6X2UC2IJ3LAELTPIBN3DSH6EPYCZOJ46P4TBX37Q, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:14.111641867 (270h19m11.7084129s) [upload=302810]: Next returned nil segment
Mar 17 17:19:14.111659056 (270h19m11.708430086s) [upload=302810]: Waiting for error group managing segments...
Mar 17 17:19:14.301192475 (270h19m11.897963499s) [noise=true , address=185.167.204.206:4062 , piece_id=ILYJ3YMOSBE27TIT7GANMKA7RUV7XLSL5TCSHNEQ22UI443SFNYA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.305860767 (270h19m11.902631782s) [noise=true , address=81.171.14.70:4025 , piece_id=RVAEGVMBHBPZUNISGJVH4D7PPHCC3E6YXH3TQBHTB3VLYGOUFYOQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.310489769 (270h19m11.907260794s) [noise=true , address=81.171.14.70:4037 , piece_id=4WTB6GUSLWZ4D3HWL7FUEO6T7UAVYAMTDKEFYEIVTF5DSQI4SPNQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.324700968 (270h19m11.921471997s) [noise=true , address=81.171.14.70:4045 , piece_id=YJCCRWLOVWCYZJCJ7IQPXLFLULFMKXJQYTDGDI5G2FZOWTEQ7MTA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.331950639 (270h19m11.928721671s) [noise=true , address=81.171.14.70:4028 , piece_id=PEHCCKWOWS6NJDQ3EU7SNUKGPWSEYVUTFMZL6IR7PM5UHFMNRFKQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.335578577 (270h19m11.932349589s) [noise=true , address=185.167.204.205:4022 , piece_id=RYPAPDNXXOITXSKUQF2HSJC53O4HLAZUXOKREAM5RNR7CQ6RBOFQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.346852014 (270h19m11.94362304s) [noise=true , address=81.171.14.70:4047 , piece_id=VX3UPTQUMBJGXPAY5CAXTC6NKIN547SC2AHMREOMYCHDTFXMTQLA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.357166991 (270h19m11.95393802s) [noise=true , address=81.171.14.70:4048 , piece_id=A7HSB7T67CNR6X2UC2IJ3LAELTPIBN3DSH6EPYCZOJ46P4TBX37Q, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.364739399 (270h19m11.961510424s) [noise=true , address=89.149.201.147:4002 , piece_id=GI7LXP7RCEBD342AXBLHQQ4OHQQK5PPBPLXBNZMLGHAWD25TJB7Q, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.368420679 (270h19m11.965191714s) [noise=true , address=185.167.204.206:4048 , piece_id=YWFY7D6H55NYNORUOIIGHQVRCT7BB4ZXGN7MWQOXUQ63KG2EKXOA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.375962984 (270h19m11.972734019s) [noise=true , address=89.149.201.147:4009 , piece_id=56VWQQ43ALAQPNJ4PP4SUIFPK4GGQOISMTTELS5RZBVPZXYM6A4A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.381603821 (270h19m11.978374857s) [noise=true , address=185.167.204.205:4026 , piece_id=VB3LFMWBZCXGZHBTFNW6NEQ7NPWSS2WOHWLGLROI3RP6XXN6JLPA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.383932002 (270h19m11.980703028s) [noise=true , address=185.167.204.206:4038 , piece_id=ON3BMECFWQDCGX7WC4MHIQUPJKYVKE4SCZMEYHQ66TJCYGHRAHKQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.396581531 (270h19m11.993352547s) [noise=true , address=185.167.204.206:4045 , piece_id=TBPUTMLUVR3Z2NBXHHYOUM2YXQ23N2LKTGY435B4CHCFL7UT3PCA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.399274126 (270h19m11.996045153s) [noise=true , address=185.167.204.206:4067 , piece_id=GEDUAUCIEFVJGYTEDPTQ6IJNXC7IT4KMO62DBDJ6UICNXBNWHBNA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.400140554 (270h19m11.996911583s) [noise=true , address=185.167.204.205:4032 , piece_id=KTVK37N2HBEFVKM5HISGUPO7AHRPJELWXWCMJKFXYDXM4JXMKKJA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.400180999 (270h19m11.996952028s) [noise=true , address=185.167.204.205:4003 , piece_id=5B6WA37IPXRRJK7AXS6OKGIGOSREFZPP6OESISLTAAITNKKHFXPQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.417956341 (270h19m12.014727366s) [noise=true , address=185.167.204.205:4019 , piece_id=I4UGPISUI33KH63AMZG7PQNDM6JMTVQNUTO4KK4RZER6WPIEH7ZQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.423262806 (270h19m12.020033835s) [noise=true , address=185.167.204.206:4065 , piece_id=24FPZFB3YSCLLWRTVHVPFRU3335MO2F32PTUNO2ZKOKIULPITABA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.434540392 (270h19m12.031311428s) [noise=true , address=89.149.201.147:4018 , piece_id=GEOMWXWE2FXQPQL52XK5BPOFBCBRNBGEGO77TC4WAC23JOUAOZWA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.809003384 (270h19m12.405774397s) [noise=true , address=81.171.14.70:4035 , piece_id=3RUQ6HFQPCRL64ZNKHND3LXTB4HCMEWMMD6T76WXUSM6LRREIK4A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.836906643 (270h19m12.433677656s) [noise=true , address=81.171.14.70:4041 , piece_id=FWHFFJMBILFX44ECKDJOT5PXRL5IG7OLA6OW5KNQK37H445FRCRA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:16.594672767 (270h19m14.191443777s) [noise=true , address=185.167.204.205:4028 , piece_id=JP7H2NEDXX6ZBO4HQGJGP2KFZ3HX2CAPJWJWE6ORDKTFFJRQD6MQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:17.109237886 (270h19m14.706008912s) [noise=true , address=185.167.204.205:4020 , piece_id=N26LMOMRWZDV2EKUZ4UXBSLPFHUSTFP253P5OKSBSJKCC6PDTE7A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:17.791882843 (270h19m15.38865387s) [noise=true , address=185.167.204.206:4044 , piece_id=QR3TBCXQGZ7PAN3MM72ABRIC5MWMDHRJFYUTS6ERMWGNA6RKNP7A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:20:13.312468131 (270h20m10.909239165s) [noise=true , address=89.149.201.147:4003 , piece_id=ZJ5ZT6ZXCNXTACAHHEEP76A2QU2BIBG4GUYNZH6T4QT4RPCITDUQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: read tcp 159.223.143.39:33446->89.149.201.147:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312671303 (270h20m10.909442339s) [noise=true , address=89.149.201.147:4017 , piece_id=T5KUBI424NXF3PPU4F7VE2VIMDYHTNKG2DE72N2KZFEC2H4JA4XA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:39946->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312691602 (270h20m10.909462624s) [noise=true , address=89.149.201.147:4007 , piece_id=CRJPF2CFC6EOD2BVLIWPYMFLURFFE7NNGHQ66F67WPS4ZURC4PAA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 159.223.143.39:33938->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312735087 (270h20m10.909506099s) [seg_pos={0 0}, upload=302810]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 17:20:13.408199172 (270h20m11.004970204s) [upload=302810]: Done uploading segments...
Mar 17 17:20:13.408257252 (270h20m11.005028292s) [upload=302810]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 5.990032538s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [.X.......X..X...................X...................X....X..] duration:
2.133980198s trace:
https://jaeger.dev.storj.io/trace/51b83f0860b491b9
FAIL (2026-03-17 17:20:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
noise=true , address=81.171.14.70:4037 , piece_id=4WTB6GUSLWZ4D3HWL7FUEO6T7UAVYAMTDKEFYEIVTF5DSQI4SPNQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.711778607 (270h19m11.308549639s) [noise=true , address=89.149.201.147:4009 , piece_id=56VWQQ43ALAQPNJ4PP4SUIFPK4GGQOISMTTELS5RZBVPZXYM6A4A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.713548267 (270h19m11.310319298s) [noise=true , address=185.167.204.205:4019 , piece_id=I4UGPISUI33KH63AMZG7PQNDM6JMTVQNUTO4KK4RZER6WPIEH7ZQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.716726828 (270h19m11.313497861s) [noise=true , address=81.171.14.70:4045 , piece_id=YJCCRWLOVWCYZJCJ7IQPXLFLULFMKXJQYTDGDI5G2FZOWTEQ7MTA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.720214767 (270h19m11.3169858s) [noise=true , address=185.167.204.206:4045 , piece_id=TBPUTMLUVR3Z2NBXHHYOUM2YXQ23N2LKTGY435B4CHCFL7UT3PCA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.722290577 (270h19m11.319061612s) [noise=true , address=81.171.14.70:4035 , piece_id=3RUQ6HFQPCRL64ZNKHND3LXTB4HCMEWMMD6T76WXUSM6LRREIK4A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.724895764 (270h19m11.321666799s) [noise=true , address=185.167.204.206:4044 , piece_id=QR3TBCXQGZ7PAN3MM72ABRIC5MWMDHRJFYUTS6ERMWGNA6RKNP7A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.725990616 (270h19m11.322761652s) [noise=true , address=185.167.204.206:4067 , piece_id=GEDUAUCIEFVJGYTEDPTQ6IJNXC7IT4KMO62DBDJ6UICNXBNWHBNA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.727695395 (270h19m11.32446676s) [noise=true , address=89.149.201.147:4003 , piece_id=ZJ5ZT6ZXCNXTACAHHEEP76A2QU2BIBG4GUYNZH6T4QT4RPCITDUQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.728256708 (270h19m11.325027738s) [noise=true , address=81.171.14.70:4041 , piece_id=FWHFFJMBILFX44ECKDJOT5PXRL5IG7OLA6OW5KNQK37H445FRCRA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.730103257 (270h19m11.326874296s) [noise=true , address=185.167.204.206:4065 , piece_id=24FPZFB3YSCLLWRTVHVPFRU3335MO2F32PTUNO2ZKOKIULPITABA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.730269869 (270h19m11.3270409s) [noise=true , address=81.171.14.70:4048 , piece_id=A7HSB7T67CNR6X2UC2IJ3LAELTPIBN3DSH6EPYCZOJ46P4TBX37Q, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:14.111641867 (270h19m11.7084129s) [upload=302810]: Next returned nil segment
Mar 17 17:19:14.111659056 (270h19m11.708430086s) [upload=302810]: Waiting for error group managing segments...
Mar 17 17:19:14.301192475 (270h19m11.897963499s) [noise=true , address=185.167.204.206:4062 , piece_id=ILYJ3YMOSBE27TIT7GANMKA7RUV7XLSL5TCSHNEQ22UI443SFNYA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.305860767 (270h19m11.902631782s) [noise=true , address=81.171.14.70:4025 , piece_id=RVAEGVMBHBPZUNISGJVH4D7PPHCC3E6YXH3TQBHTB3VLYGOUFYOQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.310489769 (270h19m11.907260794s) [noise=true , address=81.171.14.70:4037 , piece_id=4WTB6GUSLWZ4D3HWL7FUEO6T7UAVYAMTDKEFYEIVTF5DSQI4SPNQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.324700968 (270h19m11.921471997s) [noise=true , address=81.171.14.70:4045 , piece_id=YJCCRWLOVWCYZJCJ7IQPXLFLULFMKXJQYTDGDI5G2FZOWTEQ7MTA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.331950639 (270h19m11.928721671s) [noise=true , address=81.171.14.70:4028 , piece_id=PEHCCKWOWS6NJDQ3EU7SNUKGPWSEYVUTFMZL6IR7PM5UHFMNRFKQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.335578577 (270h19m11.932349589s) [noise=true , address=185.167.204.205:4022 , piece_id=RYPAPDNXXOITXSKUQF2HSJC53O4HLAZUXOKREAM5RNR7CQ6RBOFQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.346852014 (270h19m11.94362304s) [noise=true , address=81.171.14.70:4047 , piece_id=VX3UPTQUMBJGXPAY5CAXTC6NKIN547SC2AHMREOMYCHDTFXMTQLA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.357166991 (270h19m11.95393802s) [noise=true , address=81.171.14.70:4048 , piece_id=A7HSB7T67CNR6X2UC2IJ3LAELTPIBN3DSH6EPYCZOJ46P4TBX37Q, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.364739399 (270h19m11.961510424s) [noise=true , address=89.149.201.147:4002 , piece_id=GI7LXP7RCEBD342AXBLHQQ4OHQQK5PPBPLXBNZMLGHAWD25TJB7Q, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.368420679 (270h19m11.965191714s) [noise=true , address=185.167.204.206:4048 , piece_id=YWFY7D6H55NYNORUOIIGHQVRCT7BB4ZXGN7MWQOXUQ63KG2EKXOA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.375962984 (270h19m11.972734019s) [noise=true , address=89.149.201.147:4009 , piece_id=56VWQQ43ALAQPNJ4PP4SUIFPK4GGQOISMTTELS5RZBVPZXYM6A4A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.381603821 (270h19m11.978374857s) [noise=true , address=185.167.204.205:4026 , piece_id=VB3LFMWBZCXGZHBTFNW6NEQ7NPWSS2WOHWLGLROI3RP6XXN6JLPA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.383932002 (270h19m11.980703028s) [noise=true , address=185.167.204.206:4038 , piece_id=ON3BMECFWQDCGX7WC4MHIQUPJKYVKE4SCZMEYHQ66TJCYGHRAHKQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.396581531 (270h19m11.993352547s) [noise=true , address=185.167.204.206:4045 , piece_id=TBPUTMLUVR3Z2NBXHHYOUM2YXQ23N2LKTGY435B4CHCFL7UT3PCA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.399274126 (270h19m11.996045153s) [noise=true , address=185.167.204.206:4067 , piece_id=GEDUAUCIEFVJGYTEDPTQ6IJNXC7IT4KMO62DBDJ6UICNXBNWHBNA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.400140554 (270h19m11.996911583s) [noise=true , address=185.167.204.205:4032 , piece_id=KTVK37N2HBEFVKM5HISGUPO7AHRPJELWXWCMJKFXYDXM4JXMKKJA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.400180999 (270h19m11.996952028s) [noise=true , address=185.167.204.205:4003 , piece_id=5B6WA37IPXRRJK7AXS6OKGIGOSREFZPP6OESISLTAAITNKKHFXPQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.417956341 (270h19m12.014727366s) [noise=true , address=185.167.204.205:4019 , piece_id=I4UGPISUI33KH63AMZG7PQNDM6JMTVQNUTO4KK4RZER6WPIEH7ZQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.423262806 (270h19m12.020033835s) [noise=true , address=185.167.204.206:4065 , piece_id=24FPZFB3YSCLLWRTVHVPFRU3335MO2F32PTUNO2ZKOKIULPITABA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.434540392 (270h19m12.031311428s) [noise=true , address=89.149.201.147:4018 , piece_id=GEOMWXWE2FXQPQL52XK5BPOFBCBRNBGEGO77TC4WAC23JOUAOZWA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.809003384 (270h19m12.405774397s) [noise=true , address=81.171.14.70:4035 , piece_id=3RUQ6HFQPCRL64ZNKHND3LXTB4HCMEWMMD6T76WXUSM6LRREIK4A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.836906643 (270h19m12.433677656s) [noise=true , address=81.171.14.70:4041 , piece_id=FWHFFJMBILFX44ECKDJOT5PXRL5IG7OLA6OW5KNQK37H445FRCRA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:16.594672767 (270h19m14.191443777s) [noise=true , address=185.167.204.205:4028 , piece_id=JP7H2NEDXX6ZBO4HQGJGP2KFZ3HX2CAPJWJWE6ORDKTFFJRQD6MQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:17.109237886 (270h19m14.706008912s) [noise=true , address=185.167.204.205:4020 , piece_id=N26LMOMRWZDV2EKUZ4UXBSLPFHUSTFP253P5OKSBSJKCC6PDTE7A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:17.791882843 (270h19m15.38865387s) [noise=true , address=185.167.204.206:4044 , piece_id=QR3TBCXQGZ7PAN3MM72ABRIC5MWMDHRJFYUTS6ERMWGNA6RKNP7A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:20:13.312468131 (270h20m10.909239165s) [noise=true , address=89.149.201.147:4003 , piece_id=ZJ5ZT6ZXCNXTACAHHEEP76A2QU2BIBG4GUYNZH6T4QT4RPCITDUQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: read tcp 159.223.143.39:33446->89.149.201.147:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312671303 (270h20m10.909442339s) [noise=true , address=89.149.201.147:4017 , piece_id=T5KUBI424NXF3PPU4F7VE2VIMDYHTNKG2DE72N2KZFEC2H4JA4XA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:39946->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312691602 (270h20m10.909462624s) [noise=true , address=89.149.201.147:4007 , piece_id=CRJPF2CFC6EOD2BVLIWPYMFLURFFE7NNGHQ66F67WPS4ZURC4PAA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 159.223.143.39:33938->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312735087 (270h20m10.909506099s) [seg_pos={0 0}, upload=302810]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 17:20:13.408199172 (270h20m11.004970204s) [upload=302810]: Done uploading segments...
Mar 17 17:20:13.408257252 (270h20m11.005028292s) [upload=302810]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.134004318s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [..X.......X..X...................X...................X....X.] duration:
2.657937985s trace:
https://jaeger.dev.storj.io/trace/51b83f0860b491b9
FAIL (2026-03-17 17:20:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
noise=true , address=81.171.14.70:4037 , piece_id=4WTB6GUSLWZ4D3HWL7FUEO6T7UAVYAMTDKEFYEIVTF5DSQI4SPNQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.711778607 (270h19m11.308549639s) [noise=true , address=89.149.201.147:4009 , piece_id=56VWQQ43ALAQPNJ4PP4SUIFPK4GGQOISMTTELS5RZBVPZXYM6A4A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.713548267 (270h19m11.310319298s) [noise=true , address=185.167.204.205:4019 , piece_id=I4UGPISUI33KH63AMZG7PQNDM6JMTVQNUTO4KK4RZER6WPIEH7ZQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.716726828 (270h19m11.313497861s) [noise=true , address=81.171.14.70:4045 , piece_id=YJCCRWLOVWCYZJCJ7IQPXLFLULFMKXJQYTDGDI5G2FZOWTEQ7MTA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.720214767 (270h19m11.3169858s) [noise=true , address=185.167.204.206:4045 , piece_id=TBPUTMLUVR3Z2NBXHHYOUM2YXQ23N2LKTGY435B4CHCFL7UT3PCA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.722290577 (270h19m11.319061612s) [noise=true , address=81.171.14.70:4035 , piece_id=3RUQ6HFQPCRL64ZNKHND3LXTB4HCMEWMMD6T76WXUSM6LRREIK4A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.724895764 (270h19m11.321666799s) [noise=true , address=185.167.204.206:4044 , piece_id=QR3TBCXQGZ7PAN3MM72ABRIC5MWMDHRJFYUTS6ERMWGNA6RKNP7A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.725990616 (270h19m11.322761652s) [noise=true , address=185.167.204.206:4067 , piece_id=GEDUAUCIEFVJGYTEDPTQ6IJNXC7IT4KMO62DBDJ6UICNXBNWHBNA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.727695395 (270h19m11.32446676s) [noise=true , address=89.149.201.147:4003 , piece_id=ZJ5ZT6ZXCNXTACAHHEEP76A2QU2BIBG4GUYNZH6T4QT4RPCITDUQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.728256708 (270h19m11.325027738s) [noise=true , address=81.171.14.70:4041 , piece_id=FWHFFJMBILFX44ECKDJOT5PXRL5IG7OLA6OW5KNQK37H445FRCRA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.730103257 (270h19m11.326874296s) [noise=true , address=185.167.204.206:4065 , piece_id=24FPZFB3YSCLLWRTVHVPFRU3335MO2F32PTUNO2ZKOKIULPITABA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.730269869 (270h19m11.3270409s) [noise=true , address=81.171.14.70:4048 , piece_id=A7HSB7T67CNR6X2UC2IJ3LAELTPIBN3DSH6EPYCZOJ46P4TBX37Q, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:14.111641867 (270h19m11.7084129s) [upload=302810]: Next returned nil segment
Mar 17 17:19:14.111659056 (270h19m11.708430086s) [upload=302810]: Waiting for error group managing segments...
Mar 17 17:19:14.301192475 (270h19m11.897963499s) [noise=true , address=185.167.204.206:4062 , piece_id=ILYJ3YMOSBE27TIT7GANMKA7RUV7XLSL5TCSHNEQ22UI443SFNYA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.305860767 (270h19m11.902631782s) [noise=true , address=81.171.14.70:4025 , piece_id=RVAEGVMBHBPZUNISGJVH4D7PPHCC3E6YXH3TQBHTB3VLYGOUFYOQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.310489769 (270h19m11.907260794s) [noise=true , address=81.171.14.70:4037 , piece_id=4WTB6GUSLWZ4D3HWL7FUEO6T7UAVYAMTDKEFYEIVTF5DSQI4SPNQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.324700968 (270h19m11.921471997s) [noise=true , address=81.171.14.70:4045 , piece_id=YJCCRWLOVWCYZJCJ7IQPXLFLULFMKXJQYTDGDI5G2FZOWTEQ7MTA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.331950639 (270h19m11.928721671s) [noise=true , address=81.171.14.70:4028 , piece_id=PEHCCKWOWS6NJDQ3EU7SNUKGPWSEYVUTFMZL6IR7PM5UHFMNRFKQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.335578577 (270h19m11.932349589s) [noise=true , address=185.167.204.205:4022 , piece_id=RYPAPDNXXOITXSKUQF2HSJC53O4HLAZUXOKREAM5RNR7CQ6RBOFQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.346852014 (270h19m11.94362304s) [noise=true , address=81.171.14.70:4047 , piece_id=VX3UPTQUMBJGXPAY5CAXTC6NKIN547SC2AHMREOMYCHDTFXMTQLA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.357166991 (270h19m11.95393802s) [noise=true , address=81.171.14.70:4048 , piece_id=A7HSB7T67CNR6X2UC2IJ3LAELTPIBN3DSH6EPYCZOJ46P4TBX37Q, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.364739399 (270h19m11.961510424s) [noise=true , address=89.149.201.147:4002 , piece_id=GI7LXP7RCEBD342AXBLHQQ4OHQQK5PPBPLXBNZMLGHAWD25TJB7Q, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.368420679 (270h19m11.965191714s) [noise=true , address=185.167.204.206:4048 , piece_id=YWFY7D6H55NYNORUOIIGHQVRCT7BB4ZXGN7MWQOXUQ63KG2EKXOA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.375962984 (270h19m11.972734019s) [noise=true , address=89.149.201.147:4009 , piece_id=56VWQQ43ALAQPNJ4PP4SUIFPK4GGQOISMTTELS5RZBVPZXYM6A4A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.381603821 (270h19m11.978374857s) [noise=true , address=185.167.204.205:4026 , piece_id=VB3LFMWBZCXGZHBTFNW6NEQ7NPWSS2WOHWLGLROI3RP6XXN6JLPA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.383932002 (270h19m11.980703028s) [noise=true , address=185.167.204.206:4038 , piece_id=ON3BMECFWQDCGX7WC4MHIQUPJKYVKE4SCZMEYHQ66TJCYGHRAHKQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.396581531 (270h19m11.993352547s) [noise=true , address=185.167.204.206:4045 , piece_id=TBPUTMLUVR3Z2NBXHHYOUM2YXQ23N2LKTGY435B4CHCFL7UT3PCA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.399274126 (270h19m11.996045153s) [noise=true , address=185.167.204.206:4067 , piece_id=GEDUAUCIEFVJGYTEDPTQ6IJNXC7IT4KMO62DBDJ6UICNXBNWHBNA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.400140554 (270h19m11.996911583s) [noise=true , address=185.167.204.205:4032 , piece_id=KTVK37N2HBEFVKM5HISGUPO7AHRPJELWXWCMJKFXYDXM4JXMKKJA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.400180999 (270h19m11.996952028s) [noise=true , address=185.167.204.205:4003 , piece_id=5B6WA37IPXRRJK7AXS6OKGIGOSREFZPP6OESISLTAAITNKKHFXPQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.417956341 (270h19m12.014727366s) [noise=true , address=185.167.204.205:4019 , piece_id=I4UGPISUI33KH63AMZG7PQNDM6JMTVQNUTO4KK4RZER6WPIEH7ZQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.423262806 (270h19m12.020033835s) [noise=true , address=185.167.204.206:4065 , piece_id=24FPZFB3YSCLLWRTVHVPFRU3335MO2F32PTUNO2ZKOKIULPITABA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.434540392 (270h19m12.031311428s) [noise=true , address=89.149.201.147:4018 , piece_id=GEOMWXWE2FXQPQL52XK5BPOFBCBRNBGEGO77TC4WAC23JOUAOZWA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.809003384 (270h19m12.405774397s) [noise=true , address=81.171.14.70:4035 , piece_id=3RUQ6HFQPCRL64ZNKHND3LXTB4HCMEWMMD6T76WXUSM6LRREIK4A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.836906643 (270h19m12.433677656s) [noise=true , address=81.171.14.70:4041 , piece_id=FWHFFJMBILFX44ECKDJOT5PXRL5IG7OLA6OW5KNQK37H445FRCRA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:16.594672767 (270h19m14.191443777s) [noise=true , address=185.167.204.205:4028 , piece_id=JP7H2NEDXX6ZBO4HQGJGP2KFZ3HX2CAPJWJWE6ORDKTFFJRQD6MQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:17.109237886 (270h19m14.706008912s) [noise=true , address=185.167.204.205:4020 , piece_id=N26LMOMRWZDV2EKUZ4UXBSLPFHUSTFP253P5OKSBSJKCC6PDTE7A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:17.791882843 (270h19m15.38865387s) [noise=true , address=185.167.204.206:4044 , piece_id=QR3TBCXQGZ7PAN3MM72ABRIC5MWMDHRJFYUTS6ERMWGNA6RKNP7A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:20:13.312468131 (270h20m10.909239165s) [noise=true , address=89.149.201.147:4003 , piece_id=ZJ5ZT6ZXCNXTACAHHEEP76A2QU2BIBG4GUYNZH6T4QT4RPCITDUQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: read tcp 159.223.143.39:33446->89.149.201.147:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312671303 (270h20m10.909442339s) [noise=true , address=89.149.201.147:4017 , piece_id=T5KUBI424NXF3PPU4F7VE2VIMDYHTNKG2DE72N2KZFEC2H4JA4XA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:39946->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312691602 (270h20m10.909462624s) [noise=true , address=89.149.201.147:4007 , piece_id=CRJPF2CFC6EOD2BVLIWPYMFLURFFE7NNGHQ66F67WPS4ZURC4PAA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 159.223.143.39:33938->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312735087 (270h20m10.909506099s) [seg_pos={0 0}, upload=302810]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 17:20:13.408199172 (270h20m11.004970204s) [upload=302810]: Done uploading segments...
Mar 17 17:20:13.408257252 (270h20m11.005028292s) [upload=302810]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.657957758s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [...X.......X..X...................X...................X....X] duration:
1m0.099421716s trace:
https://jaeger.dev.storj.io/trace/51b83f0860b491b9
FAIL (2026-03-17 17:20:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
noise=true , address=81.171.14.70:4037 , piece_id=4WTB6GUSLWZ4D3HWL7FUEO6T7UAVYAMTDKEFYEIVTF5DSQI4SPNQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.711778607 (270h19m11.308549639s) [noise=true , address=89.149.201.147:4009 , piece_id=56VWQQ43ALAQPNJ4PP4SUIFPK4GGQOISMTTELS5RZBVPZXYM6A4A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.713548267 (270h19m11.310319298s) [noise=true , address=185.167.204.205:4019 , piece_id=I4UGPISUI33KH63AMZG7PQNDM6JMTVQNUTO4KK4RZER6WPIEH7ZQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.716726828 (270h19m11.313497861s) [noise=true , address=81.171.14.70:4045 , piece_id=YJCCRWLOVWCYZJCJ7IQPXLFLULFMKXJQYTDGDI5G2FZOWTEQ7MTA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.720214767 (270h19m11.3169858s) [noise=true , address=185.167.204.206:4045 , piece_id=TBPUTMLUVR3Z2NBXHHYOUM2YXQ23N2LKTGY435B4CHCFL7UT3PCA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.722290577 (270h19m11.319061612s) [noise=true , address=81.171.14.70:4035 , piece_id=3RUQ6HFQPCRL64ZNKHND3LXTB4HCMEWMMD6T76WXUSM6LRREIK4A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.724895764 (270h19m11.321666799s) [noise=true , address=185.167.204.206:4044 , piece_id=QR3TBCXQGZ7PAN3MM72ABRIC5MWMDHRJFYUTS6ERMWGNA6RKNP7A, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.725990616 (270h19m11.322761652s) [noise=true , address=185.167.204.206:4067 , piece_id=GEDUAUCIEFVJGYTEDPTQ6IJNXC7IT4KMO62DBDJ6UICNXBNWHBNA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.727695395 (270h19m11.32446676s) [noise=true , address=89.149.201.147:4003 , piece_id=ZJ5ZT6ZXCNXTACAHHEEP76A2QU2BIBG4GUYNZH6T4QT4RPCITDUQ, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.728256708 (270h19m11.325027738s) [noise=true , address=81.171.14.70:4041 , piece_id=FWHFFJMBILFX44ECKDJOT5PXRL5IG7OLA6OW5KNQK37H445FRCRA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.730103257 (270h19m11.326874296s) [noise=true , address=185.167.204.206:4065 , piece_id=24FPZFB3YSCLLWRTVHVPFRU3335MO2F32PTUNO2ZKOKIULPITABA, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:13.730269869 (270h19m11.3270409s) [noise=true , address=81.171.14.70:4048 , piece_id=A7HSB7T67CNR6X2UC2IJ3LAELTPIBN3DSH6EPYCZOJ46P4TBX37Q, seg_pos={0 0}, upload=302810]: Uploading piece...
Mar 17 17:19:14.111641867 (270h19m11.7084129s) [upload=302810]: Next returned nil segment
Mar 17 17:19:14.111659056 (270h19m11.708430086s) [upload=302810]: Waiting for error group managing segments...
Mar 17 17:19:14.301192475 (270h19m11.897963499s) [noise=true , address=185.167.204.206:4062 , piece_id=ILYJ3YMOSBE27TIT7GANMKA7RUV7XLSL5TCSHNEQ22UI443SFNYA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.305860767 (270h19m11.902631782s) [noise=true , address=81.171.14.70:4025 , piece_id=RVAEGVMBHBPZUNISGJVH4D7PPHCC3E6YXH3TQBHTB3VLYGOUFYOQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.310489769 (270h19m11.907260794s) [noise=true , address=81.171.14.70:4037 , piece_id=4WTB6GUSLWZ4D3HWL7FUEO6T7UAVYAMTDKEFYEIVTF5DSQI4SPNQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.324700968 (270h19m11.921471997s) [noise=true , address=81.171.14.70:4045 , piece_id=YJCCRWLOVWCYZJCJ7IQPXLFLULFMKXJQYTDGDI5G2FZOWTEQ7MTA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.331950639 (270h19m11.928721671s) [noise=true , address=81.171.14.70:4028 , piece_id=PEHCCKWOWS6NJDQ3EU7SNUKGPWSEYVUTFMZL6IR7PM5UHFMNRFKQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.335578577 (270h19m11.932349589s) [noise=true , address=185.167.204.205:4022 , piece_id=RYPAPDNXXOITXSKUQF2HSJC53O4HLAZUXOKREAM5RNR7CQ6RBOFQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.346852014 (270h19m11.94362304s) [noise=true , address=81.171.14.70:4047 , piece_id=VX3UPTQUMBJGXPAY5CAXTC6NKIN547SC2AHMREOMYCHDTFXMTQLA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.357166991 (270h19m11.95393802s) [noise=true , address=81.171.14.70:4048 , piece_id=A7HSB7T67CNR6X2UC2IJ3LAELTPIBN3DSH6EPYCZOJ46P4TBX37Q, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.364739399 (270h19m11.961510424s) [noise=true , address=89.149.201.147:4002 , piece_id=GI7LXP7RCEBD342AXBLHQQ4OHQQK5PPBPLXBNZMLGHAWD25TJB7Q, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.368420679 (270h19m11.965191714s) [noise=true , address=185.167.204.206:4048 , piece_id=YWFY7D6H55NYNORUOIIGHQVRCT7BB4ZXGN7MWQOXUQ63KG2EKXOA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.375962984 (270h19m11.972734019s) [noise=true , address=89.149.201.147:4009 , piece_id=56VWQQ43ALAQPNJ4PP4SUIFPK4GGQOISMTTELS5RZBVPZXYM6A4A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.381603821 (270h19m11.978374857s) [noise=true , address=185.167.204.205:4026 , piece_id=VB3LFMWBZCXGZHBTFNW6NEQ7NPWSS2WOHWLGLROI3RP6XXN6JLPA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.383932002 (270h19m11.980703028s) [noise=true , address=185.167.204.206:4038 , piece_id=ON3BMECFWQDCGX7WC4MHIQUPJKYVKE4SCZMEYHQ66TJCYGHRAHKQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.396581531 (270h19m11.993352547s) [noise=true , address=185.167.204.206:4045 , piece_id=TBPUTMLUVR3Z2NBXHHYOUM2YXQ23N2LKTGY435B4CHCFL7UT3PCA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.399274126 (270h19m11.996045153s) [noise=true , address=185.167.204.206:4067 , piece_id=GEDUAUCIEFVJGYTEDPTQ6IJNXC7IT4KMO62DBDJ6UICNXBNWHBNA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.400140554 (270h19m11.996911583s) [noise=true , address=185.167.204.205:4032 , piece_id=KTVK37N2HBEFVKM5HISGUPO7AHRPJELWXWCMJKFXYDXM4JXMKKJA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.400180999 (270h19m11.996952028s) [noise=true , address=185.167.204.205:4003 , piece_id=5B6WA37IPXRRJK7AXS6OKGIGOSREFZPP6OESISLTAAITNKKHFXPQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.417956341 (270h19m12.014727366s) [noise=true , address=185.167.204.205:4019 , piece_id=I4UGPISUI33KH63AMZG7PQNDM6JMTVQNUTO4KK4RZER6WPIEH7ZQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.423262806 (270h19m12.020033835s) [noise=true , address=185.167.204.206:4065 , piece_id=24FPZFB3YSCLLWRTVHVPFRU3335MO2F32PTUNO2ZKOKIULPITABA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.434540392 (270h19m12.031311428s) [noise=true , address=89.149.201.147:4018 , piece_id=GEOMWXWE2FXQPQL52XK5BPOFBCBRNBGEGO77TC4WAC23JOUAOZWA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.809003384 (270h19m12.405774397s) [noise=true , address=81.171.14.70:4035 , piece_id=3RUQ6HFQPCRL64ZNKHND3LXTB4HCMEWMMD6T76WXUSM6LRREIK4A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:14.836906643 (270h19m12.433677656s) [noise=true , address=81.171.14.70:4041 , piece_id=FWHFFJMBILFX44ECKDJOT5PXRL5IG7OLA6OW5KNQK37H445FRCRA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:16.594672767 (270h19m14.191443777s) [noise=true , address=185.167.204.205:4028 , piece_id=JP7H2NEDXX6ZBO4HQGJGP2KFZ3HX2CAPJWJWE6ORDKTFFJRQD6MQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:17.109237886 (270h19m14.706008912s) [noise=true , address=185.167.204.205:4020 , piece_id=N26LMOMRWZDV2EKUZ4UXBSLPFHUSTFP253P5OKSBSJKCC6PDTE7A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:19:17.791882843 (270h19m15.38865387s) [noise=true , address=185.167.204.206:4044 , piece_id=QR3TBCXQGZ7PAN3MM72ABRIC5MWMDHRJFYUTS6ERMWGNA6RKNP7A, seg_pos={0 0}, upload=302810]: Done uploading piece. err: <nil>
Mar 17 17:20:13.312468131 (270h20m10.909239165s) [noise=true , address=89.149.201.147:4003 , piece_id=ZJ5ZT6ZXCNXTACAHHEEP76A2QU2BIBG4GUYNZH6T4QT4RPCITDUQ, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: read tcp 159.223.143.39:33446->89.149.201.147:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312671303 (270h20m10.909442339s) [noise=true , address=89.149.201.147:4017 , piece_id=T5KUBI424NXF3PPU4F7VE2VIMDYHTNKG2DE72N2KZFEC2H4JA4XA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:39946->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312691602 (270h20m10.909462624s) [noise=true , address=89.149.201.147:4007 , piece_id=CRJPF2CFC6EOD2BVLIWPYMFLURFFE7NNGHQ66F67WPS4ZURC4PAA, seg_pos={0 0}, upload=302810]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 159.223.143.39:33938->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:20:13.312735087 (270h20m10.909506099s) [seg_pos={0 0}, upload=302810]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 17:20:13.408199172 (270h20m11.004970204s) [upload=302810]: Done uploading segments...
Mar 17 17:20:13.408257252 (270h20m11.005028292s) [upload=302810]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 1m0.099446352s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [....X.......X..X...................X...................X....] duration:
10.652239364s trace:
https://jaeger.dev.storj.io/trace/585e06d9b40a3d48
FAIL (2026-03-17 17:18:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ue , address=81.171.14.70:4027 , piece_id=VGNY3UH5WUJUIBAUTMPDKPG7W54GYQI7MHFAYKK4PP56WSHDK7OQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216084594 (270h14m50.812855627s) [noise=true , address=185.167.204.205:4003 , piece_id=VLHXUEI7VL3YGBXEF3LVKYST4ALZMNHS6RVDOHSVZ74AX6Y72APQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216111515 (270h14m50.812882546s) [noise=true , address=81.171.14.70:4041 , piece_id=S4W5XSQJCX5SBMHMF5PDA2KJXR5437FDV4JQIVF2IDS6MUZ5IARQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216531633 (270h14m50.813302713s) [noise=true , address=89.149.201.147:4011 , piece_id=VQLC4ACYDOTED7XKC3XBVFM5NRAA7P5NDPS6CDLHYA5RUHQPRP7Q, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216607759 (270h14m50.813378794s) [noise=true , address=185.167.204.205:4021 , piece_id=ONPPFWOFGEXSQQQITJBBYGII4C746M3G4CO44UUBTW3CLBPFIUQQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216961080 (270h14m50.813732114s) [noise=true , address=89.149.201.147:4012 , piece_id=A6YU3AGWDYIBXPLMTRYEBXKSRKAWZ2C2TLSIE2LWZM5QBCXTFONA, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217044553 (270h14m50.813815585s) [noise=true , address=89.149.201.147:4019 , piece_id=UDDAYGNG4NEF64D6URQWUWX77O5DQRLE24CBEHUUSS7QKPKPS2FQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217407404 (270h14m50.814178437s) [noise=true , address=81.171.14.70:4031 , piece_id=MPG2YQJIJIWFB2LKSBGF6A7VL7ZVMBOTWZUAHUPWVKV3JMYV2BPQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217459843 (270h14m50.814230874s) [noise=true , address=185.167.204.206:4051 , piece_id=PT76ZSQBHXMWUZZEIU52D6UH4UWKKHWBCX2F7TKU3K6PLS6J564A, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217877344 (270h14m50.814648375s) [noise=true , address=185.167.204.206:4039 , piece_id=SMQIH24STUFGEKYH762ETRQY6WGKYQM4VN6FMIXLSREI2USSFRMA, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.218317571 (270h14m50.815088606s) [noise=true , address=89.149.201.147:4014 , piece_id=AW7Y327EXXJXBL7QMTORAJ4DIB4BT5MQJP7GAHMVNWIT6RBAK6AQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.218752603 (270h14m50.815523635s) [noise=true , address=185.167.204.206:4059 , piece_id=YMAMSS4R25NGCS5R6TD5XLY54GTCAQ7SMUT2P4VEX2N5KPNKCNWA, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.615194851 (270h14m51.211965883s) [upload=302728]: Next returned nil segment
Mar 17 17:14:53.615210923 (270h14m51.211981957s) [upload=302728]: Waiting for error group managing segments...
Mar 17 17:14:53.824515071 (270h14m51.421286096s) [noise=true , address=81.171.14.70:4040 , piece_id=PJ7JR3NLA2F77BPI4CVD72SYYT7J6RJMTAABQXIPDNG2GLWVQH2Q, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.831570362 (270h14m51.428341388s) [noise=true , address=89.149.201.147:4023 , piece_id=SU5RTNRFWUWOIJQX5AYYNYP2O6YEKCIYPOVMP7JRAVFOBV45OLSA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.835864978 (270h14m51.432636008s) [noise=true , address=185.167.204.205:4021 , piece_id=ONPPFWOFGEXSQQQITJBBYGII4C746M3G4CO44UUBTW3CLBPFIUQQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.842458379 (270h14m51.439229406s) [noise=true , address=185.167.204.206:4061 , piece_id=JGUFYK4F735FFWZD3CEN4FAIQAIIUVF5O356HFJ42YDOLVDYQTWA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.849192793 (270h14m51.445963822s) [noise=true , address=81.171.14.70:4041 , piece_id=S4W5XSQJCX5SBMHMF5PDA2KJXR5437FDV4JQIVF2IDS6MUZ5IARQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.867223854 (270h14m51.463994891s) [noise=true , address=89.149.201.147:4014 , piece_id=AW7Y327EXXJXBL7QMTORAJ4DIB4BT5MQJP7GAHMVNWIT6RBAK6AQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.872902233 (270h14m51.469673262s) [noise=true , address=81.171.14.70:4031 , piece_id=MPG2YQJIJIWFB2LKSBGF6A7VL7ZVMBOTWZUAHUPWVKV3JMYV2BPQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.882411183 (270h14m51.479182217s) [noise=true , address=81.171.14.70:4032 , piece_id=WKQKQ6X5OUB3DPZZEOJ6BZ7NUSVKB77HVLPEDFLKOUSJJFQS46NA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.902835677 (270h14m51.499606704s) [noise=true , address=185.167.204.206:4039 , piece_id=SMQIH24STUFGEKYH762ETRQY6WGKYQM4VN6FMIXLSREI2USSFRMA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.917739995 (270h14m51.514511025s) [noise=true , address=185.167.204.206:4059 , piece_id=YMAMSS4R25NGCS5R6TD5XLY54GTCAQ7SMUT2P4VEX2N5KPNKCNWA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.920717236 (270h14m51.51748826s) [noise=true , address=89.149.201.147:4019 , piece_id=UDDAYGNG4NEF64D6URQWUWX77O5DQRLE24CBEHUUSS7QKPKPS2FQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.932355331 (270h14m51.529126362s) [noise=true , address=185.167.204.205:4006 , piece_id=T45MDBWXOLGLDXH6PJFSH7AVV6Y6KT5Z3V6DZPL5MUFINTTDU2BA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.941562059 (270h14m51.538333091s) [noise=true , address=89.149.201.147:4006 , piece_id=DBUF35S5RULZ6WWUPSK5WMR7BI42DSOK3ZVIBOTIG3CPNTLMKKVQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.941981069 (270h14m51.538752096s) [noise=true , address=185.167.204.206:4071 , piece_id=M7EMAC47GQNVBUL3OFXQUWM23JWRFYLHMTX3SAYG4SLZK3CHA6AQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.943381188 (270h14m51.540152204s) [noise=true , address=185.167.204.206:4051 , piece_id=PT76ZSQBHXMWUZZEIU52D6UH4UWKKHWBCX2F7TKU3K6PLS6J564A, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.979541952 (270h14m51.576312988s) [noise=true , address=185.167.204.206:4056 , piece_id=YXW6M4IO6YZOMG5Q4CG7DNT6AJXRNCRWYAHQS6L6YSUWRRJPTXTA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.198152281 (270h14m51.794923309s) [noise=true , address=185.167.204.205:4019 , piece_id=OZMZ2LXLHMIZMBOKI5ZHI4VOQWV23OHEUFAUSZWJWGTKTJ2MHDIA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.248119623 (270h14m51.844890887s) [noise=true , address=185.167.204.205:4003 , piece_id=VLHXUEI7VL3YGBXEF3LVKYST4ALZMNHS6RVDOHSVZ74AX6Y72APQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.272832136 (270h14m51.869603159s) [noise=true , address=81.171.14.70:4026 , piece_id=RIF67FENONVUTBLMTA4AXBHMWRBZQAJYJTP5M3QYLLY7NWOC7I4Q, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.320395865 (270h14m51.917166879s) [noise=true , address=81.171.14.70:4027 , piece_id=VGNY3UH5WUJUIBAUTMPDKPG7W54GYQI7MHFAYKK4PP56WSHDK7OQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.323393884 (270h14m51.920164911s) [noise=true , address=81.171.14.70:4030 , piece_id=QASZMJCSEXPCPSANITVOD5M3KBG2FW7IRPM4KUPP6KDYMWRGIQGA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.381270729 (270h14m51.978041752s) [noise=true , address=89.149.201.147:4011 , piece_id=VQLC4ACYDOTED7XKC3XBVFM5NRAA7P5NDPS6CDLHYA5RUHQPRP7Q, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.743727109 (270h14m52.340498122s) [noise=true , address=185.167.204.206:4065 , piece_id=CCFTZJSO4P5QNHWEO7NNRHMJNDIA3TX6FOWKCHMD2VUJBIUWI44A, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:55.358945075 (270h14m52.955716098s) [noise=true , address=185.167.204.206:4040 , piece_id=6HCXHILTNFHYPZJMRVMDO5WYNGFST5RHFALJWAQZLDM6M4RNDYOQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:56.093251878 (270h14m53.690022911s) [noise=true , address=185.167.204.206:4067 , piece_id=MASSSTID7OIUGCQBEMT7Z2PGWI565PVVWDOF554KGDAOOR3LDBGA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:15:52.836461110 (270h15m50.433232141s) [noise=true , address=89.149.201.147:4009 , piece_id=4I5NHH6BGB447QGUS4NZ7EA4TEHCH6F7EBLWLCKDMARUKMO2XADQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: read tcp 159.223.143.39:59846->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:15:52.836490913 (270h15m50.433261948s) [noise=true , address=89.149.201.147:4012 , piece_id=A6YU3AGWDYIBXPLMTRYEBXKSRKAWZ2C2TLSIE2LWZM5QBCXTFONA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:39210->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:15:52.836803289 (270h15m50.43357432s) [noise=true , address=89.149.201.147:4010 , piece_id=PVT36DWUATTHEBT7ZZFS3IGY5XXR2F3RF2OX4AFJNGROIJ4HUBNA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:38786->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:15:52.836841301 (270h15m50.433612319s) [seg_pos={0 0}, upload=302728]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 17:15:52.933262676 (270h15m50.530033691s) [upload=302728]: Done uploading segments...
Mar 17 17:15:52.933295888 (270h15m50.530066915s) [upload=302728]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 10.652269963s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [.....X.......X..X...................X...................X...] duration:
2.611774267s trace:
https://jaeger.dev.storj.io/trace/585e06d9b40a3d48
FAIL (2026-03-17 17:17:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ue , address=81.171.14.70:4027 , piece_id=VGNY3UH5WUJUIBAUTMPDKPG7W54GYQI7MHFAYKK4PP56WSHDK7OQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216084594 (270h14m50.812855627s) [noise=true , address=185.167.204.205:4003 , piece_id=VLHXUEI7VL3YGBXEF3LVKYST4ALZMNHS6RVDOHSVZ74AX6Y72APQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216111515 (270h14m50.812882546s) [noise=true , address=81.171.14.70:4041 , piece_id=S4W5XSQJCX5SBMHMF5PDA2KJXR5437FDV4JQIVF2IDS6MUZ5IARQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216531633 (270h14m50.813302713s) [noise=true , address=89.149.201.147:4011 , piece_id=VQLC4ACYDOTED7XKC3XBVFM5NRAA7P5NDPS6CDLHYA5RUHQPRP7Q, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216607759 (270h14m50.813378794s) [noise=true , address=185.167.204.205:4021 , piece_id=ONPPFWOFGEXSQQQITJBBYGII4C746M3G4CO44UUBTW3CLBPFIUQQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216961080 (270h14m50.813732114s) [noise=true , address=89.149.201.147:4012 , piece_id=A6YU3AGWDYIBXPLMTRYEBXKSRKAWZ2C2TLSIE2LWZM5QBCXTFONA, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217044553 (270h14m50.813815585s) [noise=true , address=89.149.201.147:4019 , piece_id=UDDAYGNG4NEF64D6URQWUWX77O5DQRLE24CBEHUUSS7QKPKPS2FQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217407404 (270h14m50.814178437s) [noise=true , address=81.171.14.70:4031 , piece_id=MPG2YQJIJIWFB2LKSBGF6A7VL7ZVMBOTWZUAHUPWVKV3JMYV2BPQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217459843 (270h14m50.814230874s) [noise=true , address=185.167.204.206:4051 , piece_id=PT76ZSQBHXMWUZZEIU52D6UH4UWKKHWBCX2F7TKU3K6PLS6J564A, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217877344 (270h14m50.814648375s) [noise=true , address=185.167.204.206:4039 , piece_id=SMQIH24STUFGEKYH762ETRQY6WGKYQM4VN6FMIXLSREI2USSFRMA, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.218317571 (270h14m50.815088606s) [noise=true , address=89.149.201.147:4014 , piece_id=AW7Y327EXXJXBL7QMTORAJ4DIB4BT5MQJP7GAHMVNWIT6RBAK6AQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.218752603 (270h14m50.815523635s) [noise=true , address=185.167.204.206:4059 , piece_id=YMAMSS4R25NGCS5R6TD5XLY54GTCAQ7SMUT2P4VEX2N5KPNKCNWA, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.615194851 (270h14m51.211965883s) [upload=302728]: Next returned nil segment
Mar 17 17:14:53.615210923 (270h14m51.211981957s) [upload=302728]: Waiting for error group managing segments...
Mar 17 17:14:53.824515071 (270h14m51.421286096s) [noise=true , address=81.171.14.70:4040 , piece_id=PJ7JR3NLA2F77BPI4CVD72SYYT7J6RJMTAABQXIPDNG2GLWVQH2Q, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.831570362 (270h14m51.428341388s) [noise=true , address=89.149.201.147:4023 , piece_id=SU5RTNRFWUWOIJQX5AYYNYP2O6YEKCIYPOVMP7JRAVFOBV45OLSA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.835864978 (270h14m51.432636008s) [noise=true , address=185.167.204.205:4021 , piece_id=ONPPFWOFGEXSQQQITJBBYGII4C746M3G4CO44UUBTW3CLBPFIUQQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.842458379 (270h14m51.439229406s) [noise=true , address=185.167.204.206:4061 , piece_id=JGUFYK4F735FFWZD3CEN4FAIQAIIUVF5O356HFJ42YDOLVDYQTWA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.849192793 (270h14m51.445963822s) [noise=true , address=81.171.14.70:4041 , piece_id=S4W5XSQJCX5SBMHMF5PDA2KJXR5437FDV4JQIVF2IDS6MUZ5IARQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.867223854 (270h14m51.463994891s) [noise=true , address=89.149.201.147:4014 , piece_id=AW7Y327EXXJXBL7QMTORAJ4DIB4BT5MQJP7GAHMVNWIT6RBAK6AQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.872902233 (270h14m51.469673262s) [noise=true , address=81.171.14.70:4031 , piece_id=MPG2YQJIJIWFB2LKSBGF6A7VL7ZVMBOTWZUAHUPWVKV3JMYV2BPQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.882411183 (270h14m51.479182217s) [noise=true , address=81.171.14.70:4032 , piece_id=WKQKQ6X5OUB3DPZZEOJ6BZ7NUSVKB77HVLPEDFLKOUSJJFQS46NA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.902835677 (270h14m51.499606704s) [noise=true , address=185.167.204.206:4039 , piece_id=SMQIH24STUFGEKYH762ETRQY6WGKYQM4VN6FMIXLSREI2USSFRMA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.917739995 (270h14m51.514511025s) [noise=true , address=185.167.204.206:4059 , piece_id=YMAMSS4R25NGCS5R6TD5XLY54GTCAQ7SMUT2P4VEX2N5KPNKCNWA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.920717236 (270h14m51.51748826s) [noise=true , address=89.149.201.147:4019 , piece_id=UDDAYGNG4NEF64D6URQWUWX77O5DQRLE24CBEHUUSS7QKPKPS2FQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.932355331 (270h14m51.529126362s) [noise=true , address=185.167.204.205:4006 , piece_id=T45MDBWXOLGLDXH6PJFSH7AVV6Y6KT5Z3V6DZPL5MUFINTTDU2BA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.941562059 (270h14m51.538333091s) [noise=true , address=89.149.201.147:4006 , piece_id=DBUF35S5RULZ6WWUPSK5WMR7BI42DSOK3ZVIBOTIG3CPNTLMKKVQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.941981069 (270h14m51.538752096s) [noise=true , address=185.167.204.206:4071 , piece_id=M7EMAC47GQNVBUL3OFXQUWM23JWRFYLHMTX3SAYG4SLZK3CHA6AQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.943381188 (270h14m51.540152204s) [noise=true , address=185.167.204.206:4051 , piece_id=PT76ZSQBHXMWUZZEIU52D6UH4UWKKHWBCX2F7TKU3K6PLS6J564A, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.979541952 (270h14m51.576312988s) [noise=true , address=185.167.204.206:4056 , piece_id=YXW6M4IO6YZOMG5Q4CG7DNT6AJXRNCRWYAHQS6L6YSUWRRJPTXTA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.198152281 (270h14m51.794923309s) [noise=true , address=185.167.204.205:4019 , piece_id=OZMZ2LXLHMIZMBOKI5ZHI4VOQWV23OHEUFAUSZWJWGTKTJ2MHDIA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.248119623 (270h14m51.844890887s) [noise=true , address=185.167.204.205:4003 , piece_id=VLHXUEI7VL3YGBXEF3LVKYST4ALZMNHS6RVDOHSVZ74AX6Y72APQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.272832136 (270h14m51.869603159s) [noise=true , address=81.171.14.70:4026 , piece_id=RIF67FENONVUTBLMTA4AXBHMWRBZQAJYJTP5M3QYLLY7NWOC7I4Q, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.320395865 (270h14m51.917166879s) [noise=true , address=81.171.14.70:4027 , piece_id=VGNY3UH5WUJUIBAUTMPDKPG7W54GYQI7MHFAYKK4PP56WSHDK7OQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.323393884 (270h14m51.920164911s) [noise=true , address=81.171.14.70:4030 , piece_id=QASZMJCSEXPCPSANITVOD5M3KBG2FW7IRPM4KUPP6KDYMWRGIQGA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.381270729 (270h14m51.978041752s) [noise=true , address=89.149.201.147:4011 , piece_id=VQLC4ACYDOTED7XKC3XBVFM5NRAA7P5NDPS6CDLHYA5RUHQPRP7Q, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.743727109 (270h14m52.340498122s) [noise=true , address=185.167.204.206:4065 , piece_id=CCFTZJSO4P5QNHWEO7NNRHMJNDIA3TX6FOWKCHMD2VUJBIUWI44A, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:55.358945075 (270h14m52.955716098s) [noise=true , address=185.167.204.206:4040 , piece_id=6HCXHILTNFHYPZJMRVMDO5WYNGFST5RHFALJWAQZLDM6M4RNDYOQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:56.093251878 (270h14m53.690022911s) [noise=true , address=185.167.204.206:4067 , piece_id=MASSSTID7OIUGCQBEMT7Z2PGWI565PVVWDOF554KGDAOOR3LDBGA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:15:52.836461110 (270h15m50.433232141s) [noise=true , address=89.149.201.147:4009 , piece_id=4I5NHH6BGB447QGUS4NZ7EA4TEHCH6F7EBLWLCKDMARUKMO2XADQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: read tcp 159.223.143.39:59846->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:15:52.836490913 (270h15m50.433261948s) [noise=true , address=89.149.201.147:4012 , piece_id=A6YU3AGWDYIBXPLMTRYEBXKSRKAWZ2C2TLSIE2LWZM5QBCXTFONA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:39210->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:15:52.836803289 (270h15m50.43357432s) [noise=true , address=89.149.201.147:4010 , piece_id=PVT36DWUATTHEBT7ZZFS3IGY5XXR2F3RF2OX4AFJNGROIJ4HUBNA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:38786->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:15:52.836841301 (270h15m50.433612319s) [seg_pos={0 0}, upload=302728]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 17:15:52.933262676 (270h15m50.530033691s) [upload=302728]: Done uploading segments...
Mar 17 17:15:52.933295888 (270h15m50.530066915s) [upload=302728]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.611799398s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [......X.......X..X...................X...................X..] duration:
2.542247701s trace:
https://jaeger.dev.storj.io/trace/585e06d9b40a3d48
FAIL (2026-03-17 17:16:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ue , address=81.171.14.70:4027 , piece_id=VGNY3UH5WUJUIBAUTMPDKPG7W54GYQI7MHFAYKK4PP56WSHDK7OQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216084594 (270h14m50.812855627s) [noise=true , address=185.167.204.205:4003 , piece_id=VLHXUEI7VL3YGBXEF3LVKYST4ALZMNHS6RVDOHSVZ74AX6Y72APQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216111515 (270h14m50.812882546s) [noise=true , address=81.171.14.70:4041 , piece_id=S4W5XSQJCX5SBMHMF5PDA2KJXR5437FDV4JQIVF2IDS6MUZ5IARQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216531633 (270h14m50.813302713s) [noise=true , address=89.149.201.147:4011 , piece_id=VQLC4ACYDOTED7XKC3XBVFM5NRAA7P5NDPS6CDLHYA5RUHQPRP7Q, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216607759 (270h14m50.813378794s) [noise=true , address=185.167.204.205:4021 , piece_id=ONPPFWOFGEXSQQQITJBBYGII4C746M3G4CO44UUBTW3CLBPFIUQQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216961080 (270h14m50.813732114s) [noise=true , address=89.149.201.147:4012 , piece_id=A6YU3AGWDYIBXPLMTRYEBXKSRKAWZ2C2TLSIE2LWZM5QBCXTFONA, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217044553 (270h14m50.813815585s) [noise=true , address=89.149.201.147:4019 , piece_id=UDDAYGNG4NEF64D6URQWUWX77O5DQRLE24CBEHUUSS7QKPKPS2FQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217407404 (270h14m50.814178437s) [noise=true , address=81.171.14.70:4031 , piece_id=MPG2YQJIJIWFB2LKSBGF6A7VL7ZVMBOTWZUAHUPWVKV3JMYV2BPQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217459843 (270h14m50.814230874s) [noise=true , address=185.167.204.206:4051 , piece_id=PT76ZSQBHXMWUZZEIU52D6UH4UWKKHWBCX2F7TKU3K6PLS6J564A, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217877344 (270h14m50.814648375s) [noise=true , address=185.167.204.206:4039 , piece_id=SMQIH24STUFGEKYH762ETRQY6WGKYQM4VN6FMIXLSREI2USSFRMA, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.218317571 (270h14m50.815088606s) [noise=true , address=89.149.201.147:4014 , piece_id=AW7Y327EXXJXBL7QMTORAJ4DIB4BT5MQJP7GAHMVNWIT6RBAK6AQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.218752603 (270h14m50.815523635s) [noise=true , address=185.167.204.206:4059 , piece_id=YMAMSS4R25NGCS5R6TD5XLY54GTCAQ7SMUT2P4VEX2N5KPNKCNWA, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.615194851 (270h14m51.211965883s) [upload=302728]: Next returned nil segment
Mar 17 17:14:53.615210923 (270h14m51.211981957s) [upload=302728]: Waiting for error group managing segments...
Mar 17 17:14:53.824515071 (270h14m51.421286096s) [noise=true , address=81.171.14.70:4040 , piece_id=PJ7JR3NLA2F77BPI4CVD72SYYT7J6RJMTAABQXIPDNG2GLWVQH2Q, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.831570362 (270h14m51.428341388s) [noise=true , address=89.149.201.147:4023 , piece_id=SU5RTNRFWUWOIJQX5AYYNYP2O6YEKCIYPOVMP7JRAVFOBV45OLSA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.835864978 (270h14m51.432636008s) [noise=true , address=185.167.204.205:4021 , piece_id=ONPPFWOFGEXSQQQITJBBYGII4C746M3G4CO44UUBTW3CLBPFIUQQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.842458379 (270h14m51.439229406s) [noise=true , address=185.167.204.206:4061 , piece_id=JGUFYK4F735FFWZD3CEN4FAIQAIIUVF5O356HFJ42YDOLVDYQTWA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.849192793 (270h14m51.445963822s) [noise=true , address=81.171.14.70:4041 , piece_id=S4W5XSQJCX5SBMHMF5PDA2KJXR5437FDV4JQIVF2IDS6MUZ5IARQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.867223854 (270h14m51.463994891s) [noise=true , address=89.149.201.147:4014 , piece_id=AW7Y327EXXJXBL7QMTORAJ4DIB4BT5MQJP7GAHMVNWIT6RBAK6AQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.872902233 (270h14m51.469673262s) [noise=true , address=81.171.14.70:4031 , piece_id=MPG2YQJIJIWFB2LKSBGF6A7VL7ZVMBOTWZUAHUPWVKV3JMYV2BPQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.882411183 (270h14m51.479182217s) [noise=true , address=81.171.14.70:4032 , piece_id=WKQKQ6X5OUB3DPZZEOJ6BZ7NUSVKB77HVLPEDFLKOUSJJFQS46NA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.902835677 (270h14m51.499606704s) [noise=true , address=185.167.204.206:4039 , piece_id=SMQIH24STUFGEKYH762ETRQY6WGKYQM4VN6FMIXLSREI2USSFRMA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.917739995 (270h14m51.514511025s) [noise=true , address=185.167.204.206:4059 , piece_id=YMAMSS4R25NGCS5R6TD5XLY54GTCAQ7SMUT2P4VEX2N5KPNKCNWA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.920717236 (270h14m51.51748826s) [noise=true , address=89.149.201.147:4019 , piece_id=UDDAYGNG4NEF64D6URQWUWX77O5DQRLE24CBEHUUSS7QKPKPS2FQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.932355331 (270h14m51.529126362s) [noise=true , address=185.167.204.205:4006 , piece_id=T45MDBWXOLGLDXH6PJFSH7AVV6Y6KT5Z3V6DZPL5MUFINTTDU2BA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.941562059 (270h14m51.538333091s) [noise=true , address=89.149.201.147:4006 , piece_id=DBUF35S5RULZ6WWUPSK5WMR7BI42DSOK3ZVIBOTIG3CPNTLMKKVQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.941981069 (270h14m51.538752096s) [noise=true , address=185.167.204.206:4071 , piece_id=M7EMAC47GQNVBUL3OFXQUWM23JWRFYLHMTX3SAYG4SLZK3CHA6AQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.943381188 (270h14m51.540152204s) [noise=true , address=185.167.204.206:4051 , piece_id=PT76ZSQBHXMWUZZEIU52D6UH4UWKKHWBCX2F7TKU3K6PLS6J564A, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.979541952 (270h14m51.576312988s) [noise=true , address=185.167.204.206:4056 , piece_id=YXW6M4IO6YZOMG5Q4CG7DNT6AJXRNCRWYAHQS6L6YSUWRRJPTXTA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.198152281 (270h14m51.794923309s) [noise=true , address=185.167.204.205:4019 , piece_id=OZMZ2LXLHMIZMBOKI5ZHI4VOQWV23OHEUFAUSZWJWGTKTJ2MHDIA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.248119623 (270h14m51.844890887s) [noise=true , address=185.167.204.205:4003 , piece_id=VLHXUEI7VL3YGBXEF3LVKYST4ALZMNHS6RVDOHSVZ74AX6Y72APQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.272832136 (270h14m51.869603159s) [noise=true , address=81.171.14.70:4026 , piece_id=RIF67FENONVUTBLMTA4AXBHMWRBZQAJYJTP5M3QYLLY7NWOC7I4Q, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.320395865 (270h14m51.917166879s) [noise=true , address=81.171.14.70:4027 , piece_id=VGNY3UH5WUJUIBAUTMPDKPG7W54GYQI7MHFAYKK4PP56WSHDK7OQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.323393884 (270h14m51.920164911s) [noise=true , address=81.171.14.70:4030 , piece_id=QASZMJCSEXPCPSANITVOD5M3KBG2FW7IRPM4KUPP6KDYMWRGIQGA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.381270729 (270h14m51.978041752s) [noise=true , address=89.149.201.147:4011 , piece_id=VQLC4ACYDOTED7XKC3XBVFM5NRAA7P5NDPS6CDLHYA5RUHQPRP7Q, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.743727109 (270h14m52.340498122s) [noise=true , address=185.167.204.206:4065 , piece_id=CCFTZJSO4P5QNHWEO7NNRHMJNDIA3TX6FOWKCHMD2VUJBIUWI44A, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:55.358945075 (270h14m52.955716098s) [noise=true , address=185.167.204.206:4040 , piece_id=6HCXHILTNFHYPZJMRVMDO5WYNGFST5RHFALJWAQZLDM6M4RNDYOQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:56.093251878 (270h14m53.690022911s) [noise=true , address=185.167.204.206:4067 , piece_id=MASSSTID7OIUGCQBEMT7Z2PGWI565PVVWDOF554KGDAOOR3LDBGA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:15:52.836461110 (270h15m50.433232141s) [noise=true , address=89.149.201.147:4009 , piece_id=4I5NHH6BGB447QGUS4NZ7EA4TEHCH6F7EBLWLCKDMARUKMO2XADQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: read tcp 159.223.143.39:59846->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:15:52.836490913 (270h15m50.433261948s) [noise=true , address=89.149.201.147:4012 , piece_id=A6YU3AGWDYIBXPLMTRYEBXKSRKAWZ2C2TLSIE2LWZM5QBCXTFONA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:39210->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:15:52.836803289 (270h15m50.43357432s) [noise=true , address=89.149.201.147:4010 , piece_id=PVT36DWUATTHEBT7ZZFS3IGY5XXR2F3RF2OX4AFJNGROIJ4HUBNA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:38786->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:15:52.836841301 (270h15m50.433612319s) [seg_pos={0 0}, upload=302728]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 17:15:52.933262676 (270h15m50.530033691s) [upload=302728]: Done uploading segments...
Mar 17 17:15:52.933295888 (270h15m50.530066915s) [upload=302728]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.542275944s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [.......X.......X..X...................X...................X.] duration:
2.119319841s trace:
https://jaeger.dev.storj.io/trace/585e06d9b40a3d48
FAIL (2026-03-17 17:15:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ue , address=81.171.14.70:4027 , piece_id=VGNY3UH5WUJUIBAUTMPDKPG7W54GYQI7MHFAYKK4PP56WSHDK7OQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216084594 (270h14m50.812855627s) [noise=true , address=185.167.204.205:4003 , piece_id=VLHXUEI7VL3YGBXEF3LVKYST4ALZMNHS6RVDOHSVZ74AX6Y72APQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216111515 (270h14m50.812882546s) [noise=true , address=81.171.14.70:4041 , piece_id=S4W5XSQJCX5SBMHMF5PDA2KJXR5437FDV4JQIVF2IDS6MUZ5IARQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216531633 (270h14m50.813302713s) [noise=true , address=89.149.201.147:4011 , piece_id=VQLC4ACYDOTED7XKC3XBVFM5NRAA7P5NDPS6CDLHYA5RUHQPRP7Q, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216607759 (270h14m50.813378794s) [noise=true , address=185.167.204.205:4021 , piece_id=ONPPFWOFGEXSQQQITJBBYGII4C746M3G4CO44UUBTW3CLBPFIUQQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216961080 (270h14m50.813732114s) [noise=true , address=89.149.201.147:4012 , piece_id=A6YU3AGWDYIBXPLMTRYEBXKSRKAWZ2C2TLSIE2LWZM5QBCXTFONA, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217044553 (270h14m50.813815585s) [noise=true , address=89.149.201.147:4019 , piece_id=UDDAYGNG4NEF64D6URQWUWX77O5DQRLE24CBEHUUSS7QKPKPS2FQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217407404 (270h14m50.814178437s) [noise=true , address=81.171.14.70:4031 , piece_id=MPG2YQJIJIWFB2LKSBGF6A7VL7ZVMBOTWZUAHUPWVKV3JMYV2BPQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217459843 (270h14m50.814230874s) [noise=true , address=185.167.204.206:4051 , piece_id=PT76ZSQBHXMWUZZEIU52D6UH4UWKKHWBCX2F7TKU3K6PLS6J564A, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217877344 (270h14m50.814648375s) [noise=true , address=185.167.204.206:4039 , piece_id=SMQIH24STUFGEKYH762ETRQY6WGKYQM4VN6FMIXLSREI2USSFRMA, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.218317571 (270h14m50.815088606s) [noise=true , address=89.149.201.147:4014 , piece_id=AW7Y327EXXJXBL7QMTORAJ4DIB4BT5MQJP7GAHMVNWIT6RBAK6AQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.218752603 (270h14m50.815523635s) [noise=true , address=185.167.204.206:4059 , piece_id=YMAMSS4R25NGCS5R6TD5XLY54GTCAQ7SMUT2P4VEX2N5KPNKCNWA, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.615194851 (270h14m51.211965883s) [upload=302728]: Next returned nil segment
Mar 17 17:14:53.615210923 (270h14m51.211981957s) [upload=302728]: Waiting for error group managing segments...
Mar 17 17:14:53.824515071 (270h14m51.421286096s) [noise=true , address=81.171.14.70:4040 , piece_id=PJ7JR3NLA2F77BPI4CVD72SYYT7J6RJMTAABQXIPDNG2GLWVQH2Q, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.831570362 (270h14m51.428341388s) [noise=true , address=89.149.201.147:4023 , piece_id=SU5RTNRFWUWOIJQX5AYYNYP2O6YEKCIYPOVMP7JRAVFOBV45OLSA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.835864978 (270h14m51.432636008s) [noise=true , address=185.167.204.205:4021 , piece_id=ONPPFWOFGEXSQQQITJBBYGII4C746M3G4CO44UUBTW3CLBPFIUQQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.842458379 (270h14m51.439229406s) [noise=true , address=185.167.204.206:4061 , piece_id=JGUFYK4F735FFWZD3CEN4FAIQAIIUVF5O356HFJ42YDOLVDYQTWA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.849192793 (270h14m51.445963822s) [noise=true , address=81.171.14.70:4041 , piece_id=S4W5XSQJCX5SBMHMF5PDA2KJXR5437FDV4JQIVF2IDS6MUZ5IARQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.867223854 (270h14m51.463994891s) [noise=true , address=89.149.201.147:4014 , piece_id=AW7Y327EXXJXBL7QMTORAJ4DIB4BT5MQJP7GAHMVNWIT6RBAK6AQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.872902233 (270h14m51.469673262s) [noise=true , address=81.171.14.70:4031 , piece_id=MPG2YQJIJIWFB2LKSBGF6A7VL7ZVMBOTWZUAHUPWVKV3JMYV2BPQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.882411183 (270h14m51.479182217s) [noise=true , address=81.171.14.70:4032 , piece_id=WKQKQ6X5OUB3DPZZEOJ6BZ7NUSVKB77HVLPEDFLKOUSJJFQS46NA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.902835677 (270h14m51.499606704s) [noise=true , address=185.167.204.206:4039 , piece_id=SMQIH24STUFGEKYH762ETRQY6WGKYQM4VN6FMIXLSREI2USSFRMA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.917739995 (270h14m51.514511025s) [noise=true , address=185.167.204.206:4059 , piece_id=YMAMSS4R25NGCS5R6TD5XLY54GTCAQ7SMUT2P4VEX2N5KPNKCNWA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.920717236 (270h14m51.51748826s) [noise=true , address=89.149.201.147:4019 , piece_id=UDDAYGNG4NEF64D6URQWUWX77O5DQRLE24CBEHUUSS7QKPKPS2FQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.932355331 (270h14m51.529126362s) [noise=true , address=185.167.204.205:4006 , piece_id=T45MDBWXOLGLDXH6PJFSH7AVV6Y6KT5Z3V6DZPL5MUFINTTDU2BA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.941562059 (270h14m51.538333091s) [noise=true , address=89.149.201.147:4006 , piece_id=DBUF35S5RULZ6WWUPSK5WMR7BI42DSOK3ZVIBOTIG3CPNTLMKKVQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.941981069 (270h14m51.538752096s) [noise=true , address=185.167.204.206:4071 , piece_id=M7EMAC47GQNVBUL3OFXQUWM23JWRFYLHMTX3SAYG4SLZK3CHA6AQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.943381188 (270h14m51.540152204s) [noise=true , address=185.167.204.206:4051 , piece_id=PT76ZSQBHXMWUZZEIU52D6UH4UWKKHWBCX2F7TKU3K6PLS6J564A, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.979541952 (270h14m51.576312988s) [noise=true , address=185.167.204.206:4056 , piece_id=YXW6M4IO6YZOMG5Q4CG7DNT6AJXRNCRWYAHQS6L6YSUWRRJPTXTA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.198152281 (270h14m51.794923309s) [noise=true , address=185.167.204.205:4019 , piece_id=OZMZ2LXLHMIZMBOKI5ZHI4VOQWV23OHEUFAUSZWJWGTKTJ2MHDIA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.248119623 (270h14m51.844890887s) [noise=true , address=185.167.204.205:4003 , piece_id=VLHXUEI7VL3YGBXEF3LVKYST4ALZMNHS6RVDOHSVZ74AX6Y72APQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.272832136 (270h14m51.869603159s) [noise=true , address=81.171.14.70:4026 , piece_id=RIF67FENONVUTBLMTA4AXBHMWRBZQAJYJTP5M3QYLLY7NWOC7I4Q, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.320395865 (270h14m51.917166879s) [noise=true , address=81.171.14.70:4027 , piece_id=VGNY3UH5WUJUIBAUTMPDKPG7W54GYQI7MHFAYKK4PP56WSHDK7OQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.323393884 (270h14m51.920164911s) [noise=true , address=81.171.14.70:4030 , piece_id=QASZMJCSEXPCPSANITVOD5M3KBG2FW7IRPM4KUPP6KDYMWRGIQGA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.381270729 (270h14m51.978041752s) [noise=true , address=89.149.201.147:4011 , piece_id=VQLC4ACYDOTED7XKC3XBVFM5NRAA7P5NDPS6CDLHYA5RUHQPRP7Q, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.743727109 (270h14m52.340498122s) [noise=true , address=185.167.204.206:4065 , piece_id=CCFTZJSO4P5QNHWEO7NNRHMJNDIA3TX6FOWKCHMD2VUJBIUWI44A, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:55.358945075 (270h14m52.955716098s) [noise=true , address=185.167.204.206:4040 , piece_id=6HCXHILTNFHYPZJMRVMDO5WYNGFST5RHFALJWAQZLDM6M4RNDYOQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:56.093251878 (270h14m53.690022911s) [noise=true , address=185.167.204.206:4067 , piece_id=MASSSTID7OIUGCQBEMT7Z2PGWI565PVVWDOF554KGDAOOR3LDBGA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:15:52.836461110 (270h15m50.433232141s) [noise=true , address=89.149.201.147:4009 , piece_id=4I5NHH6BGB447QGUS4NZ7EA4TEHCH6F7EBLWLCKDMARUKMO2XADQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: read tcp 159.223.143.39:59846->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:15:52.836490913 (270h15m50.433261948s) [noise=true , address=89.149.201.147:4012 , piece_id=A6YU3AGWDYIBXPLMTRYEBXKSRKAWZ2C2TLSIE2LWZM5QBCXTFONA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:39210->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:15:52.836803289 (270h15m50.43357432s) [noise=true , address=89.149.201.147:4010 , piece_id=PVT36DWUATTHEBT7ZZFS3IGY5XXR2F3RF2OX4AFJNGROIJ4HUBNA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:38786->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:15:52.836841301 (270h15m50.433612319s) [seg_pos={0 0}, upload=302728]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 17:15:52.933262676 (270h15m50.530033691s) [upload=302728]: Done uploading segments...
Mar 17 17:15:52.933295888 (270h15m50.530066915s) [upload=302728]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.11934457s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [........X.......X..X...................X...................X] duration:
1m0.099098885s trace:
https://jaeger.dev.storj.io/trace/585e06d9b40a3d48
FAIL (2026-03-17 17:15:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ue , address=81.171.14.70:4027 , piece_id=VGNY3UH5WUJUIBAUTMPDKPG7W54GYQI7MHFAYKK4PP56WSHDK7OQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216084594 (270h14m50.812855627s) [noise=true , address=185.167.204.205:4003 , piece_id=VLHXUEI7VL3YGBXEF3LVKYST4ALZMNHS6RVDOHSVZ74AX6Y72APQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216111515 (270h14m50.812882546s) [noise=true , address=81.171.14.70:4041 , piece_id=S4W5XSQJCX5SBMHMF5PDA2KJXR5437FDV4JQIVF2IDS6MUZ5IARQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216531633 (270h14m50.813302713s) [noise=true , address=89.149.201.147:4011 , piece_id=VQLC4ACYDOTED7XKC3XBVFM5NRAA7P5NDPS6CDLHYA5RUHQPRP7Q, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216607759 (270h14m50.813378794s) [noise=true , address=185.167.204.205:4021 , piece_id=ONPPFWOFGEXSQQQITJBBYGII4C746M3G4CO44UUBTW3CLBPFIUQQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.216961080 (270h14m50.813732114s) [noise=true , address=89.149.201.147:4012 , piece_id=A6YU3AGWDYIBXPLMTRYEBXKSRKAWZ2C2TLSIE2LWZM5QBCXTFONA, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217044553 (270h14m50.813815585s) [noise=true , address=89.149.201.147:4019 , piece_id=UDDAYGNG4NEF64D6URQWUWX77O5DQRLE24CBEHUUSS7QKPKPS2FQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217407404 (270h14m50.814178437s) [noise=true , address=81.171.14.70:4031 , piece_id=MPG2YQJIJIWFB2LKSBGF6A7VL7ZVMBOTWZUAHUPWVKV3JMYV2BPQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217459843 (270h14m50.814230874s) [noise=true , address=185.167.204.206:4051 , piece_id=PT76ZSQBHXMWUZZEIU52D6UH4UWKKHWBCX2F7TKU3K6PLS6J564A, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.217877344 (270h14m50.814648375s) [noise=true , address=185.167.204.206:4039 , piece_id=SMQIH24STUFGEKYH762ETRQY6WGKYQM4VN6FMIXLSREI2USSFRMA, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.218317571 (270h14m50.815088606s) [noise=true , address=89.149.201.147:4014 , piece_id=AW7Y327EXXJXBL7QMTORAJ4DIB4BT5MQJP7GAHMVNWIT6RBAK6AQ, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.218752603 (270h14m50.815523635s) [noise=true , address=185.167.204.206:4059 , piece_id=YMAMSS4R25NGCS5R6TD5XLY54GTCAQ7SMUT2P4VEX2N5KPNKCNWA, seg_pos={0 0}, upload=302728]: Uploading piece...
Mar 17 17:14:53.615194851 (270h14m51.211965883s) [upload=302728]: Next returned nil segment
Mar 17 17:14:53.615210923 (270h14m51.211981957s) [upload=302728]: Waiting for error group managing segments...
Mar 17 17:14:53.824515071 (270h14m51.421286096s) [noise=true , address=81.171.14.70:4040 , piece_id=PJ7JR3NLA2F77BPI4CVD72SYYT7J6RJMTAABQXIPDNG2GLWVQH2Q, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.831570362 (270h14m51.428341388s) [noise=true , address=89.149.201.147:4023 , piece_id=SU5RTNRFWUWOIJQX5AYYNYP2O6YEKCIYPOVMP7JRAVFOBV45OLSA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.835864978 (270h14m51.432636008s) [noise=true , address=185.167.204.205:4021 , piece_id=ONPPFWOFGEXSQQQITJBBYGII4C746M3G4CO44UUBTW3CLBPFIUQQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.842458379 (270h14m51.439229406s) [noise=true , address=185.167.204.206:4061 , piece_id=JGUFYK4F735FFWZD3CEN4FAIQAIIUVF5O356HFJ42YDOLVDYQTWA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.849192793 (270h14m51.445963822s) [noise=true , address=81.171.14.70:4041 , piece_id=S4W5XSQJCX5SBMHMF5PDA2KJXR5437FDV4JQIVF2IDS6MUZ5IARQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.867223854 (270h14m51.463994891s) [noise=true , address=89.149.201.147:4014 , piece_id=AW7Y327EXXJXBL7QMTORAJ4DIB4BT5MQJP7GAHMVNWIT6RBAK6AQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.872902233 (270h14m51.469673262s) [noise=true , address=81.171.14.70:4031 , piece_id=MPG2YQJIJIWFB2LKSBGF6A7VL7ZVMBOTWZUAHUPWVKV3JMYV2BPQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.882411183 (270h14m51.479182217s) [noise=true , address=81.171.14.70:4032 , piece_id=WKQKQ6X5OUB3DPZZEOJ6BZ7NUSVKB77HVLPEDFLKOUSJJFQS46NA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.902835677 (270h14m51.499606704s) [noise=true , address=185.167.204.206:4039 , piece_id=SMQIH24STUFGEKYH762ETRQY6WGKYQM4VN6FMIXLSREI2USSFRMA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.917739995 (270h14m51.514511025s) [noise=true , address=185.167.204.206:4059 , piece_id=YMAMSS4R25NGCS5R6TD5XLY54GTCAQ7SMUT2P4VEX2N5KPNKCNWA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.920717236 (270h14m51.51748826s) [noise=true , address=89.149.201.147:4019 , piece_id=UDDAYGNG4NEF64D6URQWUWX77O5DQRLE24CBEHUUSS7QKPKPS2FQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.932355331 (270h14m51.529126362s) [noise=true , address=185.167.204.205:4006 , piece_id=T45MDBWXOLGLDXH6PJFSH7AVV6Y6KT5Z3V6DZPL5MUFINTTDU2BA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.941562059 (270h14m51.538333091s) [noise=true , address=89.149.201.147:4006 , piece_id=DBUF35S5RULZ6WWUPSK5WMR7BI42DSOK3ZVIBOTIG3CPNTLMKKVQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.941981069 (270h14m51.538752096s) [noise=true , address=185.167.204.206:4071 , piece_id=M7EMAC47GQNVBUL3OFXQUWM23JWRFYLHMTX3SAYG4SLZK3CHA6AQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.943381188 (270h14m51.540152204s) [noise=true , address=185.167.204.206:4051 , piece_id=PT76ZSQBHXMWUZZEIU52D6UH4UWKKHWBCX2F7TKU3K6PLS6J564A, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:53.979541952 (270h14m51.576312988s) [noise=true , address=185.167.204.206:4056 , piece_id=YXW6M4IO6YZOMG5Q4CG7DNT6AJXRNCRWYAHQS6L6YSUWRRJPTXTA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.198152281 (270h14m51.794923309s) [noise=true , address=185.167.204.205:4019 , piece_id=OZMZ2LXLHMIZMBOKI5ZHI4VOQWV23OHEUFAUSZWJWGTKTJ2MHDIA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.248119623 (270h14m51.844890887s) [noise=true , address=185.167.204.205:4003 , piece_id=VLHXUEI7VL3YGBXEF3LVKYST4ALZMNHS6RVDOHSVZ74AX6Y72APQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.272832136 (270h14m51.869603159s) [noise=true , address=81.171.14.70:4026 , piece_id=RIF67FENONVUTBLMTA4AXBHMWRBZQAJYJTP5M3QYLLY7NWOC7I4Q, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.320395865 (270h14m51.917166879s) [noise=true , address=81.171.14.70:4027 , piece_id=VGNY3UH5WUJUIBAUTMPDKPG7W54GYQI7MHFAYKK4PP56WSHDK7OQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.323393884 (270h14m51.920164911s) [noise=true , address=81.171.14.70:4030 , piece_id=QASZMJCSEXPCPSANITVOD5M3KBG2FW7IRPM4KUPP6KDYMWRGIQGA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.381270729 (270h14m51.978041752s) [noise=true , address=89.149.201.147:4011 , piece_id=VQLC4ACYDOTED7XKC3XBVFM5NRAA7P5NDPS6CDLHYA5RUHQPRP7Q, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:54.743727109 (270h14m52.340498122s) [noise=true , address=185.167.204.206:4065 , piece_id=CCFTZJSO4P5QNHWEO7NNRHMJNDIA3TX6FOWKCHMD2VUJBIUWI44A, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:55.358945075 (270h14m52.955716098s) [noise=true , address=185.167.204.206:4040 , piece_id=6HCXHILTNFHYPZJMRVMDO5WYNGFST5RHFALJWAQZLDM6M4RNDYOQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:14:56.093251878 (270h14m53.690022911s) [noise=true , address=185.167.204.206:4067 , piece_id=MASSSTID7OIUGCQBEMT7Z2PGWI565PVVWDOF554KGDAOOR3LDBGA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: <nil>
Mar 17 17:15:52.836461110 (270h15m50.433232141s) [noise=true , address=89.149.201.147:4009 , piece_id=4I5NHH6BGB447QGUS4NZ7EA4TEHCH6F7EBLWLCKDMARUKMO2XADQ, seg_pos={0 0}, upload=302728]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: read tcp 159.223.143.39:59846->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:15:52.836490913 (270h15m50.433261948s) [noise=true , address=89.149.201.147:4012 , piece_id=A6YU3AGWDYIBXPLMTRYEBXKSRKAWZ2C2TLSIE2LWZM5QBCXTFONA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:39210->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:15:52.836803289 (270h15m50.43357432s) [noise=true , address=89.149.201.147:4010 , piece_id=PVT36DWUATTHEBT7ZZFS3IGY5XXR2F3RF2OX4AFJNGROIJ4HUBNA, seg_pos={0 0}, upload=302728]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:38786->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:15:52.836841301 (270h15m50.433612319s) [seg_pos={0 0}, upload=302728]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 17:15:52.933262676 (270h15m50.530033691s) [upload=302728]: Done uploading segments...
Mar 17 17:15:52.933295888 (270h15m50.530066915s) [upload=302728]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 1m0.099122839s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.........X.......X..X...................X...................] duration:
4.483428107s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:13:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 4.483460535s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..........X.......X..X...................X..................] duration:
2.569125389s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:12:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.569148762s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...........X.......X..X...................X.................] duration:
3.365655539s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:12:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 3.365684881s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [............X.......X..X...................X................] duration:
3.352960661s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:11:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 3.352999432s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.............X.......X..X...................X...............] duration:
2.125043311s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:11:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.12508346s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..............X.......X..X...................X..............] duration:
2.753070327s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:10:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.753103601s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...............X.......X..X...................X.............] duration:
2.510820621s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:10:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.510855545s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [................X.......X..X...................X............] duration:
2.866029563s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:09:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.866057481s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.................X.......X..X...................X...........] duration:
2.109530128s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:08:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.109546828s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..................X.......X..X...................X..........] duration:
58.969016302s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:08:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 58.969041387s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...................X.......X..X...................X.........] duration:
2.482153947s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:06:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.482190601s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [....................X.......X..X...................X........] duration:
4.864458253s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:06:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 4.864490062s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.....................X.......X..X...................X.......] duration:
5.322660985s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:05:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 5.322690774s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [......................X.......X..X...................X......] duration:
2.603741263s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:04:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.603767981s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.......................X.......X..X...................X.....] duration:
2.190845784s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:03:33 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.190873042s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [........................X.......X..X...................X....] duration:
19.12055685s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:02:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 19.120583593s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.........................X.......X..X...................X...] duration:
2.219778243s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:01:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.219826033s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..........................X.......X..X...................X..] duration:
2.308829024s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:00:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.308881793s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...........................X.......X..X...................X.] duration:
33.570328823s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 17:00:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 33.570352362s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [............................X.......X..X...................X] duration:
1m0.102802911s trace:
https://jaeger.dev.storj.io/trace/2b0f5e876466003
FAIL (2026-03-17 16:59:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
{0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.842270473 (269h58m56.439041502s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.843487375 (269h58m56.440258407s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.844808437 (269h58m56.441579467s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.846033388 (269h58m56.442804418s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.847336207 (269h58m56.444107244s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.848964339 (269h58m56.445735371s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.850176452 (269h58m56.446947479s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.851488431 (269h58m56.448259461s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.852925316 (269h58m56.449696349s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.854143235 (269h58m56.450914265s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.855370829 (269h58m56.452141873s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:58.856688057 (269h58m56.453459091s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Uploading piece...
Mar 17 16:58:59.297693436 (269h58m56.89446445s) [upload=302435]: Next returned nil segment
Mar 17 16:58:59.297705467 (269h58m56.89447648s) [upload=302435]: Waiting for error group managing segments...
Mar 17 16:58:59.469636042 (269h58m57.066407052s) [noise=true , address=81.171.14.70:4043 , piece_id=TTOM6KCJ5XVWK3VNW3HCI52JDE6OH67JRGOTU5BWSRN636SRHYPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.472195416 (269h58m57.068966425s) [noise=true , address=81.171.14.70:4041 , piece_id=BXUG6VOI6FXPR6OCANG5XGOXDTBZEKGVYO33XYPE6JWM2JJ3YGQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.489128691 (269h58m57.085899714s) [noise=true , address=81.171.14.70:4042 , piece_id=PIIDRSXATAAOO53EUZMURL7XXBEX3XDNGA7QYHH3LH2VJ7K3JWXA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.497053504 (269h58m57.093824528s) [noise=true , address=81.171.14.70:4030 , piece_id=AHQD2AWURRLL2B5ENSFQJXZMECKKLF56S4DX7NZTFOA7D4HNF3EA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.514830907 (269h58m57.111601941s) [noise=true , address=185.167.204.205:4004 , piece_id=VDNIAQCMIDPKNUKVIB6OGGYGVCC4YKG2YC3GFJAESURJ6SK3OZCQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.522578122 (269h58m57.119349146s) [noise=true , address=185.167.204.206:4069 , piece_id=K336MMNWWAJ3ESDZJTGMNNZDXRG5OMEEXO4GH7GVHOMPXMMFIIQQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.525333414 (269h58m57.122104438s) [noise=true , address=185.167.204.206:4056 , piece_id=TO4IFCOV455TO3PSP4H7HIF2ZQXV3ARAEZCSKO5NC6H5DIIQPVRQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.534040203 (269h58m57.13081123s) [noise=true , address=89.149.201.147:4005 , piece_id=VK6IXAMQRKMKCJX7BSI6HNZF2YQDHXNJPJWSP4UCQJEUBYIBGJ2Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.545842037 (269h58m57.14261306s) [noise=true , address=89.149.201.147:4014 , piece_id=ZTWR3ZLNSBFVFN62FLHBCZJUTLLZW3NPBV3WLIVE7QXZOGLIS4JA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.551798986 (269h58m57.14857001s) [noise=true , address=185.167.204.205:4014 , piece_id=WKRM7ZRCZHRV4CEPD62GB4FTG7LGLUK5RC7ZSLGIMHOGWABYBOJQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.552108387 (269h58m57.148879398s) [noise=true , address=185.167.204.205:4005 , piece_id=RU7QGETTRIXYVDD6NAP7OYQW7XJN367MZ4RB3JRVLU4HWA5HWUEA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.553709246 (269h58m57.150480269s) [noise=true , address=185.167.204.206:4065 , piece_id=N7HB76HGGHC6DF2JVKYXYP4JSWAHYWN64SEECNWSSRPPAEQJDC7Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.554237275 (269h58m57.151008308s) [noise=true , address=185.167.204.205:4026 , piece_id=3FRXPUJWBVAKY5S2LFFRWPQBP5LQCCJAWXLUYQHC3GI74ZGVNPOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.563501817 (269h58m57.16027283s) [noise=true , address=185.167.204.205:4024 , piece_id=BLFOMLAWUCAZ5LPNTZ6KREKLLT6M4WGR7SJVKRDPA4JNBIWE3BOA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.567788108 (269h58m57.164559133s) [noise=true , address=185.167.204.206:4071 , piece_id=IT4YMNCC7RFY5VOFLBI5XJIT3DO6CJRJ7U7XWS2SECAPFRTPGI5Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.570024460 (269h58m57.166795489s) [noise=true , address=185.167.204.206:4055 , piece_id=A6AKYPXKL4S6EPFUEUUXDWYHKAJBRCSGHHHMFHT2GQEQCELOZO3A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.574979033 (269h58m57.171750062s) [noise=true , address=185.167.204.205:4036 , piece_id=M7OWRALA7RGQVVTCHTM6LS75NXONV7Z6MKEMO2F7AD7BGOX7NV2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.615603769 (269h58m57.212374798s) [noise=true , address=185.167.204.205:4020 , piece_id=YZJCSOZKV3VJEMPBZDDPWVJDPADEOVEOEOLG3IU3QZ6DU4H3CNJA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.650925267 (269h58m57.247696301s) [noise=true , address=185.167.204.206:4037 , piece_id=CWATSSTG72GKZXMAZ5QYIKIFIFRAMBPU2WCW6QFP5LL66FHOLW4Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.954017664 (269h58m57.550788688s) [noise=true , address=81.171.14.70:4040 , piece_id=CQTB5WIDVJAR3FCGHD6X7DJ7FBAAUEU5IPII2HHVXXEMRBWM37XA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.965406649 (269h58m57.562177674s) [noise=true , address=81.171.14.70:4031 , piece_id=EG7LZQDV5LE4WIJTRZMWUCPIP3MHFJY5A45QIFVGMSKGD3DJKBIA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.976003859 (269h58m57.57277489s) [noise=true , address=81.171.14.70:4036 , piece_id=6LKFNGIU4XL5HUMSPPCF3WBRDDXJFLP6JCV5U7WI5H5STSYLZFPA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.992198446 (269h58m57.588969473s) [noise=true , address=81.171.14.70:4044 , piece_id=ERDNVSDD2Y46277VQVRK5CUW7CVMB6PO6AUGYPX6OP3NEIZOWHUA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:58:59.997299945 (269h58m57.594070972s) [noise=true , address=89.149.201.147:4015 , piece_id=CW2AI3HDSEM672L6ZSYEDSW5COVWP3ZRYFATGLORDA342KNDX5GQ, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:00.061126927 (269h58m57.657897953s) [noise=true , address=89.149.201.147:4017 , piece_id=ARDO4BTVX4I66V635FJ4NTWGOWXW4GE7TLHE4CIGD5DIDKTLCI6Q, seg_pos={0 0}, upload=302435]: Done uploading piece. err: <nil>
Mar 17 16:59:58.436886379 (269h59m56.033657412s) [noise=true , address=89.149.201.147:4009 , piece_id=UKSVIWC4A6HQSZABQ3XKSBQIPHCAY3WFKXR2AUPZCIKHJKGKDT2A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: expected piece hash; context deadline exceeded; EOF
Mar 17 16:59:58.437198123 (269h59m56.033969157s) [noise=true , address=89.149.201.147:4022 , piece_id=MBXEVXMVBODIF7XXPAQU7L42IEWLECD6E432HFMANLBREN4HX3GA, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE, address:89.149.201.147:4022): protocol: read tcp 159.223.143.39:49030->89.149.201.147:4022: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437400468 (269h59m56.034171505s) [noise=true , address=89.149.201.147:4016 , piece_id=SEW2XIOMXCX4AFVUA5VIHFNPUU2OWWB7RUO6YC55MCAMVQS7YA5A, seg_pos={0 0}, upload=302435]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: read tcp 159.223.143.39:37604->89.149.201.147:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:59:58.437437048 (269h59m56.034208058s) [seg_pos={0 0}, upload=302435]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 16:59:58.536769847 (269h59m56.133540872s) [upload=302435]: Done uploading segments...
Mar 17 16:59:58.536807925 (269h59m56.133578948s) [upload=302435]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 1m0.102829806s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.............................X.......X..X...................] duration:
2.600574034s trace:
https://jaeger.dev.storj.io/trace/6ebfed838a41a5eb
FAIL (2026-03-17 16:58:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
MJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392058338 (269h42m37.988829374s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392724484 (269h42m37.989495516s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.393432860 (269h42m37.9902039s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394092212 (269h42m37.990863247s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394733387 (269h42m37.991504423s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.395463263 (269h42m37.9922343s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396139432 (269h42m37.992910466s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396884379 (269h42m37.993655418s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.398682006 (269h42m37.995453039s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.400897852 (269h42m37.997668887s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.821970525 (269h42m38.418741537s) [upload=302129]: Next returned nil segment
Mar 17 16:42:40.821986224 (269h42m38.418757258s) [upload=302129]: Waiting for error group managing segments...
Mar 17 16:42:40.996653929 (269h42m38.593424952s) [noise=true , address=81.171.14.70:4038 , piece_id=ZUXGIUNXLWLHE6PMX5KCXRM4PBIUNM5AT6DZAUSFFYZ2DEI4KL5Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.003601462 (269h42m38.600372495s) [noise=true , address=81.171.14.70:4045 , piece_id=6JKCYRHZCYRDSWYEIAWG5OUHKL2P2E2CDM6KBQYQXGVQKSG6NYVQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.010004600 (269h42m38.606775647s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.018269893 (269h42m38.61504092s) [noise=true , address=81.171.14.70:4046 , piece_id=EAWDP4WZNH7GJXX2G6IKN74UNYPBFIQLI6NHXKWCTWPNKM5AXYYA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.024071917 (269h42m38.620842943s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037624639 (269h42m38.634395666s) [noise=true , address=185.167.204.206:4059 , piece_id=E6IZDHGOVLXGAMLEQNLF6UDARURB7DDIKLMDHPIUCIUNQX6YVILQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037976797 (269h42m38.634747827s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.038407400 (269h42m38.635178431s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.044987716 (269h42m38.641758746s) [noise=true , address=185.167.204.206:4063 , piece_id=RBGHCD3HZY7J6VAOY74GOWAV4CAVGZBUWPKOH5NJJYZBXPVKC5HQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.045303382 (269h42m38.642074405s) [noise=true , address=89.149.201.147:4004 , piece_id=7D6RAHH5C45I25GOS5Z5P75SBMUEKCLPS6M6HFA47JVWO5SYM52A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.056865781 (269h42m38.653636794s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.061270392 (269h42m38.658041409s) [noise=true , address=185.167.204.205:4019 , piece_id=VZUK5XVJA3SNS63P6QSRPCK6S75ZJIE6TKAT3K4GZTBYHGM7B3XA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.066617838 (269h42m38.663388851s) [noise=true , address=81.171.14.70:4039 , piece_id=F5DUJKSELLLGEH27NSDLCBNX2RNLXSNCE3BMHEILFW62XXJAVJYQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.067673458 (269h42m38.66444448s) [noise=true , address=185.167.204.206:4065 , piece_id=CV3DTUMJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.074294195 (269h42m38.671065218s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.075141755 (269h42m38.67191278s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.115557153 (269h42m38.712328179s) [noise=true , address=185.167.204.206:4060 , piece_id=KADK4I6S4JNOWTBFYXUEQP4BOVELYZPU24AR5EZ2NZH2NWB6KAXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.128083741 (269h42m38.724854768s) [noise=true , address=185.167.204.206:4047 , piece_id=UOCR26GUYH47LWE5DXBL6DJ2TI6M7VT4GKZXIMLMYE5MQWJ3ADHQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.139427613 (269h42m38.736198637s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.155192302 (269h42m38.75196333s) [noise=true , address=185.167.204.206:4055 , piece_id=2YKJTY6D75FOVH5WMJR7CRTCILA5JGEQDTYPYHLA5AAIOQ6XZBUA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.716042252 (269h42m39.312813272s) [noise=true , address=185.167.204.205:4031 , piece_id=VFZ5ZCKA5GIFPOKDUTYCTK6CIYPDGTHXQXIJWCICY3ELZPRTLLXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.751904742 (269h42m39.34867577s) [noise=true , address=185.167.204.205:4032 , piece_id=Z7ELO5PGCCZEGLHS732V6MP45KYKVFSAMOBLGGOCXEC7TBA36XNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:42.653599013 (269h42m40.250370044s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:44.211379782 (269h42m41.808150806s) [noise=true , address=185.167.204.206:4049 , piece_id=DKZ3ZEE55DLHXQJX7EGKFKSXNGE6IPY2LEL2PVMJC7RBQBNGY4EA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:43:40.010864156 (269h43m37.607635205s) [noise=true , address=89.149.201.147:4008 , piece_id=4MJDYSTBC2MHUA35OYQXOWQT7YXEG34SRFANPCQU7K6KJMLH5IIA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:40544->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011059157 (269h43m37.607830234s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:40700->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011176795 (269h43m37.607947854s) [noise=true , address=89.149.201.147:4017 , piece_id=MLHQBR2AKMTWBP6YBLWJLR6HYQ56PJ7XQE2NZBLEH55J7AFOCYRA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:41696->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011287689 (269h43m37.608058742s) [noise=true , address=89.149.201.147:4012 , piece_id=VAFVNMYSGEDV2OZOG3A2EJ3W6MALMSG52TYKRC4Q5O3PUVA5GUOA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:53144->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011327167 (269h43m37.608098192s) [seg_pos={0 0}, upload=302129]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 16:43:40.117340588 (269h43m37.714111625s) [upload=302129]: Done uploading segments...
Mar 17 16:43:40.117394929 (269h43m37.71416596s) [upload=302129]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.600598861s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..............................X.......X..X..................] duration:
2.413595696s trace:
https://jaeger.dev.storj.io/trace/6ebfed838a41a5eb
FAIL (2026-03-17 16:57:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
MJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392058338 (269h42m37.988829374s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392724484 (269h42m37.989495516s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.393432860 (269h42m37.9902039s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394092212 (269h42m37.990863247s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394733387 (269h42m37.991504423s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.395463263 (269h42m37.9922343s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396139432 (269h42m37.992910466s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396884379 (269h42m37.993655418s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.398682006 (269h42m37.995453039s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.400897852 (269h42m37.997668887s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.821970525 (269h42m38.418741537s) [upload=302129]: Next returned nil segment
Mar 17 16:42:40.821986224 (269h42m38.418757258s) [upload=302129]: Waiting for error group managing segments...
Mar 17 16:42:40.996653929 (269h42m38.593424952s) [noise=true , address=81.171.14.70:4038 , piece_id=ZUXGIUNXLWLHE6PMX5KCXRM4PBIUNM5AT6DZAUSFFYZ2DEI4KL5Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.003601462 (269h42m38.600372495s) [noise=true , address=81.171.14.70:4045 , piece_id=6JKCYRHZCYRDSWYEIAWG5OUHKL2P2E2CDM6KBQYQXGVQKSG6NYVQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.010004600 (269h42m38.606775647s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.018269893 (269h42m38.61504092s) [noise=true , address=81.171.14.70:4046 , piece_id=EAWDP4WZNH7GJXX2G6IKN74UNYPBFIQLI6NHXKWCTWPNKM5AXYYA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.024071917 (269h42m38.620842943s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037624639 (269h42m38.634395666s) [noise=true , address=185.167.204.206:4059 , piece_id=E6IZDHGOVLXGAMLEQNLF6UDARURB7DDIKLMDHPIUCIUNQX6YVILQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037976797 (269h42m38.634747827s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.038407400 (269h42m38.635178431s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.044987716 (269h42m38.641758746s) [noise=true , address=185.167.204.206:4063 , piece_id=RBGHCD3HZY7J6VAOY74GOWAV4CAVGZBUWPKOH5NJJYZBXPVKC5HQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.045303382 (269h42m38.642074405s) [noise=true , address=89.149.201.147:4004 , piece_id=7D6RAHH5C45I25GOS5Z5P75SBMUEKCLPS6M6HFA47JVWO5SYM52A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.056865781 (269h42m38.653636794s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.061270392 (269h42m38.658041409s) [noise=true , address=185.167.204.205:4019 , piece_id=VZUK5XVJA3SNS63P6QSRPCK6S75ZJIE6TKAT3K4GZTBYHGM7B3XA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.066617838 (269h42m38.663388851s) [noise=true , address=81.171.14.70:4039 , piece_id=F5DUJKSELLLGEH27NSDLCBNX2RNLXSNCE3BMHEILFW62XXJAVJYQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.067673458 (269h42m38.66444448s) [noise=true , address=185.167.204.206:4065 , piece_id=CV3DTUMJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.074294195 (269h42m38.671065218s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.075141755 (269h42m38.67191278s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.115557153 (269h42m38.712328179s) [noise=true , address=185.167.204.206:4060 , piece_id=KADK4I6S4JNOWTBFYXUEQP4BOVELYZPU24AR5EZ2NZH2NWB6KAXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.128083741 (269h42m38.724854768s) [noise=true , address=185.167.204.206:4047 , piece_id=UOCR26GUYH47LWE5DXBL6DJ2TI6M7VT4GKZXIMLMYE5MQWJ3ADHQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.139427613 (269h42m38.736198637s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.155192302 (269h42m38.75196333s) [noise=true , address=185.167.204.206:4055 , piece_id=2YKJTY6D75FOVH5WMJR7CRTCILA5JGEQDTYPYHLA5AAIOQ6XZBUA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.716042252 (269h42m39.312813272s) [noise=true , address=185.167.204.205:4031 , piece_id=VFZ5ZCKA5GIFPOKDUTYCTK6CIYPDGTHXQXIJWCICY3ELZPRTLLXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.751904742 (269h42m39.34867577s) [noise=true , address=185.167.204.205:4032 , piece_id=Z7ELO5PGCCZEGLHS732V6MP45KYKVFSAMOBLGGOCXEC7TBA36XNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:42.653599013 (269h42m40.250370044s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:44.211379782 (269h42m41.808150806s) [noise=true , address=185.167.204.206:4049 , piece_id=DKZ3ZEE55DLHXQJX7EGKFKSXNGE6IPY2LEL2PVMJC7RBQBNGY4EA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:43:40.010864156 (269h43m37.607635205s) [noise=true , address=89.149.201.147:4008 , piece_id=4MJDYSTBC2MHUA35OYQXOWQT7YXEG34SRFANPCQU7K6KJMLH5IIA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:40544->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011059157 (269h43m37.607830234s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:40700->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011176795 (269h43m37.607947854s) [noise=true , address=89.149.201.147:4017 , piece_id=MLHQBR2AKMTWBP6YBLWJLR6HYQ56PJ7XQE2NZBLEH55J7AFOCYRA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:41696->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011287689 (269h43m37.608058742s) [noise=true , address=89.149.201.147:4012 , piece_id=VAFVNMYSGEDV2OZOG3A2EJ3W6MALMSG52TYKRC4Q5O3PUVA5GUOA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:53144->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011327167 (269h43m37.608098192s) [seg_pos={0 0}, upload=302129]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 16:43:40.117340588 (269h43m37.714111625s) [upload=302129]: Done uploading segments...
Mar 17 16:43:40.117394929 (269h43m37.71416596s) [upload=302129]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.413621048s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...............................X.......X..X.................] duration:
59.933620749s trace:
https://jaeger.dev.storj.io/trace/6ebfed838a41a5eb
FAIL (2026-03-17 16:57:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
MJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392058338 (269h42m37.988829374s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392724484 (269h42m37.989495516s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.393432860 (269h42m37.9902039s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394092212 (269h42m37.990863247s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394733387 (269h42m37.991504423s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.395463263 (269h42m37.9922343s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396139432 (269h42m37.992910466s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396884379 (269h42m37.993655418s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.398682006 (269h42m37.995453039s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.400897852 (269h42m37.997668887s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.821970525 (269h42m38.418741537s) [upload=302129]: Next returned nil segment
Mar 17 16:42:40.821986224 (269h42m38.418757258s) [upload=302129]: Waiting for error group managing segments...
Mar 17 16:42:40.996653929 (269h42m38.593424952s) [noise=true , address=81.171.14.70:4038 , piece_id=ZUXGIUNXLWLHE6PMX5KCXRM4PBIUNM5AT6DZAUSFFYZ2DEI4KL5Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.003601462 (269h42m38.600372495s) [noise=true , address=81.171.14.70:4045 , piece_id=6JKCYRHZCYRDSWYEIAWG5OUHKL2P2E2CDM6KBQYQXGVQKSG6NYVQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.010004600 (269h42m38.606775647s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.018269893 (269h42m38.61504092s) [noise=true , address=81.171.14.70:4046 , piece_id=EAWDP4WZNH7GJXX2G6IKN74UNYPBFIQLI6NHXKWCTWPNKM5AXYYA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.024071917 (269h42m38.620842943s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037624639 (269h42m38.634395666s) [noise=true , address=185.167.204.206:4059 , piece_id=E6IZDHGOVLXGAMLEQNLF6UDARURB7DDIKLMDHPIUCIUNQX6YVILQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037976797 (269h42m38.634747827s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.038407400 (269h42m38.635178431s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.044987716 (269h42m38.641758746s) [noise=true , address=185.167.204.206:4063 , piece_id=RBGHCD3HZY7J6VAOY74GOWAV4CAVGZBUWPKOH5NJJYZBXPVKC5HQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.045303382 (269h42m38.642074405s) [noise=true , address=89.149.201.147:4004 , piece_id=7D6RAHH5C45I25GOS5Z5P75SBMUEKCLPS6M6HFA47JVWO5SYM52A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.056865781 (269h42m38.653636794s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.061270392 (269h42m38.658041409s) [noise=true , address=185.167.204.205:4019 , piece_id=VZUK5XVJA3SNS63P6QSRPCK6S75ZJIE6TKAT3K4GZTBYHGM7B3XA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.066617838 (269h42m38.663388851s) [noise=true , address=81.171.14.70:4039 , piece_id=F5DUJKSELLLGEH27NSDLCBNX2RNLXSNCE3BMHEILFW62XXJAVJYQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.067673458 (269h42m38.66444448s) [noise=true , address=185.167.204.206:4065 , piece_id=CV3DTUMJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.074294195 (269h42m38.671065218s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.075141755 (269h42m38.67191278s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.115557153 (269h42m38.712328179s) [noise=true , address=185.167.204.206:4060 , piece_id=KADK4I6S4JNOWTBFYXUEQP4BOVELYZPU24AR5EZ2NZH2NWB6KAXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.128083741 (269h42m38.724854768s) [noise=true , address=185.167.204.206:4047 , piece_id=UOCR26GUYH47LWE5DXBL6DJ2TI6M7VT4GKZXIMLMYE5MQWJ3ADHQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.139427613 (269h42m38.736198637s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.155192302 (269h42m38.75196333s) [noise=true , address=185.167.204.206:4055 , piece_id=2YKJTY6D75FOVH5WMJR7CRTCILA5JGEQDTYPYHLA5AAIOQ6XZBUA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.716042252 (269h42m39.312813272s) [noise=true , address=185.167.204.205:4031 , piece_id=VFZ5ZCKA5GIFPOKDUTYCTK6CIYPDGTHXQXIJWCICY3ELZPRTLLXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.751904742 (269h42m39.34867577s) [noise=true , address=185.167.204.205:4032 , piece_id=Z7ELO5PGCCZEGLHS732V6MP45KYKVFSAMOBLGGOCXEC7TBA36XNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:42.653599013 (269h42m40.250370044s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:44.211379782 (269h42m41.808150806s) [noise=true , address=185.167.204.206:4049 , piece_id=DKZ3ZEE55DLHXQJX7EGKFKSXNGE6IPY2LEL2PVMJC7RBQBNGY4EA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:43:40.010864156 (269h43m37.607635205s) [noise=true , address=89.149.201.147:4008 , piece_id=4MJDYSTBC2MHUA35OYQXOWQT7YXEG34SRFANPCQU7K6KJMLH5IIA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:40544->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011059157 (269h43m37.607830234s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:40700->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011176795 (269h43m37.607947854s) [noise=true , address=89.149.201.147:4017 , piece_id=MLHQBR2AKMTWBP6YBLWJLR6HYQ56PJ7XQE2NZBLEH55J7AFOCYRA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:41696->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011287689 (269h43m37.608058742s) [noise=true , address=89.149.201.147:4012 , piece_id=VAFVNMYSGEDV2OZOG3A2EJ3W6MALMSG52TYKRC4Q5O3PUVA5GUOA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:53144->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011327167 (269h43m37.608098192s) [seg_pos={0 0}, upload=302129]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 16:43:40.117340588 (269h43m37.714111625s) [upload=302129]: Done uploading segments...
Mar 17 16:43:40.117394929 (269h43m37.71416596s) [upload=302129]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 59.933685596s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [................................X.......X..X................] duration:
3.05358228s trace:
https://jaeger.dev.storj.io/trace/6ebfed838a41a5eb
FAIL (2026-03-17 16:55:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
MJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392058338 (269h42m37.988829374s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392724484 (269h42m37.989495516s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.393432860 (269h42m37.9902039s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394092212 (269h42m37.990863247s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394733387 (269h42m37.991504423s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.395463263 (269h42m37.9922343s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396139432 (269h42m37.992910466s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396884379 (269h42m37.993655418s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.398682006 (269h42m37.995453039s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.400897852 (269h42m37.997668887s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.821970525 (269h42m38.418741537s) [upload=302129]: Next returned nil segment
Mar 17 16:42:40.821986224 (269h42m38.418757258s) [upload=302129]: Waiting for error group managing segments...
Mar 17 16:42:40.996653929 (269h42m38.593424952s) [noise=true , address=81.171.14.70:4038 , piece_id=ZUXGIUNXLWLHE6PMX5KCXRM4PBIUNM5AT6DZAUSFFYZ2DEI4KL5Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.003601462 (269h42m38.600372495s) [noise=true , address=81.171.14.70:4045 , piece_id=6JKCYRHZCYRDSWYEIAWG5OUHKL2P2E2CDM6KBQYQXGVQKSG6NYVQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.010004600 (269h42m38.606775647s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.018269893 (269h42m38.61504092s) [noise=true , address=81.171.14.70:4046 , piece_id=EAWDP4WZNH7GJXX2G6IKN74UNYPBFIQLI6NHXKWCTWPNKM5AXYYA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.024071917 (269h42m38.620842943s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037624639 (269h42m38.634395666s) [noise=true , address=185.167.204.206:4059 , piece_id=E6IZDHGOVLXGAMLEQNLF6UDARURB7DDIKLMDHPIUCIUNQX6YVILQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037976797 (269h42m38.634747827s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.038407400 (269h42m38.635178431s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.044987716 (269h42m38.641758746s) [noise=true , address=185.167.204.206:4063 , piece_id=RBGHCD3HZY7J6VAOY74GOWAV4CAVGZBUWPKOH5NJJYZBXPVKC5HQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.045303382 (269h42m38.642074405s) [noise=true , address=89.149.201.147:4004 , piece_id=7D6RAHH5C45I25GOS5Z5P75SBMUEKCLPS6M6HFA47JVWO5SYM52A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.056865781 (269h42m38.653636794s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.061270392 (269h42m38.658041409s) [noise=true , address=185.167.204.205:4019 , piece_id=VZUK5XVJA3SNS63P6QSRPCK6S75ZJIE6TKAT3K4GZTBYHGM7B3XA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.066617838 (269h42m38.663388851s) [noise=true , address=81.171.14.70:4039 , piece_id=F5DUJKSELLLGEH27NSDLCBNX2RNLXSNCE3BMHEILFW62XXJAVJYQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.067673458 (269h42m38.66444448s) [noise=true , address=185.167.204.206:4065 , piece_id=CV3DTUMJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.074294195 (269h42m38.671065218s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.075141755 (269h42m38.67191278s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.115557153 (269h42m38.712328179s) [noise=true , address=185.167.204.206:4060 , piece_id=KADK4I6S4JNOWTBFYXUEQP4BOVELYZPU24AR5EZ2NZH2NWB6KAXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.128083741 (269h42m38.724854768s) [noise=true , address=185.167.204.206:4047 , piece_id=UOCR26GUYH47LWE5DXBL6DJ2TI6M7VT4GKZXIMLMYE5MQWJ3ADHQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.139427613 (269h42m38.736198637s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.155192302 (269h42m38.75196333s) [noise=true , address=185.167.204.206:4055 , piece_id=2YKJTY6D75FOVH5WMJR7CRTCILA5JGEQDTYPYHLA5AAIOQ6XZBUA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.716042252 (269h42m39.312813272s) [noise=true , address=185.167.204.205:4031 , piece_id=VFZ5ZCKA5GIFPOKDUTYCTK6CIYPDGTHXQXIJWCICY3ELZPRTLLXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.751904742 (269h42m39.34867577s) [noise=true , address=185.167.204.205:4032 , piece_id=Z7ELO5PGCCZEGLHS732V6MP45KYKVFSAMOBLGGOCXEC7TBA36XNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:42.653599013 (269h42m40.250370044s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:44.211379782 (269h42m41.808150806s) [noise=true , address=185.167.204.206:4049 , piece_id=DKZ3ZEE55DLHXQJX7EGKFKSXNGE6IPY2LEL2PVMJC7RBQBNGY4EA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:43:40.010864156 (269h43m37.607635205s) [noise=true , address=89.149.201.147:4008 , piece_id=4MJDYSTBC2MHUA35OYQXOWQT7YXEG34SRFANPCQU7K6KJMLH5IIA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:40544->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011059157 (269h43m37.607830234s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:40700->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011176795 (269h43m37.607947854s) [noise=true , address=89.149.201.147:4017 , piece_id=MLHQBR2AKMTWBP6YBLWJLR6HYQ56PJ7XQE2NZBLEH55J7AFOCYRA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:41696->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011287689 (269h43m37.608058742s) [noise=true , address=89.149.201.147:4012 , piece_id=VAFVNMYSGEDV2OZOG3A2EJ3W6MALMSG52TYKRC4Q5O3PUVA5GUOA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:53144->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011327167 (269h43m37.608098192s) [seg_pos={0 0}, upload=302129]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 16:43:40.117340588 (269h43m37.714111625s) [upload=302129]: Done uploading segments...
Mar 17 16:43:40.117394929 (269h43m37.71416596s) [upload=302129]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.053613151s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.................................X.......X..X...............] duration:
2.561323506s trace:
https://jaeger.dev.storj.io/trace/6ebfed838a41a5eb
FAIL (2026-03-17 16:54:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
MJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392058338 (269h42m37.988829374s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392724484 (269h42m37.989495516s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.393432860 (269h42m37.9902039s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394092212 (269h42m37.990863247s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394733387 (269h42m37.991504423s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.395463263 (269h42m37.9922343s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396139432 (269h42m37.992910466s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396884379 (269h42m37.993655418s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.398682006 (269h42m37.995453039s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.400897852 (269h42m37.997668887s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.821970525 (269h42m38.418741537s) [upload=302129]: Next returned nil segment
Mar 17 16:42:40.821986224 (269h42m38.418757258s) [upload=302129]: Waiting for error group managing segments...
Mar 17 16:42:40.996653929 (269h42m38.593424952s) [noise=true , address=81.171.14.70:4038 , piece_id=ZUXGIUNXLWLHE6PMX5KCXRM4PBIUNM5AT6DZAUSFFYZ2DEI4KL5Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.003601462 (269h42m38.600372495s) [noise=true , address=81.171.14.70:4045 , piece_id=6JKCYRHZCYRDSWYEIAWG5OUHKL2P2E2CDM6KBQYQXGVQKSG6NYVQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.010004600 (269h42m38.606775647s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.018269893 (269h42m38.61504092s) [noise=true , address=81.171.14.70:4046 , piece_id=EAWDP4WZNH7GJXX2G6IKN74UNYPBFIQLI6NHXKWCTWPNKM5AXYYA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.024071917 (269h42m38.620842943s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037624639 (269h42m38.634395666s) [noise=true , address=185.167.204.206:4059 , piece_id=E6IZDHGOVLXGAMLEQNLF6UDARURB7DDIKLMDHPIUCIUNQX6YVILQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037976797 (269h42m38.634747827s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.038407400 (269h42m38.635178431s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.044987716 (269h42m38.641758746s) [noise=true , address=185.167.204.206:4063 , piece_id=RBGHCD3HZY7J6VAOY74GOWAV4CAVGZBUWPKOH5NJJYZBXPVKC5HQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.045303382 (269h42m38.642074405s) [noise=true , address=89.149.201.147:4004 , piece_id=7D6RAHH5C45I25GOS5Z5P75SBMUEKCLPS6M6HFA47JVWO5SYM52A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.056865781 (269h42m38.653636794s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.061270392 (269h42m38.658041409s) [noise=true , address=185.167.204.205:4019 , piece_id=VZUK5XVJA3SNS63P6QSRPCK6S75ZJIE6TKAT3K4GZTBYHGM7B3XA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.066617838 (269h42m38.663388851s) [noise=true , address=81.171.14.70:4039 , piece_id=F5DUJKSELLLGEH27NSDLCBNX2RNLXSNCE3BMHEILFW62XXJAVJYQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.067673458 (269h42m38.66444448s) [noise=true , address=185.167.204.206:4065 , piece_id=CV3DTUMJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.074294195 (269h42m38.671065218s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.075141755 (269h42m38.67191278s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.115557153 (269h42m38.712328179s) [noise=true , address=185.167.204.206:4060 , piece_id=KADK4I6S4JNOWTBFYXUEQP4BOVELYZPU24AR5EZ2NZH2NWB6KAXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.128083741 (269h42m38.724854768s) [noise=true , address=185.167.204.206:4047 , piece_id=UOCR26GUYH47LWE5DXBL6DJ2TI6M7VT4GKZXIMLMYE5MQWJ3ADHQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.139427613 (269h42m38.736198637s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.155192302 (269h42m38.75196333s) [noise=true , address=185.167.204.206:4055 , piece_id=2YKJTY6D75FOVH5WMJR7CRTCILA5JGEQDTYPYHLA5AAIOQ6XZBUA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.716042252 (269h42m39.312813272s) [noise=true , address=185.167.204.205:4031 , piece_id=VFZ5ZCKA5GIFPOKDUTYCTK6CIYPDGTHXQXIJWCICY3ELZPRTLLXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.751904742 (269h42m39.34867577s) [noise=true , address=185.167.204.205:4032 , piece_id=Z7ELO5PGCCZEGLHS732V6MP45KYKVFSAMOBLGGOCXEC7TBA36XNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:42.653599013 (269h42m40.250370044s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:44.211379782 (269h42m41.808150806s) [noise=true , address=185.167.204.206:4049 , piece_id=DKZ3ZEE55DLHXQJX7EGKFKSXNGE6IPY2LEL2PVMJC7RBQBNGY4EA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:43:40.010864156 (269h43m37.607635205s) [noise=true , address=89.149.201.147:4008 , piece_id=4MJDYSTBC2MHUA35OYQXOWQT7YXEG34SRFANPCQU7K6KJMLH5IIA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:40544->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011059157 (269h43m37.607830234s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:40700->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011176795 (269h43m37.607947854s) [noise=true , address=89.149.201.147:4017 , piece_id=MLHQBR2AKMTWBP6YBLWJLR6HYQ56PJ7XQE2NZBLEH55J7AFOCYRA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:41696->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011287689 (269h43m37.608058742s) [noise=true , address=89.149.201.147:4012 , piece_id=VAFVNMYSGEDV2OZOG3A2EJ3W6MALMSG52TYKRC4Q5O3PUVA5GUOA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:53144->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011327167 (269h43m37.608098192s) [seg_pos={0 0}, upload=302129]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 16:43:40.117340588 (269h43m37.714111625s) [upload=302129]: Done uploading segments...
Mar 17 16:43:40.117394929 (269h43m37.71416596s) [upload=302129]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.561349416s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..................................X.......X..X..............] duration:
2.724146878s trace:
https://jaeger.dev.storj.io/trace/6ebfed838a41a5eb
FAIL (2026-03-17 16:53:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
MJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392058338 (269h42m37.988829374s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392724484 (269h42m37.989495516s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.393432860 (269h42m37.9902039s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394092212 (269h42m37.990863247s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394733387 (269h42m37.991504423s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.395463263 (269h42m37.9922343s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396139432 (269h42m37.992910466s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396884379 (269h42m37.993655418s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.398682006 (269h42m37.995453039s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.400897852 (269h42m37.997668887s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.821970525 (269h42m38.418741537s) [upload=302129]: Next returned nil segment
Mar 17 16:42:40.821986224 (269h42m38.418757258s) [upload=302129]: Waiting for error group managing segments...
Mar 17 16:42:40.996653929 (269h42m38.593424952s) [noise=true , address=81.171.14.70:4038 , piece_id=ZUXGIUNXLWLHE6PMX5KCXRM4PBIUNM5AT6DZAUSFFYZ2DEI4KL5Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.003601462 (269h42m38.600372495s) [noise=true , address=81.171.14.70:4045 , piece_id=6JKCYRHZCYRDSWYEIAWG5OUHKL2P2E2CDM6KBQYQXGVQKSG6NYVQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.010004600 (269h42m38.606775647s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.018269893 (269h42m38.61504092s) [noise=true , address=81.171.14.70:4046 , piece_id=EAWDP4WZNH7GJXX2G6IKN74UNYPBFIQLI6NHXKWCTWPNKM5AXYYA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.024071917 (269h42m38.620842943s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037624639 (269h42m38.634395666s) [noise=true , address=185.167.204.206:4059 , piece_id=E6IZDHGOVLXGAMLEQNLF6UDARURB7DDIKLMDHPIUCIUNQX6YVILQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037976797 (269h42m38.634747827s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.038407400 (269h42m38.635178431s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.044987716 (269h42m38.641758746s) [noise=true , address=185.167.204.206:4063 , piece_id=RBGHCD3HZY7J6VAOY74GOWAV4CAVGZBUWPKOH5NJJYZBXPVKC5HQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.045303382 (269h42m38.642074405s) [noise=true , address=89.149.201.147:4004 , piece_id=7D6RAHH5C45I25GOS5Z5P75SBMUEKCLPS6M6HFA47JVWO5SYM52A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.056865781 (269h42m38.653636794s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.061270392 (269h42m38.658041409s) [noise=true , address=185.167.204.205:4019 , piece_id=VZUK5XVJA3SNS63P6QSRPCK6S75ZJIE6TKAT3K4GZTBYHGM7B3XA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.066617838 (269h42m38.663388851s) [noise=true , address=81.171.14.70:4039 , piece_id=F5DUJKSELLLGEH27NSDLCBNX2RNLXSNCE3BMHEILFW62XXJAVJYQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.067673458 (269h42m38.66444448s) [noise=true , address=185.167.204.206:4065 , piece_id=CV3DTUMJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.074294195 (269h42m38.671065218s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.075141755 (269h42m38.67191278s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.115557153 (269h42m38.712328179s) [noise=true , address=185.167.204.206:4060 , piece_id=KADK4I6S4JNOWTBFYXUEQP4BOVELYZPU24AR5EZ2NZH2NWB6KAXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.128083741 (269h42m38.724854768s) [noise=true , address=185.167.204.206:4047 , piece_id=UOCR26GUYH47LWE5DXBL6DJ2TI6M7VT4GKZXIMLMYE5MQWJ3ADHQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.139427613 (269h42m38.736198637s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.155192302 (269h42m38.75196333s) [noise=true , address=185.167.204.206:4055 , piece_id=2YKJTY6D75FOVH5WMJR7CRTCILA5JGEQDTYPYHLA5AAIOQ6XZBUA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.716042252 (269h42m39.312813272s) [noise=true , address=185.167.204.205:4031 , piece_id=VFZ5ZCKA5GIFPOKDUTYCTK6CIYPDGTHXQXIJWCICY3ELZPRTLLXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.751904742 (269h42m39.34867577s) [noise=true , address=185.167.204.205:4032 , piece_id=Z7ELO5PGCCZEGLHS732V6MP45KYKVFSAMOBLGGOCXEC7TBA36XNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:42.653599013 (269h42m40.250370044s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:44.211379782 (269h42m41.808150806s) [noise=true , address=185.167.204.206:4049 , piece_id=DKZ3ZEE55DLHXQJX7EGKFKSXNGE6IPY2LEL2PVMJC7RBQBNGY4EA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:43:40.010864156 (269h43m37.607635205s) [noise=true , address=89.149.201.147:4008 , piece_id=4MJDYSTBC2MHUA35OYQXOWQT7YXEG34SRFANPCQU7K6KJMLH5IIA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:40544->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011059157 (269h43m37.607830234s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:40700->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011176795 (269h43m37.607947854s) [noise=true , address=89.149.201.147:4017 , piece_id=MLHQBR2AKMTWBP6YBLWJLR6HYQ56PJ7XQE2NZBLEH55J7AFOCYRA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:41696->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011287689 (269h43m37.608058742s) [noise=true , address=89.149.201.147:4012 , piece_id=VAFVNMYSGEDV2OZOG3A2EJ3W6MALMSG52TYKRC4Q5O3PUVA5GUOA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:53144->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011327167 (269h43m37.608098192s) [seg_pos={0 0}, upload=302129]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 16:43:40.117340588 (269h43m37.714111625s) [upload=302129]: Done uploading segments...
Mar 17 16:43:40.117394929 (269h43m37.71416596s) [upload=302129]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.724164741s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...................................X.......X..X.............] duration:
2.840374709s trace:
https://jaeger.dev.storj.io/trace/6ebfed838a41a5eb
FAIL (2026-03-17 16:53:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
MJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392058338 (269h42m37.988829374s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392724484 (269h42m37.989495516s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.393432860 (269h42m37.9902039s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394092212 (269h42m37.990863247s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394733387 (269h42m37.991504423s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.395463263 (269h42m37.9922343s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396139432 (269h42m37.992910466s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396884379 (269h42m37.993655418s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.398682006 (269h42m37.995453039s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.400897852 (269h42m37.997668887s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.821970525 (269h42m38.418741537s) [upload=302129]: Next returned nil segment
Mar 17 16:42:40.821986224 (269h42m38.418757258s) [upload=302129]: Waiting for error group managing segments...
Mar 17 16:42:40.996653929 (269h42m38.593424952s) [noise=true , address=81.171.14.70:4038 , piece_id=ZUXGIUNXLWLHE6PMX5KCXRM4PBIUNM5AT6DZAUSFFYZ2DEI4KL5Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.003601462 (269h42m38.600372495s) [noise=true , address=81.171.14.70:4045 , piece_id=6JKCYRHZCYRDSWYEIAWG5OUHKL2P2E2CDM6KBQYQXGVQKSG6NYVQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.010004600 (269h42m38.606775647s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.018269893 (269h42m38.61504092s) [noise=true , address=81.171.14.70:4046 , piece_id=EAWDP4WZNH7GJXX2G6IKN74UNYPBFIQLI6NHXKWCTWPNKM5AXYYA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.024071917 (269h42m38.620842943s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037624639 (269h42m38.634395666s) [noise=true , address=185.167.204.206:4059 , piece_id=E6IZDHGOVLXGAMLEQNLF6UDARURB7DDIKLMDHPIUCIUNQX6YVILQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037976797 (269h42m38.634747827s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.038407400 (269h42m38.635178431s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.044987716 (269h42m38.641758746s) [noise=true , address=185.167.204.206:4063 , piece_id=RBGHCD3HZY7J6VAOY74GOWAV4CAVGZBUWPKOH5NJJYZBXPVKC5HQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.045303382 (269h42m38.642074405s) [noise=true , address=89.149.201.147:4004 , piece_id=7D6RAHH5C45I25GOS5Z5P75SBMUEKCLPS6M6HFA47JVWO5SYM52A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.056865781 (269h42m38.653636794s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.061270392 (269h42m38.658041409s) [noise=true , address=185.167.204.205:4019 , piece_id=VZUK5XVJA3SNS63P6QSRPCK6S75ZJIE6TKAT3K4GZTBYHGM7B3XA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.066617838 (269h42m38.663388851s) [noise=true , address=81.171.14.70:4039 , piece_id=F5DUJKSELLLGEH27NSDLCBNX2RNLXSNCE3BMHEILFW62XXJAVJYQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.067673458 (269h42m38.66444448s) [noise=true , address=185.167.204.206:4065 , piece_id=CV3DTUMJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.074294195 (269h42m38.671065218s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.075141755 (269h42m38.67191278s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.115557153 (269h42m38.712328179s) [noise=true , address=185.167.204.206:4060 , piece_id=KADK4I6S4JNOWTBFYXUEQP4BOVELYZPU24AR5EZ2NZH2NWB6KAXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.128083741 (269h42m38.724854768s) [noise=true , address=185.167.204.206:4047 , piece_id=UOCR26GUYH47LWE5DXBL6DJ2TI6M7VT4GKZXIMLMYE5MQWJ3ADHQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.139427613 (269h42m38.736198637s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.155192302 (269h42m38.75196333s) [noise=true , address=185.167.204.206:4055 , piece_id=2YKJTY6D75FOVH5WMJR7CRTCILA5JGEQDTYPYHLA5AAIOQ6XZBUA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.716042252 (269h42m39.312813272s) [noise=true , address=185.167.204.205:4031 , piece_id=VFZ5ZCKA5GIFPOKDUTYCTK6CIYPDGTHXQXIJWCICY3ELZPRTLLXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.751904742 (269h42m39.34867577s) [noise=true , address=185.167.204.205:4032 , piece_id=Z7ELO5PGCCZEGLHS732V6MP45KYKVFSAMOBLGGOCXEC7TBA36XNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:42.653599013 (269h42m40.250370044s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:44.211379782 (269h42m41.808150806s) [noise=true , address=185.167.204.206:4049 , piece_id=DKZ3ZEE55DLHXQJX7EGKFKSXNGE6IPY2LEL2PVMJC7RBQBNGY4EA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:43:40.010864156 (269h43m37.607635205s) [noise=true , address=89.149.201.147:4008 , piece_id=4MJDYSTBC2MHUA35OYQXOWQT7YXEG34SRFANPCQU7K6KJMLH5IIA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:40544->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011059157 (269h43m37.607830234s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:40700->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011176795 (269h43m37.607947854s) [noise=true , address=89.149.201.147:4017 , piece_id=MLHQBR2AKMTWBP6YBLWJLR6HYQ56PJ7XQE2NZBLEH55J7AFOCYRA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:41696->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011287689 (269h43m37.608058742s) [noise=true , address=89.149.201.147:4012 , piece_id=VAFVNMYSGEDV2OZOG3A2EJ3W6MALMSG52TYKRC4Q5O3PUVA5GUOA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:53144->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011327167 (269h43m37.608098192s) [seg_pos={0 0}, upload=302129]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 16:43:40.117340588 (269h43m37.714111625s) [upload=302129]: Done uploading segments...
Mar 17 16:43:40.117394929 (269h43m37.71416596s) [upload=302129]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.8404078s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [....................................X.......X..X............] duration:
2.877448103s trace:
https://jaeger.dev.storj.io/trace/6ebfed838a41a5eb
FAIL (2026-03-17 16:52:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
MJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392058338 (269h42m37.988829374s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392724484 (269h42m37.989495516s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.393432860 (269h42m37.9902039s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394092212 (269h42m37.990863247s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394733387 (269h42m37.991504423s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.395463263 (269h42m37.9922343s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396139432 (269h42m37.992910466s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396884379 (269h42m37.993655418s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.398682006 (269h42m37.995453039s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.400897852 (269h42m37.997668887s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.821970525 (269h42m38.418741537s) [upload=302129]: Next returned nil segment
Mar 17 16:42:40.821986224 (269h42m38.418757258s) [upload=302129]: Waiting for error group managing segments...
Mar 17 16:42:40.996653929 (269h42m38.593424952s) [noise=true , address=81.171.14.70:4038 , piece_id=ZUXGIUNXLWLHE6PMX5KCXRM4PBIUNM5AT6DZAUSFFYZ2DEI4KL5Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.003601462 (269h42m38.600372495s) [noise=true , address=81.171.14.70:4045 , piece_id=6JKCYRHZCYRDSWYEIAWG5OUHKL2P2E2CDM6KBQYQXGVQKSG6NYVQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.010004600 (269h42m38.606775647s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.018269893 (269h42m38.61504092s) [noise=true , address=81.171.14.70:4046 , piece_id=EAWDP4WZNH7GJXX2G6IKN74UNYPBFIQLI6NHXKWCTWPNKM5AXYYA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.024071917 (269h42m38.620842943s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037624639 (269h42m38.634395666s) [noise=true , address=185.167.204.206:4059 , piece_id=E6IZDHGOVLXGAMLEQNLF6UDARURB7DDIKLMDHPIUCIUNQX6YVILQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037976797 (269h42m38.634747827s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.038407400 (269h42m38.635178431s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.044987716 (269h42m38.641758746s) [noise=true , address=185.167.204.206:4063 , piece_id=RBGHCD3HZY7J6VAOY74GOWAV4CAVGZBUWPKOH5NJJYZBXPVKC5HQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.045303382 (269h42m38.642074405s) [noise=true , address=89.149.201.147:4004 , piece_id=7D6RAHH5C45I25GOS5Z5P75SBMUEKCLPS6M6HFA47JVWO5SYM52A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.056865781 (269h42m38.653636794s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.061270392 (269h42m38.658041409s) [noise=true , address=185.167.204.205:4019 , piece_id=VZUK5XVJA3SNS63P6QSRPCK6S75ZJIE6TKAT3K4GZTBYHGM7B3XA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.066617838 (269h42m38.663388851s) [noise=true , address=81.171.14.70:4039 , piece_id=F5DUJKSELLLGEH27NSDLCBNX2RNLXSNCE3BMHEILFW62XXJAVJYQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.067673458 (269h42m38.66444448s) [noise=true , address=185.167.204.206:4065 , piece_id=CV3DTUMJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.074294195 (269h42m38.671065218s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.075141755 (269h42m38.67191278s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.115557153 (269h42m38.712328179s) [noise=true , address=185.167.204.206:4060 , piece_id=KADK4I6S4JNOWTBFYXUEQP4BOVELYZPU24AR5EZ2NZH2NWB6KAXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.128083741 (269h42m38.724854768s) [noise=true , address=185.167.204.206:4047 , piece_id=UOCR26GUYH47LWE5DXBL6DJ2TI6M7VT4GKZXIMLMYE5MQWJ3ADHQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.139427613 (269h42m38.736198637s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.155192302 (269h42m38.75196333s) [noise=true , address=185.167.204.206:4055 , piece_id=2YKJTY6D75FOVH5WMJR7CRTCILA5JGEQDTYPYHLA5AAIOQ6XZBUA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.716042252 (269h42m39.312813272s) [noise=true , address=185.167.204.205:4031 , piece_id=VFZ5ZCKA5GIFPOKDUTYCTK6CIYPDGTHXQXIJWCICY3ELZPRTLLXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.751904742 (269h42m39.34867577s) [noise=true , address=185.167.204.205:4032 , piece_id=Z7ELO5PGCCZEGLHS732V6MP45KYKVFSAMOBLGGOCXEC7TBA36XNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:42.653599013 (269h42m40.250370044s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:44.211379782 (269h42m41.808150806s) [noise=true , address=185.167.204.206:4049 , piece_id=DKZ3ZEE55DLHXQJX7EGKFKSXNGE6IPY2LEL2PVMJC7RBQBNGY4EA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:43:40.010864156 (269h43m37.607635205s) [noise=true , address=89.149.201.147:4008 , piece_id=4MJDYSTBC2MHUA35OYQXOWQT7YXEG34SRFANPCQU7K6KJMLH5IIA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:40544->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011059157 (269h43m37.607830234s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:40700->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011176795 (269h43m37.607947854s) [noise=true , address=89.149.201.147:4017 , piece_id=MLHQBR2AKMTWBP6YBLWJLR6HYQ56PJ7XQE2NZBLEH55J7AFOCYRA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:41696->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011287689 (269h43m37.608058742s) [noise=true , address=89.149.201.147:4012 , piece_id=VAFVNMYSGEDV2OZOG3A2EJ3W6MALMSG52TYKRC4Q5O3PUVA5GUOA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:53144->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011327167 (269h43m37.608098192s) [seg_pos={0 0}, upload=302129]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 16:43:40.117340588 (269h43m37.714111625s) [upload=302129]: Done uploading segments...
Mar 17 16:43:40.117394929 (269h43m37.71416596s) [upload=302129]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.877475938s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.....................................X.......X..X...........] duration:
6.046117873s trace:
https://jaeger.dev.storj.io/trace/6ebfed838a41a5eb
FAIL (2026-03-17 16:50:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
MJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392058338 (269h42m37.988829374s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392724484 (269h42m37.989495516s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.393432860 (269h42m37.9902039s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394092212 (269h42m37.990863247s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394733387 (269h42m37.991504423s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.395463263 (269h42m37.9922343s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396139432 (269h42m37.992910466s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396884379 (269h42m37.993655418s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.398682006 (269h42m37.995453039s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.400897852 (269h42m37.997668887s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.821970525 (269h42m38.418741537s) [upload=302129]: Next returned nil segment
Mar 17 16:42:40.821986224 (269h42m38.418757258s) [upload=302129]: Waiting for error group managing segments...
Mar 17 16:42:40.996653929 (269h42m38.593424952s) [noise=true , address=81.171.14.70:4038 , piece_id=ZUXGIUNXLWLHE6PMX5KCXRM4PBIUNM5AT6DZAUSFFYZ2DEI4KL5Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.003601462 (269h42m38.600372495s) [noise=true , address=81.171.14.70:4045 , piece_id=6JKCYRHZCYRDSWYEIAWG5OUHKL2P2E2CDM6KBQYQXGVQKSG6NYVQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.010004600 (269h42m38.606775647s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.018269893 (269h42m38.61504092s) [noise=true , address=81.171.14.70:4046 , piece_id=EAWDP4WZNH7GJXX2G6IKN74UNYPBFIQLI6NHXKWCTWPNKM5AXYYA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.024071917 (269h42m38.620842943s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037624639 (269h42m38.634395666s) [noise=true , address=185.167.204.206:4059 , piece_id=E6IZDHGOVLXGAMLEQNLF6UDARURB7DDIKLMDHPIUCIUNQX6YVILQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037976797 (269h42m38.634747827s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.038407400 (269h42m38.635178431s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.044987716 (269h42m38.641758746s) [noise=true , address=185.167.204.206:4063 , piece_id=RBGHCD3HZY7J6VAOY74GOWAV4CAVGZBUWPKOH5NJJYZBXPVKC5HQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.045303382 (269h42m38.642074405s) [noise=true , address=89.149.201.147:4004 , piece_id=7D6RAHH5C45I25GOS5Z5P75SBMUEKCLPS6M6HFA47JVWO5SYM52A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.056865781 (269h42m38.653636794s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.061270392 (269h42m38.658041409s) [noise=true , address=185.167.204.205:4019 , piece_id=VZUK5XVJA3SNS63P6QSRPCK6S75ZJIE6TKAT3K4GZTBYHGM7B3XA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.066617838 (269h42m38.663388851s) [noise=true , address=81.171.14.70:4039 , piece_id=F5DUJKSELLLGEH27NSDLCBNX2RNLXSNCE3BMHEILFW62XXJAVJYQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.067673458 (269h42m38.66444448s) [noise=true , address=185.167.204.206:4065 , piece_id=CV3DTUMJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.074294195 (269h42m38.671065218s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.075141755 (269h42m38.67191278s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.115557153 (269h42m38.712328179s) [noise=true , address=185.167.204.206:4060 , piece_id=KADK4I6S4JNOWTBFYXUEQP4BOVELYZPU24AR5EZ2NZH2NWB6KAXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.128083741 (269h42m38.724854768s) [noise=true , address=185.167.204.206:4047 , piece_id=UOCR26GUYH47LWE5DXBL6DJ2TI6M7VT4GKZXIMLMYE5MQWJ3ADHQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.139427613 (269h42m38.736198637s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.155192302 (269h42m38.75196333s) [noise=true , address=185.167.204.206:4055 , piece_id=2YKJTY6D75FOVH5WMJR7CRTCILA5JGEQDTYPYHLA5AAIOQ6XZBUA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.716042252 (269h42m39.312813272s) [noise=true , address=185.167.204.205:4031 , piece_id=VFZ5ZCKA5GIFPOKDUTYCTK6CIYPDGTHXQXIJWCICY3ELZPRTLLXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.751904742 (269h42m39.34867577s) [noise=true , address=185.167.204.205:4032 , piece_id=Z7ELO5PGCCZEGLHS732V6MP45KYKVFSAMOBLGGOCXEC7TBA36XNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:42.653599013 (269h42m40.250370044s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:44.211379782 (269h42m41.808150806s) [noise=true , address=185.167.204.206:4049 , piece_id=DKZ3ZEE55DLHXQJX7EGKFKSXNGE6IPY2LEL2PVMJC7RBQBNGY4EA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:43:40.010864156 (269h43m37.607635205s) [noise=true , address=89.149.201.147:4008 , piece_id=4MJDYSTBC2MHUA35OYQXOWQT7YXEG34SRFANPCQU7K6KJMLH5IIA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:40544->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011059157 (269h43m37.607830234s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:40700->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011176795 (269h43m37.607947854s) [noise=true , address=89.149.201.147:4017 , piece_id=MLHQBR2AKMTWBP6YBLWJLR6HYQ56PJ7XQE2NZBLEH55J7AFOCYRA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:41696->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011287689 (269h43m37.608058742s) [noise=true , address=89.149.201.147:4012 , piece_id=VAFVNMYSGEDV2OZOG3A2EJ3W6MALMSG52TYKRC4Q5O3PUVA5GUOA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:53144->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011327167 (269h43m37.608098192s) [seg_pos={0 0}, upload=302129]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 16:43:40.117340588 (269h43m37.714111625s) [upload=302129]: Done uploading segments...
Mar 17 16:43:40.117394929 (269h43m37.71416596s) [upload=302129]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 6.046220652s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [......................................X.......X..X..........] duration:
3.082998683s trace:
https://jaeger.dev.storj.io/trace/6ebfed838a41a5eb
FAIL (2026-03-17 16:50:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
MJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392058338 (269h42m37.988829374s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392724484 (269h42m37.989495516s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.393432860 (269h42m37.9902039s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394092212 (269h42m37.990863247s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394733387 (269h42m37.991504423s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.395463263 (269h42m37.9922343s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396139432 (269h42m37.992910466s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396884379 (269h42m37.993655418s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.398682006 (269h42m37.995453039s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.400897852 (269h42m37.997668887s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.821970525 (269h42m38.418741537s) [upload=302129]: Next returned nil segment
Mar 17 16:42:40.821986224 (269h42m38.418757258s) [upload=302129]: Waiting for error group managing segments...
Mar 17 16:42:40.996653929 (269h42m38.593424952s) [noise=true , address=81.171.14.70:4038 , piece_id=ZUXGIUNXLWLHE6PMX5KCXRM4PBIUNM5AT6DZAUSFFYZ2DEI4KL5Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.003601462 (269h42m38.600372495s) [noise=true , address=81.171.14.70:4045 , piece_id=6JKCYRHZCYRDSWYEIAWG5OUHKL2P2E2CDM6KBQYQXGVQKSG6NYVQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.010004600 (269h42m38.606775647s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.018269893 (269h42m38.61504092s) [noise=true , address=81.171.14.70:4046 , piece_id=EAWDP4WZNH7GJXX2G6IKN74UNYPBFIQLI6NHXKWCTWPNKM5AXYYA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.024071917 (269h42m38.620842943s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037624639 (269h42m38.634395666s) [noise=true , address=185.167.204.206:4059 , piece_id=E6IZDHGOVLXGAMLEQNLF6UDARURB7DDIKLMDHPIUCIUNQX6YVILQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037976797 (269h42m38.634747827s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.038407400 (269h42m38.635178431s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.044987716 (269h42m38.641758746s) [noise=true , address=185.167.204.206:4063 , piece_id=RBGHCD3HZY7J6VAOY74GOWAV4CAVGZBUWPKOH5NJJYZBXPVKC5HQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.045303382 (269h42m38.642074405s) [noise=true , address=89.149.201.147:4004 , piece_id=7D6RAHH5C45I25GOS5Z5P75SBMUEKCLPS6M6HFA47JVWO5SYM52A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.056865781 (269h42m38.653636794s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.061270392 (269h42m38.658041409s) [noise=true , address=185.167.204.205:4019 , piece_id=VZUK5XVJA3SNS63P6QSRPCK6S75ZJIE6TKAT3K4GZTBYHGM7B3XA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.066617838 (269h42m38.663388851s) [noise=true , address=81.171.14.70:4039 , piece_id=F5DUJKSELLLGEH27NSDLCBNX2RNLXSNCE3BMHEILFW62XXJAVJYQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.067673458 (269h42m38.66444448s) [noise=true , address=185.167.204.206:4065 , piece_id=CV3DTUMJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.074294195 (269h42m38.671065218s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.075141755 (269h42m38.67191278s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.115557153 (269h42m38.712328179s) [noise=true , address=185.167.204.206:4060 , piece_id=KADK4I6S4JNOWTBFYXUEQP4BOVELYZPU24AR5EZ2NZH2NWB6KAXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.128083741 (269h42m38.724854768s) [noise=true , address=185.167.204.206:4047 , piece_id=UOCR26GUYH47LWE5DXBL6DJ2TI6M7VT4GKZXIMLMYE5MQWJ3ADHQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.139427613 (269h42m38.736198637s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.155192302 (269h42m38.75196333s) [noise=true , address=185.167.204.206:4055 , piece_id=2YKJTY6D75FOVH5WMJR7CRTCILA5JGEQDTYPYHLA5AAIOQ6XZBUA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.716042252 (269h42m39.312813272s) [noise=true , address=185.167.204.205:4031 , piece_id=VFZ5ZCKA5GIFPOKDUTYCTK6CIYPDGTHXQXIJWCICY3ELZPRTLLXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.751904742 (269h42m39.34867577s) [noise=true , address=185.167.204.205:4032 , piece_id=Z7ELO5PGCCZEGLHS732V6MP45KYKVFSAMOBLGGOCXEC7TBA36XNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:42.653599013 (269h42m40.250370044s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:44.211379782 (269h42m41.808150806s) [noise=true , address=185.167.204.206:4049 , piece_id=DKZ3ZEE55DLHXQJX7EGKFKSXNGE6IPY2LEL2PVMJC7RBQBNGY4EA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:43:40.010864156 (269h43m37.607635205s) [noise=true , address=89.149.201.147:4008 , piece_id=4MJDYSTBC2MHUA35OYQXOWQT7YXEG34SRFANPCQU7K6KJMLH5IIA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:40544->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011059157 (269h43m37.607830234s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:40700->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011176795 (269h43m37.607947854s) [noise=true , address=89.149.201.147:4017 , piece_id=MLHQBR2AKMTWBP6YBLWJLR6HYQ56PJ7XQE2NZBLEH55J7AFOCYRA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:41696->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011287689 (269h43m37.608058742s) [noise=true , address=89.149.201.147:4012 , piece_id=VAFVNMYSGEDV2OZOG3A2EJ3W6MALMSG52TYKRC4Q5O3PUVA5GUOA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:53144->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011327167 (269h43m37.608098192s) [seg_pos={0 0}, upload=302129]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 16:43:40.117340588 (269h43m37.714111625s) [upload=302129]: Done uploading segments...
Mar 17 16:43:40.117394929 (269h43m37.71416596s) [upload=302129]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.083030202s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.......................................X.......X..X.........] duration:
2.609011663s trace:
https://jaeger.dev.storj.io/trace/6ebfed838a41a5eb
FAIL (2026-03-17 16:49:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
MJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392058338 (269h42m37.988829374s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392724484 (269h42m37.989495516s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.393432860 (269h42m37.9902039s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394092212 (269h42m37.990863247s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394733387 (269h42m37.991504423s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.395463263 (269h42m37.9922343s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396139432 (269h42m37.992910466s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396884379 (269h42m37.993655418s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.398682006 (269h42m37.995453039s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.400897852 (269h42m37.997668887s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.821970525 (269h42m38.418741537s) [upload=302129]: Next returned nil segment
Mar 17 16:42:40.821986224 (269h42m38.418757258s) [upload=302129]: Waiting for error group managing segments...
Mar 17 16:42:40.996653929 (269h42m38.593424952s) [noise=true , address=81.171.14.70:4038 , piece_id=ZUXGIUNXLWLHE6PMX5KCXRM4PBIUNM5AT6DZAUSFFYZ2DEI4KL5Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.003601462 (269h42m38.600372495s) [noise=true , address=81.171.14.70:4045 , piece_id=6JKCYRHZCYRDSWYEIAWG5OUHKL2P2E2CDM6KBQYQXGVQKSG6NYVQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.010004600 (269h42m38.606775647s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.018269893 (269h42m38.61504092s) [noise=true , address=81.171.14.70:4046 , piece_id=EAWDP4WZNH7GJXX2G6IKN74UNYPBFIQLI6NHXKWCTWPNKM5AXYYA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.024071917 (269h42m38.620842943s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037624639 (269h42m38.634395666s) [noise=true , address=185.167.204.206:4059 , piece_id=E6IZDHGOVLXGAMLEQNLF6UDARURB7DDIKLMDHPIUCIUNQX6YVILQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037976797 (269h42m38.634747827s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.038407400 (269h42m38.635178431s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.044987716 (269h42m38.641758746s) [noise=true , address=185.167.204.206:4063 , piece_id=RBGHCD3HZY7J6VAOY74GOWAV4CAVGZBUWPKOH5NJJYZBXPVKC5HQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.045303382 (269h42m38.642074405s) [noise=true , address=89.149.201.147:4004 , piece_id=7D6RAHH5C45I25GOS5Z5P75SBMUEKCLPS6M6HFA47JVWO5SYM52A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.056865781 (269h42m38.653636794s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.061270392 (269h42m38.658041409s) [noise=true , address=185.167.204.205:4019 , piece_id=VZUK5XVJA3SNS63P6QSRPCK6S75ZJIE6TKAT3K4GZTBYHGM7B3XA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.066617838 (269h42m38.663388851s) [noise=true , address=81.171.14.70:4039 , piece_id=F5DUJKSELLLGEH27NSDLCBNX2RNLXSNCE3BMHEILFW62XXJAVJYQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.067673458 (269h42m38.66444448s) [noise=true , address=185.167.204.206:4065 , piece_id=CV3DTUMJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.074294195 (269h42m38.671065218s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.075141755 (269h42m38.67191278s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.115557153 (269h42m38.712328179s) [noise=true , address=185.167.204.206:4060 , piece_id=KADK4I6S4JNOWTBFYXUEQP4BOVELYZPU24AR5EZ2NZH2NWB6KAXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.128083741 (269h42m38.724854768s) [noise=true , address=185.167.204.206:4047 , piece_id=UOCR26GUYH47LWE5DXBL6DJ2TI6M7VT4GKZXIMLMYE5MQWJ3ADHQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.139427613 (269h42m38.736198637s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.155192302 (269h42m38.75196333s) [noise=true , address=185.167.204.206:4055 , piece_id=2YKJTY6D75FOVH5WMJR7CRTCILA5JGEQDTYPYHLA5AAIOQ6XZBUA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.716042252 (269h42m39.312813272s) [noise=true , address=185.167.204.205:4031 , piece_id=VFZ5ZCKA5GIFPOKDUTYCTK6CIYPDGTHXQXIJWCICY3ELZPRTLLXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.751904742 (269h42m39.34867577s) [noise=true , address=185.167.204.205:4032 , piece_id=Z7ELO5PGCCZEGLHS732V6MP45KYKVFSAMOBLGGOCXEC7TBA36XNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:42.653599013 (269h42m40.250370044s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:44.211379782 (269h42m41.808150806s) [noise=true , address=185.167.204.206:4049 , piece_id=DKZ3ZEE55DLHXQJX7EGKFKSXNGE6IPY2LEL2PVMJC7RBQBNGY4EA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:43:40.010864156 (269h43m37.607635205s) [noise=true , address=89.149.201.147:4008 , piece_id=4MJDYSTBC2MHUA35OYQXOWQT7YXEG34SRFANPCQU7K6KJMLH5IIA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:40544->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011059157 (269h43m37.607830234s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:40700->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011176795 (269h43m37.607947854s) [noise=true , address=89.149.201.147:4017 , piece_id=MLHQBR2AKMTWBP6YBLWJLR6HYQ56PJ7XQE2NZBLEH55J7AFOCYRA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:41696->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011287689 (269h43m37.608058742s) [noise=true , address=89.149.201.147:4012 , piece_id=VAFVNMYSGEDV2OZOG3A2EJ3W6MALMSG52TYKRC4Q5O3PUVA5GUOA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:53144->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011327167 (269h43m37.608098192s) [seg_pos={0 0}, upload=302129]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 16:43:40.117340588 (269h43m37.714111625s) [upload=302129]: Done uploading segments...
Mar 17 16:43:40.117394929 (269h43m37.71416596s) [upload=302129]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.609055483s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [........................................X.......X..X........] duration:
12.169717045s trace:
https://jaeger.dev.storj.io/trace/6ebfed838a41a5eb
FAIL (2026-03-17 16:48:33 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
MJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392058338 (269h42m37.988829374s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.392724484 (269h42m37.989495516s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.393432860 (269h42m37.9902039s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394092212 (269h42m37.990863247s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.394733387 (269h42m37.991504423s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.395463263 (269h42m37.9922343s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396139432 (269h42m37.992910466s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.396884379 (269h42m37.993655418s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.398682006 (269h42m37.995453039s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.400897852 (269h42m37.997668887s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Uploading piece...
Mar 17 16:42:40.821970525 (269h42m38.418741537s) [upload=302129]: Next returned nil segment
Mar 17 16:42:40.821986224 (269h42m38.418757258s) [upload=302129]: Waiting for error group managing segments...
Mar 17 16:42:40.996653929 (269h42m38.593424952s) [noise=true , address=81.171.14.70:4038 , piece_id=ZUXGIUNXLWLHE6PMX5KCXRM4PBIUNM5AT6DZAUSFFYZ2DEI4KL5Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.003601462 (269h42m38.600372495s) [noise=true , address=81.171.14.70:4045 , piece_id=6JKCYRHZCYRDSWYEIAWG5OUHKL2P2E2CDM6KBQYQXGVQKSG6NYVQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.010004600 (269h42m38.606775647s) [noise=true , address=81.171.14.70:4037 , piece_id=2BBQCIK4W626NUSWE47GGBCFRMRGXVWC5TVCT3DD3MFVQEX52Q7Q, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.018269893 (269h42m38.61504092s) [noise=true , address=81.171.14.70:4046 , piece_id=EAWDP4WZNH7GJXX2G6IKN74UNYPBFIQLI6NHXKWCTWPNKM5AXYYA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.024071917 (269h42m38.620842943s) [noise=true , address=81.171.14.70:4025 , piece_id=JHC4ACEB5N5RCCQOJSKDM3DM2PMYK5G4LDUH6SIQKBNN3CC5XV5A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037624639 (269h42m38.634395666s) [noise=true , address=185.167.204.206:4059 , piece_id=E6IZDHGOVLXGAMLEQNLF6UDARURB7DDIKLMDHPIUCIUNQX6YVILQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.037976797 (269h42m38.634747827s) [noise=true , address=81.171.14.70:4036 , piece_id=46IWFSEHG6MYNQMV22RRW3YWBR5WA7BSG6L5KKKSPTIIPQ72PJTQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.038407400 (269h42m38.635178431s) [noise=true , address=185.167.204.205:4034 , piece_id=C476B7ZSQF3BYABN3K5PHCAMETX4KOXGAYET3FMKS6IFX6RUORZA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.044987716 (269h42m38.641758746s) [noise=true , address=185.167.204.206:4063 , piece_id=RBGHCD3HZY7J6VAOY74GOWAV4CAVGZBUWPKOH5NJJYZBXPVKC5HQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.045303382 (269h42m38.642074405s) [noise=true , address=89.149.201.147:4004 , piece_id=7D6RAHH5C45I25GOS5Z5P75SBMUEKCLPS6M6HFA47JVWO5SYM52A, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.056865781 (269h42m38.653636794s) [noise=true , address=89.149.201.147:4003 , piece_id=NCESZKZSSUSVJQ6QIV2ZUZAYNJLW52UKRNB4MVC5SWBIYUICBRNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.061270392 (269h42m38.658041409s) [noise=true , address=185.167.204.205:4019 , piece_id=VZUK5XVJA3SNS63P6QSRPCK6S75ZJIE6TKAT3K4GZTBYHGM7B3XA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.066617838 (269h42m38.663388851s) [noise=true , address=81.171.14.70:4039 , piece_id=F5DUJKSELLLGEH27NSDLCBNX2RNLXSNCE3BMHEILFW62XXJAVJYQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.067673458 (269h42m38.66444448s) [noise=true , address=185.167.204.206:4065 , piece_id=CV3DTUMJWFR2RPNPSVHVP5NCF3I22GCYJDVVQFEIUW7J3XYKVSFQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.074294195 (269h42m38.671065218s) [noise=true , address=185.167.204.205:4010 , piece_id=QZUK3X33ZT6XRA4CBZKHNYVZBX6DWOM7GXD3OKIJISLMK5V7UHPA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.075141755 (269h42m38.67191278s) [noise=true , address=185.167.204.206:4054 , piece_id=CRVUMPFSBVL3A3YZ7K2R63GMJDFJ74MK6MKK7KFIN5BZ7VACS4CQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.115557153 (269h42m38.712328179s) [noise=true , address=185.167.204.206:4060 , piece_id=KADK4I6S4JNOWTBFYXUEQP4BOVELYZPU24AR5EZ2NZH2NWB6KAXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.128083741 (269h42m38.724854768s) [noise=true , address=185.167.204.206:4047 , piece_id=UOCR26GUYH47LWE5DXBL6DJ2TI6M7VT4GKZXIMLMYE5MQWJ3ADHQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.139427613 (269h42m38.736198637s) [noise=true , address=185.167.204.206:4056 , piece_id=PA36B5PW4MYBKYKMZJTETPORYV5H4OOX3IZM3LLNBRK745GVN3LA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.155192302 (269h42m38.75196333s) [noise=true , address=185.167.204.206:4055 , piece_id=2YKJTY6D75FOVH5WMJR7CRTCILA5JGEQDTYPYHLA5AAIOQ6XZBUA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.716042252 (269h42m39.312813272s) [noise=true , address=185.167.204.205:4031 , piece_id=VFZ5ZCKA5GIFPOKDUTYCTK6CIYPDGTHXQXIJWCICY3ELZPRTLLXA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:41.751904742 (269h42m39.34867577s) [noise=true , address=185.167.204.205:4032 , piece_id=Z7ELO5PGCCZEGLHS732V6MP45KYKVFSAMOBLGGOCXEC7TBA36XNA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:42.653599013 (269h42m40.250370044s) [noise=true , address=185.167.204.205:4029 , piece_id=NMDPG4UZZ6JIKMOO5VL2TZ3HKF5BX56GHCKMQ3FFA527FKSCOLDQ, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:42:44.211379782 (269h42m41.808150806s) [noise=true , address=185.167.204.206:4049 , piece_id=DKZ3ZEE55DLHXQJX7EGKFKSXNGE6IPY2LEL2PVMJC7RBQBNGY4EA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: <nil>
Mar 17 16:43:40.010864156 (269h43m37.607635205s) [noise=true , address=89.149.201.147:4008 , piece_id=4MJDYSTBC2MHUA35OYQXOWQT7YXEG34SRFANPCQU7K6KJMLH5IIA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:40544->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011059157 (269h43m37.607830234s) [noise=true , address=89.149.201.147:4023 , piece_id=YHCSWH4KK7F3WYX7IDE3DRTU6WRFPUR5MDVXXAWSCRZSNHEF2WVA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:40700->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011176795 (269h43m37.607947854s) [noise=true , address=89.149.201.147:4017 , piece_id=MLHQBR2AKMTWBP6YBLWJLR6HYQ56PJ7XQE2NZBLEH55J7AFOCYRA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: read tcp 159.223.143.39:41696->89.149.201.147:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011287689 (269h43m37.608058742s) [noise=true , address=89.149.201.147:4012 , piece_id=VAFVNMYSGEDV2OZOG3A2EJ3W6MALMSG52TYKRC4Q5O3PUVA5GUOA, seg_pos={0 0}, upload=302129]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:53144->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 16:43:40.011327167 (269h43m37.608098192s) [seg_pos={0 0}, upload=302129]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 16:43:40.117340588 (269h43m37.714111625s) [upload=302129]: Done uploading segments...
Mar 17 16:43:40.117394929 (269h43m37.71416596s) [upload=302129]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 12.169740112s
core
uplink
eu-select-1
eu1-placement-15
|