Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [....X...................................X...................] duration:
4.996840727s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 18:07:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.996867244s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.....X...................................X..................] duration:
3.617412909s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 18:07:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.617447932s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [......X...................................X.................] duration:
3.49256872s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 18:06:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.492599066s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [X......X...................................X................] duration:
9.373294403s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 18:05:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 9.373325474s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.X......X...................................X...............] duration:
5.456531015s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 18:04:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 5.45655882s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..X......X...................................X..............] duration:
3.964366006s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 18:03:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 3.964390727s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...X......X...................................X.............] duration:
2.735682415s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 18:02:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.735707883s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [....X......X...................................X............] duration:
2.597064695s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 18:01:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.597096706s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [X....X......X...................................X...........] duration:
2.377837516s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 18:00:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.377866601s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.X....X......X...................................X..........] duration:
4.524006785s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 18:00:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.524074258s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..X....X......X...................................X.........] duration:
2.50141535s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 17:59:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.501509534s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...X....X......X...................................X........] duration:
2.183607238s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 17:58:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.183631992s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [....X....X......X...................................X.......] duration:
2.67128193s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 17:57:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.671308218s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.....X....X......X...................................X......] duration:
2.550077875s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 17:57:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.550109466s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [......X....X......X...................................X.....] duration:
2.644546537s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 17:56:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.644572054s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.......X....X......X...................................X....] duration:
11.171204825s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 17:55:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 11.171276575s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [........X....X......X...................................X...] duration:
5.394437996s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 17:55:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 5.394482783s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.........X....X......X...................................X..] duration:
2.738950411s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 17:54:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.738980757s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..........X....X......X...................................X.] duration:
2.544381118s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 17:53:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.544404869s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...........X....X......X...................................X] duration:
1m0.111078501s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 17:53:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 1m0.111095313s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [............X....X......X...................................] duration:
2.207164223s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:51:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.207189594s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.............X....X......X..................................] duration:
2.673633423s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:50:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.673670855s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..............X....X......X.................................] duration:
2.594502219s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:49:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.594532577s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...............X....X......X................................] duration:
2.584620843s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:48:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.584650314s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [................X....X......X...............................] duration:
2.115108999s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:47:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.115142802s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.................X....X......X..............................] duration:
2.506023996s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:46:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.506053029s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..................X....X......X.............................] duration:
2.595051068s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:45:33 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.595073294s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...................X....X......X............................] duration:
2.523186521s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:44:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.523208873s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [X...................X....X......X...........................] duration:
2.602205154s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:43:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.60222816s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.X...................X....X......X..........................] duration:
2.491022166s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:43:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.491097027s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..X...................X....X......X.........................] duration:
2.458510229s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:42:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.458531948s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...X...................X....X......X........................] duration:
2.540081204s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:41:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.540104797s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [....X...................X....X......X.......................] duration:
2.159732139s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:41:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.159756407s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.....X...................X....X......X......................] duration:
2.194181157s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:40:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.194203424s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [......X...................X....X......X.....................] duration:
2.480531438s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:39:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.480577488s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.......X...................X....X......X....................] duration:
2.516555089s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:39:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.516579761s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [........X...................X....X......X...................] duration:
2.599148411s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:38:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.599172792s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.........X...................X....X......X..................] duration:
2.591227926s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:38:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.591255473s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..........X...................X....X......X.................] duration:
2.480547694s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:37:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.480779523s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...........X...................X....X......X................] duration:
2.549051601s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:37:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.54908088s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [............X...................X....X......X...............] duration:
2.057923955s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:36:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.057947441s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.............X...................X....X......X..............] duration:
2.530133502s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:35:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.53015858s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..............X...................X....X......X.............] duration:
2.569682892s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:34:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.569705383s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...............X...................X....X......X............] duration:
2.540054104s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:33:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.540077555s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [................X...................X....X......X...........] duration:
2.513174569s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:32:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.51320047s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.................X...................X....X......X..........] duration:
2.644090844s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:32:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.644119544s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..................X...................X....X......X.........] duration:
2.588330267s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:31:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.588356087s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...................X...................X....X......X........] duration:
2.552086237s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:30:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.552120181s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [X...................X...................X....X......X.......] duration:
2.474647417s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:29:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.474673485s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [.X...................X...................X....X......X......] duration:
2.572786061s trace:
https://jaeger.dev.storj.io/trace/1a370bad5d4b83e3
FAIL (2026-03-17 17:29:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
6559313s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.951044650 (270h24m30.547815679s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.954052903 (270h24m30.550823936s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.957456660 (270h24m30.55422769s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.961248836 (270h24m30.558019868s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.964957510 (270h24m30.561728553s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.966731981 (270h24m30.563503011s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.970153737 (270h24m30.56692477s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.972502516 (270h24m30.56927355s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.981564292 (270h24m30.578335321s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:32.982928782 (270h24m30.579699806s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Uploading piece...
Mar 17 17:24:33.412486140 (270h24m31.009257164s) [upload=302908]: Next returned nil segment
Mar 17 17:24:33.412501796 (270h24m31.00927283s) [upload=302908]: Waiting for error group managing segments...
Mar 17 17:24:33.602441040 (270h24m31.199212069s) [noise=true , address=81.171.14.70:4025 , piece_id=Q5WQ55RF4LTDSTNLOEHOLKUEZ5AJTKFJ4ZVGGIV5L5BXKUZZSYUQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.614167888 (270h24m31.210938898s) [noise=true , address=81.171.14.70:4040 , piece_id=56VRWMM7GHD47HXRCT57WFWTCU3RISFBMBTHEUL2GEAUWCMV7UOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.617909995 (270h24m31.214681017s) [noise=true , address=185.167.204.205:4008 , piece_id=TNTJRD45IJTMIB6UYOAGGMIQDBM6EPAEPGHW5GUIHNSHWESH3EGA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.627791149 (270h24m31.224562159s) [noise=true , address=81.171.14.70:4029 , piece_id=FGX2XQS5ARNKCJ7RTJ4JLMMKVTTMZRXLISIDFVI7TRSYS5QRNBAA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632432520 (270h24m31.229203532s) [noise=true , address=185.167.204.206:4063 , piece_id=HBGNJIN3C7Q73EVS4JPRBTL6JV54B5XNFMDEKPNYJITGAPASPSEQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.632907119 (270h24m31.229678143s) [noise=true , address=185.167.204.205:4025 , piece_id=R3UOJI7LTIGGEMA7LTXUPEYUXFQKZGKIHDCHJSI4OAJPQ33XNMOA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.633548559 (270h24m31.230319572s) [noise=true , address=81.171.14.70:4037 , piece_id=RREEWSIQU5H5P6CO2DOD4BWZOICMICQA2BKCQBYA2UKKY5LAJNHQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.638113683 (270h24m31.234884706s) [noise=true , address=81.171.14.70:4030 , piece_id=A5667J7AO3DXMTQFA4JB56NSESXQH5CCFK2RC5NXLTIUFNWIOV4A, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.644429563 (270h24m31.241200587s) [noise=true , address=81.171.14.70:4044 , piece_id=DPQFIHRHEDMUJ5THNNNQVA6GNMMWP4UJSJO5PP363EEFPXQAWSRQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.649523432 (270h24m31.246294462s) [noise=true , address=89.149.201.147:4022 , piece_id=SNUWIUGE7ZT5LLYTYLW6DLE4XQZPAUO4AKN7QZWGUY3STW7C5ANA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.671439647 (270h24m31.268210671s) [noise=true , address=185.167.204.205:4013 , piece_id=FDSVXO5JTK5CTAIJL2WULPFL5YQAU5F6QSFICUH5WWB46EXDESMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.675110978 (270h24m31.271881987s) [noise=true , address=185.167.204.205:4010 , piece_id=FIHQEQBJJFA5VLO4UQ5QTVUR6QFVMMTIFP5LFITZJJKB27G232DQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.678607902 (270h24m31.275378925s) [noise=true , address=89.149.201.147:4014 , piece_id=IZO7TH7WPD565RJCC67PI74ILBZ4567AJRMTZMDLK575PK37FS4Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.688451600 (270h24m31.285222609s) [noise=true , address=185.167.204.206:4057 , piece_id=WN2EKUZNSQ2TB4OCGIMWDVYO7PL2VHP2I57L7DZER6ZZX2UJTRVA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.699655731 (270h24m31.296426766s) [noise=true , address=185.167.204.205:4034 , piece_id=QYKSOVAHJWVWKN2M3SVQVJY3NTNHWSYP6VOT5CIZBS6OERCJE74Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.714361451 (270h24m31.311132475s) [noise=true , address=185.167.204.206:4052 , piece_id=CKQE6AXGGA2N3DJTXZJNUACQBESJQ3BLSPCHKI6HPYWBUK4ZJXDQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:33.716872265 (270h24m31.313643289s) [noise=true , address=185.167.204.205:4001 , piece_id=NCGBSOV2GUVWRGRPAF3KGY265XXYM2OY627I6VJD6IYYCO636MXA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.099996944 (270h24m31.696767969s) [noise=true , address=89.149.201.147:4010 , piece_id=7WHKIGIVOBY5AI4HTMYFTZIOMDUI2C3TJROEJULJCJBVA3R2WTJA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101142545 (270h24m31.697913568s) [noise=true , address=81.171.14.70:4047 , piece_id=5KOAWRSWXC2OONCXICR6ULGLHU2DUHB323Q2EZPEQ72BNUI4VL2Q, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.101919060 (270h24m31.698690084s) [noise=true , address=81.171.14.70:4031 , piece_id=6YWD4VT5FGF6HHEGE3XIS3FMBSTNVYIW3IHO6L4AJHGDDEYEYNGQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.395964085 (270h24m31.992735109s) [noise=true , address=185.167.204.205:4005 , piece_id=JVB6LRCQOJBDWWDUCMBT7M23NQPHUYS2H7DOYCREJAXKRWWK42EQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:34.566450259 (270h24m32.163221297s) [noise=true , address=185.167.204.205:4002 , piece_id=DPMDFPID4HDWXCBOE3DNLQ3DKXZDGPYR3QXJAU43OAJDQO2KRPNQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:24:35.119140935 (270h24m32.71591196s) [noise=true , address=185.167.204.205:4035 , piece_id=OMO2VEMRZRKC6NXAHF4TK2PK4SQT3B6BCJSN6QEP7U62DPXODPIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:24.932156723 (270h25m22.528927733s) [noise=true , address=89.149.201.147:4017 , piece_id=FF5AJSJPM66C4LYACBSHLUS72RK6BTDO7OSOZOX2FIDKOK22MYYA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: <nil>
Mar 17 17:25:32.543880584 (270h25m30.140651616s) [noise=true , address=89.149.201.147:4018 , piece_id=I7NPK6XRTI5E6WTATWABYSJKAHOYNID3XUQK3ESJNCSU2IVG4AMA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: rpc: dial tcp 89.149.201.147:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544139803 (270h25m30.140910836s) [noise=true , address=89.149.201.147:4005 , piece_id=E2VMWO2RZDUAYCZ5KG63X43URQQ4WE4UYKTDPHNFIF7QBWQI5IZA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: rpc: dial tcp 89.149.201.147:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544447949 (270h25m30.141218976s) [noise=true , address=89.149.201.147:4011 , piece_id=D7FW56BLOCOPWE7WDOGMYPYOYNJLUOQLTWTYNJ4FKE62E2YW3FIQ, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: write tcp 159.223.143.39:43636->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544801071 (270h25m30.141572095s) [noise=true , address=89.149.201.147:4001 , piece_id=5HTEB7SZJXV2CCB5QCXD5CKOQ35VQWJY6PDFLQ7AW6DQJSG37ACA, seg_pos={0 0}, upload=302908]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:35094->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:25:32.544826745 (270h25m30.141597754s) [seg_pos={0 0}, upload=302908]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:25:32.646583114 (270h25m30.243354171s) [upload=302908]: Done uploading segments...
Mar 17 17:25:32.646623005 (270h25m30.243394081s) [upload=302908]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.572811417s
core
uplink
eu-select-1
eu1-placement-15
|