Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.265404334s FAIL (2025-07-02 17:19:01 UTC) orbiter warning: uplink: metaclient: manager closed: closed: read tcp 159.223.143.39:49282->34.150.199.48:7777: read: connection reset by peer Duration: 2.265450485s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 867.870564ms FAIL (2025-07-02 17:18:08 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 867.910311ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.257713675s FAIL (2025-07-02 17:17:57 UTC) orbiter warning: uplink: metaclient: manager closed: closed: read tcp 159.223.143.39:49282->34.150.199.48:7777: read: connection reset by peer Duration: 2.257744519s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 852.853523ms FAIL (2025-07-02 17:17:26 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 852.946469ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.281914837s FAIL (2025-07-02 17:17:16 UTC) orbiter warning: uplink: metaclient: manager closed: closed: read tcp 159.223.143.39:49282->34.150.199.48:7777: read: connection reset by peer Duration: 2.281963285s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 972.100492ms FAIL (2025-07-02 17:16:25 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 972.130143ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.178283362s FAIL (2025-07-02 17:16:05 UTC) orbiter warning: uplink: metaclient: manager closed: closed: read tcp 159.223.143.39:49282->34.150.199.48:7777: read: connection reset by peer Duration: 2.178328486s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 907.171077ms FAIL (2025-07-02 17:15:42 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 907.204202ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 647.107778ms FAIL (2025-07-02 17:15:00 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 647.135537ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1.095755906s FAIL (2025-07-02 17:14:53 UTC) orbiter warning: uplink: metaclient: manager closed: closed: read tcp 159.223.143.39:49282->34.150.199.48:7777: read: connection reset by peer Duration: 1.095788449s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 582.493619ms FAIL (2025-07-02 17:14:00 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 582.524059ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 504.215683ms FAIL (2025-07-02 17:13:36 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 504.262099ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 604.683939ms FAIL (2025-07-02 17:13:03 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 604.715973ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 408.032522ms FAIL (2025-07-02 17:11:53 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 408.05904ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 530.051718ms FAIL (2025-07-02 17:10:52 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 530.083127ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 516.584687ms FAIL (2025-07-02 17:10:14 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 516.678968ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 585.790623ms FAIL (2025-07-02 17:09:10 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 585.816469ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 559.435908ms FAIL (2025-07-02 17:08:30 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 559.506774ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 461.73554ms FAIL (2025-07-02 17:07:25 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 461.765556ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 454.286691ms FAIL (2025-07-02 17:07:09 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 454.31569ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 555.985764ms FAIL (2025-07-02 17:06:48 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 556.013023ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 488.533519ms FAIL (2025-07-02 17:05:58 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 488.566644ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 623.731715ms FAIL (2025-07-02 17:05:00 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 623.76635ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 453.871179ms FAIL (2025-07-02 17:04:31 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 453.89978ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 458.489883ms FAIL (2025-07-02 17:03:24 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 458.515701ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 467.744282ms FAIL (2025-07-02 17:02:14 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 467.779907ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 475.785293ms FAIL (2025-07-02 17:01:53 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 475.822974ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 500.262289ms FAIL (2025-07-02 17:01:03 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 500.356319ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 447.916586ms FAIL (2025-07-02 17:00:46 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 447.947569ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 897.898282ms FAIL (2025-07-02 17:00:20 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 897.93586ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 444.510312ms FAIL (2025-07-02 16:59:27 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 444.542971ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 468.294352ms FAIL (2025-07-02 16:58:56 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 468.320147ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 542.112975ms FAIL (2025-07-02 16:58:26 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 542.141216ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 449.870494ms FAIL (2025-07-02 16:57:54 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 449.900404ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 502.907888ms FAIL (2025-07-02 16:57:11 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 502.938648ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 398.241558ms FAIL (2025-07-02 16:56:43 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 398.273854ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 563.935721ms FAIL (2025-07-02 16:56:09 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 563.9708ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 486.129331ms FAIL (2025-07-02 16:55:42 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 486.165383ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 692.236012ms FAIL (2025-07-02 16:55:02 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 692.281914ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 727.042838ms FAIL (2025-07-02 16:54:26 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 727.087972ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 503.058289ms FAIL (2025-07-02 16:53:32 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== led; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF Jul 2 16:51:39.852164074 (223h40m6.778458767s) [noise=true , address=104.36.82.12:4150 , piece_id=QHXVON3LSBWYG5AWPVZ45KOTJJPUXIIAXGED7OHG65V5V3IJPULA, seg_pos={0 0}, upload=179153]: Done uploading piece. err: <nil> Jul 2 16:51:39.852220651 (223h40m6.778515346s) [seg_pos={0 0}, upload=179153]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 2 16:51:39.852324711 (223h40m6.778619405s) [upload=179153]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:51:39.852329895 (223h40m6.778624588s) [upload=179153]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:51:39.945155283 (223h40m6.871449972s) [upload=179153]: Done uploading segments... Jul 2 16:51:39.945173208 (223h40m6.871467885s) [upload=179153]: Upload finished. err: <nil> Jul 2 16:52:25.999553770 (223h40m52.925848461s) [upload=179165]: Starting upload Jul 2 16:52:25.999676452 (223h40m52.92597114s) [upload=179165]: Done starting upload Jul 2 16:52:25.999808777 (223h40m52.926103458s) [upload=179165]: Uploading segments... Jul 2 16:52:26.000049412 (223h40m52.926344119s) [upload=179165]: Got next segment. Inline: false Jul 2 16:52:26.000208665 (223h40m52.926503358s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 2 16:52:26.000216887 (223h40m52.926511587s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 2 16:52:26.029546629 (223h40m52.95584132s) [seg_pos={0 0}, upload=179165]: Begin upload segment... Jul 2 16:52:26.029596311 (223h40m52.955890985s) [seg_pos={0 0}, upload=179165]: Done begin upload segment. Jul 2 16:52:26.029630299 (223h40m52.955924986s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030073195 (223h40m52.956367894s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030398264 (223h40m52.956692955s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.030716003 (223h40m52.957010692s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031068785 (223h40m52.957363472s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031405588 (223h40m52.957700282s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.031730040 (223h40m52.958024715s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032049179 (223h40m52.958343866s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032432775 (223h40m52.958727467s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.032754164 (223h40m52.959048852s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033080515 (223h40m52.959375213s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033386908 (223h40m52.959681597s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.033709080 (223h40m52.960003768s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034030732 (223h40m52.96032542s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034335911 (223h40m52.960630599s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.034644696 (223h40m52.960939386s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Uploading piece... Jul 2 16:52:26.148244089 (223h40m53.074538765s) [upload=179165]: Next returned nil segment Jul 2 16:52:26.148268128 (223h40m53.074562811s) [upload=179165]: Waiting for error group managing segments... Jul 2 16:52:26.155850465 (223h40m53.082145153s) [noise=true , address=45.91.116.5:4298 , piece_id=JUYTY35XKYPNJYE7X3R7UMINTVMXDMNM6YZSZORJWATTVDBZFOMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156432201 (223h40m53.082726892s) [noise=true , address=77.90.31.14:4661 , piece_id=B5E2MZ5JW7Z5AG4GFQ4QGMAFW7ZMKWKRFU276Z6556JFWKYVLXTQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.156943265 (223h40m53.083237956s) [noise=true , address=104.36.82.16:4294 , piece_id=36S2PXQADEAQPWSBMQC4XEAH6H5PDA4AO34JI37VD4KPJOU2WVTA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.158591570 (223h40m53.084886251s) [noise=true , address=104.36.82.3:4767 , piece_id=U4L7ULC2R5OKDDL6BGDSEQUZNTVMQSGXJ56CGVKHNCCHTMIIDXDQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.159458953 (223h40m53.085753634s) [noise=true , address=45.91.116.8:4047 , piece_id=IJZDAO2K7KADVBNZGHLACI2ARTDDYOHIC742L2IUJT2WFAMMIGSQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161102375 (223h40m53.087397055s) [noise=true , address=45.91.116.12:4226 , piece_id=NFB2MT72D7MLPOY3A6MVO2QQBUFVYJPKN7D5XJQLQCCMYNQ6WJOA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.161556163 (223h40m53.087850838s) [noise=true , address=104.36.82.12:4149 , piece_id=V5265CLKUYZQN5B663WB4CFR3SXR2OA2BT53OAVCLFZJJ2YY6U4A, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162013197 (223h40m53.088307874s) [noise=true , address=104.36.82.14:4222 , piece_id=3HZK5YRWL2KXKY4E7XASRI2UIPCJA72JSJSTGBLPA4ZBP3MGBEOQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162459436 (223h40m53.088754112s) [noise=true , address=77.90.31.15:4698 , piece_id=VDVQDBYDQYRMVP7ZUPSEFC2R5UF2LVW45G23JURMYKS5IT6RBQFQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.162920549 (223h40m53.089215241s) [noise=true , address=77.90.31.21:4878 , piece_id=QJARHOYLDCFGYTTCD2EYCH43X3EARFK3Q3C7SCZ33X5T6CTLYDMQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.163747035 (223h40m53.090041713s) [noise=true , address=104.36.82.11:4115 , piece_id=LOK75B4Y2M3DMRJAHNYCVE46DELAAVN4SFP35AWPFESLUJT2V6KQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.167885784 (223h40m53.094180467s) [noise=true , address=104.36.82.6:4874 , piece_id=XVVQN3VX4I2KS4CIXEADBSFYBVYTVEWS5GMXAHE2LWDJGD2A2KAA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168494969 (223h40m53.094789668s) [noise=true , address=104.36.82.10:4079 , piece_id=JELVGAGG2NF2OSMKXQAV6DIXDTUFIER5WX4KTCJFQQ5P35EAMOEA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: <nil> Jul 2 16:52:26.168525706 (223h40m53.094820396s) [seg_pos={0 0}, upload=179165]: Segment reached optimal threshold of 13 pieces. Jul 2 16:52:26.168715378 (223h40m53.09501007s) [noise=true , address=77.90.31.19:4843 , piece_id=J74IERT5EP2VDSXY5PNWWBVTHQEXT4CWGLWP72Y3CQLOTSI6XZDA, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168766821 (223h40m53.095061509s) [noise=true , address=104.36.82.8:4970 , piece_id=X7KKQJYHVNI5LJDKGYNV5JHHCEGF4QSHFRKMSBLRE5W3W2ITAAHQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168816209 (223h40m53.095110907s) [noise=true , address=45.91.116.11:4118 , piece_id=CSQO6I5J4BW4NUAOFH3QDF6VEJGACWOSYNTNGXVELK2HLXIMX4YQ, seg_pos={0 0}, upload=179165]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p): protocol: expected piece hash; context canceled; EOF Jul 2 16:52:26.168851649 (223h40m53.095146335s) [seg_pos={0 0}, upload=179165]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 2 16:52:26.169058251 (223h40m53.095352944s) [upload=179165]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 2 16:52:26.169066272 (223h40m53.095360967s) [upload=179165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 2 16:52:26.220481259 (223h40m53.146775936s) [upload=179165]: Done uploading segments... Jul 2 16:52:26.220500093 (223h40m53.14679477s) [upload=179165]: Upload finished. err: <nil> Duration: 503.077496ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 1.657948816s FAIL (2025-07-02 07:47:52 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.657982122s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 1.839541997s FAIL (2025-07-02 07:46:44 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.839590434s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 1.759963455s FAIL (2025-07-02 07:45:39 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.759999455s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 1.711734337s FAIL (2025-07-02 07:44:51 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.711761849s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.656135389s FAIL (2025-07-02 07:44:34 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.656162429s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 1.68988115s FAIL (2025-07-02 07:44:07 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.689910089s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.021615688s FAIL (2025-07-02 07:42:59 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.021646884s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.798712011s FAIL (2025-07-02 07:42:34 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.798739419s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.75042496s FAIL (2025-07-02 07:41:26 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.750453942s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)