Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
299.598123ms
FAIL (2025-06-23 07:26:38 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 299.628491ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
290.66658ms
FAIL (2025-06-23 07:26:16 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 290.717495ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
413.374219ms
FAIL (2025-06-23 07:25:57 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 413.399697ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
282.892253ms
FAIL (2025-06-23 07:25:31 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 282.922756ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
431.705687ms
FAIL (2025-06-23 07:25:14 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 431.762468ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
279.511983ms
FAIL (2025-06-23 07:24:40 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 279.538789ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
439.958447ms
FAIL (2025-06-23 07:24:23 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 439.989746ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
298.004595ms
FAIL (2025-06-23 07:23:55 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 298.027821ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
411.711301ms
FAIL (2025-06-23 07:23:50 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 411.736964ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
311.812803ms
FAIL (2025-06-23 07:22:44 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 311.83843ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
413.888594ms
FAIL (2025-06-23 07:22:41 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 413.932921ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
296.589048ms
FAIL (2025-06-23 07:22:12 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 296.614055ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
426.168986ms
FAIL (2025-06-23 07:21:56 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 426.262798ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
322.014745ms
FAIL (2025-06-23 07:21:45 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 322.034596ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
434.149851ms
FAIL (2025-06-23 07:21:29 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 434.177037ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
323.338657ms
FAIL (2025-06-23 07:20:49 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 323.365662ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
469.850135ms
FAIL (2025-06-23 07:20:35 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 469.885472ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
252.209849ms
FAIL (2025-06-23 07:20:14 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 252.234718ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
556.789731ms
FAIL (2025-06-23 07:20:11 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 556.835061ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
428.260494ms
FAIL (2025-06-23 07:19:18 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 428.289121ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
286.003781ms
FAIL (2025-06-23 07:19:09 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 286.024928ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
490.720174ms
FAIL (2025-06-23 07:19:01 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 490.753219ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
441.904794ms
FAIL (2025-06-23 07:18:37 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 441.931593ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
334.30658ms
FAIL (2025-06-23 07:18:27 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 334.333561ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
449.498261ms
FAIL (2025-06-23 07:17:59 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 449.523815ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
424.146144ms
FAIL (2025-06-23 07:17:41 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 424.177659ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
264.019184ms
FAIL (2025-06-23 07:17:22 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 264.06279ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
425.327427ms
FAIL (2025-06-23 07:16:56 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 425.356914ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
288.28328ms
FAIL (2025-06-23 07:16:21 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 288.96136ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
437.635652ms
FAIL (2025-06-23 07:15:47 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 437.667645ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
307.786681ms
FAIL (2025-06-23 07:15:39 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 307.817872ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
456.664147ms
FAIL (2025-06-23 07:15:11 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 456.702566ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
825.656337ms
FAIL (2025-06-23 07:14:51 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 825.684985ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
398.927662ms
FAIL (2025-06-23 07:14:47 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 398.957609ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
451.865309ms
FAIL (2025-06-23 07:14:28 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 451.897348ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
293.473195ms
FAIL (2025-06-23 07:14:25 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 293.525586ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
436.404538ms
FAIL (2025-06-23 07:13:56 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 436.438074ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
295.001009ms
FAIL (2025-06-23 07:13:31 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 295.021462ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
485.794233ms
FAIL (2025-06-23 07:13:13 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 485.824175ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
409.74578ms
FAIL (2025-06-23 07:12:52 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 409.780128ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
331.285721ms
FAIL (2025-06-23 07:12:19 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 331.406129ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
436.585982ms
FAIL (2025-06-23 07:12:15 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 436.614181ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
445.142845ms
FAIL (2025-06-23 07:11:50 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 445.180278ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
271.701583ms
FAIL (2025-06-23 07:11:17 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 271.725223ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
560.222008ms
FAIL (2025-06-23 07:10:42 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 560.254189ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
276.303892ms
FAIL (2025-06-23 07:10:10 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 276.34269ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
439.111717ms
FAIL (2025-06-23 07:09:54 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 439.144084ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
451.406687ms
FAIL (2025-06-23 07:09:28 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 451.4968ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
264.285873ms
FAIL (2025-06-23 07:09:28 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 264.322686ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
257.106986ms
FAIL (2025-06-23 07:08:56 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 257.147974ms
edge
gateway
us-select-1
|