Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.147540509s
FAIL (2025-06-23 08:03:21 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 1.147561218s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
983.059793ms
FAIL (2025-06-23 08:02:46 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 983.090649ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
739.81304ms
FAIL (2025-06-23 08:02:19 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 739.856757ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
860.109447ms
FAIL (2025-06-23 08:01:59 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 860.154978ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
701.96593ms
FAIL (2025-06-23 08:01:32 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 702.016383ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
723.684982ms
FAIL (2025-06-23 08:00:26 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 723.794072ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
646.320386ms
FAIL (2025-06-23 07:59:16 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 646.34412ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
624.797875ms
FAIL (2025-06-23 07:58:09 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 624.822697ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
693.860433ms
FAIL (2025-06-23 07:57:01 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 693.889569ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
638.66709ms
FAIL (2025-06-23 07:56:33 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 638.694292ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
674.415367ms
FAIL (2025-06-23 07:55:24 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 674.447356ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
640.839307ms
FAIL (2025-06-23 07:54:09 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 640.93771ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
661.344218ms
FAIL (2025-06-23 07:53:32 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 661.37043ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
853.330186ms
FAIL (2025-06-23 07:53:17 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 853.476975ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
642.964394ms
FAIL (2025-06-23 07:52:09 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 642.98611ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
730.565323ms
FAIL (2025-06-23 07:51:30 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 730.590381ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
938.744029ms
FAIL (2025-06-23 07:50:31 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 938.771768ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
686.131674ms
FAIL (2025-06-23 07:49:33 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 686.162877ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
740.095042ms
FAIL (2025-06-23 07:48:57 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": context deadline exceeded
Duration: 740.112794ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
431.198008ms
FAIL (2025-06-23 07:41:16 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 431.228284ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
490.087196ms
FAIL (2025-06-23 07:40:19 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 490.183748ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
397.409075ms
FAIL (2025-06-23 07:39:53 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 397.439567ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
420.282324ms
FAIL (2025-06-23 07:39:23 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 420.32662ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
541.902072ms
FAIL (2025-06-23 07:39:02 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 541.934258ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
443.787369ms
FAIL (2025-06-23 07:38:19 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 443.822658ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
434.202819ms
FAIL (2025-06-23 07:37:59 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 434.230356ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
445.316795ms
FAIL (2025-06-23 07:37:24 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 445.346815ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
453.828867ms
FAIL (2025-06-23 07:36:17 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 453.864668ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
405.961407ms
FAIL (2025-06-23 07:35:42 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 405.992707ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
468.921119ms
FAIL (2025-06-23 07:34:47 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 468.964947ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
298.628539ms
FAIL (2025-06-23 07:34:18 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 298.647888ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
469.681291ms
FAIL (2025-06-23 07:34:06 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 469.711675ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
464.744996ms
FAIL (2025-06-23 07:33:45 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 464.76772ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
244.981491ms
FAIL (2025-06-23 07:33:35 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 245.031783ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
432.741587ms
FAIL (2025-06-23 07:33:08 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 432.77139ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
461.928519ms
FAIL (2025-06-23 07:32:49 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 461.960704ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
404.920816ms
FAIL (2025-06-23 07:32:37 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 404.940841ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
363.277472ms
FAIL (2025-06-23 07:32:11 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 363.441704ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
421.771309ms
FAIL (2025-06-23 07:31:56 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 421.799454ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
280.987575ms
FAIL (2025-06-23 07:31:11 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 281.014292ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
426.903544ms
FAIL (2025-06-23 07:30:52 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 426.992003ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
445.628807ms
FAIL (2025-06-23 07:30:29 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 445.661991ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
332.637593ms
FAIL (2025-06-23 07:30:24 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 332.67529ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
434.030317ms
FAIL (2025-06-23 07:29:16 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 434.054731ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
338.017333ms
FAIL (2025-06-23 07:29:13 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 338.063088ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
270.47692ms
FAIL (2025-06-23 07:28:32 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 270.500887ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
422.121596ms
FAIL (2025-06-23 07:28:13 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 422.152745ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
435.342704ms
FAIL (2025-06-23 07:27:35 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 435.372272ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
250.993213ms
FAIL (2025-06-23 07:27:33 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 251.054665ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
428.593472ms
FAIL (2025-06-23 07:26:49 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ed; ecclient: upload cut due to slow connection (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936246290 (110h37m29.499569292s) [noise=true , address=104.36.82.11:6115 , piece_id=AGBLUTVSX6XVXVWQH3IH323AQ2POFOKAE3O763J72QKPEBGYB6DA, seg_pos={0 0}, upload=88520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: expected piece hash; context canceled; EOF
Jun 23 07:00:53.936350229 (110h37m29.499673219s) [noise=true , address=104.36.82.7:5912 , piece_id=SFEMEVBP2BIEM4YG2PDJNZD5FLQJFNGXLKKKIQLL7OBBVGU2IKCQ, seg_pos={0 0}, upload=88520]: Done uploading piece. err: <nil>
Jun 23 07:00:53.936375393 (110h37m29.499698412s) [seg_pos={0 0}, upload=88520]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 23 07:00:53.936519350 (110h37m29.499842362s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:00:53.936527123 (110h37m29.499850132s) [upload=88520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:00:53.992446033 (110h37m29.555769061s) [upload=88520]: Done uploading segments...
Jun 23 07:00:53.992469999 (110h37m29.555792999s) [upload=88520]: Upload finished. err: <nil>
Jun 23 07:01:21.179432631 (110h37m56.74275563s) [upload=88523]: Starting upload
Jun 23 07:01:21.179511547 (110h37m56.742834536s) [upload=88523]: Done starting upload
Jun 23 07:01:21.179646668 (110h37m56.742969675s) [upload=88523]: Uploading segments...
Jun 23 07:01:21.179802494 (110h37m56.743125493s) [upload=88523]: Got next segment. Inline: false
Jun 23 07:01:21.179860370 (110h37m56.74318337s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 23 07:01:21.179865552 (110h37m56.743188554s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 23 07:01:21.225917938 (110h37m56.789240938s) [seg_pos={0 0}, upload=88523]: Begin upload segment...
Jun 23 07:01:21.225959756 (110h37m56.789282741s) [seg_pos={0 0}, upload=88523]: Done begin upload segment.
Jun 23 07:01:21.225984958 (110h37m56.78930796s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226329157 (110h37m56.789652156s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226564640 (110h37m56.789887641s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.226786273 (110h37m56.790109273s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227003603 (110h37m56.790326605s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227260555 (110h37m56.790583558s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227478837 (110h37m56.790801839s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227690562 (110h37m56.791013564s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.227920378 (110h37m56.791243383s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228136509 (110h37m56.791459512s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228352883 (110h37m56.791675885s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228575727 (110h37m56.791898729s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228786499 (110h37m56.7921095s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.228999146 (110h37m56.792322148s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229209952 (110h37m56.792532954s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.229521724 (110h37m56.792844733s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Uploading piece...
Jun 23 07:01:21.337869355 (110h37m56.901192345s) [upload=88523]: Next returned nil segment
Jun 23 07:01:21.340995996 (110h37m56.904319014s) [upload=88523]: Waiting for error group managing segments...
Jun 23 07:01:21.342450988 (110h37m56.90577399s) [noise=true , address=45.91.116.5:5299 , piece_id=ZF3ZTZ4LFT64E7HGO5VXETPSOORXR36VEPQLQUNFGIO2KK4LUHDA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.343723570 (110h37m56.907046577s) [noise=true , address=45.91.116.11:5117 , piece_id=ANMJDI2JFGTH3MP5YNWEPAHMT2KEV6DU6GLNBJ5ZM2MO3JWF7PXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345288795 (110h37m56.908611785s) [noise=true , address=77.90.31.12:4589 , piece_id=6UCILZMLLM7EFSF32WI4EX3WUFCZKNJOMSXXILVV7L6ZIDEWZFXQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.345804910 (110h37m56.909127911s) [noise=true , address=77.90.31.21:4879 , piece_id=73VAKVQDUHZCPHAKMMD6A2UAHNJRTMPFPN4YO37WK6NIWMNBUNAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346270285 (110h37m56.90959328s) [noise=true , address=77.90.31.10:4517 , piece_id=MFMN6CQ5YBPTMJCF27UHS2DXCUER6UQDUH6MOWI5ICOZ7GZSYOEA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.346717820 (110h37m56.910040811s) [noise=true , address=77.90.31.13:4627 , piece_id=2RFE3PMI5MU3UKFPRTDE5HOBCAET3J52ISLJRO2NBSYXQZRCWBBQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.347980740 (110h37m56.91130373s) [noise=true , address=45.91.116.12:5225 , piece_id=JUDODQSFPPLB6I4AJN5KM7RIWF3FLZDNSCKKF4IE5ACGOJ4UCN5A, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348382290 (110h37m56.911705279s) [noise=true , address=104.36.82.8:5972 , piece_id=4VLVX4BRVHO7YHWRDPVOZBP4OQTCDUZIBMN6RQXZE4MPLSWTOCZQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.348761158 (110h37m56.912084158s) [noise=true , address=104.36.82.15:6257 , piece_id=DXVLOYBM2LKIWYZ3UWK6V67V4CULWVIDOS3ALUJZCVWIQH3ODOWQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349108485 (110h37m56.912431473s) [noise=true , address=104.36.82.4:5802 , piece_id=VXLT4MZTF6P6CRYLJYA7TJ35X3IILKZUWH22VEVHVHOFYEIZC6HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349488574 (110h37m56.912811563s) [noise=true , address=104.36.82.13:6187 , piece_id=5C4N2TZBKOIVTVUKVDP5IO347LRWHAR6DGH7QSCWBZGN2DRILCHQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.349843340 (110h37m56.913166328s) [noise=true , address=104.36.82.12:6149 , piece_id=YIF7ZFF25XP6RITQM5TXDIW5WNGD4QK3HDAFDNT4CTK74NG4A3YA, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350360440 (110h37m56.913683429s) [noise=true , address=104.36.82.14:6221 , piece_id=PJTQTTE2BV4DH6FIJ7GRJOU7B5QLA6B6BH4EW4GKCYGJVHZNNUAQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.350369313 (110h37m56.913692303s) [seg_pos={0 0}, upload=88523]: Segment reached optimal threshold of 13 pieces.
Jun 23 07:01:21.350493953 (110h37m56.913816954s) [noise=true , address=77.90.31.18:4807 , piece_id=Q7U4QP4MXULH46N3JDZTLNSIPWKVEOWATA447TUBHYR4NFNA73HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS): protocol: expected piece hash; context canceled; EOF
Jun 23 07:01:21.350936528 (110h37m56.914259542s) [noise=true , address=104.36.82.12:6151 , piece_id=Y5WMAM5RJY76EBTT46WTBZBRYYVHTQDWMJ3KFBTJARECMK7WL3HQ, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.351080461 (110h37m56.914403448s) [noise=true , address=104.36.82.6:5874 , piece_id=KO25IAU5B6GJGG3OZHEKCJJYELOH6DNKMGSFD6PRI4AF6KQUDZ7Q, seg_pos={0 0}, upload=88523]: Done uploading piece. err: <nil>
Jun 23 07:01:21.352283810 (110h37m56.91560681s) [seg_pos={0 0}, upload=88523]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 23 07:01:21.352365893 (110h37m56.915688892s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 23 07:01:21.352371356 (110h37m56.915694355s) [upload=88523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 23 07:01:21.419132123 (110h37m56.982455121s) [upload=88523]: Done uploading segments...
Jun 23 07:01:21.419150896 (110h37m56.982473894s) [upload=88523]: Upload finished. err: <nil>
Duration: 428.697016ms
core
uplink
us-select-1
|