Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 164545 reports (Page 3145 of 3291)
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
600.032598ms
FAIL (2025-07-04 20:51:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 600.051374ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
1.051361847s
FAIL (2025-07-04 20:51:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.051384174s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
511.412879ms
FAIL (2025-07-04 20:50:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 511.454186ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
734.918638ms
FAIL (2025-07-04 20:49:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 734.936872ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
811.050506ms
FAIL (2025-07-04 20:49:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 811.074721ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
808.915496ms
FAIL (2025-07-04 20:48:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 808.935588ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
555.787769ms
FAIL (2025-07-04 20:48:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 555.832418ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
617.881364ms
FAIL (2025-07-04 20:47:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 617.904476ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
2.197059931s
FAIL (2025-07-04 20:46:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.197078429s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
773.25219ms
FAIL (2025-07-04 20:45:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 773.278967ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
669.717493ms
FAIL (2025-07-04 20:44:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 669.738018ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.001107826s
FAIL (2025-07-04 20:44:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.00112397s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
442.925133ms
FAIL (2025-07-04 19:47:00 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 442.954525ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
482.717587ms
FAIL (2025-07-04 19:46:40 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 482.744143ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
521.817073ms
FAIL (2025-07-04 19:45:26 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 521.855999ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
452.960767ms
FAIL (2025-07-04 19:44:55 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 453.065802ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
429.898399ms
FAIL (2025-07-04 19:44:04 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 429.926537ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
408.097061ms
FAIL (2025-07-04 19:43:18 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 408.123908ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
505.006568ms
FAIL (2025-07-04 19:42:23 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 505.032044ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
444.170795ms
FAIL (2025-07-04 19:41:10 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 444.206877ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
467.628757ms
FAIL (2025-07-04 19:40:08 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 467.664824ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
573.207841ms
FAIL (2025-07-04 19:39:41 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 573.239999ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................]
duration:
520.827055ms
FAIL (2025-07-04 19:39:00 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 520.862184ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................]
duration:
640.498317ms
FAIL (2025-07-04 19:37:56 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 640.526939ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................]
duration:
492.98707ms
FAIL (2025-07-04 19:36:53 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 493.013482ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................]
duration:
448.898735ms
FAIL (2025-07-04 19:36:24 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 448.939709ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................]
duration:
495.691206ms
FAIL (2025-07-04 19:35:55 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 495.71798ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................]
duration:
433.815295ms
FAIL (2025-07-04 19:35:32 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 433.857415ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
531.202931ms
FAIL (2025-07-04 19:34:48 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 531.228447ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
478.542356ms
FAIL (2025-07-04 19:34:05 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 478.569172ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
431.637686ms
FAIL (2025-07-04 19:33:05 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 431.661823ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
453.017642ms
FAIL (2025-07-04 19:32:43 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 453.054159ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
461.858386ms
FAIL (2025-07-04 19:31:36 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 461.91319ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
533.779263ms
FAIL (2025-07-04 19:31:02 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 533.808149ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
448.886706ms
FAIL (2025-07-04 19:30:20 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 448.914139ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration:
652.899607ms
FAIL (2025-07-04 19:29:23 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 652.929257ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................]
duration:
453.032607ms
FAIL (2025-07-04 19:29:00 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 453.068469ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
413.838586ms
FAIL (2025-07-04 19:28:24 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 413.940302ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
437.763267ms
FAIL (2025-07-04 19:27:35 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 437.793157ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................]
duration:
473.696407ms
FAIL (2025-07-04 19:26:55 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 473.742925ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
411.127323ms
FAIL (2025-07-04 19:26:27 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 411.155388ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
472.1609ms
FAIL (2025-07-04 19:26:08 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 472.185967ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
468.307848ms
FAIL (2025-07-04 19:25:12 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 468.338393ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................]
duration:
616.658246ms
FAIL (2025-07-04 19:24:56 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 616.725292ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................]
duration:
411.212561ms
FAIL (2025-07-04 19:23:52 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 411.292019ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration:
458.743273ms
FAIL (2025-07-04 19:22:49 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 458.769375ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration:
608.956694ms
FAIL (2025-07-04 19:22:13 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 609.097184ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
454.979523ms
FAIL (2025-07-04 19:21:34 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 455.013991ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
416.120633ms
FAIL (2025-07-04 19:21:18 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 416.154391ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
627.205446ms
FAIL (2025-07-04 19:20:46 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul  4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876     , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul  4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul  4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul  4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul  4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul  4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul  4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul  4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul  4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul  4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul  4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul  4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul  4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul  4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045     , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698     , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154    , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190    , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663     , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519     , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971     , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729     , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732     , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114    , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661     , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803     , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186    , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul  4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul  4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079    , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298     , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082    , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul  4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul  4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul  4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul  4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul  4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 627.234813ms core uplink us-select-1