Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
600.032598ms
FAIL (2025-07-04 20:51:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 600.051374ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.051361847s
FAIL (2025-07-04 20:51:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.051384174s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
511.412879ms
FAIL (2025-07-04 20:50:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 511.454186ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
734.918638ms
FAIL (2025-07-04 20:49:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 734.936872ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
811.050506ms
FAIL (2025-07-04 20:49:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 811.074721ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
808.915496ms
FAIL (2025-07-04 20:48:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 808.935588ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
555.787769ms
FAIL (2025-07-04 20:48:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 555.832418ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
617.881364ms
FAIL (2025-07-04 20:47:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 617.904476ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.197059931s
FAIL (2025-07-04 20:46:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.197078429s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
773.25219ms
FAIL (2025-07-04 20:45:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 773.278967ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
669.717493ms
FAIL (2025-07-04 20:44:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 669.738018ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001107826s
FAIL (2025-07-04 20:44:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.00112397s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
442.925133ms
FAIL (2025-07-04 19:47:00 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 442.954525ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
482.717587ms
FAIL (2025-07-04 19:46:40 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 482.744143ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
521.817073ms
FAIL (2025-07-04 19:45:26 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 521.855999ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
452.960767ms
FAIL (2025-07-04 19:44:55 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 453.065802ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
429.898399ms
FAIL (2025-07-04 19:44:04 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 429.926537ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
408.097061ms
FAIL (2025-07-04 19:43:18 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 408.123908ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
505.006568ms
FAIL (2025-07-04 19:42:23 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 505.032044ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
444.170795ms
FAIL (2025-07-04 19:41:10 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 444.206877ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
467.628757ms
FAIL (2025-07-04 19:40:08 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 467.664824ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
573.207841ms
FAIL (2025-07-04 19:39:41 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 573.239999ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
520.827055ms
FAIL (2025-07-04 19:39:00 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 520.862184ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
640.498317ms
FAIL (2025-07-04 19:37:56 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 640.526939ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
492.98707ms
FAIL (2025-07-04 19:36:53 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 493.013482ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
448.898735ms
FAIL (2025-07-04 19:36:24 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 448.939709ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
495.691206ms
FAIL (2025-07-04 19:35:55 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 495.71798ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
433.815295ms
FAIL (2025-07-04 19:35:32 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 433.857415ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
531.202931ms
FAIL (2025-07-04 19:34:48 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 531.228447ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
478.542356ms
FAIL (2025-07-04 19:34:05 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 478.569172ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
431.637686ms
FAIL (2025-07-04 19:33:05 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 431.661823ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
453.017642ms
FAIL (2025-07-04 19:32:43 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 453.054159ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
461.858386ms
FAIL (2025-07-04 19:31:36 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 461.91319ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
533.779263ms
FAIL (2025-07-04 19:31:02 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 533.808149ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
448.886706ms
FAIL (2025-07-04 19:30:20 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 448.914139ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
652.899607ms
FAIL (2025-07-04 19:29:23 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 652.929257ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
453.032607ms
FAIL (2025-07-04 19:29:00 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 453.068469ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
413.838586ms
FAIL (2025-07-04 19:28:24 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 413.940302ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
437.763267ms
FAIL (2025-07-04 19:27:35 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 437.793157ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
473.696407ms
FAIL (2025-07-04 19:26:55 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 473.742925ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
411.127323ms
FAIL (2025-07-04 19:26:27 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 411.155388ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
472.1609ms
FAIL (2025-07-04 19:26:08 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 472.185967ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
468.307848ms
FAIL (2025-07-04 19:25:12 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 468.338393ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
616.658246ms
FAIL (2025-07-04 19:24:56 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 616.725292ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
411.212561ms
FAIL (2025-07-04 19:23:52 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 411.292019ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
458.743273ms
FAIL (2025-07-04 19:22:49 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 458.769375ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
608.956694ms
FAIL (2025-07-04 19:22:13 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 609.097184ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
454.979523ms
FAIL (2025-07-04 19:21:34 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 455.013991ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
416.120633ms
FAIL (2025-07-04 19:21:18 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 416.154391ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
627.205446ms
FAIL (2025-07-04 19:20:46 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ent: upload cut due to slow connection (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE): protocol: expected piece hash; context canceled; EOF
Jul 4 19:00:31.104437105 (273h48m58.030731786s) [noise=true , address=104.36.82.6:4876 , piece_id=IO2KOOKKFG6UX5AD6UVT3G5LVSM5WQCZGBE4VSDVNE7QSPEICSUQ, seg_pos={0 0}, upload=219282]: Done uploading piece. err: <nil>
Jul 4 19:00:31.104527728 (273h48m58.030822419s) [seg_pos={0 0}, upload=219282]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 4 19:00:31.104648944 (273h48m58.030943625s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:00:31.104655455 (273h48m58.030950142s) [upload=219282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:00:31.162750349 (273h48m58.089045031s) [upload=219282]: Done uploading segments...
Jul 4 19:00:31.162773340 (273h48m58.089068016s) [upload=219282]: Upload finished. err: <nil>
Jul 4 19:01:21.112342853 (273h49m48.038637539s) [upload=219293]: Starting upload
Jul 4 19:01:21.112455651 (273h49m48.038750342s) [upload=219293]: Done starting upload
Jul 4 19:01:21.112553742 (273h49m48.038848432s) [upload=219293]: Uploading segments...
Jul 4 19:01:21.112736460 (273h49m48.039031159s) [upload=219293]: Got next segment. Inline: false
Jul 4 19:01:21.112791315 (273h49m48.039086005s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 19:01:21.112797383 (273h49m48.039092074s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 19:01:21.143531966 (273h49m48.069826653s) [seg_pos={0 0}, upload=219293]: Begin upload segment...
Jul 4 19:01:21.143608120 (273h49m48.069902811s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144145375 (273h49m48.070440063s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.144692717 (273h49m48.070987395s) [seg_pos={0 0}, upload=219293]: Done begin upload segment.
Jul 4 19:01:21.144743385 (273h49m48.071038077s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145101631 (273h49m48.071396318s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145392058 (273h49m48.071686744s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145625172 (273h49m48.071919863s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.145946419 (273h49m48.072241116s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.146359714 (273h49m48.07265441s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147285866 (273h49m48.073580563s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.147769098 (273h49m48.074063799s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149434914 (273h49m48.075729603s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.149821203 (273h49m48.076115891s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.150943260 (273h49m48.077237949s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.151677976 (273h49m48.077972668s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152030529 (273h49m48.078325219s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.152498377 (273h49m48.078793073s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Uploading piece...
Jul 4 19:01:21.270073650 (273h49m48.196368338s) [upload=219293]: Next returned nil segment
Jul 4 19:01:21.270094154 (273h49m48.196388852s) [upload=219293]: Waiting for error group managing segments...
Jul 4 19:01:21.273118218 (273h49m48.199412896s) [noise=true , address=45.91.116.8:4045 , piece_id=UWHT76QHI3LRPAMK5PJFFGEBEGYSBKZT7NIOZLNJ3ZEHNSGY3XZA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274134778 (273h49m48.200429455s) [noise=true , address=77.90.31.15:4698 , piece_id=GI4JW2FU7LJKRMQZGVXFI644BCTSIRSU5USWU6UPEWMOKTJFRMPQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.274651598 (273h49m48.200946274s) [noise=true , address=45.91.116.13:4154 , piece_id=AOI47TIUOFUJF2LTM5QD3XSGX76JQ6GN5OIQI5NSXZMEOS4AISUQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275183968 (273h49m48.201478644s) [noise=true , address=45.91.116.14:4190 , piece_id=AU3MKSFFWPQM3IGMGO5P35GDJWJ2YH4Q6Z6CGFGQEPXLAOMEIU3A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.275667848 (273h49m48.201962529s) [noise=true , address=77.90.31.14:4663 , piece_id=TSM3SKWUIMGBEZASHCKFTUR3DBHUI7ZRIEV3KI5CJIPJBQYTU4WA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.276762572 (273h49m48.203057252s) [noise=true , address=77.90.31.10:4519 , piece_id=UY4OT4LI3E7ZTFE6W6M4RYGNRQ7Z66FPJ3MY6DIUYYCR7E62MF5A, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277227148 (273h49m48.203521917s) [noise=true , address=104.36.82.8:4971 , piece_id=BTWYZKLBSRI6WHIMDPYE6TUEQJDXIAPDSX7G3KVO2VJ7RWRQN46Q, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.277685924 (273h49m48.203980601s) [noise=true , address=104.36.82.2:4729 , piece_id=FJDRP3KQDJL65Y27LE5U5SIGOWVNLYBIBJQP33F4WT5LISDG24KQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278043283 (273h49m48.204337959s) [noise=true , address=104.36.82.2:4732 , piece_id=2GOGXU22H7ZWI5OKAYFEJAQWH3XCZENYC7UJ5TED6AZ4JO7LUIBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278457355 (273h49m48.204752031s) [noise=true , address=104.36.82.11:4114 , piece_id=BQJ3TD2UXQK6S7KVBZUFU6H5GCNSOKMAD2E5SKDCIPVNPIGN4FMQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.278921322 (273h49m48.205215998s) [noise=true , address=77.90.31.14:4661 , piece_id=OP53RVAICXA6B25XCGAR73MGV5QCNLNXJCRN2OJGICS3B4MIC6VA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279552774 (273h49m48.205847454s) [noise=true , address=104.36.82.4:4803 , piece_id=DXKD2ZPSZ4XUNLDD5CDDW5ZEXJT46D76OGCIVFHNJDTWT7EB2GPA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279972556 (273h49m48.206267237s) [noise=true , address=104.36.82.13:4186 , piece_id=LGML4LYIFA3STL3CWOVSPHID4E42DUU5FM3BWOPWKE43XLYVXPIA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: <nil>
Jul 4 19:01:21.279987509 (273h49m48.206282197s) [seg_pos={0 0}, upload=219293]: Segment reached optimal threshold of 13 pieces.
Jul 4 19:01:21.280114273 (273h49m48.206408958s) [noise=true , address=104.36.82.10:4079 , piece_id=3OOR5S6RIUJI3P3CB2Z7Q7G7OFRZS3RJDHQFUW5Z4ASX2SFU4IOA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280222979 (273h49m48.206517655s) [noise=true , address=45.91.116.5:4298 , piece_id=REAGMJZIMQW7ENSBSYN6QVKUNIHUEUCXGALHIQCPBR6VFI5OVCBQ, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280299455 (273h49m48.206594131s) [noise=true , address=45.91.116.10:4082 , piece_id=MNOF3KZUVXZOCVOXT3MI6L6S6BFNYYQ6MTOXDA6Z37SRZTTQMFHA, seg_pos={0 0}, upload=219293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 4 19:01:21.280311145 (273h49m48.206605831s) [seg_pos={0 0}, upload=219293]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 19:01:21.280398041 (273h49m48.206692722s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 19:01:21.280404722 (273h49m48.206699412s) [upload=219293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 19:01:21.407841271 (273h49m48.334135968s) [upload=219293]: Done uploading segments...
Jul 4 19:01:21.407865432 (273h49m48.334160122s) [upload=219293]: Upload finished. err: <nil>
Duration: 627.234813ms
core
uplink
us-select-1
|