Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 206.33162ms FAIL (2025-07-29 01:17:51 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 206.35937ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.758390882s FAIL (2025-07-29 01:17:28 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 1.758417586s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 692.269096ms FAIL (2025-07-29 01:16:55 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 692.300145ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 233.528418ms FAIL (2025-07-29 01:16:53 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 233.559854ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.275579035s FAIL (2025-07-29 01:16:27 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.275748368s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 1.060328999s FAIL (2025-07-29 01:16:20 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.060363184s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 1.000829374s FAIL (2025-07-29 01:15:44 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.000879074s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 225.669332ms FAIL (2025-07-29 01:15:44 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 225.704166ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.677288772s FAIL (2025-07-29 01:15:33 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 1.677317013s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 805.393604ms FAIL (2025-07-29 01:15:10 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 805.430802ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 909.690613ms FAIL (2025-07-29 01:14:55 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 909.719746ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 248.136709ms FAIL (2025-07-29 01:14:30 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 248.197499ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 217.327984ms FAIL (2025-07-29 01:14:13 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 217.358204ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.268967706s FAIL (2025-07-29 01:14:07 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 1.269009733s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.72603518s FAIL (2025-07-29 01:13:55 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 5.72606413s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.107838473s FAIL (2025-07-29 01:13:53 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.107871452s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 207.852423ms FAIL (2025-07-29 01:13:46 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 207.877706ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 4.063909763s FAIL (2025-07-29 01:13:23 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.063941831s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1.654186535s FAIL (2025-07-29 01:13:10 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 1.654223668s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 3.411830482s FAIL (2025-07-29 01:13:02 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.411858108s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 216.818484ms FAIL (2025-07-29 01:12:57 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 216.851213ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.276116368s FAIL (2025-07-29 01:12:05 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.276144351s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 418.647531ms FAIL (2025-07-29 01:11:43 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 418.677076ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 3.535814081s FAIL (2025-07-29 01:11:28 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.535843679s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 196.045861ms FAIL (2025-07-29 01:11:17 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 196.119284ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.034795629s FAIL (2025-07-29 01:10:27 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.034819855s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 265.186239ms FAIL (2025-07-29 01:10:05 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 265.23496ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 1.384943882s FAIL (2025-07-29 01:09:42 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.384990064s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 930.841299ms FAIL (2025-07-29 01:09:14 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 930.870585ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 446.387161ms FAIL (2025-07-29 01:08:56 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 446.419715ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 3.79860046s FAIL (2025-07-29 01:08:31 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.798634937s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 263.98999ms FAIL (2025-07-29 01:08:07 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 264.024542ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 252.199275ms FAIL (2025-07-29 01:07:43 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 252.254036ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.165557323s FAIL (2025-07-29 01:07:25 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.165585472s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 204.977191ms FAIL (2025-07-29 01:07:04 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 205.013353ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 191.979201ms FAIL (2025-07-29 01:06:41 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 192.022914ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 9.020204244s FAIL (2025-07-29 01:06:23 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 9.020238601s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 224.991022ms FAIL (2025-07-29 01:05:47 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 225.023353ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.785983071s FAIL (2025-07-29 01:05:35 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.786020067s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 444.894618ms FAIL (2025-07-29 01:05:16 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 444.923614ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 465.88779ms FAIL (2025-07-29 01:04:41 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 465.919245ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.687020167s FAIL (2025-07-29 01:04:28 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.687151155s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 210.174068ms FAIL (2025-07-29 01:03:49 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 210.20553ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.714979267s FAIL (2025-07-29 01:03:38 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.71501278s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 942.129683ms FAIL (2025-07-29 01:02:58 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 942.159216ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 376.504343ms FAIL (2025-07-29 01:02:40 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 376.641619ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 206.856699ms FAIL (2025-07-29 01:02:12 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 206.887741ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.716987645s FAIL (2025-07-29 01:02:05 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.717084866s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 274.031852ms FAIL (2025-07-29 01:01:52 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 274.060765ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 11.463821503s FAIL (2025-07-29 01:01:28 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 11.463860784s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)