Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 1.104241511s FAIL (2025-07-29 01:30:13 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 1.104298498s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 1.341222963s FAIL (2025-07-29 01:30:11 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.341330566s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 216.57043ms FAIL (2025-07-29 01:29:52 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 216.599922ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 1.896871069s FAIL (2025-07-29 01:29:37 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 1.89691997s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 237.407992ms FAIL (2025-07-29 01:29:22 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 237.455126ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 760.701924ms FAIL (2025-07-29 01:29:19 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 760.731665ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.168000906s FAIL (2025-07-29 01:29:12 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.16803302s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 1.251770828s FAIL (2025-07-29 01:28:43 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 1.251866836s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 329.202643ms FAIL (2025-07-29 01:28:18 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 329.238931ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 1.081686066s FAIL (2025-07-29 01:28:13 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 1.081714823s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 1.119420706s FAIL (2025-07-29 01:28:05 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.119454844s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 239.707674ms FAIL (2025-07-29 01:27:57 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 239.740225ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 1.590287198s FAIL (2025-07-29 01:27:47 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.590308843s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.039313135s FAIL (2025-07-29 01:27:29 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.039367399s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 1.223558703s FAIL (2025-07-29 01:27:23 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.223587336s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 204.962728ms FAIL (2025-07-29 01:27:08 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 205.026469ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 184.577908ms FAIL (2025-07-29 01:26:50 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 184.678506ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 1.396552378s FAIL (2025-07-29 01:26:43 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 1.396603004s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.408937545s FAIL (2025-07-29 01:26:36 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.408969956s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 198.607683ms FAIL (2025-07-29 01:25:59 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 198.656683ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 1.179023381s FAIL (2025-07-29 01:25:55 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 1.179060815s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 1.011573615s FAIL (2025-07-29 01:25:42 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.011597937s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 191.346311ms FAIL (2025-07-29 01:24:58 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 191.38862ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 1.634095647s FAIL (2025-07-29 01:24:48 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 1.634123172s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.447964835s FAIL (2025-07-29 01:24:45 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.447994263s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 726.312955ms FAIL (2025-07-29 01:24:15 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 726.346282ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.602904169s FAIL (2025-07-29 01:24:14 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.602930921s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 237.348437ms FAIL (2025-07-29 01:23:45 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 237.382887ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 1.458481677s FAIL (2025-07-29 01:23:18 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 1.458512856s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 1.33481358s FAIL (2025-07-29 01:23:07 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.334856036s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 221.924407ms FAIL (2025-07-29 01:22:49 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 221.979142ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 186.902287ms FAIL (2025-07-29 01:22:25 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 186.942159ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 1.895745144s FAIL (2025-07-29 01:22:22 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.895840467s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 945.127237ms FAIL (2025-07-29 01:22:14 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 945.154379ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 409.343183ms FAIL (2025-07-29 01:21:56 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 409.374471ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 786.005159ms FAIL (2025-07-29 01:21:36 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 786.035736ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 999.848779ms FAIL (2025-07-29 01:21:34 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 999.883593ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.725523568s FAIL (2025-07-29 01:21:11 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 2.725576911s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 693.041589ms FAIL (2025-07-29 01:20:50 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 693.0707ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 936.034065ms FAIL (2025-07-29 01:20:43 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 936.063723ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 223.206067ms FAIL (2025-07-29 01:20:42 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 223.241638ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 235.753954ms FAIL (2025-07-29 01:20:10 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 235.784656ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.082479721s FAIL (2025-07-29 01:20:06 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 1.082514897s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.665606175s FAIL (2025-07-29 01:19:55 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.665703659s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 411.68083ms FAIL (2025-07-29 01:19:26 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 411.709745ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 937.067804ms FAIL (2025-07-29 01:19:13 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 937.094341ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 1.006522849s FAIL (2025-07-29 01:19:05 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.006578601s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 249.795818ms FAIL (2025-07-29 01:18:53 UTC) orbiter warning: digest mismatch: after fd8400b352923e07dc40afca72d52e351735a92393612061a5024d9f326b28dd != before 3ebc1d85f7afa5c4781d9e4b657b3b9281a601925322dd6fed10c0e329f81da4 Duration: 249.835744ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.102360912s FAIL (2025-07-29 01:18:15 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/4M") Duration: 1.102393084s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 1.313642878s FAIL (2025-07-29 01:18:10 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== : Uploading segments... Jul 29 00:57:12.442657419 (8h11m59.263608476s) [upload=7876]: Got next segment. Inline: false Jul 29 00:57:12.442697075 (8h11m59.263648133s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 00:57:12.442702376 (8h11m59.263653434s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 00:57:12.479658147 (8h11m59.300609237s) [seg_pos={0 0}, upload=7876]: Begin upload segment... Jul 29 00:57:12.479726219 (8h11m59.300677276s) [seg_pos={0 0}, upload=7876]: Done begin upload segment. Jul 29 00:57:12.479786874 (8h11m59.300737934s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.480590195 (8h11m59.301541261s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481165305 (8h11m59.302116372s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481585719 (8h11m59.302536785s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.481677037 (8h11m59.302628095s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.482907295 (8h11m59.303858362s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483203740 (8h11m59.304154803s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.483955587 (8h11m59.304906647s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484346962 (8h11m59.305298022s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.484860381 (8h11m59.305811437s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485263906 (8h11m59.306214978s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.485727605 (8h11m59.306678673s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486166897 (8h11m59.30711796s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.486708786 (8h11m59.307659853s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.487107633 (8h11m59.3080587s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.498763501 (8h11m59.319714544s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.501803108 (8h11m59.322754169s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.504695431 (8h11m59.32564653s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Uploading piece... Jul 29 00:57:12.581615823 (8h11m59.402566888s) [upload=7876]: Next returned nil segment Jul 29 00:57:12.581643781 (8h11m59.402594838s) [upload=7876]: Waiting for error group managing segments... Jul 29 00:57:12.611109586 (8h11m59.432060637s) [noise=true , address=104.36.82.4:4814 , piece_id=D232CT2LJLXBJGEWYROVEKTJ6LE3PLP2RCIICXJDM7HCR66GMCKA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.644623057 (8h11m59.465574108s) [noise=true , address=104.36.82.55:4211 , piece_id=BJ75D2QGFBWRGK2T5XCQVYBYWDAOGPFHIIFYSKDTYCJI7QWRWOGQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.657293409 (8h11m59.478244459s) [noise=true , address=104.36.82.55:4204 , piece_id=GHBPPQIX7NR7JHE52J6CQQBUUVMENCPJ4MMNIDW3VKHB2KD6GDRA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:12.703489435 (8h11m59.524440485s) [noise=true , address=104.36.82.13:4204 , piece_id=UEGP7IYLNG5G3GICHYJ7HYYDDBEUJN4HFOWIL4VAQYZW2ZLUKFTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.006785993 (8h11m59.827737051s) [noise=true , address=104.36.82.5:4853 , piece_id=ZJBAUIIIDNU3JTKHKXIO3XYB34R75TORN2ND33WGWZWW2B3ZNSTA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.151761890 (8h11m59.972712949s) [noise=true , address=64.49.13.137:4500 , piece_id=WBDJWOMV5WHF7LVWQGVYKBHOQGXPQFEIYHGKW7ZFFLZA3537ICMA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.155272289 (8h11m59.97622334s) [noise=true , address=64.49.13.138:4482 , piece_id=LXW5WP5D4RCAPCZDNEWSDY7OF5UODEYTNOJB4LQNEYH3LVN3WHTQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.774148966 (8h12m0.595100009s) [noise=true , address=104.36.82.53:4122 , piece_id=72KYU7VT6YRQVEBCVUPDPWWA72YTCMAUVUY6G3BWDXJKXYC7JTHQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:13.922794659 (8h12m0.743745713s) [noise=true , address=104.36.82.22:4540 , piece_id=LCU4AQKRFS6P44SKQKIKTYBBLKUJZ4FNC3O5OURDEY32X5MHU6NQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.127175501 (8h12m0.948126546s) [noise=true , address=104.36.82.35:4598 , piece_id=HHHHFN6UV6WQE3H5LGE7ZI3HPZZXOCSG3GNSBW5PAFIZXXKUKGFQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.396132144 (8h12m1.217083203s) [noise=true , address=104.36.82.56:4250 , piece_id=XUWJOG5VNT73RWAJL55OOCZQ5COVUF7BCX25FMWRN5PNFN4EIK4Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:14.546459073 (8h12m1.367410131s) [noise=true , address=104.36.82.41:4761 , piece_id=LXBMBQNFZ34VBXSTQT2OGHOHDBSXRAMXQZDQVIAPI4VBAZHX5WVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.221015933 (8h12m2.041966993s) [noise=true , address=104.36.82.11:4140 , piece_id=X5AGP25SGM5XN6GFKMIKZ2D2ZUOZMAOGEBFKQYF2ZXK5N2POL34Q, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748393052 (8h12m2.569344096s) [noise=true , address=104.36.82.44:4899 , piece_id=HY47GIIN7XYAYD7IVTZZZVDBAUMS3O246LMA3LRFYE5S64E2KIVQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: <nil> Jul 29 00:57:15.748417172 (8h12m2.569368218s) [seg_pos={0 0}, upload=7876]: Segment reached optimal threshold of 14 pieces. Jul 29 00:57:15.749206649 (8h12m2.570157707s) [noise=true , address=104.36.82.9:4022 , piece_id=RZEYCTNFL665QJLS72DACNIN4YHJBIYUTQJHC46AFC5VWZX4KT2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: rpc: dial tcp 104.36.82.9:4022: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749267454 (8h12m2.570218511s) [noise=true , address=104.36.82.15:4261 , piece_id=X3QPWXYL56CTAMWN6QQ4DMHR3PA6SRXC2RQT7F5VQ466FRHUSU2A, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i1jcJdEP7Ch9uaGcjDaVxpodx55dJEHUKFbcr1GeKQ9waWjYz): protocol: rpc: dial tcp 104.36.82.15:4261: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749317013 (8h12m2.570268071s) [noise=true , address=104.36.82.12:4178 , piece_id=WKBTNGB4FYVB3UNIQUJOWDNJVCZC654WYKYQEB4VLVTQJBE42DOA, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LjJ3SmaNTQi8U1rPSGmR461UYC2CfMtoZ22SSV97hDuhMwC4V): protocol: rpc: dial tcp 104.36.82.12:4178: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749364223 (8h12m2.57031528s) [noise=true , address=104.36.82.54:4161 , piece_id=MPCO7EDX62LIJFE7SABOLUFBMMBGAF7IX44QDDNYWAPWCLGLBJXQ, seg_pos={0 0}, upload=7876]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: write tcp 159.223.143.39:52662->104.36.82.54:4161: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 00:57:15.749375048 (8h12m2.570326096s) [seg_pos={0 0}, upload=7876]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 00:57:15.749440315 (8h12m2.570391372s) [upload=7876]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 00:57:15.749445230 (8h12m2.570396291s) [upload=7876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 00:59:09.883297069 (8h13m56.704248115s) [upload=7876]: Done uploading segments... Jul 29 00:59:09.883316541 (8h13m56.704267585s) [upload=7876]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.313676703s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)