Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 394.802059ms FAIL (2025-07-29 08:44:51 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 394.833656ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 311.536189ms FAIL (2025-07-29 08:44:21 UTC) orbiter warning: uplink: too many requests Duration: 311.56261ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..............................................XX............] duration: 439.047901ms FAIL (2025-07-29 08:44:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 439.074844ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 182.318301ms FAIL (2025-07-29 08:43:59 UTC) orbiter warning: uplink: too many requests Duration: 182.366994ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 515.232833ms FAIL (2025-07-29 08:43:53 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 515.262048ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 424.837773ms FAIL (2025-07-29 08:43:25 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 424.865901ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 202.208972ms FAIL (2025-07-29 08:43:18 UTC) orbiter warning: uplink: too many requests Duration: 202.276938ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...............................................XX...........] duration: 465.267317ms FAIL (2025-07-29 08:43:11 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 465.293308ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 190.216298ms FAIL (2025-07-29 08:42:52 UTC) orbiter warning: uplink: too many requests Duration: 190.247726ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 418.094256ms FAIL (2025-07-29 08:42:45 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 418.11866ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 178.499931ms FAIL (2025-07-29 08:42:23 UTC) orbiter warning: uplink: too many requests Duration: 178.531608ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [................................................XX..........] duration: 406.515951ms FAIL (2025-07-29 08:41:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 406.55618ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 381.955389ms FAIL (2025-07-29 08:41:51 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 381.985405ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 407.510613ms FAIL (2025-07-29 08:41:51 UTC) orbiter warning: uplink: too many requests Duration: 407.547055ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.................................................XX.........] duration: 460.307962ms FAIL (2025-07-29 08:41:42 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 460.338445ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [X...............................................X...........] duration: 437.211792ms FAIL (2025-07-29 08:41:30 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 437.381853ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 275.178574ms FAIL (2025-07-29 08:41:10 UTC) orbiter warning: uplink: too many requests Duration: 275.208103ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 197.894746ms FAIL (2025-07-29 08:40:52 UTC) orbiter warning: uplink: too many requests Duration: 197.926739ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..................................................XX........] duration: 499.727544ms FAIL (2025-07-29 08:40:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 499.76226ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 341.437754ms FAIL (2025-07-29 08:40:23 UTC) orbiter warning: uplink: too many requests Duration: 341.461812ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X...............................................X..........] duration: 548.619118ms FAIL (2025-07-29 08:40:20 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 548.65946ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...................................................XX.......] duration: 540.807355ms FAIL (2025-07-29 08:40:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 540.856558ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X...............................................X.........] duration: 579.578446ms FAIL (2025-07-29 08:39:51 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 579.616585ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 214.193518ms FAIL (2025-07-29 08:39:44 UTC) orbiter warning: uplink: too many requests Duration: 214.221903ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....................................................XX......] duration: 479.576941ms FAIL (2025-07-29 08:39:32 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 479.611717ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 213.297375ms FAIL (2025-07-29 08:39:25 UTC) orbiter warning: uplink: too many requests Duration: 213.470346ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X...............................................X........] duration: 460.493896ms FAIL (2025-07-29 08:39:01 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 460.531165ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X...............................................X.......] duration: 514.285665ms FAIL (2025-07-29 08:38:45 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 514.30911ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................XX.....] duration: 507.568162ms FAIL (2025-07-29 08:38:24 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 507.597592ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 206.260288ms FAIL (2025-07-29 08:38:20 UTC) orbiter warning: uplink: too many requests Duration: 206.300641ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X...............................................X......] duration: 647.186675ms FAIL (2025-07-29 08:37:56 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 647.220594ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 178.781129ms FAIL (2025-07-29 08:37:51 UTC) orbiter warning: uplink: too many requests Duration: 178.801347ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......................................................XX....] duration: 568.202941ms FAIL (2025-07-29 08:37:29 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 568.240277ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X...............................................X.....] duration: 488.476436ms FAIL (2025-07-29 08:37:23 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 488.504899ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 210.599074ms FAIL (2025-07-29 08:37:07 UTC) orbiter warning: uplink: too many requests Duration: 210.635723ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X...............................................X....] duration: 453.739537ms FAIL (2025-07-29 08:36:34 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 453.76626ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................XX...] duration: 624.725621ms FAIL (2025-07-29 08:36:33 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 624.760096ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X...............................................X...] duration: 522.661775ms FAIL (2025-07-29 08:36:11 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 522.77614ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X...................................X.......................] duration: 264.088568ms FAIL (2025-07-29 08:35:53 UTC) orbiter warning: uplink: too many requests Duration: 264.121294ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X...............................................X..] duration: 447.063202ms FAIL (2025-07-29 08:35:32 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 447.205704ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X...................................X......................] duration: 203.307336ms FAIL (2025-07-29 08:35:20 UTC) orbiter warning: uplink: too many requests Duration: 203.402646ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........................................................XX..] duration: 438.384592ms FAIL (2025-07-29 08:35:19 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 438.430209ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................XX.] duration: 50.134934283s FAIL (2025-07-29 08:35:18 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 50.13498069s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X...............................................X.] duration: 415.466509ms FAIL (2025-07-29 08:34:40 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 415.504348ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.032936253s FAIL (2025-07-29 08:34:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 1m0.03296226s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X...................................X.....................] duration: 191.784637ms FAIL (2025-07-29 08:34:11 UTC) orbiter warning: uplink: too many requests Duration: 191.814603ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X...............................................X] duration: 30.03315288s FAIL (2025-07-29 08:33:56 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 30.033178013s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X...................................X....................] duration: 452.674589ms FAIL (2025-07-29 08:33:31 UTC) orbiter warning: uplink: too many requests Duration: 452.701801ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.030709038s FAIL (2025-07-29 08:33:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 8.328921973 (15h47m15.149873033s) [upload=15191]: Got next segment. Inline: false Jul 29 08:32:28.328972154 (15h47m15.149923224s) [upload=15191]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 08:32:28.328978951 (15h47m15.149930018s) [upload=15191]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 08:32:28.408284979 (15h47m15.229236055s) [seg_pos={0 0}, upload=15191]: Begin upload segment... Jul 29 08:32:28.408377647 (15h47m15.229328706s) [seg_pos={0 0}, upload=15191]: Done begin upload segment. Jul 29 08:32:28.411185993 (15h47m15.232137065s) [noise=true , address=104.36.82.5:4870 , piece_id=7JHFNJMGEGDRBJM7QBVWLN6BXK7CHCUX3GJUZQZFF3XHLKSZID6A, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.411221038 (15h47m15.2321721s) [noise=true , address=104.36.82.10:4092 , piece_id=KSDVLYQMF4DOKAVGPLHB7BZINPNGF4SI5EPDWEZU4XVMYFDCHOMQ, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.411797012 (15h47m15.232748082s) [noise=true , address=104.36.82.44:4881 , piece_id=XXQX53Y47QVRD4KXKCRRS5UK56FOD7QDNMNJPRA5ED7ATPDWNZYQ, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.412252247 (15h47m15.233203319s) [noise=true , address=104.36.82.3:4773 , piece_id=AS2FBDD22GM5KRGMSQ325Q4R5LGS7ACMCNK7ULR3JUXEGRLQIHKQ, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.412534229 (15h47m15.233485295s) [noise=true , address=104.36.82.12:4176 , piece_id=37F33V6BM6DVJVIQ7NO6I37LSSNZBNKTBJ5FJ63SJGQXQOWALPDA, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.412782935 (15h47m15.233734014s) [noise=true , address=104.36.82.54:4184 , piece_id=GNEPZVTYYRD5LK3JHP3TACZ2NTBUXIGNTYZBRTMXJQD4T7MVVRJQ, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.412955990 (15h47m15.233907058s) [noise=true , address=104.36.82.60:4350 , piece_id=EH7SEY7K6NTYZ2CETSI5NBBLW5EDDUCSDKLHMONLZ7XUZBWS2ZLQ, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.413282924 (15h47m15.234233999s) [noise=true , address=104.36.82.53:4136 , piece_id=WKVOWJ6HNEBMTXB76MHJG7G237XUUHV4ASPCJ7SYQZE2UHM53KAQ, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.413341070 (15h47m15.234292137s) [noise=true , address=104.36.82.11:4145 , piece_id=AM2Y35S5HNE5ZORZMKTT2XJPAY5GWVX7RBOA4E33SRHAHCRG7ZQQ, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.413718578 (15h47m15.234669638s) [noise=true , address=104.36.82.47:4537 , piece_id=X6EDW2S3BKXP5CQXRVVYGEEAP3YRIY3C6SOOV5IIQDAPWRRFBI4A, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.413746985 (15h47m15.234698057s) [noise=true , address=104.36.82.46:4485 , piece_id=SMD3B5IYCRV4UWW4V3PBETTHGYQBN72F3PFZJ7WTW362IA6JEXYQ, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.414087764 (15h47m15.235038831s) [noise=true , address=104.36.82.52:4106 , piece_id=MZSRGSD44HSC6X7LMZLJLEKOGDKU5OZB64OYN5OIFS4EKRKA662Q, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.414177398 (15h47m15.235128486s) [noise=true , address=104.36.82.52:4101 , piece_id=CRVOSIVIHOJMMLKCWR3AFUQE2DRYH277PNGG2RDR7K7JTCXT2AWQ, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.414672004 (15h47m15.235623075s) [noise=true , address=104.36.82.13:4190 , piece_id=PXJERQDXEXBQK5TPIUQTR3N4N4JCBXAR36RZG46ZFZCKSV54HGUQ, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.415305855 (15h47m15.23625692s) [noise=true , address=104.36.82.9:4010 , piece_id=VTBFYGOPWU2DBYJSVIBVKVR3PPSL5NF227SV743CXPZWAFHPPUEQ, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.416904104 (15h47m15.237855172s) [noise=true , address=104.36.82.41:4795 , piece_id=SUO4AR6PQU73FFDOA5NOAKZQBZ3GCUZQF3IYZJQXXHWOH54IZGOQ, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.417351368 (15h47m15.238302435s) [noise=true , address=104.36.82.46:4514 , piece_id=TLUTWKJE5PF2KAFM2GAU5LVRTFJFWM2CSUUHCZTZ5IWKO5X6LC5A, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.417559661 (15h47m15.238510832s) [noise=true , address=104.36.82.62:4413 , piece_id=RXIV656AGGVJA5JVVJJCV4CTQYM7GK2T6FNRMA2L6AO2YBMVGA7Q, seg_pos={0 0}, upload=15191]: Uploading piece... Jul 29 08:32:28.550201105 (15h47m15.371152151s) [upload=15191]: Next returned nil segment Jul 29 08:32:28.550221994 (15h47m15.371173062s) [upload=15191]: Waiting for error group managing segments... Jul 29 08:32:28.559851159 (15h47m15.380802212s) [noise=true , address=104.36.82.3:4773 , piece_id=AS2FBDD22GM5KRGMSQ325Q4R5LGS7ACMCNK7ULR3JUXEGRLQIHKQ, seg_pos={0 0}, upload=15191]: Done uploading piece. err: <nil> Jul 29 08:32:28.560296324 (15h47m15.381247375s) [noise=true , address=104.36.82.52:4101 , piece_id=CRVOSIVIHOJMMLKCWR3AFUQE2DRYH277PNGG2RDR7K7JTCXT2AWQ, seg_pos={0 0}, upload=15191]: Done uploading piece. err: <nil> Jul 29 08:32:28.561085276 (15h47m15.38203632s) [noise=true , address=104.36.82.52:4106 , piece_id=MZSRGSD44HSC6X7LMZLJLEKOGDKU5OZB64OYN5OIFS4EKRKA662Q, seg_pos={0 0}, upload=15191]: Done uploading piece. err: <nil> Jul 29 08:32:28.561131432 (15h47m15.38208248s) [noise=true , address=104.36.82.12:4176 , piece_id=37F33V6BM6DVJVIQ7NO6I37LSSNZBNKTBJ5FJ63SJGQXQOWALPDA, seg_pos={0 0}, upload=15191]: Done uploading piece. err: <nil> Jul 29 08:32:28.562087315 (15h47m15.383038362s) [noise=true , address=104.36.82.60:4350 , piece_id=EH7SEY7K6NTYZ2CETSI5NBBLW5EDDUCSDKLHMONLZ7XUZBWS2ZLQ, seg_pos={0 0}, upload=15191]: Done uploading piece. err: <nil> Jul 29 08:32:28.562240474 (15h47m15.383191525s) [noise=true , address=104.36.82.13:4190 , piece_id=PXJERQDXEXBQK5TPIUQTR3N4N4JCBXAR36RZG46ZFZCKSV54HGUQ, seg_pos={0 0}, upload=15191]: Done uploading piece. err: <nil> Jul 29 08:32:28.563333416 (15h47m15.384284466s) [noise=true , address=104.36.82.54:4184 , piece_id=GNEPZVTYYRD5LK3JHP3TACZ2NTBUXIGNTYZBRTMXJQD4T7MVVRJQ, seg_pos={0 0}, upload=15191]: Done uploading piece. err: <nil> Jul 29 08:32:28.563490306 (15h47m15.384441365s) [noise=true , address=104.36.82.46:4514 , piece_id=TLUTWKJE5PF2KAFM2GAU5LVRTFJFWM2CSUUHCZTZ5IWKO5X6LC5A, seg_pos={0 0}, upload=15191]: Done uploading piece. err: <nil> Jul 29 08:32:28.563941173 (15h47m15.384892218s) [noise=true , address=104.36.82.11:4145 , piece_id=AM2Y35S5HNE5ZORZMKTT2XJPAY5GWVX7RBOA4E33SRHAHCRG7ZQQ, seg_pos={0 0}, upload=15191]: Done uploading piece. err: <nil> Jul 29 08:32:28.563995825 (15h47m15.38494687s) [noise=true , address=104.36.82.62:4413 , piece_id=RXIV656AGGVJA5JVVJJCV4CTQYM7GK2T6FNRMA2L6AO2YBMVGA7Q, seg_pos={0 0}, upload=15191]: Done uploading piece. err: <nil> Jul 29 08:32:28.564563031 (15h47m15.385514075s) [noise=true , address=104.36.82.47:4537 , piece_id=X6EDW2S3BKXP5CQXRVVYGEEAP3YRIY3C6SOOV5IIQDAPWRRFBI4A, seg_pos={0 0}, upload=15191]: Done uploading piece. err: <nil> Jul 29 08:32:28.564828871 (15h47m15.385779916s) [noise=true , address=104.36.82.46:4485 , piece_id=SMD3B5IYCRV4UWW4V3PBETTHGYQBN72F3PFZJ7WTW362IA6JEXYQ, seg_pos={0 0}, upload=15191]: Done uploading piece. err: <nil> Jul 29 08:32:28.569880397 (15h47m15.390831463s) [noise=true , address=104.36.82.44:4881 , piece_id=XXQX53Y47QVRD4KXKCRRS5UK56FOD7QDNMNJPRA5ED7ATPDWNZYQ, seg_pos={0 0}, upload=15191]: Done uploading piece. err: <nil> Jul 29 08:33:28.292800800 (15h48m15.11375187s) [noise=true , address=104.36.82.5:4870 , piece_id=7JHFNJMGEGDRBJM7QBVWLN6BXK7CHCUX3GJUZQZFF3XHLKSZID6A, seg_pos={0 0}, upload=15191]: Done uploading piece. err: ecclient: upload failed (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX, address:104.36.82.5:4870): protocol: rpc: dial tcp 104.36.82.5:4870: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:33:28.292886689 (15h48m15.113837756s) [noise=true , address=104.36.82.10:4092 , piece_id=KSDVLYQMF4DOKAVGPLHB7BZINPNGF4SI5EPDWEZU4XVMYFDCHOMQ, seg_pos={0 0}, upload=15191]: Done uploading piece. err: ecclient: upload failed (node:128P9omT47U7tm1k4XdeUR5vd1VAqskCvyfjF6VDy1ncwMDoZm9, address:104.36.82.10:4092): protocol: write tcp 159.223.143.39:39626->104.36.82.10:4092: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:33:28.292933640 (15h48m15.113884702s) [noise=true , address=104.36.82.53:4136 , piece_id=WKVOWJ6HNEBMTXB76MHJG7G237XUUHV4ASPCJ7SYQZE2UHM53KAQ, seg_pos={0 0}, upload=15191]: Done uploading piece. err: ecclient: upload failed (node:12rkSxE1mCbyoUyh3pPwz6xdw8rXqpeyFrhciFoB8bgs4TkKmyT, address:104.36.82.53:4136): protocol: write tcp 159.223.143.39:33158->104.36.82.53:4136: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:33:28.292974938 (15h48m15.113925997s) [noise=true , address=104.36.82.9:4010 , piece_id=VTBFYGOPWU2DBYJSVIBVKVR3PPSL5NF227SV743CXPZWAFHPPUEQ, seg_pos={0 0}, upload=15191]: Done uploading piece. err: ecclient: upload failed (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp, address:104.36.82.9:4010): protocol: write tcp 159.223.143.39:44160->104.36.82.9:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:33:28.293012212 (15h48m15.113963282s) [noise=true , address=104.36.82.41:4795 , piece_id=SUO4AR6PQU73FFDOA5NOAKZQBZ3GCUZQF3IYZJQXXHWOH54IZGOQ, seg_pos={0 0}, upload=15191]: Done uploading piece. err: ecclient: upload failed (node:12ovwD5mScxxBf7RtRjAbBqRiqgAmTC8ajN3oBAXSaWrDQ1t9xk, address:104.36.82.41:4795): protocol: write tcp 159.223.143.39:53710->104.36.82.41:4795: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:33:28.293080729 (15h48m15.114031799s) [seg_pos={0 0}, upload=15191]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jul 29 08:33:28.320434615 (15h48m15.141385678s) [upload=15191]: Done uploading segments... Jul 29 08:33:28.320511454 (15h48m15.141462518s) [upload=15191]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.030739536s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X...................................X...................] duration: 499.036199ms FAIL (2025-07-29 08:32:41 UTC) orbiter warning: uplink: too many requests Duration: 499.067166ms core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)