Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 573.209002ms FAIL (2025-07-29 08:57:02 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 573.313213ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 378.709701ms FAIL (2025-07-29 08:56:46 UTC) orbiter warning: uplink: too many requests Duration: 378.736125ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 514.894753ms FAIL (2025-07-29 08:56:34 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 514.930367ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 312.865353ms FAIL (2025-07-29 08:56:27 UTC) orbiter warning: uplink: too many requests Duration: 312.887823ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...............................XX...........................] duration: 793.612404ms FAIL (2025-07-29 08:56:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 793.646395ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 1.276932726s FAIL (2025-07-29 08:55:47 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1.276965383s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 412.27104ms FAIL (2025-07-29 08:55:35 UTC) orbiter warning: uplink: too many requests Duration: 412.29822ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [................................XX..........................] duration: 749.891236ms FAIL (2025-07-29 08:55:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 749.918146ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.................................XX.........................] duration: 816.876812ms FAIL (2025-07-29 08:54:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 816.900975ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 1.063573344s FAIL (2025-07-29 08:54:44 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1.063602161s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 346.012527ms FAIL (2025-07-29 08:54:30 UTC) orbiter warning: uplink: too many requests Duration: 346.040616ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 515.1282ms FAIL (2025-07-29 08:54:14 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 515.157013ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..................................XX........................] duration: 747.727248ms FAIL (2025-07-29 08:54:03 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 747.781844ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 214.340062ms FAIL (2025-07-29 08:53:20 UTC) orbiter warning: uplink: too many requests Duration: 214.370547ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 497.530253ms FAIL (2025-07-29 08:53:13 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 497.574639ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 193.322371ms FAIL (2025-07-29 08:53:02 UTC) orbiter warning: uplink: too many requests Duration: 193.349947ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...................................XX.......................] duration: 507.689313ms FAIL (2025-07-29 08:52:49 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 507.722775ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 196.811136ms FAIL (2025-07-29 08:52:20 UTC) orbiter warning: uplink: too many requests Duration: 196.841008ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 469.157824ms FAIL (2025-07-29 08:52:17 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 469.205639ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....................................XX......................] duration: 739.344441ms FAIL (2025-07-29 08:52:16 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 739.376446ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 514.231114ms FAIL (2025-07-29 08:51:58 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 514.260182ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 193.119309ms FAIL (2025-07-29 08:51:39 UTC) orbiter warning: uplink: too many requests Duration: 193.18274ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 432.970615ms FAIL (2025-07-29 08:51:27 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 433.05328ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 416.537755ms FAIL (2025-07-29 08:51:11 UTC) orbiter warning: uplink: too many requests Duration: 416.57029ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration: 540.201453ms FAIL (2025-07-29 08:51:07 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 540.246057ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 260.829032ms FAIL (2025-07-29 08:50:23 UTC) orbiter warning: uplink: too many requests Duration: 260.865132ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 420.416798ms FAIL (2025-07-29 08:50:22 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 420.444765ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......................................XX....................] duration: 673.927118ms FAIL (2025-07-29 08:49:56 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 673.978536ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 406.154457ms FAIL (2025-07-29 08:49:39 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 406.191615ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 224.598648ms FAIL (2025-07-29 08:49:37 UTC) orbiter warning: uplink: too many requests Duration: 224.630882ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......................................XX...................] duration: 432.73009ms FAIL (2025-07-29 08:49:29 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 432.761908ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 194.404893ms FAIL (2025-07-29 08:48:54 UTC) orbiter warning: uplink: too many requests Duration: 194.459751ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 490.139678ms FAIL (2025-07-29 08:48:51 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 490.166633ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........................................XX..................] duration: 457.893983ms FAIL (2025-07-29 08:48:25 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 457.937792ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 451.542714ms FAIL (2025-07-29 08:47:54 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 451.580557ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 181.258837ms FAIL (2025-07-29 08:47:49 UTC) orbiter warning: uplink: too many requests Duration: 181.294492ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........................................XX.................] duration: 528.531948ms FAIL (2025-07-29 08:47:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 528.562016ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........................................XX................] duration: 501.754093ms FAIL (2025-07-29 08:47:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 501.786739ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 225.240048ms FAIL (2025-07-29 08:47:03 UTC) orbiter warning: uplink: too many requests Duration: 225.268057ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 425.306931ms FAIL (2025-07-29 08:46:51 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 425.335897ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 435.725943ms FAIL (2025-07-29 08:46:36 UTC) orbiter warning: uplink: too many requests Duration: 435.767023ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...........................................XX...............] duration: 426.67957ms FAIL (2025-07-29 08:46:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 426.712211ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 498.697712ms FAIL (2025-07-29 08:46:10 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 498.728349ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 203.042254ms FAIL (2025-07-29 08:46:07 UTC) orbiter warning: uplink: too many requests Duration: 203.076446ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [............................................XX..............] duration: 446.552984ms FAIL (2025-07-29 08:45:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 446.584397ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 436.694883ms FAIL (2025-07-29 08:45:47 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 436.727954ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 193.56156ms FAIL (2025-07-29 08:45:34 UTC) orbiter warning: uplink: too many requests Duration: 193.609644ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 451.839573ms FAIL (2025-07-29 08:45:25 UTC) orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 11) Duration: 451.869485ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 193.310889ms FAIL (2025-07-29 08:44:59 UTC) orbiter warning: uplink: too many requests Duration: 193.342977ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.............................................XX.............] duration: 644.561898ms FAIL (2025-07-29 08:44:53 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== 29396822s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.508952596 (15h48m15.329903666s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509401082 (15h48m15.330352153s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.509818482 (15h48m15.330769553s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510225954 (15h48m15.331177025s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.510633841 (15h48m15.331584912s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511255635 (15h48m15.332206685s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.511671340 (15h48m15.332622423s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512081651 (15h48m15.333032736s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512527046 (15h48m15.333478116s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.512949295 (15h48m15.333900368s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513325303 (15h48m15.334276369s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.513697448 (15h48m15.334648518s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514086620 (15h48m15.335037686s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.514481567 (15h48m15.335432639s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517240884 (15h48m15.338191952s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517683523 (15h48m15.338634588s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.517994621 (15h48m15.338945683s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Uploading piece... Jul 29 08:33:28.637090704 (15h48m15.45804177s) [upload=15205]: Next returned nil segment Jul 29 08:33:28.637111137 (15h48m15.458062204s) [upload=15205]: Waiting for error group managing segments... Jul 29 08:33:28.644180102 (15h48m15.465131163s) [noise=true , address=104.36.82.54:4180 , piece_id=VC7B62RZ7VBXVQOP37CYRVWCYBP32YVI7OTC5XVD2B2ERRGR6PRA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645592621 (15h48m15.466543676s) [noise=true , address=104.36.82.44:4875 , piece_id=57S6ZDPCLD4TQAHTJXFQPT6QIBJPS4TBX2ZB5N75JLNXNTOAML6A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.645978711 (15h48m15.466929759s) [noise=true , address=104.36.82.47:4542 , piece_id=GBSP4F7KD7JDGMMFUU225YJJOZNSYN3R5GFSM5YTCEX5KU7C4ZIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646138005 (15h48m15.467089069s) [noise=true , address=104.36.82.46:4484 , piece_id=Q5GI6NHHARUAW2UIH3C2XXH4CATE7JAPDG3MMYG5MVRNH4MVU5QA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.646644108 (15h48m15.467595157s) [noise=true , address=104.36.82.3:4770 , piece_id=3L2ES5H7QZXYQY4M3TLTACXXGENEEIYNK5XSEZQ4LQ22ARV2ORIQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647053901 (15h48m15.468004958s) [noise=true , address=104.36.82.47:4540 , piece_id=IWWXSY6BF7VTLHERVVFPUBR5KNFXAZMVNBRQ5BMACGGGEMZUUJMQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647286518 (15h48m15.468237565s) [noise=true , address=104.36.82.46:4498 , piece_id=3M6OZG632UKHMQKYIMAREZ6GKCL4GWUANWLS3C5FJ3Q3Z2GUK3YA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647762434 (15h48m15.468713495s) [noise=true , address=104.36.82.12:4173 , piece_id=H6CRX6F7HLEOEHCJEGODL5TARQWTMR67TJFBXPHCIXI4OZG4B2CA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.647881559 (15h48m15.468832609s) [noise=true , address=104.36.82.4:4816 , piece_id=IES5GV3FHWWRUJESJJKK5PXGSTEITI3NDJOEWKYYSJB2CPE2ZCAQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:33:28.649052927 (15h48m15.470003986s) [noise=true , address=104.36.82.53:4129 , piece_id=JLQVER4QJXVNBWL3245NODYTH3PCJC62PK5XZOR2HHHINXPHXRZQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: <nil> Jul 29 08:34:28.398854510 (15h49m15.219805573s) [noise=true , address=104.36.82.15:4287 , piece_id=KPL4LQW6VOXONTMT5O5L56KC32UF5XW574GEPVKGBRH4LPDUYLHA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12GvK5gHFVFqvbPjGEKssvcjczZYCw1TVf1q3y7G9qhhhgeU6BJ, address:104.36.82.15:4287): protocol: rpc: dial tcp 104.36.82.15:4287: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.398948736 (15h49m15.219899797s) [noise=true , address=104.36.82.15:4270 , piece_id=JOCDSZIED633CCYHWGSHYOWN6ENN6UMWA66T4OPLIBT6G4M3F2RA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1nkuzy3vxeLdHhVs73Nceje7qXDiGJ1zEhpGgGKSk3cKb7vJbB, address:104.36.82.15:4270): protocol: rpc: dial tcp 104.36.82.15:4270: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399236812 (15h49m15.220187859s) [noise=true , address=104.36.82.10:4094 , piece_id=CTP6DS7PU64SF7RIRGU5K2ZDVNZWHJSGDD2TQPDPDKURN4IE3RYA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:124zBCfZBTW69BSaGRzUyjWUBjSJhaLMZXQYnqMPGSKL4EX6HVV, address:104.36.82.10:4094): protocol: write tcp 159.223.143.39:47998->104.36.82.10:4094: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399307635 (15h49m15.220258695s) [noise=true , address=104.36.82.5:4847 , piece_id=ECZM2XPPNMWPZHALAFSEGKCA2MHIE5RLCODT4YKW4VWPV3U3CRWQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:104.36.82.5:4847): protocol: rpc: dial tcp 104.36.82.5:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399531548 (15h49m15.220482591s) [noise=true , address=104.36.82.55:4199 , piece_id=34CQP7ADVD7TOMVG6H7KFIIDIRJ2MKFSY7JWOUUUBYPZMSBPG6MQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1mCH3fNEMd64WztUYYRCE2KUdJgLxWGoPUfEe4KaF34YhUxUXx, address:104.36.82.55:4199): protocol: rpc: dial tcp 104.36.82.55:4199: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399623256 (15h49m15.220574315s) [noise=true , address=104.36.82.42:4831 , piece_id=X4QAWE6B5437AAMLFF4ZSNGJ3OLCHZ4SV3MF3X2FXIC5AKQIMOEA, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12hZK8xSEF54FaK2tBkB4BVHywDuJs45HisTs2SJ7ZrnuKkoDDX, address:104.36.82.42:4831): protocol: rpc: dial tcp 104.36.82.42:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399684285 (15h49m15.220635344s) [noise=true , address=104.36.82.6:4892 , piece_id=AU2UKHKRQWF2VPJ5QVAU2GY463JUNYPCDTHZJVHHM5RVWW2UT4QQ, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:12MmZivyjXMMHcDgU3aG4HkWqBgY2QRf4Q1pkxJDF5QKSTQ7RXA, address:104.36.82.6:4892): protocol: rpc: dial tcp 104.36.82.6:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399697381 (15h49m15.220648427s) [noise=true , address=104.36.82.13:4189 , piece_id=PMGLKJR4AGWV4YXFEAZD3KFZL73HTD6YPFM2XJCVHF6RJHD4E37A, seg_pos={0 0}, upload=15205]: Done uploading piece. err: ecclient: upload failed (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv, address:104.36.82.13:4189): protocol: rpc: dial tcp 104.36.82.13:4189: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 08:34:28.399729611 (15h49m15.220680656s) [seg_pos={0 0}, upload=15205]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Jul 29 08:34:28.428326033 (15h49m15.24927709s) [upload=15205]: Done uploading segments... Jul 29 08:34:28.428418415 (15h49m15.249369478s) [upload=15205]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 644.591088ms core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)