Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 924.311537ms FAIL (2025-06-26 18:44:23 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 924.344906ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.030965496s FAIL (2025-06-26 18:43:44 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.030985353s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 1.332772365s FAIL (2025-06-26 18:43:25 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.332798304s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 1.043391071s FAIL (2025-06-26 18:42:34 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.043417469s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.03458212s FAIL (2025-06-26 18:41:32 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.034662548s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.13453628s FAIL (2025-06-26 18:40:55 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.134562089s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 1.215172053s FAIL (2025-06-26 18:40:20 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.215205813s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 901.252986ms FAIL (2025-06-26 18:39:59 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 901.288957ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 987.124282ms FAIL (2025-06-26 18:38:53 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 987.153605ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.012918899s FAIL (2025-06-26 18:37:50 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.012950283s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.189424892s FAIL (2025-06-26 18:37:05 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.189454703s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 858.910314ms FAIL (2025-06-26 18:36:44 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 858.942619ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 801.311663ms FAIL (2025-06-26 18:36:24 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 801.34772ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 952.662048ms FAIL (2025-06-26 18:35:17 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 953.202425ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 1.028641512s FAIL (2025-06-26 18:34:47 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.028747709s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 954.67382ms FAIL (2025-06-26 18:33:52 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 954.703994ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 1.107547493s FAIL (2025-06-26 18:32:39 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.107579046s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 642.088749ms FAIL (2025-06-26 18:31:47 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 642.145628ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 915.21651ms FAIL (2025-06-26 18:30:38 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 915.257481ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 958.350857ms FAIL (2025-06-26 18:29:46 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 958.371489ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 1.456135734s FAIL (2025-06-26 18:29:28 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.456225759s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 1.054576218s FAIL (2025-06-26 18:28:48 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.05460763s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 1.111531301s FAIL (2025-06-26 18:28:15 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.11162286s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 1.227241733s FAIL (2025-06-26 18:27:10 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.2272704s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 1.050358068s FAIL (2025-06-26 18:26:54 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.050409663s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 964.587645ms FAIL (2025-06-26 18:26:29 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 964.65745ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 1.001705301s FAIL (2025-06-26 18:25:43 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.001736775s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 870.48011ms FAIL (2025-06-26 18:25:19 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 870.529745ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 1.306082374s FAIL (2025-06-26 18:25:04 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.306125764s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 1.124525493s FAIL (2025-06-26 18:24:12 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.12456066s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 942.667111ms FAIL (2025-06-26 18:23:05 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 942.698156ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 638.275062ms FAIL (2025-06-26 18:22:33 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 638.308497ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 1.296717824s FAIL (2025-06-26 18:21:37 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.296744521s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 1.017664687s FAIL (2025-06-26 18:20:27 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.01769147s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 1.056039593s FAIL (2025-06-26 18:19:28 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.056069785s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 641.86266ms FAIL (2025-06-26 18:18:34 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 641.886878ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 980.308424ms FAIL (2025-06-26 18:17:45 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 980.337008ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 921.708513ms FAIL (2025-06-26 18:16:33 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 921.737419ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 1.386315357s FAIL (2025-06-26 18:16:04 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.386346871s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 1.35139744s FAIL (2025-06-26 18:15:41 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.351430752s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 1.392295942s FAIL (2025-06-26 18:14:38 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.39232687s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 1.457513431s FAIL (2025-06-26 18:13:28 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.457555671s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 650.504439ms FAIL (2025-06-26 18:12:31 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 650.604511ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 693.505146ms FAIL (2025-06-26 18:11:53 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 693.52998ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 1.368635185s FAIL (2025-06-26 18:10:44 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.368662524s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.23749441s FAIL (2025-06-26 18:10:21 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.237529748s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 542.58418ms FAIL (2025-06-26 18:09:39 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 542.612944ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.400504398s FAIL (2025-06-26 18:08:58 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.40053091s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.115857249s FAIL (2025-06-26 18:08:06 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 1.115883334s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 919.14355ms FAIL (2025-06-26 18:07:30 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== egments... Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment... Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment. Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece... Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments... Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil> Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces. Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments... Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil> Duration: 919.176884ms core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)