Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 250.251341ms FAIL (2025-06-22 05:51:18 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 250.279548ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 70.049258ms FAIL (2025-06-22 05:50:47 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 70.074193ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 362.63133ms FAIL (2025-06-22 05:50:24 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 362.650001ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 67.186724ms FAIL (2025-06-22 05:49:44 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 67.273961ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 291.269786ms FAIL (2025-06-22 05:49:24 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 291.300156ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 110.481613ms FAIL (2025-06-22 05:48:52 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 110.499796ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 264.304992ms FAIL (2025-06-22 05:48:22 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 264.328872ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 251.27969ms FAIL (2025-06-22 05:47:53 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 251.29932ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 290.274628ms FAIL (2025-06-22 05:47:29 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 290.290078ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.002008645s FAIL (2025-06-22 05:47:24 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 30.002036778s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.062541603s FAIL (2025-06-22 04:23:17 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 2.062566902s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 3.533300189s FAIL (2025-06-22 04:22:43 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 3.533329767s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 3.225520565s FAIL (2025-06-22 04:21:56 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 3.225575186s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.034819347s FAIL (2025-06-22 04:20:40 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 2.034852658s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.46988385s FAIL (2025-06-22 04:19:44 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 2.469911546s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.699517943s FAIL (2025-06-22 04:19:25 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 2.699546946s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 3.656321666s FAIL (2025-06-22 04:18:55 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 3.656346355s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.606544157s FAIL (2025-06-22 04:18:38 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 2.606586177s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 3.32286877s FAIL (2025-06-22 04:17:52 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 3.322896849s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.281256533s FAIL (2025-06-22 04:16:54 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 5.281285862s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.153079549s FAIL (2025-06-22 04:16:14 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 6.153105832s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 4.559017631s FAIL (2025-06-22 04:15:05 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 4.559051408s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 6.364403875s FAIL (2025-06-22 04:14:41 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 6.364434654s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 11.794813773s FAIL (2025-06-22 04:14:09 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 11.794840828s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 4.858207797s FAIL (2025-06-22 04:13:39 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 4.858253858s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.841239478s FAIL (2025-06-22 04:13:16 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 2.841266293s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.732978178s FAIL (2025-06-22 04:12:34 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 5.733006751s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 4.698523434s FAIL (2025-06-22 04:11:25 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 4.698567665s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 8.542569032s FAIL (2025-06-22 04:10:35 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 8.542691772s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.714195744s FAIL (2025-06-22 04:10:12 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 6.714228295s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 4.81641963s FAIL (2025-06-22 04:08:56 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 4.816452449s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 3.760145844s FAIL (2025-06-22 04:07:55 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 3.760195031s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 4.756671053s FAIL (2025-06-22 04:07:39 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 4.756700564s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 9.436990081s FAIL (2025-06-22 04:07:17 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 9.437159465s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 9.832577822s FAIL (2025-06-22 04:06:32 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 9.832608857s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 9.779494688s FAIL (2025-06-22 04:05:27 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 9.779529035s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 12.667847968s FAIL (2025-06-22 04:04:49 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 12.667876776s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 18.946501907s FAIL (2025-06-22 04:04:20 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 18.946527132s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 3.663215726s FAIL (2025-06-22 04:03:26 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 3.663242783s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 9.95903738s FAIL (2025-06-22 04:02:21 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 9.959094526s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.584150857s FAIL (2025-06-22 04:01:39 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 5.584173875s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 10.735934159s FAIL (2025-06-22 04:01:27 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 10.736005238s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 8.990047271s FAIL (2025-06-22 04:01:09 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 8.990075686s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 15.092524596s FAIL (2025-06-22 04:00:09 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 15.092583518s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 7.996914007s FAIL (2025-06-22 03:59:15 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 7.996943874s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 12.186474772s FAIL (2025-06-22 03:58:58 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 12.186519602s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 10.777649471s FAIL (2025-06-22 03:58:13 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 10.777692063s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 15.357120938s FAIL (2025-06-22 03:57:11 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 15.357152232s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 9.338179251s FAIL (2025-06-22 03:56:17 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 9.338208147s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 14.71505954s FAIL (2025-06-22 03:55:18 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 4 (83h17m33.572378185s) [upload=66665]: Uploading segments... Jun 22 03:40:58.009397890 (83h17m33.572720878s) [upload=66665]: Got next segment. Inline: false Jun 22 03:40:58.009451249 (83h17m33.572774249s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 03:40:58.009457748 (83h17m33.572780755s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 03:40:58.044661723 (83h17m33.607984722s) [seg_pos={0 0}, upload=66665]: Begin upload segment... Jun 22 03:40:58.044722729 (83h17m33.608045718s) [seg_pos={0 0}, upload=66665]: Done begin upload segment. Jun 22 03:40:58.044746618 (83h17m33.608069618s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.044784017 (83h17m33.608107034s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045240611 (83h17m33.608563622s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.045699560 (83h17m33.609022565s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046153432 (83h17m33.609476443s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046516869 (83h17m33.609839878s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.046897154 (83h17m33.610220195s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047287027 (83h17m33.610610033s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047564954 (83h17m33.610887959s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047691900 (83h17m33.611014907s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.047925386 (83h17m33.611248395s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048123429 (83h17m33.611446434s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048331201 (83h17m33.61165421s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.048701328 (83h17m33.612024333s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049050929 (83h17m33.612373939s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049392658 (83h17m33.612715669s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.049754448 (83h17m33.613077451s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.050127175 (83h17m33.613450178s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Uploading piece... Jun 22 03:40:58.091864444 (83h17m33.655187435s) [noise=true , address=79.127.219.48:4076 , piece_id=UQM6DRGET6FQFND5HU4CTJDIC4337XX6MK5NJV5XQPOK7AFCPSMQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1QeLZQsubmwYFwTPC9ipEgKJJvFjJ7VrXLC7QncaYoPyyFM4Fn, address:79.127.219.48:4076): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.161661930 (83h17m33.72498492s) [upload=66665]: Next returned nil segment Jun 22 03:40:58.161681692 (83h17m33.725004695s) [upload=66665]: Waiting for error group managing segments... Jun 22 03:40:58.190491904 (83h17m33.753814895s) [noise=true , address=104.36.82.11:6125 , piece_id=NP2722BQYMG5H7RQD3TLWYO23TFPT3HSBZFS6JRYYBFYBZWHEB5A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:6125): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.207750455 (83h17m33.77107344s) [noise=true , address=77.90.31.14:4688 , piece_id=GHO7ZNMRBXPWN34PPDFGKPOOA7L65YVO6AYHFFP5R4XCUGACY3DQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:40:58.531973385 (83h17m34.095296379s) [noise=true , address=64.49.13.169:5711 , piece_id=ROPI2UEYUINLDKQ4IEVWXTYGSU3PXWGXFI7TC2L675L2KENKWWEQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: ecclient: upload failed (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu, address:64.49.13.169:5711): protocol: storage node overloaded, request limit: 2000 Jun 22 03:40:58.990571568 (83h17m34.553894561s) [noise=true , address=104.36.82.9:6016 , piece_id=MLPYRXQYKDFRHRQ4BKELVLTJD6ZMOHM7YSCS5O5HH6525IQOBPGQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.325760684 (83h17m35.889083676s) [noise=true , address=104.36.82.14:6227 , piece_id=B4YO53N2MW6VCC5KHU5LWN6PQNGAJ4ULDPFLHL3OFRP3IBDUSVCA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:00.953756837 (83h17m36.517079837s) [noise=true , address=45.91.116.8:5058 , piece_id=FVHGWLW7PVRET7FKWLXJ6V6MUJKWVTFNOKLGIEQQI72ZXZTW74BA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.386979509 (83h17m36.950302499s) [noise=true , address=104.36.82.10:6112 , piece_id=56XUDWBP5SSSKOWDY2N2JV6PV63VXTROBOJQLZUUKGLI2ZBE7YMA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.689801010 (83h17m37.253124004s) [noise=true , address=104.36.82.3:5792 , piece_id=W2WE2U645R765EZI5CGYAOLJWIS6LQIGEFVNZUK4PS2IC6HEUILA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:01.856352835 (83h17m37.419675823s) [noise=true , address=104.36.82.5:5856 , piece_id=ZATJRQE4NARTU5JDY3XMUDSW5E6DTQZPTD5VQV5OIANWC2CSNARA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.717835535 (83h17m39.281158548s) [noise=true , address=104.36.82.42:6832 , piece_id=TRXGPKOEU7HPFSEDKPJN3C6GJOBUZPBM6CNPZWS6ZLOHO2F7SSLA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:03.961658935 (83h17m39.524981945s) [noise=true , address=79.127.220.97:4363 , piece_id=5HMOMDEQKEOHRF67UVYFYSKIMH2IRLMME6S7XKDNVAMAFHE5EO6Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:09.244412959 (83h17m44.807735964s) [noise=true , address=104.36.82.56:4252 , piece_id=KHT4ZUAQRO7NJ2IWH6FORUJSH5V2UFKTGYJETRL5SLYRU2D57V4A, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:14.056547620 (83h17m49.619870606s) [noise=true , address=104.36.82.53:4136 , piece_id=QK4OSCIQAD6IB3I4QK4KYU4MTZEOPDJC5GG6HLMCUAXGDNLMSFYA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:19.882456778 (83h17m55.445779771s) [noise=true , address=104.36.82.55:4217 , piece_id=6DKIHWLLTMCGBT63TAG234VGEPOX7QCTXLOBVQSG56LJS5YYSPPA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:28.035171487 (83h18m3.598494478s) [noise=true , address=104.36.82.52:4094 , piece_id=7AXGQ6CXE6H7GTURGOCHG3UBTV3VWLVNIXPNM2NAN7IR2RQCTRIA, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717732997 (83h18m33.281055985s) [noise=true , address=104.36.82.12:6158 , piece_id=VWTJS7XRTMBJFUNAYMZCJQ2EEMT5CVILS4JWMPUK5GIYPLQADAJQ, seg_pos={0 0}, upload=66665]: Done uploading piece. err: <nil> Jun 22 03:41:57.717762830 (83h18m33.281085829s) [seg_pos={0 0}, upload=66665]: Segment reached optimal threshold of 14 pieces. Jun 22 03:41:57.718005914 (83h18m33.281328913s) [noise=true , address=104.36.82.54:4167 , piece_id=I4FIVN2M4OF7EARPGIY3X72D2DOARBQGIRU2W7KCCOMUEEMZ776Q, seg_pos={0 0}, upload=66665]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hhT46NW5CQ7dWHRxy5MSjyKc3PiQqBifThT7dBmx2sgNvn8GZ): protocol: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56114->104.36.82.54:4167: use of closed network connection Jun 22 03:41:57.718019794 (83h18m33.281342793s) [seg_pos={0 0}, upload=66665]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 03:41:57.718095039 (83h18m33.281418038s) [upload=66665]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 03:41:57.718100732 (83h18m33.281423731s) [upload=66665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 03:41:57.767433584 (83h18m33.330756651s) [upload=66665]: Done uploading segments... Jun 22 03:41:57.767452412 (83h18m33.330775402s) [upload=66665]: Upload finished. err: <nil> Duration: 14.715092678s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)