Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................................................X.........] duration: 806.33492ms trace: https://jaeger.dev.storj.io/trace/548b25e7698c55e FAIL (2026-05-25 12:36:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 806.37583ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................................................X........] duration: 852.039268ms trace: https://jaeger.dev.storj.io/trace/548b25e7698c55e FAIL (2026-05-25 12:36:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 852.15118ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................................................X.......] duration: 814.579014ms trace: https://jaeger.dev.storj.io/trace/548b25e7698c55e FAIL (2026-05-25 12:36:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 814.62024ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................................................X......] duration: 884.21266ms trace: https://jaeger.dev.storj.io/trace/548b25e7698c55e FAIL (2026-05-25 12:35:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 884.246686ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................................X.....] duration: 799.977004ms trace: https://jaeger.dev.storj.io/trace/548b25e7698c55e FAIL (2026-05-25 12:34:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 800.048018ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................................X....] duration: 823.257812ms trace: https://jaeger.dev.storj.io/trace/548b25e7698c55e FAIL (2026-05-25 12:33:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 823.27864ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................................................X...] duration: 835.631396ms trace: https://jaeger.dev.storj.io/trace/548b25e7698c55e FAIL (2026-05-25 12:33:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 835.652865ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................................X..] duration: 845.685201ms trace: https://jaeger.dev.storj.io/trace/548b25e7698c55e FAIL (2026-05-25 12:33:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 845.726936ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................................X.] duration: 775.702007ms trace: https://jaeger.dev.storj.io/trace/548b25e7698c55e FAIL (2026-05-25 12:32:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 775.749076ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 5.001952424s trace: https://jaeger.dev.storj.io/trace/548b25e7698c55e FAIL (2026-05-25 12:31:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001973106s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 1.975832611s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:49:47 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 1.975858832s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.209954806s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:49:16 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 2.209989988s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 1.937409528s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:48:09 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 1.937457917s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.27828226s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:47:27 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 2.278319089s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.046279108s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:46:42 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 2.046305511s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [X....X......................................................] duration: 2.52902028s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:45:56 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 2.529139358s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.X....X.....................................................] duration: 2.075439606s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:45:25 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 2.075549095s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..X....X....................................................] duration: 2.086610412s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:45:07 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 2.086639876s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...X....X...................................................] duration: 2.280597835s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:44:37 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 2.280626479s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....X....X..................................................] duration: 26.648333238s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:44:35 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 26.648368409s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....X....X.................................................] duration: 7.903484449s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:43:26 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 7.903518289s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......X....X................................................] duration: 1.993023254s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:42:12 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 1.993056963s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......X....X...............................................] duration: 2.787475405s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:41:54 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 2.787505783s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........X....X..............................................] duration: 2.146421803s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:40:40 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 2.146465927s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.........X....X.............................................] duration: 2.034782648s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:40:24 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 2.03481689s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..........X....X............................................] duration: 1.880733464s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:39:33 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 1.88077243s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...........X....X...........................................] duration: 2.360400569s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:38:55 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 2.3604296s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [............X....X..........................................] duration: 4.02549144s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:37:49 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 4.025592186s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.............X....X.........................................] duration: 1.943995264s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:36:57 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 1.944045288s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 806.528562ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:36:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 806.623757ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..............X....X........................................] duration: 1.94322899s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:35:42 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 1.943251356s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.X..........................................................] duration: 996.187558ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:35:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 996.209081ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...............X....X.......................................] duration: 4.577145586s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:35:11 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 4.577178071s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..X.........................................................] duration: 844.342698ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:35:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 844.370221ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [................X....X......................................] duration: 2.017240636s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:34:41 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 2.017290337s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...X........................................................] duration: 835.038891ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:34:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 835.070331ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....X.......................................................] duration: 793.872407ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:33:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 793.903015ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.................X....X.....................................] duration: 1.972154421s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:33:34 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 1.972180587s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....X......................................................] duration: 892.845349ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:33:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 892.880897ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..................X....X....................................] duration: 3.870097093s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:32:37 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 3.87013737s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...................X....X...................................] duration: 18.378106558s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:32:32 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 18.378132841s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......X.....................................................] duration: 808.905682ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:32:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 808.937032ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......X....................................................] duration: 789.195098ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:31:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 789.224927ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....................X....X..................................] duration: 2.42042547s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:31:17 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 2.420453838s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........X...................................................] duration: 773.649749ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:30:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 773.73367ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....................X....X.................................] duration: 6.820892738s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:30:44 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 6.820931345s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........X..................................................] duration: 838.548656ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:30:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 838.607294ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........X.................................................] duration: 961.146001ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:29:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 961.339535ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......................X....X................................] duration: 1.954906719s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:29:49 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 1.955013612s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........X................................................] duration: 1.129710833s trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:29:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.129760617s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)