Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 1.099924127s trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:17:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 1.099967181s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 193.715153ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:16:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 193.744785ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 277.559208ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:16:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 277.591774ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 260.6622ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:15:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 260.693013ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 268.574853ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:14:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 268.603655ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 256.939162ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:13:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 257.00051ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 202.658374ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:12:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 202.684417ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 199.454928ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:12:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 199.49246ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 202.700492ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:11:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 202.805919ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 241.326415ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:10:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 241.435074ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 197.915146ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:09:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 197.941057ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 280.475807ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:09:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 280.58291ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 223.153382ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:07:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 223.192657ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 206.97173ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:06:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 206.999322ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 195.562492ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:06:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 195.602112ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 320.01479ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:05:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 320.051366ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 207.349676ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:04:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 207.38293ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 219.262013ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:03:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 219.290946ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 256.848867ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:02:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 256.904235ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 212.838871ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:02:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 212.869453ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 205.172123ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:01:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 205.211519ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 227.172612ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:01:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 227.20437ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 254.678576ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 19:00:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 254.70506ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 210.173313ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 18:59:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 210.208317ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 209.15078ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 18:58:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 209.18542ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 207.096254ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 18:57:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 207.120665ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 222.441537ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 18:56:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 222.468845ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 221.279ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 18:56:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 221.328039ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 219.927444ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 18:55:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 219.967634ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 229.973889ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 18:54:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 230.005856ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 219.468699ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 18:54:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 219.509282ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 266.996443ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 18:53:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 267.028216ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 278.1507ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 18:52:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 278.308808ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 201.326363ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 18:51:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 201.354265ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 212.055613ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 18:51:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 212.151749ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 250.614674ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 18:51:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 250.647587ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 100.391101ms trace: https://jaeger.dev.storj.io/trace/4e61caa8af497b0f FAIL (2026-03-18 18:50:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: internal error ======LOGS====== Mar 18 18:50:37.197689801 (295h50m34.794460832s) [upload=331359]: Starting upload Mar 18 18:50:37.197768007 (295h50m34.79453904s) [upload=331359]: Done starting upload Mar 18 18:50:37.197865441 (295h50m34.79463646s) [upload=331359]: Uploading segments... Mar 18 18:50:37.198001255 (295h50m34.794772285s) [upload=331359]: Got next segment. Inline: true Mar 18 18:50:37.198009821 (295h50m34.794780854s) [upload=331359]: Waiting for error group managing segments... Mar 18 18:50:37.198092531 (295h50m34.794863559s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 18:50:37.198099572 (295h50m34.794870604s) [upload=331359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 18:50:37.198103547 (295h50m34.794874571s) [upload=331359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 18:50:37.234689079 (295h50m34.831460108s) [upload=331359]: Done uploading segments... Mar 18 18:50:37.234743231 (295h50m34.831514254s) [upload=331359]: Upload finished. err: metaclient: internal error Duration:* 100.415304ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 1.224036558s trace: https://jaeger.dev.storj.io/trace/72d1768dadcbe46b FAIL (2026-03-18 17:34:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: internal error ======LOGS====== 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.626765311 (293h51m7.22353634s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.627040986 (293h51m7.22381201s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628025201 (293h51m7.224796227s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628325911 (293h51m7.225096946s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628627099 (293h51m7.225398122s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628839133 (293h51m7.225610159s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629107755 (293h51m7.225878781s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629262958 (293h51m7.226033985s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629635295 (293h51m7.226406325s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629653133 (293h51m7.226424146s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630058646 (293h51m7.226829659s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630150638 (293h51m7.226921661s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630482158 (293h51m7.227253192s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630583078 (293h51m7.227354102s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630979980 (293h51m7.227751009s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630991686 (293h51m7.22776271s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.631478670 (293h51m7.228249705s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.702440166 (293h51m7.299211182s) [upload=329111]: Next returned nil segment Mar 18 16:51:09.702456559 (293h51m7.299227582s) [upload=329111]: Waiting for error group managing segments... Mar 18 16:51:09.708407591 (293h51m7.305178602s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.712495525 (293h51m7.309266553s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.725343753 (293h51m7.322114771s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.726981573 (293h51m7.323752582s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.727988660 (293h51m7.324759695s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.733311274 (293h51m7.330082286s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.739872034 (293h51m7.336643065s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.745323402 (293h51m7.342094431s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.762176142 (293h51m7.358947165s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.959127349 (293h51m7.55589838s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.974703744 (293h51m7.571474768s) [noise=true , address=167.17.72.69:4710 , piece_id=QYEKCEVYXUOJNTCPB45SWVAZDXH4PFNBGDHFTUH6M5CLEZMQ7NOQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.984676068 (293h51m7.581447083s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.186312524 (293h51m7.78308355s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209670436 (293h51m7.806441459s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209695349 (293h51m7.806466373s) [seg_pos={0 0}, upload=329111]: Satisfied cohort requirements after 14 pieces Mar 18 16:51:10.209975349 (293h51m7.806746384s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BhogobSTS5pCJxh7NGgnsU5qn1kwDDv25XxQiqqPXGSU9QL9H): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.209988536 (293h51m7.80675957s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210087026 (293h51m7.806858058s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qcwvrgkkT6Q8pVEuUu7fA4wwHXNidvCNnKhrU3DpdqAHKGtLG): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210112972 (293h51m7.806883998s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210410740 (293h51m7.807181771s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cHb8XLk563sSJ6s92CpzfmxwjiydGAe3GjZWqEsZgcmzRqpLR): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210422131 (293h51m7.807193165s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210448494 (293h51m7.807219527s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7G5jzPdqBzSjhVDsktUNK4MDhsBZ9b4BexkjXyVrGCXaujE1): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210461044 (293h51m7.80723208s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210506936 (293h51m7.807277951s) [seg_pos={0 0}, upload=329111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Mar 18 16:51:10.210602806 (293h51m7.80737383s) [upload=329111]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 16:51:10.210609332 (293h51m7.807380355s) [upload=329111]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 16:51:10.262661082 (293h51m7.859432097s) [upload=329111]: Done uploading segments... Mar 18 16:51:10.262684233 (293h51m7.859455246s) [upload=329111]: Upload finished. err: <nil> Duration: 1.224065551s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 1.085363906s trace: https://jaeger.dev.storj.io/trace/72d1768dadcbe46b FAIL (2026-03-18 17:33:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: internal error ======LOGS====== 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.626765311 (293h51m7.22353634s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.627040986 (293h51m7.22381201s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628025201 (293h51m7.224796227s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628325911 (293h51m7.225096946s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628627099 (293h51m7.225398122s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628839133 (293h51m7.225610159s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629107755 (293h51m7.225878781s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629262958 (293h51m7.226033985s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629635295 (293h51m7.226406325s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629653133 (293h51m7.226424146s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630058646 (293h51m7.226829659s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630150638 (293h51m7.226921661s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630482158 (293h51m7.227253192s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630583078 (293h51m7.227354102s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630979980 (293h51m7.227751009s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630991686 (293h51m7.22776271s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.631478670 (293h51m7.228249705s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.702440166 (293h51m7.299211182s) [upload=329111]: Next returned nil segment Mar 18 16:51:09.702456559 (293h51m7.299227582s) [upload=329111]: Waiting for error group managing segments... Mar 18 16:51:09.708407591 (293h51m7.305178602s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.712495525 (293h51m7.309266553s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.725343753 (293h51m7.322114771s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.726981573 (293h51m7.323752582s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.727988660 (293h51m7.324759695s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.733311274 (293h51m7.330082286s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.739872034 (293h51m7.336643065s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.745323402 (293h51m7.342094431s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.762176142 (293h51m7.358947165s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.959127349 (293h51m7.55589838s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.974703744 (293h51m7.571474768s) [noise=true , address=167.17.72.69:4710 , piece_id=QYEKCEVYXUOJNTCPB45SWVAZDXH4PFNBGDHFTUH6M5CLEZMQ7NOQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.984676068 (293h51m7.581447083s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.186312524 (293h51m7.78308355s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209670436 (293h51m7.806441459s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209695349 (293h51m7.806466373s) [seg_pos={0 0}, upload=329111]: Satisfied cohort requirements after 14 pieces Mar 18 16:51:10.209975349 (293h51m7.806746384s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BhogobSTS5pCJxh7NGgnsU5qn1kwDDv25XxQiqqPXGSU9QL9H): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.209988536 (293h51m7.80675957s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210087026 (293h51m7.806858058s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qcwvrgkkT6Q8pVEuUu7fA4wwHXNidvCNnKhrU3DpdqAHKGtLG): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210112972 (293h51m7.806883998s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210410740 (293h51m7.807181771s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cHb8XLk563sSJ6s92CpzfmxwjiydGAe3GjZWqEsZgcmzRqpLR): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210422131 (293h51m7.807193165s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210448494 (293h51m7.807219527s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7G5jzPdqBzSjhVDsktUNK4MDhsBZ9b4BexkjXyVrGCXaujE1): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210461044 (293h51m7.80723208s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210506936 (293h51m7.807277951s) [seg_pos={0 0}, upload=329111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Mar 18 16:51:10.210602806 (293h51m7.80737383s) [upload=329111]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 16:51:10.210609332 (293h51m7.807380355s) [upload=329111]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 16:51:10.262661082 (293h51m7.859432097s) [upload=329111]: Done uploading segments... Mar 18 16:51:10.262684233 (293h51m7.859455246s) [upload=329111]: Upload finished. err: <nil> Duration: 1.085399592s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 1.225063349s trace: https://jaeger.dev.storj.io/trace/72d1768dadcbe46b FAIL (2026-03-18 17:32:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: internal error ======LOGS====== 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.626765311 (293h51m7.22353634s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.627040986 (293h51m7.22381201s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628025201 (293h51m7.224796227s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628325911 (293h51m7.225096946s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628627099 (293h51m7.225398122s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628839133 (293h51m7.225610159s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629107755 (293h51m7.225878781s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629262958 (293h51m7.226033985s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629635295 (293h51m7.226406325s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629653133 (293h51m7.226424146s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630058646 (293h51m7.226829659s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630150638 (293h51m7.226921661s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630482158 (293h51m7.227253192s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630583078 (293h51m7.227354102s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630979980 (293h51m7.227751009s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630991686 (293h51m7.22776271s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.631478670 (293h51m7.228249705s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.702440166 (293h51m7.299211182s) [upload=329111]: Next returned nil segment Mar 18 16:51:09.702456559 (293h51m7.299227582s) [upload=329111]: Waiting for error group managing segments... Mar 18 16:51:09.708407591 (293h51m7.305178602s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.712495525 (293h51m7.309266553s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.725343753 (293h51m7.322114771s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.726981573 (293h51m7.323752582s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.727988660 (293h51m7.324759695s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.733311274 (293h51m7.330082286s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.739872034 (293h51m7.336643065s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.745323402 (293h51m7.342094431s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.762176142 (293h51m7.358947165s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.959127349 (293h51m7.55589838s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.974703744 (293h51m7.571474768s) [noise=true , address=167.17.72.69:4710 , piece_id=QYEKCEVYXUOJNTCPB45SWVAZDXH4PFNBGDHFTUH6M5CLEZMQ7NOQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.984676068 (293h51m7.581447083s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.186312524 (293h51m7.78308355s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209670436 (293h51m7.806441459s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209695349 (293h51m7.806466373s) [seg_pos={0 0}, upload=329111]: Satisfied cohort requirements after 14 pieces Mar 18 16:51:10.209975349 (293h51m7.806746384s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BhogobSTS5pCJxh7NGgnsU5qn1kwDDv25XxQiqqPXGSU9QL9H): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.209988536 (293h51m7.80675957s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210087026 (293h51m7.806858058s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qcwvrgkkT6Q8pVEuUu7fA4wwHXNidvCNnKhrU3DpdqAHKGtLG): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210112972 (293h51m7.806883998s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210410740 (293h51m7.807181771s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cHb8XLk563sSJ6s92CpzfmxwjiydGAe3GjZWqEsZgcmzRqpLR): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210422131 (293h51m7.807193165s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210448494 (293h51m7.807219527s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7G5jzPdqBzSjhVDsktUNK4MDhsBZ9b4BexkjXyVrGCXaujE1): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210461044 (293h51m7.80723208s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210506936 (293h51m7.807277951s) [seg_pos={0 0}, upload=329111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Mar 18 16:51:10.210602806 (293h51m7.80737383s) [upload=329111]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 16:51:10.210609332 (293h51m7.807380355s) [upload=329111]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 16:51:10.262661082 (293h51m7.859432097s) [upload=329111]: Done uploading segments... Mar 18 16:51:10.262684233 (293h51m7.859455246s) [upload=329111]: Upload finished. err: <nil> Duration: 1.225091829s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 1.088425041s trace: https://jaeger.dev.storj.io/trace/72d1768dadcbe46b FAIL (2026-03-18 17:31:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: internal error ======LOGS====== 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.626765311 (293h51m7.22353634s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.627040986 (293h51m7.22381201s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628025201 (293h51m7.224796227s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628325911 (293h51m7.225096946s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628627099 (293h51m7.225398122s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628839133 (293h51m7.225610159s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629107755 (293h51m7.225878781s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629262958 (293h51m7.226033985s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629635295 (293h51m7.226406325s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629653133 (293h51m7.226424146s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630058646 (293h51m7.226829659s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630150638 (293h51m7.226921661s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630482158 (293h51m7.227253192s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630583078 (293h51m7.227354102s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630979980 (293h51m7.227751009s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630991686 (293h51m7.22776271s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.631478670 (293h51m7.228249705s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.702440166 (293h51m7.299211182s) [upload=329111]: Next returned nil segment Mar 18 16:51:09.702456559 (293h51m7.299227582s) [upload=329111]: Waiting for error group managing segments... Mar 18 16:51:09.708407591 (293h51m7.305178602s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.712495525 (293h51m7.309266553s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.725343753 (293h51m7.322114771s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.726981573 (293h51m7.323752582s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.727988660 (293h51m7.324759695s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.733311274 (293h51m7.330082286s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.739872034 (293h51m7.336643065s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.745323402 (293h51m7.342094431s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.762176142 (293h51m7.358947165s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.959127349 (293h51m7.55589838s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.974703744 (293h51m7.571474768s) [noise=true , address=167.17.72.69:4710 , piece_id=QYEKCEVYXUOJNTCPB45SWVAZDXH4PFNBGDHFTUH6M5CLEZMQ7NOQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.984676068 (293h51m7.581447083s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.186312524 (293h51m7.78308355s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209670436 (293h51m7.806441459s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209695349 (293h51m7.806466373s) [seg_pos={0 0}, upload=329111]: Satisfied cohort requirements after 14 pieces Mar 18 16:51:10.209975349 (293h51m7.806746384s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BhogobSTS5pCJxh7NGgnsU5qn1kwDDv25XxQiqqPXGSU9QL9H): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.209988536 (293h51m7.80675957s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210087026 (293h51m7.806858058s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qcwvrgkkT6Q8pVEuUu7fA4wwHXNidvCNnKhrU3DpdqAHKGtLG): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210112972 (293h51m7.806883998s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210410740 (293h51m7.807181771s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cHb8XLk563sSJ6s92CpzfmxwjiydGAe3GjZWqEsZgcmzRqpLR): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210422131 (293h51m7.807193165s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210448494 (293h51m7.807219527s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7G5jzPdqBzSjhVDsktUNK4MDhsBZ9b4BexkjXyVrGCXaujE1): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210461044 (293h51m7.80723208s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210506936 (293h51m7.807277951s) [seg_pos={0 0}, upload=329111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Mar 18 16:51:10.210602806 (293h51m7.80737383s) [upload=329111]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 16:51:10.210609332 (293h51m7.807380355s) [upload=329111]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 16:51:10.262661082 (293h51m7.859432097s) [upload=329111]: Done uploading segments... Mar 18 16:51:10.262684233 (293h51m7.859455246s) [upload=329111]: Upload finished. err: <nil> Duration: 1.088454173s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 980.29473ms trace: https://jaeger.dev.storj.io/trace/72d1768dadcbe46b FAIL (2026-03-18 17:30:57 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: internal error ======LOGS====== 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.626765311 (293h51m7.22353634s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.627040986 (293h51m7.22381201s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628025201 (293h51m7.224796227s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628325911 (293h51m7.225096946s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628627099 (293h51m7.225398122s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628839133 (293h51m7.225610159s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629107755 (293h51m7.225878781s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629262958 (293h51m7.226033985s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629635295 (293h51m7.226406325s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629653133 (293h51m7.226424146s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630058646 (293h51m7.226829659s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630150638 (293h51m7.226921661s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630482158 (293h51m7.227253192s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630583078 (293h51m7.227354102s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630979980 (293h51m7.227751009s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630991686 (293h51m7.22776271s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.631478670 (293h51m7.228249705s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.702440166 (293h51m7.299211182s) [upload=329111]: Next returned nil segment Mar 18 16:51:09.702456559 (293h51m7.299227582s) [upload=329111]: Waiting for error group managing segments... Mar 18 16:51:09.708407591 (293h51m7.305178602s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.712495525 (293h51m7.309266553s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.725343753 (293h51m7.322114771s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.726981573 (293h51m7.323752582s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.727988660 (293h51m7.324759695s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.733311274 (293h51m7.330082286s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.739872034 (293h51m7.336643065s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.745323402 (293h51m7.342094431s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.762176142 (293h51m7.358947165s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.959127349 (293h51m7.55589838s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.974703744 (293h51m7.571474768s) [noise=true , address=167.17.72.69:4710 , piece_id=QYEKCEVYXUOJNTCPB45SWVAZDXH4PFNBGDHFTUH6M5CLEZMQ7NOQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.984676068 (293h51m7.581447083s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.186312524 (293h51m7.78308355s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209670436 (293h51m7.806441459s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209695349 (293h51m7.806466373s) [seg_pos={0 0}, upload=329111]: Satisfied cohort requirements after 14 pieces Mar 18 16:51:10.209975349 (293h51m7.806746384s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BhogobSTS5pCJxh7NGgnsU5qn1kwDDv25XxQiqqPXGSU9QL9H): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.209988536 (293h51m7.80675957s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210087026 (293h51m7.806858058s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qcwvrgkkT6Q8pVEuUu7fA4wwHXNidvCNnKhrU3DpdqAHKGtLG): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210112972 (293h51m7.806883998s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210410740 (293h51m7.807181771s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cHb8XLk563sSJ6s92CpzfmxwjiydGAe3GjZWqEsZgcmzRqpLR): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210422131 (293h51m7.807193165s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210448494 (293h51m7.807219527s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7G5jzPdqBzSjhVDsktUNK4MDhsBZ9b4BexkjXyVrGCXaujE1): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210461044 (293h51m7.80723208s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210506936 (293h51m7.807277951s) [seg_pos={0 0}, upload=329111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Mar 18 16:51:10.210602806 (293h51m7.80737383s) [upload=329111]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 16:51:10.210609332 (293h51m7.807380355s) [upload=329111]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 16:51:10.262661082 (293h51m7.859432097s) [upload=329111]: Done uploading segments... Mar 18 16:51:10.262684233 (293h51m7.859455246s) [upload=329111]: Upload finished. err: <nil> Duration: 980.321268ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 973.153632ms trace: https://jaeger.dev.storj.io/trace/72d1768dadcbe46b FAIL (2026-03-18 17:30:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: internal error ======LOGS====== 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.626765311 (293h51m7.22353634s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.627040986 (293h51m7.22381201s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628025201 (293h51m7.224796227s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628325911 (293h51m7.225096946s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628627099 (293h51m7.225398122s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628839133 (293h51m7.225610159s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629107755 (293h51m7.225878781s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629262958 (293h51m7.226033985s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629635295 (293h51m7.226406325s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629653133 (293h51m7.226424146s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630058646 (293h51m7.226829659s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630150638 (293h51m7.226921661s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630482158 (293h51m7.227253192s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630583078 (293h51m7.227354102s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630979980 (293h51m7.227751009s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630991686 (293h51m7.22776271s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.631478670 (293h51m7.228249705s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.702440166 (293h51m7.299211182s) [upload=329111]: Next returned nil segment Mar 18 16:51:09.702456559 (293h51m7.299227582s) [upload=329111]: Waiting for error group managing segments... Mar 18 16:51:09.708407591 (293h51m7.305178602s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.712495525 (293h51m7.309266553s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.725343753 (293h51m7.322114771s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.726981573 (293h51m7.323752582s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.727988660 (293h51m7.324759695s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.733311274 (293h51m7.330082286s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.739872034 (293h51m7.336643065s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.745323402 (293h51m7.342094431s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.762176142 (293h51m7.358947165s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.959127349 (293h51m7.55589838s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.974703744 (293h51m7.571474768s) [noise=true , address=167.17.72.69:4710 , piece_id=QYEKCEVYXUOJNTCPB45SWVAZDXH4PFNBGDHFTUH6M5CLEZMQ7NOQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.984676068 (293h51m7.581447083s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.186312524 (293h51m7.78308355s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209670436 (293h51m7.806441459s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209695349 (293h51m7.806466373s) [seg_pos={0 0}, upload=329111]: Satisfied cohort requirements after 14 pieces Mar 18 16:51:10.209975349 (293h51m7.806746384s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BhogobSTS5pCJxh7NGgnsU5qn1kwDDv25XxQiqqPXGSU9QL9H): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.209988536 (293h51m7.80675957s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210087026 (293h51m7.806858058s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qcwvrgkkT6Q8pVEuUu7fA4wwHXNidvCNnKhrU3DpdqAHKGtLG): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210112972 (293h51m7.806883998s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210410740 (293h51m7.807181771s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cHb8XLk563sSJ6s92CpzfmxwjiydGAe3GjZWqEsZgcmzRqpLR): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210422131 (293h51m7.807193165s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210448494 (293h51m7.807219527s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7G5jzPdqBzSjhVDsktUNK4MDhsBZ9b4BexkjXyVrGCXaujE1): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210461044 (293h51m7.80723208s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210506936 (293h51m7.807277951s) [seg_pos={0 0}, upload=329111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Mar 18 16:51:10.210602806 (293h51m7.80737383s) [upload=329111]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 16:51:10.210609332 (293h51m7.807380355s) [upload=329111]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 16:51:10.262661082 (293h51m7.859432097s) [upload=329111]: Done uploading segments... Mar 18 16:51:10.262684233 (293h51m7.859455246s) [upload=329111]: Upload finished. err: <nil> Duration: 973.186961ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 1.233495135s trace: https://jaeger.dev.storj.io/trace/72d1768dadcbe46b FAIL (2026-03-18 17:29:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: internal error ======LOGS====== 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.626765311 (293h51m7.22353634s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.627040986 (293h51m7.22381201s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628025201 (293h51m7.224796227s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628325911 (293h51m7.225096946s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628627099 (293h51m7.225398122s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628839133 (293h51m7.225610159s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629107755 (293h51m7.225878781s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629262958 (293h51m7.226033985s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629635295 (293h51m7.226406325s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629653133 (293h51m7.226424146s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630058646 (293h51m7.226829659s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630150638 (293h51m7.226921661s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630482158 (293h51m7.227253192s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630583078 (293h51m7.227354102s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630979980 (293h51m7.227751009s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630991686 (293h51m7.22776271s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.631478670 (293h51m7.228249705s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.702440166 (293h51m7.299211182s) [upload=329111]: Next returned nil segment Mar 18 16:51:09.702456559 (293h51m7.299227582s) [upload=329111]: Waiting for error group managing segments... Mar 18 16:51:09.708407591 (293h51m7.305178602s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.712495525 (293h51m7.309266553s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.725343753 (293h51m7.322114771s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.726981573 (293h51m7.323752582s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.727988660 (293h51m7.324759695s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.733311274 (293h51m7.330082286s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.739872034 (293h51m7.336643065s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.745323402 (293h51m7.342094431s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.762176142 (293h51m7.358947165s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.959127349 (293h51m7.55589838s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.974703744 (293h51m7.571474768s) [noise=true , address=167.17.72.69:4710 , piece_id=QYEKCEVYXUOJNTCPB45SWVAZDXH4PFNBGDHFTUH6M5CLEZMQ7NOQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.984676068 (293h51m7.581447083s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.186312524 (293h51m7.78308355s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209670436 (293h51m7.806441459s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209695349 (293h51m7.806466373s) [seg_pos={0 0}, upload=329111]: Satisfied cohort requirements after 14 pieces Mar 18 16:51:10.209975349 (293h51m7.806746384s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BhogobSTS5pCJxh7NGgnsU5qn1kwDDv25XxQiqqPXGSU9QL9H): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.209988536 (293h51m7.80675957s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210087026 (293h51m7.806858058s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qcwvrgkkT6Q8pVEuUu7fA4wwHXNidvCNnKhrU3DpdqAHKGtLG): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210112972 (293h51m7.806883998s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210410740 (293h51m7.807181771s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cHb8XLk563sSJ6s92CpzfmxwjiydGAe3GjZWqEsZgcmzRqpLR): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210422131 (293h51m7.807193165s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210448494 (293h51m7.807219527s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7G5jzPdqBzSjhVDsktUNK4MDhsBZ9b4BexkjXyVrGCXaujE1): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210461044 (293h51m7.80723208s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210506936 (293h51m7.807277951s) [seg_pos={0 0}, upload=329111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Mar 18 16:51:10.210602806 (293h51m7.80737383s) [upload=329111]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 16:51:10.210609332 (293h51m7.807380355s) [upload=329111]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 16:51:10.262661082 (293h51m7.859432097s) [upload=329111]: Done uploading segments... Mar 18 16:51:10.262684233 (293h51m7.859455246s) [upload=329111]: Upload finished. err: <nil> Duration: 1.23352057s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.137052863s trace: https://jaeger.dev.storj.io/trace/72d1768dadcbe46b FAIL (2026-03-18 17:29:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: internal error ======LOGS====== 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.626765311 (293h51m7.22353634s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.627040986 (293h51m7.22381201s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628025201 (293h51m7.224796227s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628325911 (293h51m7.225096946s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628627099 (293h51m7.225398122s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628839133 (293h51m7.225610159s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629107755 (293h51m7.225878781s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629262958 (293h51m7.226033985s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629635295 (293h51m7.226406325s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629653133 (293h51m7.226424146s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630058646 (293h51m7.226829659s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630150638 (293h51m7.226921661s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630482158 (293h51m7.227253192s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630583078 (293h51m7.227354102s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630979980 (293h51m7.227751009s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630991686 (293h51m7.22776271s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.631478670 (293h51m7.228249705s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.702440166 (293h51m7.299211182s) [upload=329111]: Next returned nil segment Mar 18 16:51:09.702456559 (293h51m7.299227582s) [upload=329111]: Waiting for error group managing segments... Mar 18 16:51:09.708407591 (293h51m7.305178602s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.712495525 (293h51m7.309266553s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.725343753 (293h51m7.322114771s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.726981573 (293h51m7.323752582s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.727988660 (293h51m7.324759695s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.733311274 (293h51m7.330082286s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.739872034 (293h51m7.336643065s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.745323402 (293h51m7.342094431s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.762176142 (293h51m7.358947165s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.959127349 (293h51m7.55589838s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.974703744 (293h51m7.571474768s) [noise=true , address=167.17.72.69:4710 , piece_id=QYEKCEVYXUOJNTCPB45SWVAZDXH4PFNBGDHFTUH6M5CLEZMQ7NOQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.984676068 (293h51m7.581447083s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.186312524 (293h51m7.78308355s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209670436 (293h51m7.806441459s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209695349 (293h51m7.806466373s) [seg_pos={0 0}, upload=329111]: Satisfied cohort requirements after 14 pieces Mar 18 16:51:10.209975349 (293h51m7.806746384s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BhogobSTS5pCJxh7NGgnsU5qn1kwDDv25XxQiqqPXGSU9QL9H): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.209988536 (293h51m7.80675957s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210087026 (293h51m7.806858058s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qcwvrgkkT6Q8pVEuUu7fA4wwHXNidvCNnKhrU3DpdqAHKGtLG): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210112972 (293h51m7.806883998s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210410740 (293h51m7.807181771s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cHb8XLk563sSJ6s92CpzfmxwjiydGAe3GjZWqEsZgcmzRqpLR): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210422131 (293h51m7.807193165s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210448494 (293h51m7.807219527s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7G5jzPdqBzSjhVDsktUNK4MDhsBZ9b4BexkjXyVrGCXaujE1): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210461044 (293h51m7.80723208s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210506936 (293h51m7.807277951s) [seg_pos={0 0}, upload=329111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Mar 18 16:51:10.210602806 (293h51m7.80737383s) [upload=329111]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 16:51:10.210609332 (293h51m7.807380355s) [upload=329111]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 16:51:10.262661082 (293h51m7.859432097s) [upload=329111]: Done uploading segments... Mar 18 16:51:10.262684233 (293h51m7.859455246s) [upload=329111]: Upload finished. err: <nil> Duration: 1.137083735s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.291016704s trace: https://jaeger.dev.storj.io/trace/72d1768dadcbe46b FAIL (2026-03-18 17:28:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: internal error ======LOGS====== 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.626765311 (293h51m7.22353634s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.627040986 (293h51m7.22381201s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628025201 (293h51m7.224796227s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628325911 (293h51m7.225096946s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628627099 (293h51m7.225398122s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628839133 (293h51m7.225610159s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629107755 (293h51m7.225878781s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629262958 (293h51m7.226033985s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629635295 (293h51m7.226406325s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629653133 (293h51m7.226424146s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630058646 (293h51m7.226829659s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630150638 (293h51m7.226921661s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630482158 (293h51m7.227253192s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630583078 (293h51m7.227354102s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630979980 (293h51m7.227751009s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630991686 (293h51m7.22776271s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.631478670 (293h51m7.228249705s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.702440166 (293h51m7.299211182s) [upload=329111]: Next returned nil segment Mar 18 16:51:09.702456559 (293h51m7.299227582s) [upload=329111]: Waiting for error group managing segments... Mar 18 16:51:09.708407591 (293h51m7.305178602s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.712495525 (293h51m7.309266553s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.725343753 (293h51m7.322114771s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.726981573 (293h51m7.323752582s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.727988660 (293h51m7.324759695s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.733311274 (293h51m7.330082286s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.739872034 (293h51m7.336643065s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.745323402 (293h51m7.342094431s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.762176142 (293h51m7.358947165s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.959127349 (293h51m7.55589838s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.974703744 (293h51m7.571474768s) [noise=true , address=167.17.72.69:4710 , piece_id=QYEKCEVYXUOJNTCPB45SWVAZDXH4PFNBGDHFTUH6M5CLEZMQ7NOQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.984676068 (293h51m7.581447083s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.186312524 (293h51m7.78308355s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209670436 (293h51m7.806441459s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209695349 (293h51m7.806466373s) [seg_pos={0 0}, upload=329111]: Satisfied cohort requirements after 14 pieces Mar 18 16:51:10.209975349 (293h51m7.806746384s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BhogobSTS5pCJxh7NGgnsU5qn1kwDDv25XxQiqqPXGSU9QL9H): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.209988536 (293h51m7.80675957s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210087026 (293h51m7.806858058s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qcwvrgkkT6Q8pVEuUu7fA4wwHXNidvCNnKhrU3DpdqAHKGtLG): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210112972 (293h51m7.806883998s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210410740 (293h51m7.807181771s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cHb8XLk563sSJ6s92CpzfmxwjiydGAe3GjZWqEsZgcmzRqpLR): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210422131 (293h51m7.807193165s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210448494 (293h51m7.807219527s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7G5jzPdqBzSjhVDsktUNK4MDhsBZ9b4BexkjXyVrGCXaujE1): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210461044 (293h51m7.80723208s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210506936 (293h51m7.807277951s) [seg_pos={0 0}, upload=329111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Mar 18 16:51:10.210602806 (293h51m7.80737383s) [upload=329111]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 16:51:10.210609332 (293h51m7.807380355s) [upload=329111]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 16:51:10.262661082 (293h51m7.859432097s) [upload=329111]: Done uploading segments... Mar 18 16:51:10.262684233 (293h51m7.859455246s) [upload=329111]: Upload finished. err: <nil> Duration: 1.29104065s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 1.124926456s trace: https://jaeger.dev.storj.io/trace/72d1768dadcbe46b FAIL (2026-03-18 17:27:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: internal error ======LOGS====== 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.626765311 (293h51m7.22353634s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.627040986 (293h51m7.22381201s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628025201 (293h51m7.224796227s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628325911 (293h51m7.225096946s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628627099 (293h51m7.225398122s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628839133 (293h51m7.225610159s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629107755 (293h51m7.225878781s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629262958 (293h51m7.226033985s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629635295 (293h51m7.226406325s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629653133 (293h51m7.226424146s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630058646 (293h51m7.226829659s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630150638 (293h51m7.226921661s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630482158 (293h51m7.227253192s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630583078 (293h51m7.227354102s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630979980 (293h51m7.227751009s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630991686 (293h51m7.22776271s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.631478670 (293h51m7.228249705s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.702440166 (293h51m7.299211182s) [upload=329111]: Next returned nil segment Mar 18 16:51:09.702456559 (293h51m7.299227582s) [upload=329111]: Waiting for error group managing segments... Mar 18 16:51:09.708407591 (293h51m7.305178602s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.712495525 (293h51m7.309266553s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.725343753 (293h51m7.322114771s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.726981573 (293h51m7.323752582s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.727988660 (293h51m7.324759695s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.733311274 (293h51m7.330082286s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.739872034 (293h51m7.336643065s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.745323402 (293h51m7.342094431s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.762176142 (293h51m7.358947165s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.959127349 (293h51m7.55589838s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.974703744 (293h51m7.571474768s) [noise=true , address=167.17.72.69:4710 , piece_id=QYEKCEVYXUOJNTCPB45SWVAZDXH4PFNBGDHFTUH6M5CLEZMQ7NOQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.984676068 (293h51m7.581447083s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.186312524 (293h51m7.78308355s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209670436 (293h51m7.806441459s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209695349 (293h51m7.806466373s) [seg_pos={0 0}, upload=329111]: Satisfied cohort requirements after 14 pieces Mar 18 16:51:10.209975349 (293h51m7.806746384s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BhogobSTS5pCJxh7NGgnsU5qn1kwDDv25XxQiqqPXGSU9QL9H): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.209988536 (293h51m7.80675957s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210087026 (293h51m7.806858058s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qcwvrgkkT6Q8pVEuUu7fA4wwHXNidvCNnKhrU3DpdqAHKGtLG): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210112972 (293h51m7.806883998s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210410740 (293h51m7.807181771s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cHb8XLk563sSJ6s92CpzfmxwjiydGAe3GjZWqEsZgcmzRqpLR): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210422131 (293h51m7.807193165s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210448494 (293h51m7.807219527s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7G5jzPdqBzSjhVDsktUNK4MDhsBZ9b4BexkjXyVrGCXaujE1): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210461044 (293h51m7.80723208s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210506936 (293h51m7.807277951s) [seg_pos={0 0}, upload=329111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Mar 18 16:51:10.210602806 (293h51m7.80737383s) [upload=329111]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 16:51:10.210609332 (293h51m7.807380355s) [upload=329111]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 16:51:10.262661082 (293h51m7.859432097s) [upload=329111]: Done uploading segments... Mar 18 16:51:10.262684233 (293h51m7.859455246s) [upload=329111]: Upload finished. err: <nil> Duration: 1.12495964s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 1.135346086s trace: https://jaeger.dev.storj.io/trace/72d1768dadcbe46b FAIL (2026-03-18 17:26:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: internal error ======LOGS====== 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.626765311 (293h51m7.22353634s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.627040986 (293h51m7.22381201s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628025201 (293h51m7.224796227s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628325911 (293h51m7.225096946s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628627099 (293h51m7.225398122s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628839133 (293h51m7.225610159s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629107755 (293h51m7.225878781s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629262958 (293h51m7.226033985s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629635295 (293h51m7.226406325s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629653133 (293h51m7.226424146s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630058646 (293h51m7.226829659s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630150638 (293h51m7.226921661s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630482158 (293h51m7.227253192s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630583078 (293h51m7.227354102s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630979980 (293h51m7.227751009s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630991686 (293h51m7.22776271s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.631478670 (293h51m7.228249705s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.702440166 (293h51m7.299211182s) [upload=329111]: Next returned nil segment Mar 18 16:51:09.702456559 (293h51m7.299227582s) [upload=329111]: Waiting for error group managing segments... Mar 18 16:51:09.708407591 (293h51m7.305178602s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.712495525 (293h51m7.309266553s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.725343753 (293h51m7.322114771s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.726981573 (293h51m7.323752582s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.727988660 (293h51m7.324759695s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.733311274 (293h51m7.330082286s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.739872034 (293h51m7.336643065s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.745323402 (293h51m7.342094431s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.762176142 (293h51m7.358947165s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.959127349 (293h51m7.55589838s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.974703744 (293h51m7.571474768s) [noise=true , address=167.17.72.69:4710 , piece_id=QYEKCEVYXUOJNTCPB45SWVAZDXH4PFNBGDHFTUH6M5CLEZMQ7NOQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.984676068 (293h51m7.581447083s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.186312524 (293h51m7.78308355s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209670436 (293h51m7.806441459s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209695349 (293h51m7.806466373s) [seg_pos={0 0}, upload=329111]: Satisfied cohort requirements after 14 pieces Mar 18 16:51:10.209975349 (293h51m7.806746384s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BhogobSTS5pCJxh7NGgnsU5qn1kwDDv25XxQiqqPXGSU9QL9H): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.209988536 (293h51m7.80675957s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210087026 (293h51m7.806858058s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qcwvrgkkT6Q8pVEuUu7fA4wwHXNidvCNnKhrU3DpdqAHKGtLG): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210112972 (293h51m7.806883998s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210410740 (293h51m7.807181771s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cHb8XLk563sSJ6s92CpzfmxwjiydGAe3GjZWqEsZgcmzRqpLR): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210422131 (293h51m7.807193165s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210448494 (293h51m7.807219527s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7G5jzPdqBzSjhVDsktUNK4MDhsBZ9b4BexkjXyVrGCXaujE1): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210461044 (293h51m7.80723208s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210506936 (293h51m7.807277951s) [seg_pos={0 0}, upload=329111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Mar 18 16:51:10.210602806 (293h51m7.80737383s) [upload=329111]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 16:51:10.210609332 (293h51m7.807380355s) [upload=329111]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 16:51:10.262661082 (293h51m7.859432097s) [upload=329111]: Done uploading segments... Mar 18 16:51:10.262684233 (293h51m7.859455246s) [upload=329111]: Upload finished. err: <nil> Duration: 1.135470218s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 1.266083095s trace: https://jaeger.dev.storj.io/trace/72d1768dadcbe46b FAIL (2026-03-18 17:25:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: internal error ======LOGS====== 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.626765311 (293h51m7.22353634s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.627040986 (293h51m7.22381201s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628025201 (293h51m7.224796227s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628325911 (293h51m7.225096946s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628627099 (293h51m7.225398122s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628839133 (293h51m7.225610159s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629107755 (293h51m7.225878781s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629262958 (293h51m7.226033985s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629635295 (293h51m7.226406325s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629653133 (293h51m7.226424146s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630058646 (293h51m7.226829659s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630150638 (293h51m7.226921661s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630482158 (293h51m7.227253192s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630583078 (293h51m7.227354102s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630979980 (293h51m7.227751009s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630991686 (293h51m7.22776271s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.631478670 (293h51m7.228249705s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.702440166 (293h51m7.299211182s) [upload=329111]: Next returned nil segment Mar 18 16:51:09.702456559 (293h51m7.299227582s) [upload=329111]: Waiting for error group managing segments... Mar 18 16:51:09.708407591 (293h51m7.305178602s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.712495525 (293h51m7.309266553s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.725343753 (293h51m7.322114771s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.726981573 (293h51m7.323752582s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.727988660 (293h51m7.324759695s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.733311274 (293h51m7.330082286s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.739872034 (293h51m7.336643065s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.745323402 (293h51m7.342094431s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.762176142 (293h51m7.358947165s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.959127349 (293h51m7.55589838s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.974703744 (293h51m7.571474768s) [noise=true , address=167.17.72.69:4710 , piece_id=QYEKCEVYXUOJNTCPB45SWVAZDXH4PFNBGDHFTUH6M5CLEZMQ7NOQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.984676068 (293h51m7.581447083s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.186312524 (293h51m7.78308355s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209670436 (293h51m7.806441459s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209695349 (293h51m7.806466373s) [seg_pos={0 0}, upload=329111]: Satisfied cohort requirements after 14 pieces Mar 18 16:51:10.209975349 (293h51m7.806746384s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BhogobSTS5pCJxh7NGgnsU5qn1kwDDv25XxQiqqPXGSU9QL9H): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.209988536 (293h51m7.80675957s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210087026 (293h51m7.806858058s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qcwvrgkkT6Q8pVEuUu7fA4wwHXNidvCNnKhrU3DpdqAHKGtLG): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210112972 (293h51m7.806883998s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210410740 (293h51m7.807181771s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cHb8XLk563sSJ6s92CpzfmxwjiydGAe3GjZWqEsZgcmzRqpLR): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210422131 (293h51m7.807193165s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210448494 (293h51m7.807219527s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7G5jzPdqBzSjhVDsktUNK4MDhsBZ9b4BexkjXyVrGCXaujE1): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210461044 (293h51m7.80723208s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210506936 (293h51m7.807277951s) [seg_pos={0 0}, upload=329111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Mar 18 16:51:10.210602806 (293h51m7.80737383s) [upload=329111]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 16:51:10.210609332 (293h51m7.807380355s) [upload=329111]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 16:51:10.262661082 (293h51m7.859432097s) [upload=329111]: Done uploading segments... Mar 18 16:51:10.262684233 (293h51m7.859455246s) [upload=329111]: Upload finished. err: <nil> Duration: 1.266177336s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.130784526s trace: https://jaeger.dev.storj.io/trace/72d1768dadcbe46b FAIL (2026-03-18 17:25:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: internal error ======LOGS====== 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.626765311 (293h51m7.22353634s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.627040986 (293h51m7.22381201s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628025201 (293h51m7.224796227s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628325911 (293h51m7.225096946s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628627099 (293h51m7.225398122s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.628839133 (293h51m7.225610159s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629107755 (293h51m7.225878781s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629262958 (293h51m7.226033985s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629635295 (293h51m7.226406325s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.629653133 (293h51m7.226424146s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630058646 (293h51m7.226829659s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630150638 (293h51m7.226921661s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630482158 (293h51m7.227253192s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630583078 (293h51m7.227354102s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630979980 (293h51m7.227751009s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.630991686 (293h51m7.22776271s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.631478670 (293h51m7.228249705s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Uploading piece... Mar 18 16:51:09.702440166 (293h51m7.299211182s) [upload=329111]: Next returned nil segment Mar 18 16:51:09.702456559 (293h51m7.299227582s) [upload=329111]: Waiting for error group managing segments... Mar 18 16:51:09.708407591 (293h51m7.305178602s) [noise=true , address=45.91.116.14:4223 , piece_id=Y2LJF2T2JF6JEB3XEOUEKW7XXJSZFA7GIW7S4YE4OZGJZY2T4GAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.712495525 (293h51m7.309266553s) [noise=true , address=145.79.227.34:4929 , piece_id=4IIPYX7673RIL67LZL4SSHOKOE6ZPHVLULEMO2KUIM6JA35QGAAQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.725343753 (293h51m7.322114771s) [noise=true , address=45.91.116.11:4143 , piece_id=ELVNAOVV34L343UP5JIUG6WIWMLF45WIHLM35YN5QQIZQDKHH2ZA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.726981573 (293h51m7.323752582s) [noise=true , address=45.91.116.7:4039 , piece_id=6HJFURMEX4XXUT4IBEJ7ECIVGJDSGFSV632BDJFWY454ZFEDVPUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.727988660 (293h51m7.324759695s) [noise=true , address=145.79.227.18:4027 , piece_id=Z5PLBA54QIJPPLZAXQ5DAPI5ML37IVQ4FWZHFENB5GHA6GPPG7LQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.733311274 (293h51m7.330082286s) [noise=true , address=79.127.219.46:4903 , piece_id=UPMVRM62GELNI7LQZJD3GIEVPNAM2WDTRFO3HCHCSB2TXFS3VWSQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.739872034 (293h51m7.336643065s) [noise=true , address=77.90.31.18:4836 , piece_id=L3AVOEUDR6SXRVUFXPGVQKO7P2HZGQIGLXP3BQFREEHZIGMOBIUA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.745323402 (293h51m7.342094431s) [noise=true , address=79.127.219.38:4848 , piece_id=SOT23DPU4PZFPHRRSBGNCVAREMFW7NXSILPKN4A7TBUTZYTQSVQA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.762176142 (293h51m7.358947165s) [noise=true , address=45.91.116.10:4086 , piece_id=HFCEUWSSPKMNOALZCLCYQFIGLGRXYWTJ2SL5S7EK4OQFOVMOEFJA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.959127349 (293h51m7.55589838s) [noise=true , address=167.17.72.70:4778 , piece_id=JGWVQAXS3WC4DLJ3FTDRCO3TTXEUQBLBKEV4OLQWZBVT2H7KZXNQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.974703744 (293h51m7.571474768s) [noise=true , address=167.17.72.69:4710 , piece_id=QYEKCEVYXUOJNTCPB45SWVAZDXH4PFNBGDHFTUH6M5CLEZMQ7NOQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:09.984676068 (293h51m7.581447083s) [noise=true , address=167.17.72.68:4669 , piece_id=KMC3K46EOM7PHFCKPJZAPV3PCENB7M5R6JWVRZJ7O4OAZDJQVEQQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.186312524 (293h51m7.78308355s) [noise=true , address=79.127.205.237:4222 , piece_id=GNXIJOMWYHSGMDASN5FWBLVHNVMG3NB26UVROISLP7VKI2VI7FEQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209670436 (293h51m7.806441459s) [noise=true , address=79.127.205.233:4162 , piece_id=QSD4X5KFQIV5UHI223H4WW5WGOXKBCAIVX3MLYZFGBLAMSB6SZ6Q, seg_pos={0 0}, upload=329111]: Done uploading piece. err: <nil> Mar 18 16:51:10.209695349 (293h51m7.806466373s) [seg_pos={0 0}, upload=329111]: Satisfied cohort requirements after 14 pieces Mar 18 16:51:10.209975349 (293h51m7.806746384s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BhogobSTS5pCJxh7NGgnsU5qn1kwDDv25XxQiqqPXGSU9QL9H): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.209988536 (293h51m7.80675957s) [noise=true , address=193.149.164.67:4020 , piece_id=REOKCOPHYMKUIVKBPCGOBNASQ35YX55EMYTDCMOOSDTROOQIHAIQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210087026 (293h51m7.806858058s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qcwvrgkkT6Q8pVEuUu7fA4wwHXNidvCNnKhrU3DpdqAHKGtLG): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210112972 (293h51m7.806883998s) [noise=true , address=193.149.164.69:4077 , piece_id=HLBUOFEG2KHIU3YDA4VFK45MNJ7SQ4H3ASOOZVQOBMTQRSILAWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210410740 (293h51m7.807181771s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cHb8XLk563sSJ6s92CpzfmxwjiydGAe3GjZWqEsZgcmzRqpLR): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210422131 (293h51m7.807193165s) [noise=true , address=193.149.164.68:4047 , piece_id=KI2GOOUSR4RXRBDRUPDFTPC7H5X7EARHWMMFHBV4YGRUOOZXWWUQ, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210448494 (293h51m7.807219527s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7G5jzPdqBzSjhVDsktUNK4MDhsBZ9b4BexkjXyVrGCXaujE1): protocol: expected piece hash; context canceled; EOF Mar 18 16:51:10.210461044 (293h51m7.80723208s) [noise=true , address=193.149.164.70:4119 , piece_id=NNFYTOCFKSJ3SAGTF5CKFPV5ZQOKTZOOLMNZG55ZW3MS7JWESEIA, seg_pos={0 0}, upload=329111]: Long tail cancellation due to optimal threshold Mar 18 16:51:10.210506936 (293h51m7.807277951s) [seg_pos={0 0}, upload=329111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Mar 18 16:51:10.210602806 (293h51m7.80737383s) [upload=329111]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 16:51:10.210609332 (293h51m7.807380355s) [upload=329111]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 16:51:10.262661082 (293h51m7.859432097s) [upload=329111]: Done uploading segments... Mar 18 16:51:10.262684233 (293h51m7.859455246s) [upload=329111]: Upload finished. err: <nil> Duration: 1.130806563s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)