Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [..XXXXXX.....XXXX.XXX.......................................] duration: 655.989999ms trace: https://jaeger.dev.storj.io/trace/6dceff78c86f0774 FAIL (2026-03-18 22:23:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:54:17.190275520 (298h54m14.787046534s) [upload=334781]: Starting upload Mar 18 21:54:17.190367052 (298h54m14.787138068s) [upload=334781]: Done starting upload Mar 18 21:54:17.190448332 (298h54m14.787219348s) [upload=334781]: Uploading segments... Mar 18 21:54:17.190705184 (298h54m14.787476207s) [upload=334781]: Got next segment. Inline: false Mar 18 21:54:17.190783980 (298h54m14.787555002s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:54:17.190804859 (298h54m14.787575882s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 18 21:54:25.452304457 (298h54m23.049075487s) [seg_pos={0 0}, upload=334781]: Begin upload segment... Mar 18 21:54:25.452374690 (298h54m23.049145713s) [seg_pos={0 0}, upload=334781]: Done begin upload segment. Mar 18 21:54:25.452463335 (298h54m23.049234366s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.452479705 (298h54m23.049250739s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.453224160 (298h54m23.049995188s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454147610 (298h54m23.050918643s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454790080 (298h54m23.051561121s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.455678920 (298h54m23.052449952s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456387102 (298h54m23.053158136s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456987483 (298h54m23.053758515s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.457980795 (298h54m23.054751829s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.459806473 (298h54m23.056577503s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.460305248 (298h54m23.057076281s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.461552822 (298h54m23.058323848s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.463144575 (298h54m23.059915608s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.464837828 (298h54m23.06160886s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.466411504 (298h54m23.063182537s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.469091278 (298h54m23.065862311s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.586976347 (298h54m23.183747361s) [upload=334781]: Next returned nil segment Mar 18 21:54:25.587000505 (298h54m23.183771534s) [upload=334781]: Waiting for error group managing segments... Mar 18 21:54:25.596319798 (298h54m23.193090825s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.596985876 (298h54m23.1937569s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598026901 (298h54m23.194797934s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598566162 (298h54m23.195337186s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598781105 (298h54m23.19555213s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600260475 (298h54m23.197031509s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600344398 (298h54m23.197115411s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602467676 (298h54m23.19923871s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602977247 (298h54m23.199748272s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603520888 (298h54m23.200291919s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603907549 (298h54m23.200678573s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.604438080 (298h54m23.201209113s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.618924566 (298h54m23.21569559s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.619077190 (298h54m23.215848214s) [seg_pos={0 0}, upload=334781]: Satisfied cohort requirements after 13 pieces Mar 18 21:54:25.619546929 (298h54m23.216317961s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.619578476 (298h54m23.21634951s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620166659 (298h54m23.216937744s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620178720 (298h54m23.216949746s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620702987 (298h54m23.217474021s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620718441 (298h54m23.217489474s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620748329 (298h54m23.21751937s) [seg_pos={0 0}, upload=334781]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 18 21:54:25.620912612 (298h54m23.21768364s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 21:54:25.620920854 (298h54m23.217691883s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:54:38.136688455 (298h54m35.733459485s) [upload=334781]: Done uploading segments... Mar 18 21:54:38.136713048 (298h54m35.73348408s) [upload=334781]: Upload finished. err: <nil> Duration: 656.034296ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 11 out of 60 is failed (threshold=3) [.X...XXX..XX.X..X..X.XX.....................................] duration: 242.740298ms trace: https://jaeger.dev.storj.io/trace/7c4371cfa8f7834c FAIL (2026-03-18 22:22:54 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 242.77349ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.....X.XXXXXX.X..XXX........................................] duration: 1.781767382s trace: https://jaeger.dev.storj.io/trace/27ed2876d5f3e85d FAIL (2026-03-18 22:22:49 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.781840188s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 262.3232ms trace: https://jaeger.dev.storj.io/trace/2ab94940f3da3187 FAIL (2026-03-18 22:22:49 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:41:41.272084084 (298h41m38.868855112s) [upload=334559]: Starting upload Mar 18 21:41:41.272169036 (298h41m38.868940066s) [upload=334559]: Done starting upload Mar 18 21:41:41.272251155 (298h41m38.869022168s) [upload=334559]: Uploading segments... Mar 18 21:41:41.272358183 (298h41m38.869129211s) [upload=334559]: Got next segment. Inline: true Mar 18 21:41:41.272367512 (298h41m38.869138542s) [upload=334559]: Waiting for error group managing segments... Mar 18 21:41:41.272525860 (298h41m38.869296906s) [upload=334559]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:41:41.272550748 (298h41m38.869321776s) [upload=334559]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 21:41:41.272555523 (298h41m38.86932655s) [upload=334559]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:42:30.253452076 (298h42m27.850223099s) [upload=334559]: Done uploading segments... Mar 18 21:42:30.253475139 (298h42m27.850246163s) [upload=334559]: Upload finished. err: <nil> Duration:* 262.355962ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 21 out of 60 is failed (threshold=6) [X..XXXXXXXXXXXXXXXXXXXX.....................................] duration: 731.309317ms trace: https://jaeger.dev.storj.io/trace/6cabdd7d47c9cb44 FAIL (2026-03-18 22:22:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 731.348482ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 11 out of 60 is failed (threshold=3) [..X...XXX..XX.X..X..X.XX....................................] duration: 288.101528ms trace: https://jaeger.dev.storj.io/trace/7c4371cfa8f7834c FAIL (2026-03-18 22:22:31 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 288.12847ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 11 out of 60 is failed (threshold=3) [......XXXXXX.X...XX.X.X.....................................] duration: 244.654958ms trace: https://jaeger.dev.storj.io/trace/47004c0815b844e7 FAIL (2026-03-18 22:22:22 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:53:36.090826124 (298h53m33.687597155s) [upload=334767]: Starting upload Mar 18 21:53:36.090977797 (298h53m33.687748822s) [upload=334767]: Done starting upload Mar 18 21:53:36.091078093 (298h53m33.687849119s) [upload=334767]: Uploading segments... Mar 18 21:53:36.091268776 (298h53m33.688040083s) [upload=334767]: Got next segment. Inline: true Mar 18 21:53:36.091279074 (298h53m33.688050103s) [upload=334767]: Waiting for error group managing segments... Mar 18 21:53:36.091372978 (298h53m33.688144001s) [upload=334767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:53:36.091379985 (298h53m33.688151008s) [upload=334767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 21:53:36.091384265 (298h53m33.688155287s) [upload=334767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:54:04.718146694 (298h54m2.314917717s) [upload=334767]: Done uploading segments... Mar 18 21:54:04.718169125 (298h54m2.314940155s) [upload=334767]: Upload finished. err: <nil> Duration:* 244.688358ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [...XXXXXX.....XXXX.XXX......................................] duration: 449.024761ms trace: https://jaeger.dev.storj.io/trace/6dceff78c86f0774 FAIL (2026-03-18 22:22:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:54:17.190275520 (298h54m14.787046534s) [upload=334781]: Starting upload Mar 18 21:54:17.190367052 (298h54m14.787138068s) [upload=334781]: Done starting upload Mar 18 21:54:17.190448332 (298h54m14.787219348s) [upload=334781]: Uploading segments... Mar 18 21:54:17.190705184 (298h54m14.787476207s) [upload=334781]: Got next segment. Inline: false Mar 18 21:54:17.190783980 (298h54m14.787555002s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:54:17.190804859 (298h54m14.787575882s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 18 21:54:25.452304457 (298h54m23.049075487s) [seg_pos={0 0}, upload=334781]: Begin upload segment... Mar 18 21:54:25.452374690 (298h54m23.049145713s) [seg_pos={0 0}, upload=334781]: Done begin upload segment. Mar 18 21:54:25.452463335 (298h54m23.049234366s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.452479705 (298h54m23.049250739s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.453224160 (298h54m23.049995188s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454147610 (298h54m23.050918643s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454790080 (298h54m23.051561121s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.455678920 (298h54m23.052449952s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456387102 (298h54m23.053158136s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456987483 (298h54m23.053758515s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.457980795 (298h54m23.054751829s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.459806473 (298h54m23.056577503s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.460305248 (298h54m23.057076281s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.461552822 (298h54m23.058323848s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.463144575 (298h54m23.059915608s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.464837828 (298h54m23.06160886s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.466411504 (298h54m23.063182537s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.469091278 (298h54m23.065862311s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.586976347 (298h54m23.183747361s) [upload=334781]: Next returned nil segment Mar 18 21:54:25.587000505 (298h54m23.183771534s) [upload=334781]: Waiting for error group managing segments... Mar 18 21:54:25.596319798 (298h54m23.193090825s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.596985876 (298h54m23.1937569s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598026901 (298h54m23.194797934s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598566162 (298h54m23.195337186s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598781105 (298h54m23.19555213s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600260475 (298h54m23.197031509s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600344398 (298h54m23.197115411s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602467676 (298h54m23.19923871s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602977247 (298h54m23.199748272s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603520888 (298h54m23.200291919s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603907549 (298h54m23.200678573s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.604438080 (298h54m23.201209113s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.618924566 (298h54m23.21569559s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.619077190 (298h54m23.215848214s) [seg_pos={0 0}, upload=334781]: Satisfied cohort requirements after 13 pieces Mar 18 21:54:25.619546929 (298h54m23.216317961s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.619578476 (298h54m23.21634951s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620166659 (298h54m23.216937744s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620178720 (298h54m23.216949746s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620702987 (298h54m23.217474021s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620718441 (298h54m23.217489474s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620748329 (298h54m23.21751937s) [seg_pos={0 0}, upload=334781]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 18 21:54:25.620912612 (298h54m23.21768364s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 21:54:25.620920854 (298h54m23.217691883s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:54:38.136688455 (298h54m35.733459485s) [upload=334781]: Done uploading segments... Mar 18 21:54:38.136713048 (298h54m35.73348408s) [upload=334781]: Upload finished. err: <nil> Duration: 449.051624ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 11 out of 60 is failed (threshold=3) [...X...XXX..XX.X..X..X.XX...................................] duration: 251.063295ms trace: https://jaeger.dev.storj.io/trace/7c4371cfa8f7834c FAIL (2026-03-18 22:22:11 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 251.088783ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 204.124266ms trace: https://jaeger.dev.storj.io/trace/2ab94940f3da3187 FAIL (2026-03-18 22:22:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:41:41.272084084 (298h41m38.868855112s) [upload=334559]: Starting upload Mar 18 21:41:41.272169036 (298h41m38.868940066s) [upload=334559]: Done starting upload Mar 18 21:41:41.272251155 (298h41m38.869022168s) [upload=334559]: Uploading segments... Mar 18 21:41:41.272358183 (298h41m38.869129211s) [upload=334559]: Got next segment. Inline: true Mar 18 21:41:41.272367512 (298h41m38.869138542s) [upload=334559]: Waiting for error group managing segments... Mar 18 21:41:41.272525860 (298h41m38.869296906s) [upload=334559]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:41:41.272550748 (298h41m38.869321776s) [upload=334559]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 21:41:41.272555523 (298h41m38.86932655s) [upload=334559]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:42:30.253452076 (298h42m27.850223099s) [upload=334559]: Done uploading segments... Mar 18 21:42:30.253475139 (298h42m27.850246163s) [upload=334559]: Upload finished. err: <nil> Duration:* 204.181823ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 12 out of 60 is failed (threshold=3) [X.....X.XXXXXX.X..XXX.......................................] duration: 1.728206963s trace: https://jaeger.dev.storj.io/trace/27ed2876d5f3e85d FAIL (2026-03-18 22:21:37 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.728239274s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 22 out of 60 is failed (threshold=6) [XX..XXXXXXXXXXXXXXXXXXXX....................................] duration: 805.012699ms trace: https://jaeger.dev.storj.io/trace/6cabdd7d47c9cb44 FAIL (2026-03-18 22:21:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 805.579897ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [....XXXXXX.....XXXX.XXX.....................................] duration: 486.159685ms trace: https://jaeger.dev.storj.io/trace/6dceff78c86f0774 FAIL (2026-03-18 22:21:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:54:17.190275520 (298h54m14.787046534s) [upload=334781]: Starting upload Mar 18 21:54:17.190367052 (298h54m14.787138068s) [upload=334781]: Done starting upload Mar 18 21:54:17.190448332 (298h54m14.787219348s) [upload=334781]: Uploading segments... Mar 18 21:54:17.190705184 (298h54m14.787476207s) [upload=334781]: Got next segment. Inline: false Mar 18 21:54:17.190783980 (298h54m14.787555002s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:54:17.190804859 (298h54m14.787575882s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 18 21:54:25.452304457 (298h54m23.049075487s) [seg_pos={0 0}, upload=334781]: Begin upload segment... Mar 18 21:54:25.452374690 (298h54m23.049145713s) [seg_pos={0 0}, upload=334781]: Done begin upload segment. Mar 18 21:54:25.452463335 (298h54m23.049234366s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.452479705 (298h54m23.049250739s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.453224160 (298h54m23.049995188s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454147610 (298h54m23.050918643s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454790080 (298h54m23.051561121s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.455678920 (298h54m23.052449952s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456387102 (298h54m23.053158136s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456987483 (298h54m23.053758515s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.457980795 (298h54m23.054751829s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.459806473 (298h54m23.056577503s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.460305248 (298h54m23.057076281s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.461552822 (298h54m23.058323848s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.463144575 (298h54m23.059915608s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.464837828 (298h54m23.06160886s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.466411504 (298h54m23.063182537s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.469091278 (298h54m23.065862311s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.586976347 (298h54m23.183747361s) [upload=334781]: Next returned nil segment Mar 18 21:54:25.587000505 (298h54m23.183771534s) [upload=334781]: Waiting for error group managing segments... Mar 18 21:54:25.596319798 (298h54m23.193090825s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.596985876 (298h54m23.1937569s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598026901 (298h54m23.194797934s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598566162 (298h54m23.195337186s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598781105 (298h54m23.19555213s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600260475 (298h54m23.197031509s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600344398 (298h54m23.197115411s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602467676 (298h54m23.19923871s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602977247 (298h54m23.199748272s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603520888 (298h54m23.200291919s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603907549 (298h54m23.200678573s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.604438080 (298h54m23.201209113s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.618924566 (298h54m23.21569559s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.619077190 (298h54m23.215848214s) [seg_pos={0 0}, upload=334781]: Satisfied cohort requirements after 13 pieces Mar 18 21:54:25.619546929 (298h54m23.216317961s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.619578476 (298h54m23.21634951s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620166659 (298h54m23.216937744s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620178720 (298h54m23.216949746s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620702987 (298h54m23.217474021s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620718441 (298h54m23.217489474s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620748329 (298h54m23.21751937s) [seg_pos={0 0}, upload=334781]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 18 21:54:25.620912612 (298h54m23.21768364s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 21:54:25.620920854 (298h54m23.217691883s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:54:38.136688455 (298h54m35.733459485s) [upload=334781]: Done uploading segments... Mar 18 21:54:38.136713048 (298h54m35.73348408s) [upload=334781]: Upload finished. err: <nil> Duration: 486.187544ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 12 out of 60 is failed (threshold=3) [X......XXXXXX.X...XX.X.X....................................] duration: 264.462194ms trace: https://jaeger.dev.storj.io/trace/47004c0815b844e7 FAIL (2026-03-18 22:21:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:53:36.090826124 (298h53m33.687597155s) [upload=334767]: Starting upload Mar 18 21:53:36.090977797 (298h53m33.687748822s) [upload=334767]: Done starting upload Mar 18 21:53:36.091078093 (298h53m33.687849119s) [upload=334767]: Uploading segments... Mar 18 21:53:36.091268776 (298h53m33.688040083s) [upload=334767]: Got next segment. Inline: true Mar 18 21:53:36.091279074 (298h53m33.688050103s) [upload=334767]: Waiting for error group managing segments... Mar 18 21:53:36.091372978 (298h53m33.688144001s) [upload=334767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:53:36.091379985 (298h53m33.688151008s) [upload=334767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 21:53:36.091384265 (298h53m33.688155287s) [upload=334767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:54:04.718146694 (298h54m2.314917717s) [upload=334767]: Done uploading segments... Mar 18 21:54:04.718169125 (298h54m2.314940155s) [upload=334767]: Upload finished. err: <nil> Duration:* 264.506953ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 11 out of 60 is failed (threshold=3) [....X...XXX..XX.X..X..X.XX..................................] duration: 269.63567ms trace: https://jaeger.dev.storj.io/trace/7c4371cfa8f7834c FAIL (2026-03-18 22:21:14 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 269.664522ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.....XXXXXX.....XXXX.XXX....................................] duration: 456.42434ms trace: https://jaeger.dev.storj.io/trace/6dceff78c86f0774 FAIL (2026-03-18 22:21:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:54:17.190275520 (298h54m14.787046534s) [upload=334781]: Starting upload Mar 18 21:54:17.190367052 (298h54m14.787138068s) [upload=334781]: Done starting upload Mar 18 21:54:17.190448332 (298h54m14.787219348s) [upload=334781]: Uploading segments... Mar 18 21:54:17.190705184 (298h54m14.787476207s) [upload=334781]: Got next segment. Inline: false Mar 18 21:54:17.190783980 (298h54m14.787555002s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:54:17.190804859 (298h54m14.787575882s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 18 21:54:25.452304457 (298h54m23.049075487s) [seg_pos={0 0}, upload=334781]: Begin upload segment... Mar 18 21:54:25.452374690 (298h54m23.049145713s) [seg_pos={0 0}, upload=334781]: Done begin upload segment. Mar 18 21:54:25.452463335 (298h54m23.049234366s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.452479705 (298h54m23.049250739s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.453224160 (298h54m23.049995188s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454147610 (298h54m23.050918643s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454790080 (298h54m23.051561121s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.455678920 (298h54m23.052449952s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456387102 (298h54m23.053158136s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456987483 (298h54m23.053758515s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.457980795 (298h54m23.054751829s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.459806473 (298h54m23.056577503s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.460305248 (298h54m23.057076281s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.461552822 (298h54m23.058323848s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.463144575 (298h54m23.059915608s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.464837828 (298h54m23.06160886s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.466411504 (298h54m23.063182537s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.469091278 (298h54m23.065862311s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.586976347 (298h54m23.183747361s) [upload=334781]: Next returned nil segment Mar 18 21:54:25.587000505 (298h54m23.183771534s) [upload=334781]: Waiting for error group managing segments... Mar 18 21:54:25.596319798 (298h54m23.193090825s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.596985876 (298h54m23.1937569s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598026901 (298h54m23.194797934s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598566162 (298h54m23.195337186s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598781105 (298h54m23.19555213s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600260475 (298h54m23.197031509s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600344398 (298h54m23.197115411s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602467676 (298h54m23.19923871s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602977247 (298h54m23.199748272s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603520888 (298h54m23.200291919s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603907549 (298h54m23.200678573s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.604438080 (298h54m23.201209113s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.618924566 (298h54m23.21569559s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.619077190 (298h54m23.215848214s) [seg_pos={0 0}, upload=334781]: Satisfied cohort requirements after 13 pieces Mar 18 21:54:25.619546929 (298h54m23.216317961s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.619578476 (298h54m23.21634951s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620166659 (298h54m23.216937744s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620178720 (298h54m23.216949746s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620702987 (298h54m23.217474021s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620718441 (298h54m23.217489474s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620748329 (298h54m23.21751937s) [seg_pos={0 0}, upload=334781]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 18 21:54:25.620912612 (298h54m23.21768364s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 21:54:25.620920854 (298h54m23.217691883s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:54:38.136688455 (298h54m35.733459485s) [upload=334781]: Done uploading segments... Mar 18 21:54:38.136713048 (298h54m35.73348408s) [upload=334781]: Upload finished. err: <nil> Duration: 456.453145ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 195.768898ms trace: https://jaeger.dev.storj.io/trace/2ab94940f3da3187 FAIL (2026-03-18 22:21:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:41:41.272084084 (298h41m38.868855112s) [upload=334559]: Starting upload Mar 18 21:41:41.272169036 (298h41m38.868940066s) [upload=334559]: Done starting upload Mar 18 21:41:41.272251155 (298h41m38.869022168s) [upload=334559]: Uploading segments... Mar 18 21:41:41.272358183 (298h41m38.869129211s) [upload=334559]: Got next segment. Inline: true Mar 18 21:41:41.272367512 (298h41m38.869138542s) [upload=334559]: Waiting for error group managing segments... Mar 18 21:41:41.272525860 (298h41m38.869296906s) [upload=334559]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:41:41.272550748 (298h41m38.869321776s) [upload=334559]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 21:41:41.272555523 (298h41m38.86932655s) [upload=334559]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:42:30.253452076 (298h42m27.850223099s) [upload=334559]: Done uploading segments... Mar 18 21:42:30.253475139 (298h42m27.850246163s) [upload=334559]: Upload finished. err: <nil> Duration:* 195.814572ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 13 out of 60 is failed (threshold=3) [XX.....X.XXXXXX.X..XXX......................................] duration: 1.659821733s trace: https://jaeger.dev.storj.io/trace/27ed2876d5f3e85d FAIL (2026-03-18 22:20:55 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.659847694s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 211.670343ms trace: https://jaeger.dev.storj.io/trace/2ab94940f3da3187 FAIL (2026-03-18 22:20:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:41:41.272084084 (298h41m38.868855112s) [upload=334559]: Starting upload Mar 18 21:41:41.272169036 (298h41m38.868940066s) [upload=334559]: Done starting upload Mar 18 21:41:41.272251155 (298h41m38.869022168s) [upload=334559]: Uploading segments... Mar 18 21:41:41.272358183 (298h41m38.869129211s) [upload=334559]: Got next segment. Inline: true Mar 18 21:41:41.272367512 (298h41m38.869138542s) [upload=334559]: Waiting for error group managing segments... Mar 18 21:41:41.272525860 (298h41m38.869296906s) [upload=334559]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:41:41.272550748 (298h41m38.869321776s) [upload=334559]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 21:41:41.272555523 (298h41m38.86932655s) [upload=334559]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:42:30.253452076 (298h42m27.850223099s) [upload=334559]: Done uploading segments... Mar 18 21:42:30.253475139 (298h42m27.850246163s) [upload=334559]: Upload finished. err: <nil> Duration:* 211.701555ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 23 out of 60 is failed (threshold=6) [XXX..XXXXXXXXXXXXXXXXXXXX...................................] duration: 731.094445ms trace: https://jaeger.dev.storj.io/trace/6cabdd7d47c9cb44 FAIL (2026-03-18 22:20:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 731.145682ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 12 out of 60 is failed (threshold=3) [.X......XXXXXX.X...XX.X.X...................................] duration: 270.68184ms trace: https://jaeger.dev.storj.io/trace/47004c0815b844e7 FAIL (2026-03-18 22:20:21 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:53:36.090826124 (298h53m33.687597155s) [upload=334767]: Starting upload Mar 18 21:53:36.090977797 (298h53m33.687748822s) [upload=334767]: Done starting upload Mar 18 21:53:36.091078093 (298h53m33.687849119s) [upload=334767]: Uploading segments... Mar 18 21:53:36.091268776 (298h53m33.688040083s) [upload=334767]: Got next segment. Inline: true Mar 18 21:53:36.091279074 (298h53m33.688050103s) [upload=334767]: Waiting for error group managing segments... Mar 18 21:53:36.091372978 (298h53m33.688144001s) [upload=334767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:53:36.091379985 (298h53m33.688151008s) [upload=334767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 21:53:36.091384265 (298h53m33.688155287s) [upload=334767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:54:04.718146694 (298h54m2.314917717s) [upload=334767]: Done uploading segments... Mar 18 21:54:04.718169125 (298h54m2.314940155s) [upload=334767]: Upload finished. err: <nil> Duration:* 270.711213ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.XX.....X.XXXXXX.X..XXX.....................................] duration: 1.697298239s trace: https://jaeger.dev.storj.io/trace/27ed2876d5f3e85d FAIL (2026-03-18 22:20:21 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.69732758s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [X....X...XXX..XX.X..X..X.XX.................................] duration: 255.766437ms trace: https://jaeger.dev.storj.io/trace/7c4371cfa8f7834c FAIL (2026-03-18 22:20:12 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 255.798701ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 225.073647ms trace: https://jaeger.dev.storj.io/trace/2ab94940f3da3187 FAIL (2026-03-18 22:20:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:41:41.272084084 (298h41m38.868855112s) [upload=334559]: Starting upload Mar 18 21:41:41.272169036 (298h41m38.868940066s) [upload=334559]: Done starting upload Mar 18 21:41:41.272251155 (298h41m38.869022168s) [upload=334559]: Uploading segments... Mar 18 21:41:41.272358183 (298h41m38.869129211s) [upload=334559]: Got next segment. Inline: true Mar 18 21:41:41.272367512 (298h41m38.869138542s) [upload=334559]: Waiting for error group managing segments... Mar 18 21:41:41.272525860 (298h41m38.869296906s) [upload=334559]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:41:41.272550748 (298h41m38.869321776s) [upload=334559]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 21:41:41.272555523 (298h41m38.86932655s) [upload=334559]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:42:30.253452076 (298h42m27.850223099s) [upload=334559]: Done uploading segments... Mar 18 21:42:30.253475139 (298h42m27.850246163s) [upload=334559]: Upload finished. err: <nil> Duration:* 225.102414ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [......XXXXXX.....XXXX.XXX...................................] duration: 520.511885ms trace: https://jaeger.dev.storj.io/trace/6dceff78c86f0774 FAIL (2026-03-18 22:20:03 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:54:17.190275520 (298h54m14.787046534s) [upload=334781]: Starting upload Mar 18 21:54:17.190367052 (298h54m14.787138068s) [upload=334781]: Done starting upload Mar 18 21:54:17.190448332 (298h54m14.787219348s) [upload=334781]: Uploading segments... Mar 18 21:54:17.190705184 (298h54m14.787476207s) [upload=334781]: Got next segment. Inline: false Mar 18 21:54:17.190783980 (298h54m14.787555002s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:54:17.190804859 (298h54m14.787575882s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 18 21:54:25.452304457 (298h54m23.049075487s) [seg_pos={0 0}, upload=334781]: Begin upload segment... Mar 18 21:54:25.452374690 (298h54m23.049145713s) [seg_pos={0 0}, upload=334781]: Done begin upload segment. Mar 18 21:54:25.452463335 (298h54m23.049234366s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.452479705 (298h54m23.049250739s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.453224160 (298h54m23.049995188s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454147610 (298h54m23.050918643s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454790080 (298h54m23.051561121s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.455678920 (298h54m23.052449952s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456387102 (298h54m23.053158136s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456987483 (298h54m23.053758515s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.457980795 (298h54m23.054751829s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.459806473 (298h54m23.056577503s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.460305248 (298h54m23.057076281s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.461552822 (298h54m23.058323848s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.463144575 (298h54m23.059915608s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.464837828 (298h54m23.06160886s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.466411504 (298h54m23.063182537s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.469091278 (298h54m23.065862311s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.586976347 (298h54m23.183747361s) [upload=334781]: Next returned nil segment Mar 18 21:54:25.587000505 (298h54m23.183771534s) [upload=334781]: Waiting for error group managing segments... Mar 18 21:54:25.596319798 (298h54m23.193090825s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.596985876 (298h54m23.1937569s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598026901 (298h54m23.194797934s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598566162 (298h54m23.195337186s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598781105 (298h54m23.19555213s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600260475 (298h54m23.197031509s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600344398 (298h54m23.197115411s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602467676 (298h54m23.19923871s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602977247 (298h54m23.199748272s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603520888 (298h54m23.200291919s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603907549 (298h54m23.200678573s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.604438080 (298h54m23.201209113s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.618924566 (298h54m23.21569559s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.619077190 (298h54m23.215848214s) [seg_pos={0 0}, upload=334781]: Satisfied cohort requirements after 13 pieces Mar 18 21:54:25.619546929 (298h54m23.216317961s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.619578476 (298h54m23.21634951s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620166659 (298h54m23.216937744s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620178720 (298h54m23.216949746s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620702987 (298h54m23.217474021s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620718441 (298h54m23.217489474s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620748329 (298h54m23.21751937s) [seg_pos={0 0}, upload=334781]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 18 21:54:25.620912612 (298h54m23.21768364s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 21:54:25.620920854 (298h54m23.217691883s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:54:38.136688455 (298h54m35.733459485s) [upload=334781]: Done uploading segments... Mar 18 21:54:38.136713048 (298h54m35.73348408s) [upload=334781]: Upload finished. err: <nil> Duration: 520.564924ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [.X....X...XXX..XX.X..X..X.XX................................] duration: 283.201597ms trace: https://jaeger.dev.storj.io/trace/7c4371cfa8f7834c FAIL (2026-03-18 22:19:39 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 283.255037ms core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 24 out of 60 is failed (threshold=6) [XXXX..XXXXXXXXXXXXXXXXXXXX..................................] duration: 479.541307ms trace: https://jaeger.dev.storj.io/trace/6cabdd7d47c9cb44 FAIL (2026-03-18 22:19:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 479.59516ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 12 out of 60 is failed (threshold=3) [..X......XXXXXX.X...XX.X.X..................................] duration: 302.280646ms trace: https://jaeger.dev.storj.io/trace/47004c0815b844e7 FAIL (2026-03-18 22:19:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:53:36.090826124 (298h53m33.687597155s) [upload=334767]: Starting upload Mar 18 21:53:36.090977797 (298h53m33.687748822s) [upload=334767]: Done starting upload Mar 18 21:53:36.091078093 (298h53m33.687849119s) [upload=334767]: Uploading segments... Mar 18 21:53:36.091268776 (298h53m33.688040083s) [upload=334767]: Got next segment. Inline: true Mar 18 21:53:36.091279074 (298h53m33.688050103s) [upload=334767]: Waiting for error group managing segments... Mar 18 21:53:36.091372978 (298h53m33.688144001s) [upload=334767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:53:36.091379985 (298h53m33.688151008s) [upload=334767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 21:53:36.091384265 (298h53m33.688155287s) [upload=334767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:54:04.718146694 (298h54m2.314917717s) [upload=334767]: Done uploading segments... Mar 18 21:54:04.718169125 (298h54m2.314940155s) [upload=334767]: Upload finished. err: <nil> Duration:* 302.313022ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 13 out of 60 is failed (threshold=3) [..XX.....X.XXXXXX.X..XXX....................................] duration: 1.685692842s trace: https://jaeger.dev.storj.io/trace/27ed2876d5f3e85d FAIL (2026-03-18 22:19:26 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.685788305s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 263.933607ms trace: https://jaeger.dev.storj.io/trace/2ab94940f3da3187 FAIL (2026-03-18 22:19:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:41:41.272084084 (298h41m38.868855112s) [upload=334559]: Starting upload Mar 18 21:41:41.272169036 (298h41m38.868940066s) [upload=334559]: Done starting upload Mar 18 21:41:41.272251155 (298h41m38.869022168s) [upload=334559]: Uploading segments... Mar 18 21:41:41.272358183 (298h41m38.869129211s) [upload=334559]: Got next segment. Inline: true Mar 18 21:41:41.272367512 (298h41m38.869138542s) [upload=334559]: Waiting for error group managing segments... Mar 18 21:41:41.272525860 (298h41m38.869296906s) [upload=334559]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:41:41.272550748 (298h41m38.869321776s) [upload=334559]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 21:41:41.272555523 (298h41m38.86932655s) [upload=334559]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:42:30.253452076 (298h42m27.850223099s) [upload=334559]: Done uploading segments... Mar 18 21:42:30.253475139 (298h42m27.850246163s) [upload=334559]: Upload finished. err: <nil> Duration:* 263.958925ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.......XXXXXX.....XXXX.XXX..................................] duration: 425.055188ms trace: https://jaeger.dev.storj.io/trace/6dceff78c86f0774 FAIL (2026-03-18 22:18:59 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:54:17.190275520 (298h54m14.787046534s) [upload=334781]: Starting upload Mar 18 21:54:17.190367052 (298h54m14.787138068s) [upload=334781]: Done starting upload Mar 18 21:54:17.190448332 (298h54m14.787219348s) [upload=334781]: Uploading segments... Mar 18 21:54:17.190705184 (298h54m14.787476207s) [upload=334781]: Got next segment. Inline: false Mar 18 21:54:17.190783980 (298h54m14.787555002s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:54:17.190804859 (298h54m14.787575882s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 18 21:54:25.452304457 (298h54m23.049075487s) [seg_pos={0 0}, upload=334781]: Begin upload segment... Mar 18 21:54:25.452374690 (298h54m23.049145713s) [seg_pos={0 0}, upload=334781]: Done begin upload segment. Mar 18 21:54:25.452463335 (298h54m23.049234366s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.452479705 (298h54m23.049250739s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.453224160 (298h54m23.049995188s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454147610 (298h54m23.050918643s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454790080 (298h54m23.051561121s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.455678920 (298h54m23.052449952s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456387102 (298h54m23.053158136s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456987483 (298h54m23.053758515s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.457980795 (298h54m23.054751829s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.459806473 (298h54m23.056577503s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.460305248 (298h54m23.057076281s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.461552822 (298h54m23.058323848s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.463144575 (298h54m23.059915608s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.464837828 (298h54m23.06160886s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.466411504 (298h54m23.063182537s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.469091278 (298h54m23.065862311s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.586976347 (298h54m23.183747361s) [upload=334781]: Next returned nil segment Mar 18 21:54:25.587000505 (298h54m23.183771534s) [upload=334781]: Waiting for error group managing segments... Mar 18 21:54:25.596319798 (298h54m23.193090825s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.596985876 (298h54m23.1937569s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598026901 (298h54m23.194797934s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598566162 (298h54m23.195337186s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598781105 (298h54m23.19555213s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600260475 (298h54m23.197031509s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600344398 (298h54m23.197115411s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602467676 (298h54m23.19923871s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602977247 (298h54m23.199748272s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603520888 (298h54m23.200291919s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603907549 (298h54m23.200678573s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.604438080 (298h54m23.201209113s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.618924566 (298h54m23.21569559s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.619077190 (298h54m23.215848214s) [seg_pos={0 0}, upload=334781]: Satisfied cohort requirements after 13 pieces Mar 18 21:54:25.619546929 (298h54m23.216317961s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.619578476 (298h54m23.21634951s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620166659 (298h54m23.216937744s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620178720 (298h54m23.216949746s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620702987 (298h54m23.217474021s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620718441 (298h54m23.217489474s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620748329 (298h54m23.21751937s) [seg_pos={0 0}, upload=334781]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 18 21:54:25.620912612 (298h54m23.21768364s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 21:54:25.620920854 (298h54m23.217691883s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:54:38.136688455 (298h54m35.733459485s) [upload=334781]: Done uploading segments... Mar 18 21:54:38.136713048 (298h54m35.73348408s) [upload=334781]: Upload finished. err: <nil> Duration: 425.084713ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 12 out of 60 is failed (threshold=3) [...X......XXXXXX.X...XX.X.X.................................] duration: 289.795278ms trace: https://jaeger.dev.storj.io/trace/47004c0815b844e7 FAIL (2026-03-18 22:18:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:53:36.090826124 (298h53m33.687597155s) [upload=334767]: Starting upload Mar 18 21:53:36.090977797 (298h53m33.687748822s) [upload=334767]: Done starting upload Mar 18 21:53:36.091078093 (298h53m33.687849119s) [upload=334767]: Uploading segments... Mar 18 21:53:36.091268776 (298h53m33.688040083s) [upload=334767]: Got next segment. Inline: true Mar 18 21:53:36.091279074 (298h53m33.688050103s) [upload=334767]: Waiting for error group managing segments... Mar 18 21:53:36.091372978 (298h53m33.688144001s) [upload=334767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:53:36.091379985 (298h53m33.688151008s) [upload=334767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 21:53:36.091384265 (298h53m33.688155287s) [upload=334767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:54:04.718146694 (298h54m2.314917717s) [upload=334767]: Done uploading segments... Mar 18 21:54:04.718169125 (298h54m2.314940155s) [upload=334767]: Upload finished. err: <nil> Duration:* 289.823954ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [..X....X...XXX..XX.X..X..X.XX...............................] duration: 291.063168ms trace: https://jaeger.dev.storj.io/trace/7c4371cfa8f7834c FAIL (2026-03-18 22:18:36 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 291.102015ms core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 25 out of 60 is failed (threshold=6) [XXXXX..XXXXXXXXXXXXXXXXXXXX.................................] duration: 484.205151ms trace: https://jaeger.dev.storj.io/trace/6cabdd7d47c9cb44 FAIL (2026-03-18 22:18:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 484.245415ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 13 out of 60 is failed (threshold=3) [...XX.....X.XXXXXX.X..XXX...................................] duration: 1.758106869s trace: https://jaeger.dev.storj.io/trace/27ed2876d5f3e85d FAIL (2026-03-18 22:18:22 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.758141344s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 232.818644ms trace: https://jaeger.dev.storj.io/trace/2ab94940f3da3187 FAIL (2026-03-18 22:18:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:41:41.272084084 (298h41m38.868855112s) [upload=334559]: Starting upload Mar 18 21:41:41.272169036 (298h41m38.868940066s) [upload=334559]: Done starting upload Mar 18 21:41:41.272251155 (298h41m38.869022168s) [upload=334559]: Uploading segments... Mar 18 21:41:41.272358183 (298h41m38.869129211s) [upload=334559]: Got next segment. Inline: true Mar 18 21:41:41.272367512 (298h41m38.869138542s) [upload=334559]: Waiting for error group managing segments... Mar 18 21:41:41.272525860 (298h41m38.869296906s) [upload=334559]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:41:41.272550748 (298h41m38.869321776s) [upload=334559]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 21:41:41.272555523 (298h41m38.86932655s) [upload=334559]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:42:30.253452076 (298h42m27.850223099s) [upload=334559]: Done uploading segments... Mar 18 21:42:30.253475139 (298h42m27.850246163s) [upload=334559]: Upload finished. err: <nil> Duration:* 232.924838ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 26 out of 60 is failed (threshold=6) [XXXXXX..XXXXXXXXXXXXXXXXXXXX................................] duration: 487.621051ms trace: https://jaeger.dev.storj.io/trace/6cabdd7d47c9cb44 FAIL (2026-03-18 22:18:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 487.649149ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [........XXXXXX.....XXXX.XXX.................................] duration: 431.962763ms trace: https://jaeger.dev.storj.io/trace/6dceff78c86f0774 FAIL (2026-03-18 22:18:15 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:54:17.190275520 (298h54m14.787046534s) [upload=334781]: Starting upload Mar 18 21:54:17.190367052 (298h54m14.787138068s) [upload=334781]: Done starting upload Mar 18 21:54:17.190448332 (298h54m14.787219348s) [upload=334781]: Uploading segments... Mar 18 21:54:17.190705184 (298h54m14.787476207s) [upload=334781]: Got next segment. Inline: false Mar 18 21:54:17.190783980 (298h54m14.787555002s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:54:17.190804859 (298h54m14.787575882s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 18 21:54:25.452304457 (298h54m23.049075487s) [seg_pos={0 0}, upload=334781]: Begin upload segment... Mar 18 21:54:25.452374690 (298h54m23.049145713s) [seg_pos={0 0}, upload=334781]: Done begin upload segment. Mar 18 21:54:25.452463335 (298h54m23.049234366s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.452479705 (298h54m23.049250739s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.453224160 (298h54m23.049995188s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454147610 (298h54m23.050918643s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454790080 (298h54m23.051561121s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.455678920 (298h54m23.052449952s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456387102 (298h54m23.053158136s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456987483 (298h54m23.053758515s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.457980795 (298h54m23.054751829s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.459806473 (298h54m23.056577503s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.460305248 (298h54m23.057076281s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.461552822 (298h54m23.058323848s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.463144575 (298h54m23.059915608s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.464837828 (298h54m23.06160886s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.466411504 (298h54m23.063182537s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.469091278 (298h54m23.065862311s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.586976347 (298h54m23.183747361s) [upload=334781]: Next returned nil segment Mar 18 21:54:25.587000505 (298h54m23.183771534s) [upload=334781]: Waiting for error group managing segments... Mar 18 21:54:25.596319798 (298h54m23.193090825s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.596985876 (298h54m23.1937569s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598026901 (298h54m23.194797934s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598566162 (298h54m23.195337186s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598781105 (298h54m23.19555213s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600260475 (298h54m23.197031509s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600344398 (298h54m23.197115411s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602467676 (298h54m23.19923871s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602977247 (298h54m23.199748272s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603520888 (298h54m23.200291919s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603907549 (298h54m23.200678573s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.604438080 (298h54m23.201209113s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.618924566 (298h54m23.21569559s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.619077190 (298h54m23.215848214s) [seg_pos={0 0}, upload=334781]: Satisfied cohort requirements after 13 pieces Mar 18 21:54:25.619546929 (298h54m23.216317961s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.619578476 (298h54m23.21634951s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620166659 (298h54m23.216937744s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620178720 (298h54m23.216949746s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620702987 (298h54m23.217474021s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620718441 (298h54m23.217489474s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620748329 (298h54m23.21751937s) [seg_pos={0 0}, upload=334781]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 18 21:54:25.620912612 (298h54m23.21768364s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 21:54:25.620920854 (298h54m23.217691883s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:54:38.136688455 (298h54m35.733459485s) [upload=334781]: Done uploading segments... Mar 18 21:54:38.136713048 (298h54m35.73348408s) [upload=334781]: Upload finished. err: <nil> Duration: 431.999861ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 13 out of 60 is failed (threshold=3) [....XX.....X.XXXXXX.X..XXX..................................] duration: 1.662474828s trace: https://jaeger.dev.storj.io/trace/27ed2876d5f3e85d FAIL (2026-03-18 22:18:06 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.662502166s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 27 out of 60 is failed (threshold=6) [XXXXXXX..XXXXXXXXXXXXXXXXXXXX...............................] duration: 551.197239ms trace: https://jaeger.dev.storj.io/trace/6cabdd7d47c9cb44 FAIL (2026-03-18 22:17:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 551.235452ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [...X....X...XXX..XX.X..X..X.XX..............................] duration: 257.5922ms trace: https://jaeger.dev.storj.io/trace/7c4371cfa8f7834c FAIL (2026-03-18 22:17:45 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 257.6997ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 12 out of 60 is failed (threshold=3) [....X......XXXXXX.X...XX.X.X................................] duration: 275.026755ms trace: https://jaeger.dev.storj.io/trace/47004c0815b844e7 FAIL (2026-03-18 22:17:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:53:36.090826124 (298h53m33.687597155s) [upload=334767]: Starting upload Mar 18 21:53:36.090977797 (298h53m33.687748822s) [upload=334767]: Done starting upload Mar 18 21:53:36.091078093 (298h53m33.687849119s) [upload=334767]: Uploading segments... Mar 18 21:53:36.091268776 (298h53m33.688040083s) [upload=334767]: Got next segment. Inline: true Mar 18 21:53:36.091279074 (298h53m33.688050103s) [upload=334767]: Waiting for error group managing segments... Mar 18 21:53:36.091372978 (298h53m33.688144001s) [upload=334767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:53:36.091379985 (298h53m33.688151008s) [upload=334767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 21:53:36.091384265 (298h53m33.688155287s) [upload=334767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:54:04.718146694 (298h54m2.314917717s) [upload=334767]: Done uploading segments... Mar 18 21:54:04.718169125 (298h54m2.314940155s) [upload=334767]: Upload finished. err: <nil> Duration:* 275.131555ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.........XXXXXX.....XXXX.XXX................................] duration: 442.915674ms trace: https://jaeger.dev.storj.io/trace/6dceff78c86f0774 FAIL (2026-03-18 22:17:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:54:17.190275520 (298h54m14.787046534s) [upload=334781]: Starting upload Mar 18 21:54:17.190367052 (298h54m14.787138068s) [upload=334781]: Done starting upload Mar 18 21:54:17.190448332 (298h54m14.787219348s) [upload=334781]: Uploading segments... Mar 18 21:54:17.190705184 (298h54m14.787476207s) [upload=334781]: Got next segment. Inline: false Mar 18 21:54:17.190783980 (298h54m14.787555002s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:54:17.190804859 (298h54m14.787575882s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 18 21:54:25.452304457 (298h54m23.049075487s) [seg_pos={0 0}, upload=334781]: Begin upload segment... Mar 18 21:54:25.452374690 (298h54m23.049145713s) [seg_pos={0 0}, upload=334781]: Done begin upload segment. Mar 18 21:54:25.452463335 (298h54m23.049234366s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.452479705 (298h54m23.049250739s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.453224160 (298h54m23.049995188s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454147610 (298h54m23.050918643s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454790080 (298h54m23.051561121s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.455678920 (298h54m23.052449952s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456387102 (298h54m23.053158136s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456987483 (298h54m23.053758515s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.457980795 (298h54m23.054751829s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.459806473 (298h54m23.056577503s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.460305248 (298h54m23.057076281s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.461552822 (298h54m23.058323848s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.463144575 (298h54m23.059915608s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.464837828 (298h54m23.06160886s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.466411504 (298h54m23.063182537s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.469091278 (298h54m23.065862311s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.586976347 (298h54m23.183747361s) [upload=334781]: Next returned nil segment Mar 18 21:54:25.587000505 (298h54m23.183771534s) [upload=334781]: Waiting for error group managing segments... Mar 18 21:54:25.596319798 (298h54m23.193090825s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.596985876 (298h54m23.1937569s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598026901 (298h54m23.194797934s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598566162 (298h54m23.195337186s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598781105 (298h54m23.19555213s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600260475 (298h54m23.197031509s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600344398 (298h54m23.197115411s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602467676 (298h54m23.19923871s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602977247 (298h54m23.199748272s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603520888 (298h54m23.200291919s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603907549 (298h54m23.200678573s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.604438080 (298h54m23.201209113s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.618924566 (298h54m23.21569559s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.619077190 (298h54m23.215848214s) [seg_pos={0 0}, upload=334781]: Satisfied cohort requirements after 13 pieces Mar 18 21:54:25.619546929 (298h54m23.216317961s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.619578476 (298h54m23.21634951s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620166659 (298h54m23.216937744s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620178720 (298h54m23.216949746s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620702987 (298h54m23.217474021s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620718441 (298h54m23.217489474s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620748329 (298h54m23.21751937s) [seg_pos={0 0}, upload=334781]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 18 21:54:25.620912612 (298h54m23.21768364s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 21:54:25.620920854 (298h54m23.217691883s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:54:38.136688455 (298h54m35.733459485s) [upload=334781]: Done uploading segments... Mar 18 21:54:38.136713048 (298h54m35.73348408s) [upload=334781]: Upload finished. err: <nil> Duration: 443.029334ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 28 out of 60 is failed (threshold=6) [XXXXXXXX..XXXXXXXXXXXXXXXXXXXX..............................] duration: 512.248272ms trace: https://jaeger.dev.storj.io/trace/6cabdd7d47c9cb44 FAIL (2026-03-18 22:17:15 UTC) operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 512.2786ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 213.841087ms trace: https://jaeger.dev.storj.io/trace/2ab94940f3da3187 FAIL (2026-03-18 22:17:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:41:41.272084084 (298h41m38.868855112s) [upload=334559]: Starting upload Mar 18 21:41:41.272169036 (298h41m38.868940066s) [upload=334559]: Done starting upload Mar 18 21:41:41.272251155 (298h41m38.869022168s) [upload=334559]: Uploading segments... Mar 18 21:41:41.272358183 (298h41m38.869129211s) [upload=334559]: Got next segment. Inline: true Mar 18 21:41:41.272367512 (298h41m38.869138542s) [upload=334559]: Waiting for error group managing segments... Mar 18 21:41:41.272525860 (298h41m38.869296906s) [upload=334559]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:41:41.272550748 (298h41m38.869321776s) [upload=334559]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Mar 18 21:41:41.272555523 (298h41m38.86932655s) [upload=334559]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:42:30.253452076 (298h42m27.850223099s) [upload=334559]: Done uploading segments... Mar 18 21:42:30.253475139 (298h42m27.850246163s) [upload=334559]: Upload finished. err: <nil> Duration:* 213.867506ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [....X....X...XXX..XX.X..X..X.XX.............................] duration: 227.411145ms trace: https://jaeger.dev.storj.io/trace/7c4371cfa8f7834c FAIL (2026-03-18 22:17:12 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 227.443892ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.....XX.....X.XXXXXX.X..XXX.................................] duration: 1.782924623s trace: https://jaeger.dev.storj.io/trace/27ed2876d5f3e85d FAIL (2026-03-18 22:17:09 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.782950721s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [..........XXXXXX.....XXXX.XXX...............................] duration: 444.53508ms trace: https://jaeger.dev.storj.io/trace/6dceff78c86f0774 FAIL (2026-03-18 22:17:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Mar 18 21:54:17.190275520 (298h54m14.787046534s) [upload=334781]: Starting upload Mar 18 21:54:17.190367052 (298h54m14.787138068s) [upload=334781]: Done starting upload Mar 18 21:54:17.190448332 (298h54m14.787219348s) [upload=334781]: Uploading segments... Mar 18 21:54:17.190705184 (298h54m14.787476207s) [upload=334781]: Got next segment. Inline: false Mar 18 21:54:17.190783980 (298h54m14.787555002s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 18 21:54:17.190804859 (298h54m14.787575882s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 18 21:54:25.452304457 (298h54m23.049075487s) [seg_pos={0 0}, upload=334781]: Begin upload segment... Mar 18 21:54:25.452374690 (298h54m23.049145713s) [seg_pos={0 0}, upload=334781]: Done begin upload segment. Mar 18 21:54:25.452463335 (298h54m23.049234366s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.452479705 (298h54m23.049250739s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.453224160 (298h54m23.049995188s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454147610 (298h54m23.050918643s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.454790080 (298h54m23.051561121s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.455678920 (298h54m23.052449952s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456387102 (298h54m23.053158136s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.456987483 (298h54m23.053758515s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.457980795 (298h54m23.054751829s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.459806473 (298h54m23.056577503s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.460305248 (298h54m23.057076281s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.461552822 (298h54m23.058323848s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.463144575 (298h54m23.059915608s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.464837828 (298h54m23.06160886s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.466411504 (298h54m23.063182537s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.469091278 (298h54m23.065862311s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Uploading piece... Mar 18 21:54:25.586976347 (298h54m23.183747361s) [upload=334781]: Next returned nil segment Mar 18 21:54:25.587000505 (298h54m23.183771534s) [upload=334781]: Waiting for error group managing segments... Mar 18 21:54:25.596319798 (298h54m23.193090825s) [noise=true , address=79.127.219.41:4926 , piece_id=AVSCKJ5WDK4OBWWUSLUQNOPZI7BGTTDGT4XJYSLQAJPUHRYY4KVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.596985876 (298h54m23.1937569s) [noise=true , address=45.91.116.9:4264 , piece_id=EE3TXU5KSPHKMNNCI3BHIGFKQNYZQRBDO4YT3TTR5U66YJMFT6XQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598026901 (298h54m23.194797934s) [noise=true , address=145.79.227.26:4656 , piece_id=DDNFTYMUJMFHTZXFHJTFUURSVOJBQX2KVT6UWLBCZ5TIOVBDVOVQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598566162 (298h54m23.195337186s) [noise=true , address=145.79.227.50:4376 , piece_id=BHABIBKA3ZENQUNU2OVBVUJZVWEQRZD435EHA3MEB25KMNBVFQIA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.598781105 (298h54m23.19555213s) [noise=true , address=77.90.31.16:4737 , piece_id=SMQOC6BKSIEIE5FXEYZGOIWRZ6GORC7GCOVEOFZXPQX4FGILVIPA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600260475 (298h54m23.197031509s) [noise=true , address=145.79.227.6:4261 , piece_id=CYOWHNR7X3Y4YE5SFHPNDBOU5QQ6M6DZIRAO3VX56KQBL3OP2FLQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.600344398 (298h54m23.197115411s) [noise=true , address=145.79.227.4:4190 , piece_id=LDID6UGFJ4GWYK635S5OE6334DEULOPVSOLOCLYQCBOFTXRZEKRQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602467676 (298h54m23.19923871s) [noise=true , address=145.79.227.2:4116 , piece_id=KEKK3M6M37G7Y7HXPULI2RSX5CFGUNCM3LILYNQOZ2PASM742ZGQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.602977247 (298h54m23.199748272s) [noise=true , address=145.79.227.48:4307 , piece_id=D6WSRVCL6UO4KQ542EKZWA6IP7FLA3ZUGSBXCSZUMLPFCJ5G5CQA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603520888 (298h54m23.200291919s) [noise=true , address=79.127.219.45:4855 , piece_id=644Z2MAXJ423ZF4JGZ2YLPM6XJRZT7IUJCZRRE7ZJMHB3EW7KB4Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.603907549 (298h54m23.200678573s) [noise=true , address=145.79.227.36:4518 , piece_id=R5PDKAATCPFI3LOOUX6HJ4OP64NQ72N3RAOZS3GYFH5VSWPFU6OQ, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.604438080 (298h54m23.201209113s) [noise=true , address=45.91.116.11:4118 , piece_id=CVKN5WPP2OTRAHYWJKDLCJV3OZ3I6G5CLYXTSEKJDQD7LRTJ55EA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.618924566 (298h54m23.21569559s) [noise=true , address=79.127.219.46:4892 , piece_id=533AWUNWA66VX4AZF7Y3AANCF65GMESWZD3IJWBC5IOKB4QMVTZA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: <nil> Mar 18 21:54:25.619077190 (298h54m23.215848214s) [seg_pos={0 0}, upload=334781]: Satisfied cohort requirements after 13 pieces Mar 18 21:54:25.619546929 (298h54m23.216317961s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.619578476 (298h54m23.21634951s) [noise=true , address=145.79.227.46:4604 , piece_id=DAGTJ24IRMED5FNGQHRYTXEIXYTDVSRW2IT23MC2UC45SES3PE7Q, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620166659 (298h54m23.216937744s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620178720 (298h54m23.216949746s) [noise=true , address=145.79.227.19:4080 , piece_id=ANOMNO3HLII5GPWIT2RDX6P7WOBTVJXMOJM5PAPDMK7ST2NYJWMA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620702987 (298h54m23.217474021s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18TqoejkuHLqZWhEPe3QPH1weVXnWJhaeoi8BGkvjCTLW6t4qT): protocol: expected piece hash; context canceled; EOF Mar 18 21:54:25.620718441 (298h54m23.217489474s) [noise=true , address=145.79.227.37:4569 , piece_id=PTE4YT3YJ5M3NDKXKQOUFTGQ3T5FDAUZB74QHJBVH6HQL53QXLUA, seg_pos={0 0}, upload=334781]: Long tail cancellation due to optimal threshold Mar 18 21:54:25.620748329 (298h54m23.21751937s) [seg_pos={0 0}, upload=334781]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 18 21:54:25.620912612 (298h54m23.21768364s) [upload=334781]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 18 21:54:25.620920854 (298h54m23.217691883s) [upload=334781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 18 21:54:38.136688455 (298h54m35.733459485s) [upload=334781]: Done uploading segments... Mar 18 21:54:38.136713048 (298h54m35.73348408s) [upload=334781]: Upload finished. err: <nil> Duration: 444.565924ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [.....X....X...XXX..XX.X..X..X.XX............................] duration: 248.471609ms trace: https://jaeger.dev.storj.io/trace/7c4371cfa8f7834c FAIL (2026-03-18 22:16:53 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 248.495803ms core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 29 out of 60 is failed (threshold=6) [XXXXXXXXX..XXXXXXXXXXXXXXXXXXXX.............................] duration: 489.297396ms trace: https://jaeger.dev.storj.io/trace/6cabdd7d47c9cb44 FAIL (2026-03-18 22:16:49 UTC) operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 489.325427ms core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)