Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 827.049837ms trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:33:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 827.085713ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [...............................X..X.........XXX.............] duration: 493.329624ms trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:32:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 493.361101ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.333232376s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:32:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.333259576s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 680.095772ms trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:32:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 680.239627ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 1.35900284s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:32:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.359045267s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [................................X..X.........XXX............] duration: 450.144941ms trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:31:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 450.174768ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 610.112517ms trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:31:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 610.143703ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.336929146s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:31:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.336965596s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 650.012914ms trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:31:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 650.047611ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [.................................X..X.........XXX...........] duration: 518.868446ms trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:30:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 518.92076ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.399944075s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:30:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.399974525s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [..................................X..X.........XXX..........] duration: 466.532053ms trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:30:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 466.603518ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 682.220905ms trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:29:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 682.241649ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [...................................X..X.........XXX.........] duration: 504.104512ms trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:29:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 504.148208ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.45629083s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:29:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.456352326s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 630.216761ms trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:29:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 630.305528ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 820.556877ms trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:29:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 820.595426ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [....................................X..X.........XXX........] duration: 542.184139ms trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:28:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 542.272514ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.44330232s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:28:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.44332483s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 632.972215ms trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:28:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 633.003527ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [.....................................X..X.........XXX.......] duration: 484.367596ms trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:28:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 486.088933ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 609.735681ms trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:27:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 609.849095ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.616371577s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:27:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.616543282s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 666.722637ms trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:27:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 666.756989ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [......................................X..X.........XXX......] duration: 455.803201ms trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:27:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 455.834657ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.413873508s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:26:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.413903643s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [.......................................X..X.........XXX.....] duration: 473.192391ms trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:26:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 473.219399ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 778.486368ms trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:26:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 778.589373ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [........................................X..X.........XXX....] duration: 505.738036ms trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:25:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 505.773875ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.39263254s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:25:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.392737391s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 621.249299ms trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:25:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 621.311519ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [.........................................X..X.........XXX...] duration: 611.567515ms trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:24:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 611.598031ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 786.539219ms trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:24:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 786.580954ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.522229705s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:24:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.522254797s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.324560908s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:23:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.324594055s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 649.429685ms trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:23:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 649.586463ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [..........................................X..X.........XXX..] duration: 566.676637ms trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:23:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 566.705303ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.424162676s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:23:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.424198748s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [...........................................X..X.........XXX.] duration: 722.827127ms trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:23:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 722.935226ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 8.107744748s trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:23:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.107780788s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.001580376s trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:22:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001649946s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 3.702980913s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:22:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.70300665s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.030418061s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:22:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.030457483s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [............................................X..X.........XXX] duration: 5.001554404s trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:22:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001607395s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [.............................................X..X.........XX] duration: 5.001546215s trace: https://jaeger.dev.storj.io/trace/32b98355d629c258 FAIL (2026-04-04 04:21:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001572651s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..............................................X..X.........X] duration: 5.000901754s trace: https://jaeger.dev.storj.io/trace/474eab181933c923 FAIL (2026-04-04 04:21:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000930085s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...............................................X..X.........] duration: 567.320487ms trace: https://jaeger.dev.storj.io/trace/4a7a462adcbd6e1b FAIL (2026-04-04 04:20:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 567.358575ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [................................................X..X........] duration: 486.53249ms trace: https://jaeger.dev.storj.io/trace/4a7a462adcbd6e1b FAIL (2026-04-04 04:19:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 486.627996ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.................................................X..X.......] duration: 696.293972ms trace: https://jaeger.dev.storj.io/trace/4a7a462adcbd6e1b FAIL (2026-04-04 04:18:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 696.325538ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..................................................X..X......] duration: 533.25298ms trace: https://jaeger.dev.storj.io/trace/4a7a462adcbd6e1b FAIL (2026-04-04 04:18:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 533.280362ms core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)