Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.39263254s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:25:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.392737391s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 621.249299ms trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:25:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 621.311519ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [.........................................X..X.........XXX...] duration: 611.567515ms trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:24:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 611.598031ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 786.539219ms trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:24:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 786.580954ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.522229705s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:24:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.522254797s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.324560908s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:23:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.324594055s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 649.429685ms trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:23:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 649.586463ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [..........................................X..X.........XXX..] duration: 566.676637ms trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:23:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 566.705303ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.424162676s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:23:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.424198748s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [...........................................X..X.........XXX.] duration: 722.827127ms trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:23:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 722.935226ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 8.107744748s trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:23:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.107780788s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.001580376s trace: https://jaeger.dev.storj.io/trace/670ee369f5f2d334 FAIL (2026-04-04 04:22:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001649946s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 3.702980913s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:22:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.70300665s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.030418061s trace: https://jaeger.dev.storj.io/trace/5cce09de575b8506 FAIL (2026-04-04 04:22:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 6881916s) [upload=772064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Apr 4 04:21:44.460130782 (689h21m42.056901815s) [upload=772064]: Flush batch item: pb.BatchRequestItem_SegmentBegin Apr 4 04:21:44.500551580 (689h21m42.097322604s) [seg_pos={0 0}, upload=772064]: Begin upload segment... Apr 4 04:21:44.500628241 (689h21m42.097399263s) [seg_pos={0 0}, upload=772064]: Done begin upload segment. Apr 4 04:21:44.500668892 (689h21m42.097439922s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.500792978 (689h21m42.097564014s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501687053 (689h21m42.09845809s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.501828492 (689h21m42.098599515s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502343164 (689h21m42.099114198s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.502900735 (689h21m42.099671764s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503495842 (689h21m42.100266868s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.503796813 (689h21m42.100567839s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504006258 (689h21m42.100777287s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504542000 (689h21m42.101313035s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.504560079 (689h21m42.101331115s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505047220 (689h21m42.101818243s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505183875 (689h21m42.10195491s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.505619570 (689h21m42.102390603s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506074686 (689h21m42.102845722s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.506877697 (689h21m42.103648727s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507462874 (689h21m42.104233903s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.507975323 (689h21m42.10474639s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Uploading piece... Apr 4 04:21:44.582999887 (689h21m42.17977091s) [upload=772064]: Next returned nil segment Apr 4 04:21:44.583065715 (689h21m42.179836738s) [upload=772064]: Waiting for error group managing segments... Apr 4 04:21:44.587179313 (689h21m42.183950339s) [noise=true , address=45.91.116.12:4229 , piece_id=CDXY4QA2BKVNNJUHGL2JPK3MMHTVDPRN64SAQSMZSVQIG755ZOJQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.587315638 (689h21m42.184086655s) [noise=true , address=45.91.116.13:4158 , piece_id=OX4BJEH3DNMAUXS64QHDHRK75YYEF6DPQJAX7MS3J6K7RUM4GM2Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.592227274 (689h21m42.188998305s) [noise=true , address=145.79.227.8:4345 , piece_id=2UWIKM3L3JUKNYWPBVJBEGFOEWS3WVM24AY7C2OVBZWDAXDG4I3A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:44.897574490 (689h21m42.494345523s) [noise=true , address=167.17.72.70:4751 , piece_id=AX7C5IEHMVNPGGAB7WPWUOSFEHVWWA75JGDAH3DAGZVZCVMEZKKQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084711646 (689h21m42.681482669s) [noise=true , address=193.149.164.66:4996 , piece_id=YGOQ6INTPJ3AZW3RSTVH2IWITNFONA7JTW25BIXNBZRRZUN6YRYA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.084884121 (689h21m42.681655134s) [noise=true , address=193.149.164.67:4002 , piece_id=CYJYJ5ZNXT63OT5DBDLW7ML32OIZLGNWMLM4W2F5TPSSJ2QJ2NBA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.089152844 (689h21m42.685923867s) [noise=true , address=193.149.164.70:4115 , piece_id=EHMHJHJ2ZQWAJWBFSHOTAXWE7QJQOIICXDKAK33KMOAF7C7KZ2PA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.103385369 (689h21m42.700156382s) [noise=true , address=193.149.164.68:4062 , piece_id=IM6B4U2ARVUSBX4276OSQPEPQNMWMFSUUOYAEJ3ZG2GLFUKGGQGQ, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.127711185 (689h21m42.724482213s) [noise=true , address=193.149.164.69:4084 , piece_id=BUV3LZ7PDHSGRNKHJSSN2OFQYMIYUELWEPO4PF3DMTBX65S4YPMA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.143513369 (689h21m42.740284381s) [noise=true , address=193.149.164.71:4308 , piece_id=YGF5F7J25BEULKSTR3ZDC3HE4EHVJ3IF4HQCNATVWHITGRB344JA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.307124646 (689h21m42.903895674s) [noise=true , address=167.17.72.68:4656 , piece_id=YFAXDPM4TYBLYL4UR3Z6FDCDJXU34J7XRURDGLXZAMUOYYZL56IA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:45.517599945 (689h21m43.114370966s) [noise=true , address=145.79.227.33:4898 , piece_id=64X2NB2BPWLP4C5EC53A6EKFPNQCJI6BGEDY6BFE2RFNYEPCDA5Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:21:46.061904485 (689h21m43.658675509s) [noise=true , address=193.149.164.143:4704 , piece_id=PZ2W2J22M5MZIYBFEOJCEOIVAJOJGYCHCQUPDSELS764HZG4OF2A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: <nil> Apr 4 04:22:44.423237599 (689h22m42.020008631s) [noise=true , address=77.90.31.13:4658 , piece_id=I7GGGCPJIHSQ5RYYOPIXKWAJBOMSRSK3ZDCASMKUPBQPALOJCKXA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:129aongkQE9HMNz8vsNNA5SvKbhsHqdt9UrtSTPJJpP9mkFsboX, address:77.90.31.13:4658): protocol: read tcp 159.223.143.39:50834->77.90.31.13:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423364101 (689h22m42.020135144s) [noise=true , address=77.90.31.17:4783 , piece_id=E2XPGXQAVSYEMBWOIPKHGL5MVVGC2FSLN5KHZQC6DBUAT3VUWOKA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: read tcp 159.223.143.39:45990->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423435607 (689h22m42.020206643s) [noise=true , address=77.90.31.16:4750 , piece_id=TI2D4Z2MYSXWBHX3ZVEMRFLI4LW5RDVCENH43S7GEFR7WGIVCI6A, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12TGd8NnWdekDtHzBQHmJPgTtHjXC6g8fi6RoZYFQJVHDa5hdyE, address:77.90.31.16:4750): protocol: read tcp 159.223.143.39:34564->77.90.31.16:4750: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423560856 (689h22m42.020332015s) [noise=true , address=77.90.31.18:4823 , piece_id=MI45FJCGXJ2CIL4OOVHEUB7TJXEGH6WELCSTKR6JD753YLF5UN4Q, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:12uUCUDKZDwj25UcEKQ4WiTuQFMRbWw2oymGAdUdMX8wcUSd7jS, address:77.90.31.18:4823): protocol: read tcp 159.223.143.39:40028->77.90.31.18:4823: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423793037 (689h22m42.020564071s) [noise=true , address=77.90.31.15:4709 , piece_id=HQLXOXRSN7R5WC5K2W7X4YUBVEZFITOY4VEYKG7J6WIJDEHABWGA, seg_pos={0 0}, upload=772064]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: read tcp 159.223.143.39:59234->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Apr 4 04:22:44.423864095 (689h22m42.020635106s) [seg_pos={0 0}, upload=772064]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Apr 4 04:22:44.451342916 (689h22m42.048113939s) [upload=772064]: Done uploading segments... Apr 4 04:22:44.451381831 (689h22m42.048152855s) [upload=772064]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.030457483s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 5 out of 60 is failed (threshold=6) [............................................X..X.........XXX] duration: 5.001554404s trace: https://jaeger.dev.storj.io/trace/3304a822f59853ad FAIL (2026-04-04 04:22:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001607395s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 4 out of 60 is failed (threshold=6) [.............................................X..X.........XX] duration: 5.001546215s trace: https://jaeger.dev.storj.io/trace/32b98355d629c258 FAIL (2026-04-04 04:21:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001572651s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..............................................X..X.........X] duration: 5.000901754s trace: https://jaeger.dev.storj.io/trace/474eab181933c923 FAIL (2026-04-04 04:21:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000930085s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...............................................X..X.........] duration: 567.320487ms trace: https://jaeger.dev.storj.io/trace/4a7a462adcbd6e1b FAIL (2026-04-04 04:20:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 567.358575ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [................................................X..X........] duration: 486.53249ms trace: https://jaeger.dev.storj.io/trace/4a7a462adcbd6e1b FAIL (2026-04-04 04:19:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 486.627996ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.................................................X..X.......] duration: 696.293972ms trace: https://jaeger.dev.storj.io/trace/4a7a462adcbd6e1b FAIL (2026-04-04 04:18:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 696.325538ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..................................................X..X......] duration: 533.25298ms trace: https://jaeger.dev.storj.io/trace/4a7a462adcbd6e1b FAIL (2026-04-04 04:18:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 533.280362ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...................................................X..X.....] duration: 553.687802ms trace: https://jaeger.dev.storj.io/trace/4a7a462adcbd6e1b FAIL (2026-04-04 04:18:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 553.737947ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....................................................X..X....] duration: 713.11701ms trace: https://jaeger.dev.storj.io/trace/4a7a462adcbd6e1b FAIL (2026-04-04 04:17:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 713.1779ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.....................................................X..X...] duration: 632.180222ms trace: https://jaeger.dev.storj.io/trace/4a7a462adcbd6e1b FAIL (2026-04-04 04:16:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 632.1991ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [......................................................X..X..] duration: 475.708593ms trace: https://jaeger.dev.storj.io/trace/4a7a462adcbd6e1b FAIL (2026-04-04 04:15:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 475.777942ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.......................................................X..X.] duration: 496.712688ms trace: https://jaeger.dev.storj.io/trace/4a7a462adcbd6e1b FAIL (2026-04-04 04:15:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 496.742128ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [........................................................X..X] duration: 5.003106025s trace: https://jaeger.dev.storj.io/trace/4a7a462adcbd6e1b FAIL (2026-04-04 04:14:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.003137231s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................................X..] duration: 434.692658ms trace: https://jaeger.dev.storj.io/trace/731e3210b1774b05 FAIL (2026-04-04 04:13:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 434.732754ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................................X.] duration: 435.060303ms trace: https://jaeger.dev.storj.io/trace/731e3210b1774b05 FAIL (2026-04-04 04:13:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 435.566914ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 5.00227137s trace: https://jaeger.dev.storj.io/trace/731e3210b1774b05 FAIL (2026-04-04 04:12:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.003315844s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 681.255405ms trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:57:20 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 681.285156ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [XX..........................................................] duration: 775.426696ms trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:56:17 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 775.456432ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.XX.........................................................] duration: 626.776669ms trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:55:55 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 626.810599ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..XX........................................................] duration: 1.091767196s trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:55:36 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.09181631s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...XX.......................................................] duration: 635.731431ms trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:55:17 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 635.772454ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....XX......................................................] duration: 1.377262637s trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:54:44 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.377386999s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.....XX.....................................................] duration: 1.835353084s trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:54:25 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.835408917s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [......XX....................................................] duration: 551.345634ms trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:54:02 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 551.381838ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.......XX...................................................] duration: 620.594107ms trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:53:28 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 620.686747ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [........XX..................................................] duration: 485.566907ms trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:52:43 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 485.607436ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.........XX.................................................] duration: 490.278477ms trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:51:32 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 490.389671ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..........XX................................................] duration: 524.610968ms trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:50:38 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 524.637104ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...........XX...............................................] duration: 667.950163ms trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:49:38 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 668.032057ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [............XX..............................................] duration: 694.787314ms trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:49:16 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 694.822401ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.............XX.............................................] duration: 494.274525ms trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:48:07 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 494.330627ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..............XX............................................] duration: 463.810271ms trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:47:39 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 463.837823ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...............XX...........................................] duration: 474.44721ms trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:47:22 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 474.493541ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [................XX..........................................] duration: 520.671239ms trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:46:14 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 520.694779ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.................XX.........................................] duration: 706.071909ms trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:45:35 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 706.139625ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..................XX........................................] duration: 534.382354ms trace: https://jaeger.dev.storj.io/trace/215a41ee5a6f5888 FAIL (2026-04-03 22:44:55 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 534.429243ms core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)